Abinitio Developer with AWS, DevOps, SQL, and Informatica - Lorven technologies
Atlanta, GA
About the Job
Job Title: Abinitio Developer with AWS, DevOps, SQL, and Informatica
Location: North Carolina & Georgia
Job Summary
The Abinitio Developer will be responsible for designing, developing, and maintaining data integration solutions using Abinitio, AWS, SQL, DevOps, and Informatica tools. This role will involve collaborating with various teams to create robust, scalable, and high-performing data pipelines and solutions for complex data processing. The ideal candidate will have strong experience in Abinitio and be well-versed in cloud-based environments, especially AWS, along with an understanding of DevOps practices.
Key Responsibilities:
- Design, develop, and implement ETL solutions using Abinitio: Build end-to-end data pipelines, data processing workflows, and ETL solutions with Abinitio to move and transform data across various platforms.
- Work with AWS cloud services: Use AWS services such as S3, EC2, Lambda, Redshift, and others to support data integration processes and storage. Migrate and modernize existing data solutions to AWS.
- Collaborate with DevOps teams: Implement DevOps best practices, including CI/CD pipelines, automated testing, and continuous delivery using tools like Jenkins, Docker, and Kubernetes.
- Database management and SQL scripting: Develop and optimize complex SQL queries to interact with relational databases such as Oracle, MySQL, and Postgres. Work on database design, tuning, and data modeling.
- Utilize Informatica for data integration: Integrate and maintain data workflows using Informatica tools where applicable, ensuring seamless collaboration between various ETL tools.
- Participate in data warehousing projects: Build and maintain data warehouses, ensuring scalability, reliability, and high performance of data solutions.
- Monitor, troubleshoot, and optimize data solutions: Perform root cause analysis for production issues and proactively optimize the performance of data pipelines.
- Documentation and compliance: Maintain detailed documentation of data flow designs, technical specifications, and best practices. Ensure solutions adhere to organizational standards, security, and regulatory compliance.
- Collaborate with cross-functional teams: Work closely with business analysts, architects, QA teams, and stakeholders to ensure that technical solutions align with business goals.
Required Skills and Qualifications:
- Proficiency in Abinitio: Strong experience in Abinitio toolsets (GDE, Co>Operating System, Express>It, EME).
- Cloud expertise with AWS: Hands-on experience with AWS services (EC2, S3, Redshift, Lambda, etc.). Understanding of cloud architecture and AWS best practices for data integration.
- DevOps knowledge: Experience in setting up CI/CD pipelines using Jenkins, Git, Docker, and Kubernetes. Familiarity with automated testing and deployment.
- SQL expertise: Strong knowledge of SQL for querying, data manipulation, and performance tuning. Experience with relational databases like Oracle, SQL Server, MySQL, and PostgreSQL.
- Informatica knowledge: Familiarity with Informatica PowerCenter, Data Quality, or other Informatica toolsets for ETL and data integration purposes.
- Experience with data modeling: Knowledge of logical and physical data modeling, understanding of data warehousing concepts, and familiarity with ETL processes.
- Scripting and automation: Proficiency in shell scripting (Unix/Linux) and other programming languages like Python or Perl to automate processes.
- Data transformation and processing: Experience in data transformation, data cleansing, and optimization techniques.
- Strong problem-solving skills: Ability to troubleshoot issues, optimize performance, and propose solutions.
- Version control experience: Familiarity with Git, Bitbucket, or similar version control systems.
- Understanding of Agile/Scrum: Experience in working within Agile/Scrum methodologies for project management and delivery.
Work Environment:
- Collaborative, fast-paced environment with Agile methodologies.
- Opportunities for remote work and flexible hours.
- Focus on continuous learning and professional development with access to training and certification programs.