Senior ETL Developer - Indus River Technologies Inc

TheSenior ETL Developer with expertise in Informatica PowerCenter will design,develop, and administer ETL processes to support data integration andtransformation for cloud-based data solutions. The role involves building andoptimizing complex ETL workflows using Informatica PowerCenter to extract,transform, and load data from various sources into Azure Synapse Analytics andother data platforms. The candidate will manage the Informatica PowerCenterenvironment, ensuring high availability, security, and performance, while alsoleveraging Azure Synapse for data warehousing and analytics. They willcollaborate with data engineers, business analysts, and stakeholders tounderstand data requirements, develop scalable ETL pipelines, and ensure dataaccuracy. Strong experience in both ETL L development and administration, cloudtechnologies like Azure, and SQL databases is essential. The role also involvesmaintaining documentation, performance tuning, and ensuring compliance withdata governance standards.

JobDescription:

1.Design, develop, and optimize complex ETL workflows and mappings usingInformatica PowerCenter to extract, transform, and load data from multiplesources.

2.Manage data integration from disparate systems (e.g., databases, flat files,APIs) into data warehouses, data lakes, and other repositories.

3.Administer the Informatica PowerCenter environment, including installation,configuration, upgrades, and patch management.

4.Monitor and optimize ETL processes for performance, including load balancing,parallel processing, and tuning transformations to minimize execution time.

5.Identify and resolve ETL issues, such as data inconsistencies, job failures,and performance bottlenecks, ensuring minimal downtime.

6.Ensure data accuracy, consistency, and completeness by implementing rigorousvalidation checks throughout the ETL process.

7.Work closely with business analysts, data architects, and stakeholders togather data requirements and ensure the ETL solutions meet business objectives.

8.Create and maintain comprehensive documentation of ETL processes, workflows,mappings, and data models.

9.Automate ETL jobs and workflows, scheduling them for execution at optimaltimes, and managing dependencies across jobs.

10.Implement data cleansing, data quality checks, and transformation logic toensure the integrity of data before loading.

11.Ensure that ETL processes comply with security standards and governancepolicies, managing access controls and data privacy.

12.Implement version control, manage updates to ETL processes, and ensure smoothtransitions during changes to production environments.

13.Monitor and manage system resources, ensuring the ETL infrastructure can handlegrowing data volumes and future expansion.

14.Work with database administrators and engineers to optimize databaseperformance and ensure data is structured efficiently for ETL processing.

15.Develop error-handling mechanisms, including logging, alerting, and rollbackprocedures to address issues in ETL workflows.

16.Provide guidance, mentorship, and support to junior ETL developers and otherteam members in best practices for ETL development.

17.Ensure ETL processes adhere to organizational data governance policies,including metadata management, data lineage, and audit trails.

18.Stay updated on the latest ETL tools, technologies, and best practices, andimplement improvements in ETL processes to enhance efficiency andeffectiveness.

19.Strong knowledge and experience with Oracle and SQL server databases

20.Expert in writing SQL and PL/SQL queries

21.Preferred to have experience in Python for creating data pipelines

PreferredExperience/Qualification/Knowledge Skills

1. Education: Bachelors Degree in Information Systems, Computer Science, or related scientific or technical field and three (3) years minimum of relevant experience
2. General Experience: Work Experience: 3%2B years of experience designing and implementing data solutions and creating data at enterprise-level applications. Industry Knowledge: Preferred to have experience in water and wastewater industry understanding of oracle utility applications. Project Experience: Demonstrated experience working on large-scale data projects in diverse team environments with a focus on analytics, business intelligence, and enterprise systems
3. Specialized Experience

o  Data Modeling: Extensive experiencewith data modeling and database design.

o  Enterprise Analytics: Provenexpertise in implementing enterprise-wide analytics and business intelligencesolutions, including data integration from multiple systems into a single datarepository.

1. Skillset

o  Database & Data Structures: Deepunderstanding of database design principles, SQL, PL/SQL, and Oracle databasemanagement systems, including performance optimization and troubleshooting.

o  Data Governance & Quality:Familiarity with data governance frameworks, ensuring data integrity, quality,and security within an enterprise context.

o  Communication & Collaboration:Excellent verbal and written communication skills, with the ability to workclosely with stakeholders to translate business needs into technical solutions.

o  Problem-Solving: Strong analyticalskills and problem-solving abilities, especially when working with large,complex datasets