Lead MDM Data Engineer - NiSource
Canonsburg, PA 15317-5817
About the Job
Description
Lead Master Data Management Data Engineer
Full Time
Way of Work: Remote
Salary: $107,000 - $160,500 plus annual bonus
The Lead Master and Reference Data Engineer will be a member of a dynamic team responsible for leading data engineering efforts to create a proprietary Master and Reference Data system. This person will play a crucial role in creating high-quality data models and structures to support downstream analytics, reporting, and applications. Collaborating with Data Governance Activation Team, Business Analyst and Data Scientist, the Lead MDM Data Engineer will understand data needs and will design optimized structures pertaining to Master Data Management. As a recognized subject matter expert, the Lead Data Engineer tackles complex problems with a broad perspective, while also coaching, reviewing, and delegating tasks to less experienced professionals.
Your responsibilities may include, but are not limited to:
Collaborate with Data Governance Activation Team, Business Analyst, Data Scientist, and other Business Partners & stakeholders to align data models and programming development with business needs
Implement master data management architecture strategy
Create data management policies and best practices to support MDM/RDM data structures
Development conceptual, logical, and physical data models for the MDM/RDM architecture
Coordinate and develop system integration designs for master data/ reference data within projects, including high-level and detailed system, application, and technology diagrams
Design & implement effective database solutions and models for storing and retrieving company data
Implement complex and efficient SQL queries to insert data along with data manipulation and retrieval
Optimize query performance to ensure scalability and efficiency
Create, manage and optimize data pipelines to ensure timely and accurate data processing and delivery
Troubleshoot data-related issues, identify variances and recommended improvements
Identifies Match & Merge rules, develop & configure trust matrix, match path, match rules
You must possess the below minimum qualifications to be initially considered for this position. Preferred qualifications are in addition to the minimum requirements and are considered a plus factor in identifying top candidates.
Minimum Qualifications
Bachelor’s degree or equivalent work experience
6+ years recent (conceptual, logical, and physical) modeling
6+ years building and optimizing big-data pipelines, architectures and data sets.
6+ years Python and related big-data engineering technologies such as Spark, Hadoop, Kafka, etc.
6+ years utilizing cloud data products in platforms such as AWS, Azure, Databricks, GCP
Preferred Qualifications
Experience with both relational SQL and NoSQL databases
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Experience with containerization and microservices (e.g., Docker, Kubernetes)
Familiarity with Linux and Unix
Experience deploying and maintaining code with version control tools
Understanding of best practices in Data Warehousing and Data Lake architectureAdvanced SQL skills and experience working across a variety of database technologies
Disclaimer
The preceding description is not designed to be a complete list of all duties and responsibilities required of the position
Inclusion and Diversity
Value inclusion within your day-to-day responsibilities by respecting others' perspectives/convictions, engaging others' opinions, creating a safe environment where people, ideas, and opinions are valued within your Team/Customers and external partners.
Respect and take into consideration diversity within your Team/Customers and external work partners by valuing different world views, challenges, and cultures that represent all walks of life and all backgrounds.
Treat others with respect and consideration. Actively participate in creating and contributing to a positive work environment.
Safety
Promote a safe work environment by actively participating in all aspects of our employee safety program.
Report any unsafe conditions and take actions to prevent personal injuries.
Support our interdependent safety culture by ensuring the safety of your co-workers.
Stay focused on the task at hand and promote productivity through good work habits.
#MDM #DataEngineer #Data #BigData #RemoteJobs #NiSource #WomenInTech #NowHiring #OhioMeansJobs #DataEngineer #MDMEngineer #MasterData #DataGoverance
Work Authorization
Authorized to work in the United States without requiring sponsorship.
Inclusion & Diversity
Value inclusion within your day to day responsibilities by respecting others perspectives/convictions, engaging others opinions, creating a safe environment where people, ideas, and opinions are valued within your Team/Customers and external partners.
Respect and take into consideration diversity within your Team/Customers and external work partners by valuing different world views, challenges, and cultures that represent all walks of life and all backgrounds.
Treat others with respect and consideration. Actively participate in creating and contributing to a positive work environment.
Equal Employment Opportunity
NiSource is committed to providing equal employment opportunities in each of its companies to all employees and applicants for employment without regard to race, color, religion, national origin or ancestry, veteran status, disability, gender, age, marital status, sexual orientation, gender identity, sex (including pregnancy, lactation, childbirth or related medical conditions), genetic information, citizenship status, or any protected group status as defined by law. Each employee is expected to abide by this principle.
By applying, you may be considered for other job opportunities.
Safety Statement
Promote a safe work environment by actively participating in all aspects of our employee safety program. Report any unsafe conditions and take actions to prevent personal injuries. Support our interdependent safety culture by ensuring the safety of your co-workers. Stay focused on the task at hand and promote productivity through good work habits.
Salary Range:
$107,000.00 - $160,500.00Posting Start Date:
2024-09-16Posting End Date (if applicable):
2024-10-01Please note that the job posting will close on the day before the posting end date.
