Lead Data Engineer - Piper Companies

Piper Companies is seeking a Lead Data Engineer to join an established Financial Services company located in Kennett Square, PA . This position is HYBRID, and requires you to be onsite 2-3 days a week. As the Lead Data Engineer you will drive the evolution of our data platform, leading the creation of Data Lake and Data Warehouse systems, while managing a talented team of data engineers.

Responsibilities of the Lead Data Engineer include:

• Lead the design, architecture, and implementation of ETL processes.
• Oversee the development and maintenance of scalable Data Lake and Data Warehouse architectures.
• Collaborate with business stakeholders to understand and deliver on data needs.
• Implement and enforce data governance and quality standards.
• Manage and mentor a team of data engineers.
• Stay updated on industry trends and recommend new tools and technologies.
• Ensure the reliability and performance of data systems through robust testing and monitoring.
• Develop and manage the data engineering budget, aligning resources with organizational goals

Qualifications for the Lead Data Engineer include:

• Proven experience in data engineering, including ETL processes, data modeling, and data warehousing.
• Strong proficiency in SQL, relational databases, and NoSQL databases.
• Experience with cloud data services (AWS, Azure, Google Cloud).
• Familiarity with Data Warehousing tools like Snowflake, Redshift, BigQuery, or Databricks.
• Experience with data integration tools like FiveTran, Talend, or Informatica.
• Demonstrated ability to build and manage a technical team.
• Excellent problem-solving, communication, and interpersonal skills.
• Knowledge of data security practices, governance, and compliance.
• Familiarity with tools like Collibra, Alation, or Informatica Axon for data governance.
• Experience with data quality tools such as Great Expectations or dbt.
• Experience deploying machine learning models in production environments.
• Bachelor’s or master’s degree in Computer Science, Data Science, Information Technology, or a related field.

Compensation for Compliance Advisor include:

• Salary Range: $180,000-$200,000 **depending on experience**
• Full Benefits: Medical, Dental, Vision, 401k, ect.

Keywords: Team Lead, Data Engineering, Data Engineering Manager, Lead Data Architect, Data Infrastructure Manager, Principal Data Engineer, Senior Data Engineer, Data Platform Lead, Data Operations Manager, Data Warehouse Architect, Big Data Engineering Lead, Director of Data Engineering, Data Platform Evolution, Data Lake, Data Warehouse, ETL Processes, Data Governance, Data Quality Standards, Data-Driven Decision-Making, Technical Team Management, Data Security Practices, Compliance, Data Integration, Machine Learning Models, Production Environments, SQL, Relational Databases, NoSQL Databases, Cloud Data Services (AWS, Azure, Google Cloud), Data Warehousing Tools, Snowflake, Redshift, BigQuery, Databricks, Data Integration Tools, FiveTran, Talend, Informatica, Data Governance Tools, Collibra, Alation, Informatica Axon, Data Quality Tools, Great Expectations, dbt

#LI-GM1 #LI-Hybrid