Lead Data Engineer at Zachary Piper Solutions, LLC
Kennett Square, PA 19348
About the Job
Piper Companies is seeking a Lead Data Engineer to join an established Financial Services company located in Kennett Square, PA . This position is HYBRID, and requires you to be onsite 2-3 days a week. As the Lead Data Engineer you will drive the evolution of our data platform, leading the creation of Data Lake and Data Warehouse systems, while managing a talented team of data engineers.
Responsibilities of the Lead Data Engineer include:
Qualifications for the Lead Data Engineer include:
Compensation for Compliance Advisor include:
Responsibilities of the Lead Data Engineer include:
- Lead the design, architecture, and implementation of ETL processes.
- Oversee the development and maintenance of scalable Data Lake and Data Warehouse architectures.
- Collaborate with business stakeholders to understand and deliver on data needs.
- Implement and enforce data governance and quality standards.
- Manage and mentor a team of data engineers.
- Stay updated on industry trends and recommend new tools and technologies.
- Ensure the reliability and performance of data systems through robust testing and monitoring.
- Develop and manage the data engineering budget, aligning resources with organizational goals
Qualifications for the Lead Data Engineer include:
- Proven experience in data engineering, including ETL processes, data modeling, and data warehousing .
- Strong proficiency in SQL, relational databases, and NoSQL databases.
- Experience with cloud data services (AWS, Azure, Google Cloud).
- Familiarity with Data Warehousing tools like Snowflake, Redshift, BigQuery, or Databricks.
- Experience with data integration tools like FiveTran, Talend, or Informatica.
- Demonstrated ability to build and manage a technical team.
- Excellent problem-solving, communication, and interpersonal skills.
- Knowledge of data security practices, governance, and compliance.
- Familiarity with tools like Collibra, Alation, or Informatica Axon for data governance.
- Experience with data quality tools such as Great Expectations or dbt.
- Experience deploying machine learning models in production environments.
- Bachelor's or master's degree in Computer Science, Data Science, Information Technology, or a related field.
Compensation for Compliance Advisor include:
- Salary Range : $180,000-$200,000 **depending on experience**
- Full Benefits: Medical, Dental, Vision, 401k, ect.