Principal Data Engineer- Remote, USA at Ambry Genetics

Compensation: $180,000 - $200,000 per year. You are eligible to a Short-Term Incentive Plan with the target at 7.5% of your annual earnings, terms and conditions apply. Principal Data Engineer- Remote USA  The Principal Data Engineer is responsible for driving the design, development, and implementation of Ambry's data infrastructure and solutions. This role will play a pivotal part in building and maintaining scalable, reliable, and efficient data pipelines, data warehouses, and data lakes. The Principal Data Engineer will collaborate closely with data architects, scientists, and analysts to ensure that data is accessible, secure, and aligned with business objectives. As a Principal Data Engineer at Ambry, you’ll approach tasks with a customer-based, cloud-first mindset to support and enhance various data platform products, including Ambry’s data lakes, streams, and warehouses. This role will be primarily responsible for building, monitoring, and operationalizing our data streams which are hydrated via CDC (change data capture) from a suite of 20 on-prem and cloud databases.Essential Functions  Build Kafka connectors to sync updates from source data storesBuild partitioned Kafka topics to sync updates to destination data martsBuild multiplexed data analytics workloads using Apache Flink to monitor streaming metrics and perform real-time data transformationsBuild dashboards using Datadog and Cloudwatch to ensure system health and user supportBuild opinionated but accommodating schema registries that ensure data governanceWork closely with your West Coast based scrum team to submit and review PRs daily, maintain documentation and backlogs, validate builds across multiple environments, and deploy at a 2–4-week sprint cadenceDesign reasonable database schemas with query access patterns as the forethought Build and maintain CI/CD pipelines using infrastructure-as-codeIteratively migrate on-prem ETL jobs written in PHP into AWS Flink and Glue processes Partner with QA Engineers in building automated test suitesPartner with end-users to resolve service disruptions and evangelize our data product offerings Vigilantly oversee data quality and alert upstream data producers of all disparities, latency, and defectsDevelop and maintain the overall data platform architecture strategy, roadmap, and implementation plans to support the company's data-driven initiatives and business objectives.Design and implement scalable, secure, and high-performance data architectures, including data warehouses, data lakes, and data pipelines, leveraging both on-premises and cloud technologies.Establish data governance policies, standards, and best practices for data management, data quality, data security, and data privacy across the organization.Lead the development and implementation of real-time data streaming solutions, including event-driven architectures, data ingestion, transformation, and consumption using technologies like Apache Kafka, Apache Flink, and AWS Managed Streaming for Kafka (MSK).Oversee the creation and maintenance of Business Intelligence (BI) platforms, data visualization tools, and self-service analytics capabilities to enable data-driven decision-making across the organization.Lead and manage a team of data engineers, database administrators, and data analysts, fostering their professional growth, promoting best practices, and ensuring adherence to organizational standards and processesOther duties as assignedQualifications Basic understanding of genomic concepts and terminologyWilling to work PST hours between 8:00 AM - 5:00 PM or 9:00 AM – 6:00 PMStrong familiarity with any combination of our tech stacks in order of importance: Apache Kafka (MSK flavor preferred), Debezium, Python, Apache Flink or PySpark Streaming, MySQL (RDS flavors preferred), Python, CDK or Terraform, Athena, Glue, Lambda, Appflow, HANA/4, PHP, Redis, Docker, JavascriptExperience building data APIs and offering Data as a ServiceExperience integrating with SaaS platforms such as SAP and SalesforceExperience or willingness to learn working with PHP MVC frameworks such as SymfonyExperience with Atlassian products, i.e. Jira, Confluence, BambooExperience with system diagramming tools such as Miro, LucidCharts, or Visio6+ years’ experience working with professional scrum teams and/or equivalent schooling4+ years’ experience using Git versioning control3+ years’ experience designing and indexing relational databases2+ years’ experience building and operationalizing real-time data streamsBachelor’s or master’s degree in computer, data, math, or life sciences or equivalent work experiencePreferredAWS Associate Solution Architect certificationAWS Data Engineer certificationAbout Us:  Ambry Genetics Corporation is a CAP-accredited and CLIA-licensed molecular genetics laboratory based in Aliso Viejo, California. We are a genetics-based healthcare company that is dedicated to open scientific exchange so we can work together to understand and treat all human disease faster.At Ambry, everyone is welcome. A career at Ambry Genetics is a chance to be part of a dynamic company that aims to improve health by understanding the relationships between genetics and human disease. We earned our reputation as industry leaders by responsibly introducing cutting-edge genetic testing solutions and continually sharing what we learn with the global scientific community.At Ambry you will be learning, challenging yourself, and having fun while collaborating with teammates through the open exchange of ideas.  Our outstanding benefits program includes medical, dental, vision, 401k with a 4% employer match, FSA, paid sick leave and generous paid time off (PTO) program. You can learn more about the benefits here. Ambry Genetics is an Equal Opportunity Employer (EOE) and we maintain a drug-free work environment.The Company believes in second chance employment.  Qualified applicants with arrest or conviction history will be considered regardless of their arrest or conviction history, consistent with local laws such as Los Angeles County Fair Chance Ordinance and the California Fair Chance Act.  You do not need to disclose your criminal history or participate in a background check until a conditional job offer is made to you. After making a conditional offer and running a background check, if the Company is concerned about conviction that is directly related to the job, you will be given the chance to explain the circumstances surrounding the conviction, provide mitigating evidence, or challenge the accuracy of the background report. For the purpose of the above job description, “Essential Functions” are “Material Job Duties”.Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.All qualified applicants will receive consideration for employment without regard to race (and traits historically associated with race, including, but not limited to hair texture and protective hairstyles such as braids, locks, and twists), color, creed, religion, sex, sexual orientation, gender identity, gender expression (including transgender status), national origin, ancestry, age, marital status or protected veteran status and will not be discriminated against on the basis of disability, protected medical condition as defined by applicable state or local law, genetic information, or any other characteristic protected by applicable federal, state, or local laws and ordinances. If you have a disability or special need that requires accommodation, please contact us at careers@ambrygen.comAmbry does not accept unsolicited resumes from individual recruiters, third party recruiting agencies, outside recruiters or firms without an executed contract in place. We are not responsible for any fees related to resumes that are unsolicited or are received by Ambry. Such resumes will be deemed the sole property of Ambry and will be processed accordingly. PRIVACY NOTICES To review Ambry’s Privacy Notice, Click here: To review the California privacy notice, click here: California Privacy Notice | Ambry GeneticsTo review the UKG privacy notice, click here: California Privacy Notice | UKG#LI-REMOTE #LI-NK1 Job SummaryRequisition Number: PRINC003818Job Category: EngineeringSchedule: Full-Time