AWS DataBricks - Diverse Linx
Indianapolis, IN
About the Job
Architecture and Design:
- Design and implement Databricks clusters, notebooks, and jobs.
- Define data lakehouse architecture leveraging Delta Lake.
- Optimize data processing workflows for performance and cost efficiency.
Data Engineering:
- Develop ETL pipelines using Databricks, Apache Spark, and Python.
- Integrate data from various sources (S3, Redshift, etc.) into Databricks.
- Ensure data quality, consistency, and reliability.
Machine Learning and AI:
- Collaborate with data scientists to deploy Client models on Databricks.
- Implement model serving and monitoring.
- Explore generative AI solutions for business insights.
Security and Governance:
- Configure access controls, encryption, and auditing.
- Ensure compliance with data privacy regulations.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Linx