Azure Databricks Engineer - Diverse Linx
Louisville, KY
About the Job
Title: Azure Databricks Engineer
Location: Louisville, Kentucky (Onsite)
Job Type: Contract
Job Description:
Experience in generating data pipelines in Azure ADF
Experience in ingesting data from different Sources using in Azure ADF
Experience in transforming the data using Azure Databricks & Delta lake and Pyspark
Experience in Azure DevOps CI/CD Stories, Bugs, and Issue management
Implement Integration solution in Microsoft Azure
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
Experience working in agile development projects and sprint deliver
Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines.
Perform data transformations and cleansing operations to ensure data accuracy and consistency.
Evolve existing scripts and notebooks to meet client needs.
Monitor, troubleshoot, and optimize data pipelines for seamless functionality.
Ensure data solutions align with security and compliance standards
Work closely with data architects to harmonize data models with project objectives.
Document programming efforts and processes, technical specifications, and best practices. mming efforts and processes, technical specifications, and best
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location: Louisville, Kentucky (Onsite)
Job Type: Contract
Job Description:
Experience in generating data pipelines in Azure ADF
Experience in ingesting data from different Sources using in Azure ADF
Experience in transforming the data using Azure Databricks & Delta lake and Pyspark
Experience in Azure DevOps CI/CD Stories, Bugs, and Issue management
Implement Integration solution in Microsoft Azure
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
Experience working in agile development projects and sprint deliver
Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines.
Perform data transformations and cleansing operations to ensure data accuracy and consistency.
Evolve existing scripts and notebooks to meet client needs.
Monitor, troubleshoot, and optimize data pipelines for seamless functionality.
Ensure data solutions align with security and compliance standards
Work closely with data architects to harmonize data models with project objectives.
Document programming efforts and processes, technical specifications, and best practices. mming efforts and processes, technical specifications, and best
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Linx
