Azure Data Engineer- Remote - Georgia IT Inc.
Chicago, IL
About the Job
Job Title: Azure Data Engineer
Location: Chicago, IL (Remote)
Duration: Contract
Rate: DOE
Requirements:
Able to translate functional and technical requirements into detail design. Responsible for analyzing large data sets to develop custom data pipelines to drive business solutions
Work with team leads for regular updates, requirement understanding and design discussions
Develops data pipeline for ingesting & cleansing data, applies data validation & transformation, stores data in various zones using Python, PySpark .
Hands on experience in design of Near Real time Data Processing solutions using various data streaming technologies in on-Prem and Azure cloud. Implements solution to stream data from various sources to Azure using Cloud native services
Gathers the data from various third-party data in to cloud and on-Prem data platforms, optimizing it and joining with internal datasets to gather meaningful information. Stores data in various zones in right file format using appropriate compression techniques (ORC, Parquet and Avro)
Plan the closure of the solutions and see through the implementation of the solutions
Prepare and produce releases of data pipelines.
Good troubleshooting and application performance tuning experience.
Participates in day to day project and production delivery status meetings and provide technical support for faster resolution of issues.
Ability to co-ordinate work with geographically distributed team
Share knowledge, mentor and provide technical guidance to team members
Works with various scrum teams contribute to strengthening of DevOps and Agile methodologies to improve cycle times, consistency, and quality.
Solid understanding of Azure Data Platform and components
Location: Chicago, IL (Remote)
Duration: Contract
Rate: DOE
Requirements:
Able to translate functional and technical requirements into detail design. Responsible for analyzing large data sets to develop custom data pipelines to drive business solutions
Work with team leads for regular updates, requirement understanding and design discussions
Develops data pipeline for ingesting & cleansing data, applies data validation & transformation, stores data in various zones using Python, PySpark .
Hands on experience in design of Near Real time Data Processing solutions using various data streaming technologies in on-Prem and Azure cloud. Implements solution to stream data from various sources to Azure using Cloud native services
Gathers the data from various third-party data in to cloud and on-Prem data platforms, optimizing it and joining with internal datasets to gather meaningful information. Stores data in various zones in right file format using appropriate compression techniques (ORC, Parquet and Avro)
Plan the closure of the solutions and see through the implementation of the solutions
Prepare and produce releases of data pipelines.
Good troubleshooting and application performance tuning experience.
Participates in day to day project and production delivery status meetings and provide technical support for faster resolution of issues.
Ability to co-ordinate work with geographically distributed team
Share knowledge, mentor and provide technical guidance to team members
Works with various scrum teams contribute to strengthening of DevOps and Agile methodologies to improve cycle times, consistency, and quality.
Solid understanding of Azure Data Platform and components
Source : Georgia IT Inc.
