ETL Data Engineer/ Architect - TechDigital
Washington, DC
About the Job
Required Skill/ JD
Azure Databricks and Pyspark
Skills : Data ETL / Data Engineering
Azure Databricks and Pyspark
Skills : Data ETL / Data Engineering
Key Technology : ADF, Databricks, dbt, Azure Cloud Services
Supporting Technology : MS SQL Server ADW/DB, Python, Pyspark, Devops
Proven development experience in building complex data pipeline for lakehouse/data warehouses using Agile methodology.
Experience : 9-10 years
Skill proficiency rating and required years of experience mentioned in skill matrix table.
| Required Skills | Rating (Scale 1-10) | Work Experience (Years) | Last Used (Year) | Related Projects /End Customer Names |
| ADF | 9-10 | 9-10 years | ||
| Pyspark | 8 | 9-10 years | ||
| Azure Databricks | 9 | 9-10 years | ||
| DBT | 8 | 9-10 years | ||
| Azure Cloud Services | 9-10 | 9-10 years |
Source : TechDigital
