Lead Data Engineer - Diverse Linx
Boston, MA
About the Job
Position: Lead Data Engineer
Location: Boston, MA / Quincy MA
Duration: Contact
Required Skill:
Senior/Lead developer position who has extensive experience with development/design in Azure Databricks (language :Scala) experience. 2. The candidate should have strong experience in either Databricks or Snowflake however Databricks knowledge is must 3. The candidate should have extensive experience in the data engineering 4. The candidate should have good experience in Scala programming language for data bricks development(He should have done the end to end data ingestion and data transformation in Databricks/snowflake). 5. Candidate should have strong experience in the Data warehousing (ETL Concepts, Types of SCD) 6. Candidate should have very good experience in the data lakeand delta tables concepts. 7. Candidate should have experience in databases like SQL server/Oracle 8. If Candidate have bigdata hadoop experience will be added advantage. Willing to work out of Quincy, MAPrior experience with migrations from SQLSERVER/ORACLE to Databricks Familiarity with multiple source systems database Need strong experience in Data ingestion and Data transformation in azure DatabricksExpecting very good knowledge in datawarehousing concepts in Azure DatabricksCapablity to migrate data from multiple data source to databricks.Strong coding knowledge in scala languageShould have a experience in Spark sqlAny other etl experiece is preferableTSQL /PLSQLExperiance writing functions complex queriesStrong communication skills,Strong experience with implementing delta lakehouses on Azure Databricks using medallion architectur
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location: Boston, MA / Quincy MA
Duration: Contact
Required Skill:
Senior/Lead developer position who has extensive experience with development/design in Azure Databricks (language :Scala) experience. 2. The candidate should have strong experience in either Databricks or Snowflake however Databricks knowledge is must 3. The candidate should have extensive experience in the data engineering 4. The candidate should have good experience in Scala programming language for data bricks development(He should have done the end to end data ingestion and data transformation in Databricks/snowflake). 5. Candidate should have strong experience in the Data warehousing (ETL Concepts, Types of SCD) 6. Candidate should have very good experience in the data lakeand delta tables concepts. 7. Candidate should have experience in databases like SQL server/Oracle 8. If Candidate have bigdata hadoop experience will be added advantage. Willing to work out of Quincy, MAPrior experience with migrations from SQLSERVER/ORACLE to Databricks Familiarity with multiple source systems database Need strong experience in Data ingestion and Data transformation in azure DatabricksExpecting very good knowledge in datawarehousing concepts in Azure DatabricksCapablity to migrate data from multiple data source to databricks.Strong coding knowledge in scala languageShould have a experience in Spark sqlAny other etl experiece is preferableTSQL /PLSQLExperiance writing functions complex queriesStrong communication skills,Strong experience with implementing delta lakehouses on Azure Databricks using medallion architectur
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Linx
