Azure Databricks Architect - Diverse Lynx

Azure Databricks Architect @@@ Atlanta, GA

Job Title: Data Architect (Azure Databricks)

Location: Atlanta, GA

Employment Type: Full-time

Overview:

We are seeking an experienced Data Architect with deep expertise in Azure Databricks to design and implement scalable, high-performance data solutions. The ideal candidate will have strong technical skills in Azure services, Apache Spark, and data processing frameworks, along with a proven ability to architect data pipelines, optimize performance, and ensure data governance.

Experience:

• Proven experience as a Data Architect or similar role, with extensive experience designing and implementing solutions on Azure Databricks .

Technical Skills:

• Azure Databricks & Apache Spark : Proficiency with Azure Databricks and Apache Spark for big data processing.
• Azure Services : Strong experience with Azure services, including Azure Data Lake , Azure Synapse Analytics , and Azure SQL .
• Data Architecture : Familiarity with data modeling , ETL processes , and data warehousing concepts.
• Programming Languages : Proficiency in programming languages such as Python , Scala , and SQL .

Core Skills:

• Problem-Solving : Excellent problem-solving and analytical skills, with a strong focus on optimizing data solutions.
• Communication : Strong verbal and written communication skills, with the ability to collaborate effectively with cross-functional teams.
• Project Management : Ability to manage multiple projects and prioritize tasks effectively in a fast-paced environment.

Preferred Certifications:

• Azure Data Engineer or Azure Solutions Architect certifications are preferred but not mandatory.

Key Responsibilities:

• Architecture Design :
  Design and architect scalable , high-performance data solutions on Azure Databricks, including:
  • Data pipelines for ETL/ELT processes.
  • Data lakes for structured and unstructured data storage.
  • Real-time data processing systems.

• Implementation :
  Lead the implementation of Azure Databricks solutions, ensuring best practices for performance, security, and data governance are followed.
• Integration :
  Integrate Azure Databricks with other Azure services such as:
  • Azure Data Lake Storage
  • Azure Synapse Analytics
  • Azure SQL Database
    Also, integrate with third-party tools and external data sources as required.

• Optimization :
  Monitor and optimize data workflows and queries for performance, reliability, and cost efficiency on Azure.
• Collaboration :
  Work closely with data engineers , data scientists , and business stakeholders to understand project requirements and deliver effective data solutions.
• Governance :
  Ensure data governance and security policies are properly implemented and adhered to within the Databricks environment.
• Documentation :
  Create and maintain comprehensive documentation for architectural designs, processes, best practices, and system configurations.
• Mentorship :
  Provide guidance and mentorship to junior team members, helping them navigate technical challenges and promoting best practices.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.