Lead Engineer, Data Platform - Agama Solutions

Job Details: Lead Engineer, Data Platform

Location: Remote

Top Skill

• 8 - 10 years of experience in data engineering and designing scalable ETL pipelines
• Advanced Proficiency in Hadoop, Scala, Spark, Kafka and SQL
• 6+ years of experience with cloud platforms like Azure, AWS, Google
• Be skilled at architecting large and complex data pipelines.
• Experience performing data analysis and data exploration.
• Experience working with Cloud technologies, Azure, Databricks, ADLS, Spark, Cosmos DB, and other big data technologies.
• Experience working in an agile delivery environment.
• Experience working in multi-developer environment, using version control.
• Excellent knowledge in data structures and design patterns
• Preferred experience with data integration tools
• Work with cross-functional agile teams to drive projects through the full development cycle.
• Help the team improve with the usage of data engineering best practices.
• Write SQL for processing raw data, data validation and QA
• Knowledge working with APIs to collect or ingest data
• Strong Database knowledge, SQL & No-SQL preferred
• Communication Skills Data Engineers are part of a team, working with database administrators, data analysts and management and need to be effective communicators.
• Problem-Solving Skills Data Engineers look at an issue that needs to be solved and come up with solutions quickly.
• Experience integrating and building data platform in support of BI, Analytics, Data Science, and real-time applications.
• Strong communication skills, with the ability to initiate and drive projects proactively and accurately