Lead Engineer, Data Platform - Agama Solutions
NULL
About the Job
Job Details: Lead Engineer, Data Platform
Location: Remote
Top Skill
- 8 - 10 years of experience in data engineering and designing scalable ETL pipelines
- Advanced Proficiency in Hadoop, Scala, Spark, Kafka and SQL
- 6+ years of experience with cloud platforms like Azure, AWS, Google
- Be skilled at architecting large and complex data pipelines.
- Experience performing data analysis and data exploration.
- Experience working with Cloud technologies, Azure, Databricks, ADLS, Spark, Cosmos DB, and other big data technologies.
- Experience working in an agile delivery environment.
- Experience working in multi-developer environment, using version control.
- Excellent knowledge in data structures and design patterns
- Preferred experience with data integration tools
- Work with cross-functional agile teams to drive projects through the full development cycle.
- Help the team improve with the usage of data engineering best practices.
- Write SQL for processing raw data, data validation and QA
- Knowledge working with APIs to collect or ingest data
- Strong Database knowledge, SQL & No-SQL preferred
- Communication Skills Data Engineers are part of a team, working with database administrators, data analysts and management and need to be effective communicators.
- Problem-Solving Skills Data Engineers look at an issue that needs to be solved and come up with solutions quickly.
- Experience integrating and building data platform in support of BI, Analytics, Data Science, and real-time applications.
- Strong communication skills, with the ability to initiate and drive projects proactively and accurately
Source : Agama Solutions