Lead Scala Spark Developer - Expert In Recruitment Solutions
Alpharetta, GA 30009
About the Job
Mandatory Skills: Development , Scala, Spark
Key Responsibilities:
• Develop and maintain data processing applications using Spark and Scala.
• Collaborate with cross-functional teams to understand data requirements and design efficient solutions.
• Implement test-driven deployment practices to enhance the reliability of application.
• Deploy artifacts from lower to higher environment ensuring smooth transition
• Troubleshoot and debug Spark performance issues to ensure optimal data processing.
• Work in an agile environment, contributing to sprint planning, development and delivering high quality solutions on time
• Provide essential support for production batches, addressing issues and providing fix to meet critical business needs Skills/Competencies:
• Strong knowledge of Scala programming language
• Excellent problem-solving and analytical skills.
• Proficiency in Spark, including the development and optimization of Spark applications.
• Ability to troubleshoot and debug performance issues in Spark.
• Understanding of design patterns and data structure for efficient data processing
• Familiarity with database concepts and SQL
* Java and Snowflake (Good to have).
• Experience with test-driven deployment practices (Good to have).
• Familiarity with Python (Good to have).
• Knowledge of Databricks (Good to have).
• Understanding of DevOps practices (Good to have).
Must Have Skills –
Skill 1 – Yrs of Exp – Java 5+
Skill 2 – Yrs of Exp –Scala 8+
Skill 3 – Yrs of Exp –Spark 8+
Good To have Skills –
Skill 1 – Yrs of Exp – SQL 5+
Skill 2 – Yrs of Exp – Kubernetes 3+
Key Responsibilities:
• Develop and maintain data processing applications using Spark and Scala.
• Collaborate with cross-functional teams to understand data requirements and design efficient solutions.
• Implement test-driven deployment practices to enhance the reliability of application.
• Deploy artifacts from lower to higher environment ensuring smooth transition
• Troubleshoot and debug Spark performance issues to ensure optimal data processing.
• Work in an agile environment, contributing to sprint planning, development and delivering high quality solutions on time
• Provide essential support for production batches, addressing issues and providing fix to meet critical business needs Skills/Competencies:
• Strong knowledge of Scala programming language
• Excellent problem-solving and analytical skills.
• Proficiency in Spark, including the development and optimization of Spark applications.
• Ability to troubleshoot and debug performance issues in Spark.
• Understanding of design patterns and data structure for efficient data processing
• Familiarity with database concepts and SQL
* Java and Snowflake (Good to have).
• Experience with test-driven deployment practices (Good to have).
• Familiarity with Python (Good to have).
• Knowledge of Databricks (Good to have).
• Understanding of DevOps practices (Good to have).
Must Have Skills –
Skill 1 – Yrs of Exp – Java 5+
Skill 2 – Yrs of Exp –Scala 8+
Skill 3 – Yrs of Exp –Spark 8+
Good To have Skills –
Skill 1 – Yrs of Exp – SQL 5+
Skill 2 – Yrs of Exp – Kubernetes 3+
Source : Expert In Recruitment Solutions
