Scala Spark Lead - Marshall Technologies

Location: Broadway, New York, NY 10036 (On-site 3 days per week)
Job Type: Contract
Experience: 10+ Years
NOTE: FINAL ROUND F2F Interview in Broadway, NY

• Develop and Maintain: Design, develop, and maintain data processing applications using Scala and Apache Spark.
• Collaborate: Work with cross-functional teams to gather data requirements and build efficient solutions.
• Test-Driven Development: Implement test-driven development (TDD) practices to ensure reliable, maintainable code.
• Deploy & Optimize: Deploy artifacts across environments and ensure smooth transitions while optimizing Spark applications for performance.
• Troubleshoot: Identify, troubleshoot, and resolve performance issues in Spark applications.
• Agile Environment: Participate actively in sprint planning, development, and deliver high-quality solutions on time.
• Production Support: Provide essential support for production batches, addressing issues and providing fixes to meet business needs.

• Big Data: 7+ years of experience with Big Data technologies.
• Scala: 8+ years of experience in Scala programming.
• Apache Spark: 7+ years of experience with Apache Spark including development, optimization, and troubleshooting.
• Core Java: 5+ years of experience in Core Java programming.

• Snowflake: Experience with Snowflake for data management.
• Python: Familiarity with Python programming.
• Test-Driven Development: Experience with TDD practices.
• Databricks: Knowledge of Databricks for Spark optimization.
• DevOps: Understanding of DevOps practices for streamlined development and deployment.

• Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Problem-Solving Skills: Strong analytical and problem-solving abilities.
• Communication: Excellent verbal and written communication skills.
• Team Collaboration: Ability to work well in a team-oriented environment.

• Location: Broadway, New York, NY 10036.
• On-site: 3 days per week (mandatory).