Big Data Engineers (Architect Level)-Woonsocket RI - Georgia IT Inc.
Woonsocket, RI
About the Job
Big Data Engineers (Architect Level)
Location: Woonsocket RI
Rate: DOE
Contract
U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time
Job Description:
Location: Woonsocket RI
Rate: DOE
Contract
U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time
Job Description:
- Agile methodology
- Debugging issues related to Spark performance in a big data environment.
- Coding and architecting of end-to-end applications on modern data processing technology stack (e.g. Hadoop, Cloud, Spark ecosystem technologies)
- Build continuous integration/continuous delivery, test-driven development, and production deployment frameworks
- Lead conversations with infrastructure teams (on-prem & cloud) on analytics application requirements (e.g., configuration, access, tools, services, compute capacity, etc.)
- Platforms: Hadoop, Spark, Kafka, Kinesis, Oracle, TD
- Languages: Python, PySpark, Hive, Shell Scripting, SQL, Pig, Java / Scala
- Proficient in Map-Reduce, Conda, H2O, Spark, Airflow / Oozie / Jenkins, Hbase, Pig, No-SQL, Chef / Puppet, Git
- Familiarity with building data pipelines, data modeling, architecture & governance concepts
- Experience implementing Client models and building highly scalable and high availability systems
- Experience operating in distributed environments including cloud (Azure, GCP, AWS etc.)
- Experience building, launching and maintaining complex analytics pipelines in production
Source : Georgia IT Inc.