AWS Data Engineer - Diverse Linx
Newark, NJ
About the Job
Role: Data Engineer
Location: Newark, NJ (Onsite)
Duration: Full-time
JD:
Skill: Java developer
Responsibilities:
AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location: Newark, NJ (Onsite)
Duration: Full-time
JD:
Skill: Java developer
- Minimum 5 years of professional experience in data integration and management.
- 3+ years of hands on development experience in AWS Glue, Lambda functions, AWS Athena, Redshift, Pyspark.
- Hands on working experience in AWS GLUE ETL tool and having good knowledge on any of the ETL tools(Informatica cloud, Talend etc.).
- Must have working experience with SQL, and databases (e.g.: Postgres, Redshift) implementing Data Models.
- Expertise with Python Language and Apache Spark. Have working experience in projects involving these.
- Strong hands on exposure to AWS Analytics services particularly Lambda, Step functions, EMR, Athena, Glue, Data-Pipelines.
- Understanding and technical knowledge on AWS service like EC2, S3. Should have used these technologies in previously executed projects.
- Strong AWS development experience for data ETL/pipeline/integration/automation work. Should have a deep understanding of BI & Analytics Solution development lifecycle.
- Full Flexed in AWS cloud development & Automation for Analytics. Should have a deep understanding of AWS Services (Redshift, Glue, Lambda, Athena, S3, EC2), Visual Studio, SQL Server, SSIS, Matillion; Python.
- Strong experience on real-time scalable workflow implementation.
Responsibilities:
- Developer will be part of an Agile Development team focusing on Sprint Agile implementation.
- Developer will be developing data ingestion pipelines from heterogenous sources like databases, Files, APIs, Kafka streaming etc using a variety of services.
- Developer may be assigned to deliver the data from AWS data platform for different consumption use cases and services.
- Developer may be engaged in peer reviews to ensure code accuracy and well architected architecture and implementation.
- Developer may be asked to do client demo or another project demo.
- Developer must be proactive in escalating impacting issues and be resourceful to look for alternative.
- Developer may have to work on tight timelines sometimes.
AWS Glue, Lambda, Athena, Pyspark, Redshift, EMR, AWS RDB, AWS DynamoDB, AWS Glacier, Python.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Source : Diverse Linx
