Data Engineer - PamTen Inc
Newark, NJ
About the Job
- Experience implementing software applications supporting data lakes, data warehouses and data applications on AWS for large enterprises
- Programming experience with Python, Shell scripting and SQL
- Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DataSync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc. Candidates must have experience with AWS Step Functions.
- Solid experience implementing solutions on AWS based data lakes.
- Experience in AWS data lake/data warehouse/business analytics
- Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS
- Knowledge of ETL/ELT
- End-to-end data solutions (ingest, storage, integration, processing, access) on AWS
- Architect and implement CI/CD strategy for EDP
- Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)
- Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift
- Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift
- AWS Solutions Architect or AWS Developer Certification preferred
Requirements:
- 5+ Years of experience as Data application developer
- MUST have good experience with AWS Services – Glue, Lambda, Step Functions, SQS, DynamoDB, S3, Redshift.
- Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience
Source : PamTen Inc
