Big Data Engineer at Judge Group
Malvern, PA
About the Job
Location: Malvern, PA
Description: Our large, financial services client located in Malvern, PA is looking for a Big Data Engineer (1+ Year Contract/Hybrid).
This job will have the following responsibilities:
Contact: dcalingo@judge.com
Description: Our large, financial services client located in Malvern, PA is looking for a Big Data Engineer (1+ Year Contract/Hybrid).
This job will have the following responsibilities:
- Writes ETL processes, designs database systems, and develops tools for real-time and offline analytic processing.
- Troubleshoots software and processes for data consistency and integrity. Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions.
- Leads all phases of solution development. Explains technical considerations at related meetings, including those with internal clients and less experienced team members.
- Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.
- MANDATORY- Python, CI/CD pipeline (Bitbucket, Bamboo, GitHub), AWS Services-S3, Glue, Athena, EMR Cluster, Redshift, Pandas, Spark, Lambda, CloudFormation, IAM, Service Catalog, SQL, ETL Processes
- GOOD TO HAVE- Collibra, Dremio, Tableau, Data Modeling
Contact: dcalingo@judge.com
This job and many more are available through The Judge Group. Find us on the web at www.judge.com