Data Engineer - Randstad USA
Morristown, NJ 07960
About the Job
Are you ready to take your data engineering career to the next level? Join our clients dynamic team where you'll have the opportunity to design and develop cutting-edge ETL pipelines, data models, and cloud-based infrastructures. You'll work alongside industry leaders, collaborating with data scientists, product owners, and enterprise architects to deliver innovative enterprise data solutions.
Their projects offer a blend of challenge and excitement, as you'll be driving optimization from an end-to-end perspective and implementing the latest in data integration frameworks and scalable distributed systems. If you're passionate about turning complex data into actionable insights and thrive in a collaborative, forward-thinking environment, they want you on their team.
Embrace the chance to influence key business initiatives, grow your expertise in leading technologies like Azure Data Factory and Databricks, and be part of a company that values your contributions and fosters your professional growth.
Please let me know if you have any questions!
Matias Rodriguez
Account Manager - PPO
Randstad Digital
Matias.Rodriguez@randstaddigital.com
location: Morristown, New Jersey
job type: Permanent
salary: $100,000 - 140,000 per year
work hours: 8am to 4pm
education: Bachelors
responsibilities:
- Design and Develop:
- Create and manage ETL pipelines, data models, queries, scripts, and maintenance procedures.
- Identify opportunities to optimize performance from an end-to-end perspective.
- Create and manage ETL pipelines, data models, queries, scripts, and maintenance procedures.
- Collaborate and Communicate:
- Work closely with business domain leads, data scientists, product owners, enterprise architects, and other functional leads to deliver enterprise data solutions.
- Partner with foundational solution functional teams, vendors, and technology support teams to build and deliver solutions aligned with business initiatives.
- Effectively communicate complex technical information to stakeholders, including those without a technical background, to capture non-functional requirements.
- Work closely with business domain leads, data scientists, product owners, enterprise architects, and other functional leads to deliver enterprise data solutions.
- Delivery and Documentation:
- Deliver solutions through a minimum viable product (MVP) and subsequent iterative development cycles.
- Prepare and maintain design and architectural documents for management and development teams.
- Deliver solutions through a minimum viable product (MVP) and subsequent iterative development cycles.
- Cloud and Data Management:
- Design and develop cloud-based infrastructure for both real-time and batch ETL processes.
- Build multi-dimensional databases and data marts.
- Participate in the development of data management policies, standards, and procedures.
- Identify, design, and implement internal process improvements such as automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability.
- Design and develop cloud-based infrastructure for both real-time and batch ETL processes.
- Interface and Assist:
- Interface across several business areas, proactively assisting in defining project direction with business stakeholders.
Required Skills:
- Development Experience:
- Proficiency in one or more of the following: SQL, Python, Spark, Cloud-based ETL tools.
- Expertise in developing ETL interfaces, Data Warehouses, Data Lakes, and Analytics solutions.
- Proficiency in one or more of the following: SQL, Python, Spark, Cloud-based ETL tools.
- Preferred Technologies:
- Experience with Azure Data Factory, Azure Databricks, and Snowflake is highly preferred, but similar cloud technology experience will be considered.
- Technical and Leadership Skills:
- Demonstrated leadership in designing and building highly scalable cloud-based data solutions.
- Knowledge of data management best practices including data integration, data security, data warehousing, data analytics, metadata management, and data quality.
- Familiarity with modern data integration frameworks, scalable distributed systems, and emerging data architecture designs/patterns.
- Demonstrated leadership in designing and building highly scalable cloud-based data solutions.
- Modeling