Palantir Foundry, Pyspark Data Engineer/Lead at IT & EBusiness Consulting Services Inc.
Mountain View, CA 94043
About the Job
Position: Palantir Foundry, Pyspark Data Engineer/Lead
Location: CA. 100% Remote
Key Skills: Palantir Foundry, Python, spark, AWS,Pyspark
Responsibilities
- Preferred candidate having experience with Palantir Foundry (Code Repository, Contour, Data connection and workshop). Palantir Foundry experience is must to have.
- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
- Collaborate with product and technology teams to design and validate the capabilities of the data platform
- Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
- Provide technical support and usage guidance to the users of our platform’s services.
- Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
- Experience building and optimizing data pipelines in a distributed environment
- Experience supporting and working with cross-functional teams
- Proficiency working in Linux environment
- 4+ years of advanced working knowledge of Palantir Foundry, SQL, Python, and PySpark
- 2+ years of experience with using a broad range of AWS technologies
- Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
- Experience with platform monitoring and alerts tools
