Data Engineer - Cyborgwave
Los Angeles, CA
About the Job
Candidates MUST be authorized to work without sponsorship
*Candidate must be able to work EST hours from day 1* Remote
We are seeking a highly skilled Senior Data/Software Engineer with expertise in CI/CD pipelines, automation, and full-stack development to drive a high-priority project. This role involves building and testing code through CI/CD pipelines in AWS, managing test case definition, and storing data in a Datalake. The role is critical in meeting tight deadlines, with a focus on delivering product readiness by mid-October and full results by the end of October.
Top Requirements:&
JAMA, BAZEL, Step Functions, Python and AWS
Key Responsibilities:
- CI/CD Development: Build and manage CI/CD pipelines using&
Jenkins and Bazel&
for continuous integration and testing.
- Test Case Management: Define test cases with strict adherence to requirements and ensure documentation is stored in&
Jama.
- Scripting Automation: Perform heavy scripting and automation tasks to streamline processes.
- Datalake Management: Store and manage CI test results in a Datalake accessible through APIs.
-&
AWS Infrastructure:
& Utilize AWS services, including EC2 and Terraform, to build, maintain, and automate the infrastructure.
- API Integration: Drive extensive API integration work for seamless data access and functionality.
- Simulation Testing: Conduct sensor simulation tests and provide detailed reports on status and results.
- Leadership Oversight: Assign and manage contractors to ensure smooth project execution, track progress, and address any technical questions or concerns.
Skills Experience Required:
-
& Strong background in CI/CD pipeline development using Jenkins and Basil.
- Experience with AWS services (EC2, Datalake, Terraform).
- Proficient in scripting and automation with hands-on experience in API integration
- Ability to manage test case creation and reporting in Jama.
- Experience with full-stack development, with a focus on automation.
- Strong problem-solving and project management skills to meet tight deadlines.
- Excellent communication and leadership skills, with the ability to manage and mentor contractors.
Preferred Qualifications:
- Prior experience in sensor simulation testing and familiarity with testing frameworks
- Experience& with&
Bazel
& for build and testing frameworks.
- Strong organizational skills to ensure all timelines are met.
&
&
System Description!!!
Product Readiness Report Overview:
Objective
:
Build and test code through CI/CD pipelines.
Store results in the datalake, accessible via API.
Define and execute test cases with strict adherence to requirements recorded in Jama.
Technologies Tools
:
CI/CD
: Jenkins pipelines in AWS.
Build Testing Frameworks
: Bazel.
Infrastructure
: Terraform, EC2.
Data Storage
: Datalake with API integration.
Scripting Automation
: Heavy emphasis on scripting and automation.
Full-Stack Skills
: Required, though front-end specifics are uncertain.
Responsibilities
:
Create and store CI test results in the datalake.
Drill down into test results to assess basic status and specifics around sensor test simulations.
Manage tight deadlines:
Mid-October for initial results.
End of October for final results.
Team Structure
:
Senior engineer assigned to manage contractors.
Drive production, track progress, and address questions.
Project Duration
:
3 months.
Start Date
:
Immediate start required to meet deadlines.
Source : Cyborgwave