Senior Mission Data Engineer - Peraton
Chantilly, VA
About the Job
Responsibilities
- Design, construct and maintain large scale data processing pipelines that are robust, flexible and cost-efficient.
- Develop new and modify existing ETL code to transform data sets into standard data models
- Maximize the use of existing ETL code and data conditioners to expedite processing for downstream exploitation.
- Develop data conditioning strategies based on business needs and the capabilities and constraints of IT resources and work across the customer’s organizational boundaries to ensure greatest degree of code interoperability between customer systems to maximize efficiency and impact across mission partners.
- Apply data quality and data validation methods in the ETL process to ensure the data loaded into the target format is accurate, reliable and consistent.
- Propose ways to improve data quality, reliability & efficiency of the whole data pipeline.
- Ensure compliance with data governance and security policies for all data ingested, transported and stored.
- Perform root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement.
- Develop and deliver for each code project Software Documentation that includes ETL Transformations, ETL mappings, code use guide, code location, access instructions, and anomalies encountered.
- Propose ways to improve efficiency, data quality, and scalability of the ETL process, propose and/or implement new technology including AI/ML that can be used to automate data engineering tasks and processes.
Qualifications
Required
Minimum of 5 years with BS/BA; Minimum of 3 years with MS/MA; minimum 10 years without degree.
Experience in scripting or programming with Python, PySpark and Java
- Experience with ETL of large datasets
- Ability to collaboratively interact with customers including senior management, data scientists, and end users.
- TS/SCI with poly
Desired
- Delivering the design and development of software applications.
- Programming/coding the data layer, application layer, and the user interfaces.
- Decomposing functional requirements into technical specifications and tasks.
- Software development and maintenance using tools and languages such as Java, SQL, JavaScript libraries, HTML, XML, Python, Spark, etc.
- Developing and maintaining unit test scripts.
- Developing APIs and web services for integration between systems and services.
- Experience with Experience with Agile development methodologies
- Experience with SecDevOps processes
- Designing and delivering software solutions for the Sponsor.
- Supporting and leading software security accreditation processes, developing required artifacts, coordinating with sponsor infosec, implementing security requirements and remediations.
- Knowledge of automation tools such as Python, Powershell, Terraform, Ansible
- Familiarity with databases such as MongoDB, Open Search and Elasticsearch
- Experience with development in cloud environments such as AWS, Azure, Google Cloud
Peraton Overview
Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we’re keeping people around the world safe and secure.