Data Engineer - (FM) - Lyteworx Automation Systems

Lyteworx Automation Systems (Lyteworx) is seeking talented individuals to join our team of technology pioneers. With over 16 years of experience, we have honed our core capabilities in IT infrastructure engineering, cyber security, data science, and artificial intelligence. Our comprehensive suite of engineering and technical support services caters to clients across defense, intelligence, and commercial sectors. If you have a passion for cutting-edge technology and a drive to push the boundaries of innovation, Lyteworx is the place for you. Join us and be part of a team that is shaping the future of technology.

Requirements

• Experience with Big Data Systems and ETL Processes:
  
• Extensive experience in managing and analyzing large-scale data sets using Big Data technologies such as Hadoop, Spark, and Kafka.
  
• Proficient in designing, implementing, and optimizing ETL (Extract, Transform, Load) processes to ensure efficient data extraction, transformation, and loading from various sources into data warehouses or data lakes.
  
• Strong understanding of data pipeline architecture, ensuring data integrity, consistency, and quality throughout the ETL process.
  
• Experience with Amazon Web Services (AWS):
  
• In-depth knowledge of deploying, managing, and scaling applications on AWS.
  
• Familiarity with a wide range of AWS services, including but not limited to EC2, S3, RDS, Lambda, and Redshift.
  
• Expertise in using AWS tools for data storage, processing, and analytics, leveraging cloud-native architectures and serverless computing.
  
• Applying DoD Security Technical Implementation Guides (STIGs) and Automating the Process:
  
• Comprehensive understanding of DoD Security Technical Implementation Guides (STIGs) and their application in securing systems and networks.
  
• Experience in automating the application of STIGs using configuration management tools such as Ansible, Puppet, or Chef.
  
• Proven ability to develop and maintain secure, compliant environments by implementing best practices for cybersecurity and risk management.
  
• Skilled in conducting security assessments and audits to ensure compliance with DoD regulations and standards.
  
• 10+ Years of Development Experience; Expertise in Python, Spark, and SQL:
  
• Over a decade of professional experience in software development, with a strong emphasis on data-centric programming.
  
• Advanced proficiency in Python, Spark, and SQL, with a demonstrated ability to write efficient, maintainable, and scalable code.
  
• Experience with software development methodologies, version control systems (e.g., Git), and collaborative development environments.
  
• Strong problem-solving skills and the ability to develop complex algorithms and data processing routines.
  
• Demonstrated Ability to Stand Up and Independently Manage a Portfolio of Data Pipelines:
  
• Proven track record of independently designing, implementing, and managing multiple data pipelines.
  
• Experience in end-to-end data pipeline development, from data ingestion and processing to storage and analysis.
  
• Strong project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results.
  
• Ability to work independently and collaboratively, demonstrating initiative and leadership in managing data pipeline projects.
  

• Code and manage changes to the existing FM Common Data Model and add procurement data sources
  
• Work with data scientist and functional resources to build silver and gold tables as required to support procurement data within Advana and the building of applications
  
• Support the configuration and ingestion of designated structured, unstructured, and semi-structured data repositories into capabilities that satisfy mission partner requirements and support a data analytics and DevOps pipeline to drive rapid delivery of functionality to the client
  
• Maintain all operational aspects of data transfers while accounting for the security posture of the underlying infrastructure and the systems and applications that are supported and monitoring the health of the environment through a variety of health tracking capabilities
  
• Automate configuration management, leverage tools, and stay current on data extract, transfer, and load (ETL) technologies and services. 
  
• Work under general guidance, demonstrate an initiative to develop approaches to solutions independently, review architecture, and identify areas for automation, optimization, right-sizing, and cost reduction to support the overall health of the environment
  
• Apply comprehension of data engineering-specific technologies and services, leverage expertise in databases and a variety of approaches to structuring and retrieving of data, comprehend Cloud architectural constructs, and support the establishment and maintenance of Cloud environments programmatically using vendor consoles
  
• Engage with multiple functional groups to comprehend client challenges, prototype new ideas and new technologies, help to create solutions to drive the next wave of innovation, and design, implement, schedule, test, and deploy full features and components of solutions
  
• Identify and implement scalable and efficient coding solutions.
  

Benefits

• 401K Plan
  
• Vacation and Paid Time Off (PTO)
  
• Health, Dental & Vision Insurance
  
• Life & Supplemental Life Insurance
  
• Disability & Accidental Death & Dismemberment
  
• Mental Health Care
  
• Health Saving Account (HSA)
  

--------- SOURCING RESUMES ---------- We are seeking a highly skilled Data Engineer to join our Financial Management Data Product Team. This role is crucial in enhancing core and data analytics capabilities across various functional domains, with a focus on Procurement and Financial Management (FM) datasets. By improving the linkage of these datasets, we provide the Department of Defense (DoD) with essential insights into mission-critical processes. The position requires enhancing the quality and completeness of data at detailed contract line item number (CLIN) and line of accounting (LOA) levels, ensuring robust and reliable data integration for optimal decision-making. If you have expertise in financial management and a passion for data analytics, we invite you to apply and contribute to our mission. Requirements Security Clearance: Active Secret Clearance Education: Bachlor's Degree or Higher Skills & Experience: Experience with Big Data Systems and ETL Processes: Extensive experience in managing and analyzing large-scale data sets using Big Data technologies such as Hadoop, Spark, and Kafka. Proficient in designing, implementing, and optimizing ETL (Extract, Transform, Load) processes to ensure efficient data extraction, transformation, and loading from various sources into data warehouses or data lakes. Strong understanding of data pipeline architecture, ensuring data integrity, consistency, and quality throughout the ETL process. Experience with Amazon Web Services (AWS): In-depth knowledge of deploying, managing, and scaling applications on AWS. Familiarity with a wide range of AWS services, including but not limited to EC2, S3, RDS, Lambda, and Redshift. Expertise in using AWS tools for data storage, processing, and analytics, leveraging cloud-native architectures and serverless computing. Applying DoD Security Technical Implementation Guides (STIGs) and Automating the Process: Comprehensive understanding of DoD Security Technical Implementation Guides (STIGs) and their application in securing systems and networks. Experience in automating the application of STIGs using configuration management tools such as Ansible, Puppet, or Chef. Proven ability to develop and maintain secure, compliant environments by implementing best practices for cybersecurity and risk management. Skilled in conducting security assessments and audits to ensure compliance with DoD regulations and standards. 10+ Years of Development Experience; Expertise in Python, Spark, and SQL: Over a decade of professional experience in software development, with a strong emphasis on data-centric programming. Advanced proficiency in Python, Spark, and SQL, with a demonstrated ability to write efficient, maintainable, and scalable code. Experience with software development methodologies, version control systems (e.g., Git), and collaborative development environments. Strong problem-solving skills and the ability to develop complex algorithms and data processing routines. Demonstrated Ability to Stand Up and Independently Manage a Portfolio of Data Pipelines: Proven track record of independently designing, implementing, and managing multiple data pipelines. Experience in end-to-end data pipeline development, from data ingestion and processing to storage and analysis. Strong project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results. Ability to work independently and collaboratively, demonstrating initiative and leadership in managing data pipeline projects. Major Duties: Code and manage changes to the existing FM Common Data Model and add procurement data sources Work with data scientist and functional resources to build silver and gold tables as required to support procurement data within Advana and the building of applications Support the configuration and ingestion of designated structured, unstructured, and semi-structured data repositories into capabilities that satisfy mission partner requirements and support a data analytics and DevOps pipeline to drive rapid delivery of functionality to the client Maintain all operational aspects of data transfers while accounting for the security posture of the underlying infrastructure and the systems and applications that are supported and monitoring the health of the environment through a variety of health tracking capabilities Automate configuration management, leverage tools, and stay current on data extract, transfer, and load (ETL) technologies and services. Work under general guidance, demonstrate an initiative to develop approaches to solutions independently, review architecture, and identify areas for automation, optimization, right-sizing, and cost reduction to support the overall health of the environment Apply comprehension of data engineering-specific technologies and services, leverage expertise in databases and a variety of approaches to structuring and retrieving of data, comprehend Cloud architectural constructs,