Data Streaming Engineer IV - Navy Federal Credit Union
Vienna, VA 22180
About the Job
Overview
Develop technical solutions for real-time data integration with Navy Federal's enterprise data ecosystem on cloud. Responsible for designing, building and integrating data in streams into high performing operational data hubs, enterprise event hubs and data lake to support use cases like near real time data virtualization and real time fraud detection. Develop complex event driven applications with the goal of optimizing the performance of Navy Federal's messaging/event driven data ecosystem. Solves highly complex problems; takes a broad perspective to identify solutions. Works independently.
Responsibilities
Design and build highly scalable data pipelines for real-time data ingestion.
Recognize potential issues and risks during the project implementation and suggest mitigation strategies.
Follow approved DevOps process and coordinate with deployment teams to deploy changes in higher environments.
Partner with data analysts, data modelers and functional SMEs to understand the data structure and design target database and event payload schemas.
Apply engineering principles into the design and enhancement of new and existing systems.
Ensure the security and integrity of system and product solutions including compliance with Navy Federal, industry engineering and Information Security principles and practices.
Perform other duties as assigned.
Qualifications
Bachelor's degree in computer science or related field, or the equivalent combination of education, training, and experience.
Hands-on experience in message-oriented middleware/streaming data technologies such as Kafka/NiFi, MQ, Azure Event Hub, Confluent, Spark Streaming.
Hands-on experience in configuring Azure Event Hub, Event Grid, Stream Analytics, API and logic/function apps.
Hands on skills in Python, Databricks, Azure Data Factory.
Experienced in the use of ETL tools and techniques and have knowledge of CI/CD.
Must have strong programming skills / experience in C# / .NET and developing and deploying Azure Logic App and Azure functions.
General knowledge and experience with configuration, load-balancing, auto-scaling, monitoring, networking, and problem-solving in a cloud environment.
Demonstrates change management and excellent communication skills.
Expert research, analytical, and problem-solving skills.
Advanced skill exercising initiative and using good judgment to make sound decisions.
Hours: Monday - Friday, 8:00AM - 4:30PM
Location: 820 Follin Lane, Vienna, VA 22180
About Us
Navy Federal provides much more than a job. We provide a meaningful career experience, including a culture that is energized, engaged and committed; and fierce appreciation for our teams, who are rewarded with highly competitive pay and generous benefits and perks.
• Best Companies for Latinos to Work for 2024
• Computerworld Best Places to Work in IT
• Forbes 2024 America's Best Large Employers
• Forbes 2023 The Best Employers for New Grads
• Fortune Best Workplaces for Millennials 2023
• Fortune Best Workplaces for Women 2023
• Fortune 100 Best Companies to Work For 2024
• Military Times 2023 Best for Vets Employers
• Newsweek Most Loved Workplaces
• Ripplematch Campus Forward Award - Excellence in Early Career Hiring
• Yello and WayUp Top 100 Internship Programs
From Fortune. 2024 Fortune Media IP Limited. All rights reserved. Used under license. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, Navy Federal Credit Union.
Equal Employment Opportunity: Navy Federal values, celebrates, and enacts diversity in the workplace. Navy Federal takes affirmative action to employ and advance in employment qualified individuals with disabilities, disabled veterans, Armed Forces service medal veterans, recently separated veterans, and other protected veterans. EOE/AA/M/F/Veteran/Disability EOE/AA/M/F/Veteran/Disability
Hybrid Workplace: Navy Federal Credit Union is a hybrid workplace, and details will be discussed during your interview process.
Disclaimers: Navy Federal reserves the right to fill this role at a higher/lower grade level based on business need. An assessment may be required to compete for this position. Job postings are subject to close early or extend out longer than the anticipated closing date at the hiring team's discretion based on qualified applicant volume. Navy Federal Credit Union assesses market data to establish salary ranges that enable us to remain competitive. You are paid within the salary range, based on your experience, location and market position
Bank Secrecy Act: Remains cognizant of and adheres to Navy Federal policies and procedures, and regulations pertaining to the Bank Secrecy Act.
Develop technical solutions for real-time data integration with Navy Federal's enterprise data ecosystem on cloud. Responsible for designing, building and integrating data in streams into high performing operational data hubs, enterprise event hubs and data lake to support use cases like near real time data virtualization and real time fraud detection. Develop complex event driven applications with the goal of optimizing the performance of Navy Federal's messaging/event driven data ecosystem. Solves highly complex problems; takes a broad perspective to identify solutions. Works independently.
Responsibilities
Design and build highly scalable data pipelines for real-time data ingestion.
Recognize potential issues and risks during the project implementation and suggest mitigation strategies.
Follow approved DevOps process and coordinate with deployment teams to deploy changes in higher environments.
Partner with data analysts, data modelers and functional SMEs to understand the data structure and design target database and event payload schemas.
Apply engineering principles into the design and enhancement of new and existing systems.
Ensure the security and integrity of system and product solutions including compliance with Navy Federal, industry engineering and Information Security principles and practices.
Perform other duties as assigned.
Qualifications
Bachelor's degree in computer science or related field, or the equivalent combination of education, training, and experience.
Hands-on experience in message-oriented middleware/streaming data technologies such as Kafka/NiFi, MQ, Azure Event Hub, Confluent, Spark Streaming.
Hands-on experience in configuring Azure Event Hub, Event Grid, Stream Analytics, API and logic/function apps.
Hands on skills in Python, Databricks, Azure Data Factory.
Experienced in the use of ETL tools and techniques and have knowledge of CI/CD.
Must have strong programming skills / experience in C# / .NET and developing and deploying Azure Logic App and Azure functions.
General knowledge and experience with configuration, load-balancing, auto-scaling, monitoring, networking, and problem-solving in a cloud environment.
Demonstrates change management and excellent communication skills.
Expert research, analytical, and problem-solving skills.
Advanced skill exercising initiative and using good judgment to make sound decisions.
Hours: Monday - Friday, 8:00AM - 4:30PM
Location: 820 Follin Lane, Vienna, VA 22180
About Us
Navy Federal provides much more than a job. We provide a meaningful career experience, including a culture that is energized, engaged and committed; and fierce appreciation for our teams, who are rewarded with highly competitive pay and generous benefits and perks.
• Best Companies for Latinos to Work for 2024
• Computerworld Best Places to Work in IT
• Forbes 2024 America's Best Large Employers
• Forbes 2023 The Best Employers for New Grads
• Fortune Best Workplaces for Millennials 2023
• Fortune Best Workplaces for Women 2023
• Fortune 100 Best Companies to Work For 2024
• Military Times 2023 Best for Vets Employers
• Newsweek Most Loved Workplaces
• Ripplematch Campus Forward Award - Excellence in Early Career Hiring
• Yello and WayUp Top 100 Internship Programs
From Fortune. 2024 Fortune Media IP Limited. All rights reserved. Used under license. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, Navy Federal Credit Union.
Equal Employment Opportunity: Navy Federal values, celebrates, and enacts diversity in the workplace. Navy Federal takes affirmative action to employ and advance in employment qualified individuals with disabilities, disabled veterans, Armed Forces service medal veterans, recently separated veterans, and other protected veterans. EOE/AA/M/F/Veteran/Disability EOE/AA/M/F/Veteran/Disability
Hybrid Workplace: Navy Federal Credit Union is a hybrid workplace, and details will be discussed during your interview process.
Disclaimers: Navy Federal reserves the right to fill this role at a higher/lower grade level based on business need. An assessment may be required to compete for this position. Job postings are subject to close early or extend out longer than the anticipated closing date at the hiring team's discretion based on qualified applicant volume. Navy Federal Credit Union assesses market data to establish salary ranges that enable us to remain competitive. You are paid within the salary range, based on your experience, location and market position
Bank Secrecy Act: Remains cognizant of and adheres to Navy Federal policies and procedures, and regulations pertaining to the Bank Secrecy Act.
Source : Navy Federal Credit Union
