Incident Manager - Meta Force Technology Staffing LLC

Title: IT Engineer V / Sr. Incident/Triage Engineer

Duration: 12 Months

Possibility to Extend: Yes

Location: RTC, Hybrid (once a week OR based off office location requirements) open to remote but HIGHLY prefer local to Reston

2000 Opportunity Way, Reston, VA 20190

New or Backfill Role: Backfill

Convertible Talent: Yes

Subcontractors: No, W2 only

ADDITIONAL DETAILS:

• Enterprise command center team looking for someone to join triage/incident management calls and perform incident management primary focus is AWS cloud infrastructure knowledge will work on triage and identify root causes, will not develop solutions but will participate in knowledge sharing
• Must have strong communication skills will be on calls with 20-30 people including executive leaders
• Not looking for a developer, need someone with hands on experience with the infrastructure side of AWS
• Should be open to work shifts between 7am-7pm EST

Technical skills:

• cloud infrastructure knowledge, understand how transactions flow from different tools to AWS cloud
• OpenTel
• Splunk
• DynaTrace
• Incident management experience
• Nice to have: google cloud, azure

Job Description:

In this incident management function, manage incidents to resolution in a 24/7/365 environment using the Fannie Mae incident management processes, effectively guide incident and triage calls from a technical perspective, share technical details obtained from monitoring tools and dashboards to aid troubleshooting, outline details of resolution activities, recommend and implement improved processes, provide timely status updates to stakeholders, assist with postmortem related activities and support various efforts related to operational improvements. Manage efforts to maintain application in production, including troubleshooting stoppages, repairing bugs, documenting application performance, and coordinating with technology infrastructure management.

KEY JOB FUNCTIONS
Manage IT production incidents to resolution in a 24/7/365 environment using the Fannie Mae incident management processes and communicate management of incident status, impact and resolution actions.
Hands on experience managing and monitoring applications deployed on Amazon Web Services (AWS).
Troubleshooting and resolving incidents on the AWS cloud infrastructure.
Experience with building tools for monitoring and troubleshooting of system resources in an AWS environment. Ability to triage AWS related incidents using monitoring tools on AWS Cloud.
Experience with performance engineering of AWS Cloud applications.
Hands on experience working with AWS tools like EC2, ELB, RDS, Redshift, DynamoDB, Aurora, Route53, ECS, Lambada, S3, Batch, CloudWatch, CloudTrail, WAF etc.
Hands on experience with transaction level monitoring using Dynatrace and Splunk.
Ability to perform transaction level monitoring and troubleshooting in AWS cloud platform.
Eyes on glass monitoring of the health of applications as well as the underlying infrastructure.
Monitoring experience with tools like Extrahop, SolarWinds, Netcool suite, Catchpoint, MoogSoft.
Ability to analyze dashboards and reporting/monitoring tools to look at trends and patterns in application health and performance.
Proactively looking for hardware, software, and environmental alerts or malfunctions.
Effectively lead and guide Incident triage calls from a technical perspective analyzing different components of the infrastructure and application environment via the use of a variety of monitoring tools and processes.
Troubleshoot the incidents and identify root cause quickly using operations, wire data analytics, application performance management and event correlation monitoring tools.
Perform analysis of data, evaluating multiple application protocols including web, database, storage, and supporting infrastructure such as AWS, UNIX, DNS, LDAP, SSL, SMTP, and FTP.
Influence other technical teams on the calls and articulate troubleshooting steps effectively.
Lead required technical follow-up calls for critical incidents.
Assist with documentation of Root Cause Analysis (RCA) or Correction of Errors (COE) and data quality for all ECC communicated incidents.
Ensure appropriate functional and management escalation takes place as per the standards and procedures.
Follow up on items that could potentially negatively impact production operations, assist with postmortem related activities and support various efforts related to operational improvements.
Based on recommendations from management, implement new and improved processes, change processes, perform new tasks, create reports and address ad-hoc requests.
Participate in on-call rotation. Ability to work on any shifts as needed including weekends and night shifts.
Ability to report incident details and metrics to senior leadership.

EDUCATION
Bachelor's Degree or equivalent required.

MINIMUM EXPERIENCE
6+ years of related experience

SPECIALIZED KNOWLEDGE & SKILLS
6+ years of working experience with different IT Infrastructure components such as Unix/ Linux Servers, Wintel Servers, AWS, networks, firewalls, routers, load balancers, VPN, Apache, web logic, LDAP, Active Directory, Exchange, Oracle/MS SQL databases, SAN, Virtualization, Email systems, Enterprise monitoring and access management solutions for single sign on. Subject matter expertise is not required and experience with at least eight of the above is preferred.
Senior level hands-on working experience with Amazon Web Services (AWS).
Proven methodical approach to problem identification, monitoring, problem solving and resolution.
Ability to analyze different components of the infrastructure and application environments during Incident triage calls.
Aptitude to influence other technical teams on the incident calls and articulate troubleshooting steps effectively.
Experience and confidence working with all levels of management; excellent written and verbal skills.
Able to quickly and concisely communicate with senior management on technical issues in non-technical terms and to run large conference calls during Incident calls with a wide range of personnel and management levels.
Strong relationship management skills and aptitude to multi-task and work well in a high stress environment, both within teams and independently.
AWS Solution Architect Associate or higher certification
Monitoring and observability experience.
Experience with monitoring dashboards for incident detection and alerting.
Perform end-to-end analysis of transactions under an observability environment.
Troubleshoot incidents and identify root cause quickly using wire data analytics, application performance management and event correlation monitoring tools.
Diagnose and resolve incidents by providing factual data from the various monitoring and instrumentation systems.
Monitor applications and infrastructure using tools like Splunk, DynaTrace, OpenTel, Catchpoint, MoogSoft, xMatters, SignalFx, xMatters, SolarWinds, Extrahop etc.

Preferred Qualifications:
Understanding of tools like CloudFormation or Terraform
Management and troubleshooting of Middleware products on UNIX and Linux environments. Knowledge of Service Oriented Architecture (SOA), Java etc.
Understanding of Azure or Google Cloud.
Experience with OpenTel
Prior Fannie Mae or Financial industry experience.