Sr System Reliability Engineer (Automation) - Fulcrum Digital

Who are we
Fulcrum Digital is an agile and next-generation digital accelerating company providing digital transformation and technology services right from ideation to implementation. These services have applicability across a variety of industries, including banking & financial services, insurance, retail, higher education, food, healthcare, and manufacturing.

 

The Role

• Plan, manage, and oversee all aspects of a Production Environment 
  
• Define strategies for Application Performance Monitoring, Optimization in Prod environment
  
• Respond to Incidents and improvise platform based on feedback and measure the reduction of incidents over time.
  
• Support deployment of code into multiple lower environments.  Supporting current processes with an emphasis on automating everything as soon as possible.
  
• Design, develop and standardize Monitoring and Alerting mechanism for the supported applications.
  
• Take a holistic approach to problem solving, by connecting the dots during a production event through the various technology stack that makes up the platform, to optimize meantime to recover.
  
• Engage in and improve the whole lifecycle of services—from inception and design, through deployment, operation and refinement.
  
• Analyse ITSM activities of the platform and provide feedback loop to development teams on operational gaps or resiliency concerns.
  
• Support services before they go live through activities such as system design consulting, capacity planning and launch reviews.
  
• Support the application CI/CD pipeline for promoting software into higher environments through validation and operational gating, and lead in DevOps automation and best practices.
  
• Maintain services once they are live by measuring and monitoring availability, latency, and overall system health.
  
• Scale systems sustainably through mechanisms like automation and evolving systems by pushing for changes that improve reliability and velocity.
  
• Work with a global team spread across tech hubs in multiple geographies and time zones.
  
• Ability to share knowledge and explain processes and procedures to others.
  
• Able to perform on-call duties on a rotational basis.
  
• Occasional off hours work required.
  

 

 

 

 

Requirements

Must Have

• Linux
  
• Shell Scripting  
  
• ITIL / ITSM
  
• SQL - Good to have
  
• Application Troubleshooting - Basic
  
• Any Monitoring tool (Preferred Splunk/Dynatrace)
  
• Jenkins - CI/CD
  
• Groovy Scripting/Yaml
  
• Git basic/bit bucket
  
• Ansible/Chef - Basic
  

Good To Have

• Even Framework architecture
  

Understanding of event-driven architectures Distributed systems - How clusters are formed, Quorum management, Failure handling. 3 to 5 years of hands-on Experience in MQ or NATS broker or similar messaging solutions. Understanding of Kafka clustering would be good to have. Knows Client-Server communication aspects - sockets, TLS protocol etc Understands the concept of region and AZs. Provide L2 support production systems like application, database, middleware components, infrastructure and network components. Manage production incidents end-to-end within defined SLAs with focus on resolution rather than who caused it. Interact with various stakeholders such as Release managers, program leads, service managers, development and test leads Review operational readiness requirements such as monitoring and alerting, log rotation and resilience of the components and report the gaps Provide pre-implementation support with activities such as release notes review and implementation dry runs. Protect production components by running health checks monitoring latency and memory utilization. Automate day-to-day activities and propose changes that improve reliability Participate in CAB and provide feedback on change requests Support the DevOps team in testing the promoted pipelines and suggest automation of configuration items. Practice incident management best practices and perform RCA. Participate in disaster recovery tests and operational acceptance tests Analyze the technology stack that makes up the product and optimize recovery time objective. Work with team members spread across and time zones Share knowledge, document improvements and mentor junior resources It is good to have skills using Jenkins to orchestrate builds and link to Sonar, Maven, etc. to build out the CI/CD pipeline. Support deployments of code into multiple lower environments. Supporting current processes needed with an emphasis on automating everything as soon as possible. It is good to have skill to design, Implement, and enhance our deployment automation based on Chef. We need proven experience designing and implementing an overall release and deployment process. It is good to have skill to design and implement a Git based code management strategy that will support multiple environment deployments in parallel. Experience with automation for Branch management, code promotions, and version management. Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation, and refinement. Requirements MQ/EB Understanding of event-driven architectures Distributed systems - How clusters are formed, Quorum management, Failure handling. 3 to 5 years of hands-on Experience in MQ or NATS broker or similar messaging solutions. An understanding of Kafka clustering would be good to have. Knows Client-Server communication aspects - sockets, TLS protocol etc Understand the concept of region and AZs. Deployments MTF/Prod, Maintenance items (including stop/start, Disaster Recovery-related activities, etc.), CR for changes in MTF/Prod Good knowledge on Nginx Tools - Log Monitoring Tool - Splunk Application Monitoring tool - Dynatrace Ticketing incident/problem management tool - Remedy Dev-ops Basics - CI-CD Basics, Overview of Git, Bit-bucket, SonarQube, Ansible/Chef Skills - Linux & Shell Scripting ITIL / ITSM PL/SQL Troubleshooting Jenkins - CI/CD Groovy Scripting/Yaml Ansible/Chef Nginx Java / JEE Event-Driven Architectures MQ or NATS broker or similar messaging solutions. Kafka Client-server communication aspects - sockets, TLS protocol Understand the concept of region and AZs.