Log Data Engineering Consultant - Owings Mills, MD (Hybrid - 2 days onsite) - Georgia IT Inc.
Owings Mills, MD
About the Job
Log Data Engineering Consultant
Location: Owings Mills, MD (Hybrid - 2 days onsite)
Duration: 12 Months
Pay Rate: DOE
US Citizens and Green cards are Preferred.
Roles and Responsibilities:
Location: Owings Mills, MD (Hybrid - 2 days onsite)
Duration: 12 Months
Pay Rate: DOE
US Citizens and Green cards are Preferred.
Roles and Responsibilities:
- Support the full systems engineering lifecycle for large hybrid Splunk and Cribl deployments, including requirements gathering, design, testing, implementation, operations, and documentation.
- Implement automated log data pipelines using Python to ingest logs into platforms like Splunk and Open Search.
- Automate platform management processes using Ansible or other scripting tools and languages.
- Troubleshoot incidents impacting the log data platforms, ensuring minimal downtime.
- Collaborate and coordinate with users to optimize platform performance and usability.
- Develop comprehensive training and documentation materials to support platform users.
- Support platform upgrades, coordinating and testing new versions with users.
- Gather and process raw data from multiple sources, transforming it into a suitable format for analysis.
- Enable log data batch and real-time analytical processing solutions using emerging technologies.
- Build robust log data pipelines to aid in the development and testing phases of log data engineering projects.
- Strong troubleshooting and diagnostic skills for complex issues.
- Proven experience in supporting technical users and conducting requirements analysis.
- Ability to work independently with minimal supervision.
- Experience with IT Service Management and familiarity with Incident and Problem management.
- Expertise in identifying performance bottlenecks and resolving service issues.
- Effective cross-functional team collaboration skills, influencing design, operations, and deployment of highly available software.
- Knowledge of best practices related to security, performance, and disaster recovery.
- 3-5 years of experience managing and configuring Splunk Enterprise and/or Splunk Cloud.
- Experience in developing and managing requirements and making data-driven decisions.
- Proficiency with Linux and Windows agents (Splunk, Fluentbit/Fluentd) for log data engineering.
- Experience in designing, developing, and deploying cloud-based solutions using AWS.
- Experience in onboarding new data, configuration, creating dashboards, and extracting information through Splunk and Cribl.
- Expertise in systems development for data extraction, ingestion, and processing of large data volumes.
- Proficiency with scripting and automation (bash, Python, or other programming languages).
- Familiarity with Splunk REST APIs.
- Knowledge of cloud platforms (preferably AWS) and container orchestration technologies.
- Experience with data pipeline orchestration platforms.
- Splunk Certification (Admin or Architect).
- Experience with Ansible Tower automations.
- Experience using GitLab.
- Experience with large platform migration efforts.
- Experience with AWS OpenSearch and Cribl.
- Familiarity with data streaming technologies such as Kafka, Kinesis , Spark Streaming, etc.
Source : Georgia IT Inc.