GCP Data Engineer at Global IT Con

Job Title: GCP Data Engineer
Location: St. Louis, MO
Duration: Long-term

Job Description:

We are seeking an experienced GCP Data Engineer to join our team for a long-term project. The ideal candidate will have extensive experience in designing, implementing, and managing large-scale data systems on Google Cloud Platform (GCP) and other cloud infrastructures. This position offers the flexibility of remote work, but candidates should be able to collaborate effectively across time zones.

Key Responsibilities:

• Design, develop, and manage data pipelines using GCP services such as BigQuery, Cloud Composer, Cloud Spanner, and Cloud Storage.
• Implement and manage message-driven architectures using Pub/Sub.
• Develop automation solutions using Ansible and Terraform for infrastructure and configuration management.
• Work on data integration and migration strategies, including setting up and managing Kafka, Teradata, and AWS environments.
• Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions.
• Ensure the performance, scalability, and security of data solutions in cloud environments.
• Perform data modeling, data integration, and data pipeline optimization to enable efficient data processing and analysis.
• Utilize Python for scripting, data manipulation, and workflow automation.

Required Skills:

• Expertise with GCP services: BigQuery, Cloud Composer, Cloud Spanner, Cloud Storage, Pub/Sub.
• Strong hands-on experience with Python for automation and data processing.
• Proficiency in infrastructure automation tools such as Ansible and Terraform.
• Experience working with Kafka for real-time data streaming.
• Knowledge of data warehousing solutions, including Teradata.
• Familiarity with AWS cloud services.
• Solid understanding of CI/CD processes and version control systems.
• Strong SQL skills for querying, analyzing, and processing large datasets.

Preferred Qualifications:

• Experience in managing multi-cloud environments.
• Familiarity with other data integration tools and frameworks.
• Ability to troubleshoot and resolve complex data and infrastructure-related issues.

Education and Experience:

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.

Minimum of 10+ years of experience in data engineering, with a focus on cloud platforms (GCP preferred