Sr. Data Engineer - Datum Software, Inc

Sr.Data Engineer 
Long Term Contract
Atlanta, GA


Qualifications:
Summary
A Senior Data Engineer with extensive experience in designing, building, and managing data solutions using cloud-based infrastructure. Skilled in transforming data from multiple sources to provide insights for business stakeholders, with a focus on scalable, resilient, and efficient technology solutions. Adept at working in cross-functional teams and Agile environments, driving informed decision-making through data engineering.

Key Strengths:

• Extensive experience with the full data lifecycle and its application in machine learning, business analytics, and reporting.
• Expertise in transforming complex data into actionable insights, optimizing pipelines for performance and reliability.
• Strong leadership and mentorship capabilities in fast-paced environments, with a "can-do " mindset and critical thinking skills.
• Excellent interpersonal and communication skills for cross-functional collaboration with both technical teams and business stakeholders.

Core Competencies:

• Data Engineering : Designing, implementing, and operating data solutions in cloud-based environments.
• ETL Development : Building and maintaining ETL pipelines with a focus on data quality and reliability.
• Cloud Expertise : Proficiency in AWS services (EC2, S3, RDS, Lambda, CloudFormation), cloud infrastructure automation (Terraform, CloudFormation), and cloud data management.
• Database Technologies : Expertise in Teradata SQL, database optimization, and performance tuning.
• Leadership & Collaboration : Ability to lead technical projects, mentor junior engineers, and act as a liaison between technical and business teams.

Responsibilities:

• Architect, design, and implement scalable data solutions in cloud environments using Agile methodology.
• Collaborate with cross-functional teams, including Data Engineers, Data Analysts, and business leaders, to provide actionable insights from data.
• Lead and mentor junior engineers, conducting code reviews and ensuring best practices are followed.
• Serve as a technical advisor, guiding data engineering projects to meet business needs.

Technical Responsibilities:

• Develop and maintain ETL pipelines, ensuring data quality, scalability, and reliability.
• Optimize database performance through query tuning, indexing, and use of materialized views.
• Automate infrastructure deployment using AWS services such as Lambda, Step Functions, Glue, and Terraform.
• Implement security and governance policies in data management.

Technologies & Tools:

• Teradata : Advanced knowledge of Teradata architecture (AMP, Parsing Engines), utilities (BTEQ, FastLoad, MultiLoad), and optimization techniques (partitioning, indexing).
• AWS Cloud : Hands-on experience with EC2, S3, RDS, Lambda, and CloudFormation for infrastructure automation.
• Programming & Scripting : Proficient in Python, Shell scripting, and SQL for automating tasks and managing relational databases.
• Data Security & Governance : Ensuring data compliance, security, and governance across pipelines and storage solutions.

Preferred Qualifications:

• Education : Bachelor's degree in computer science or equivalent.
• Certifications : Vantage Master 2.0 certifications, Vantage Data Science Master certifications.
• Experience : Over 7 years of professional experience, with 5+ years in the airline industry and 4+ years building ETL pipelines.
• Skills : Strong knowledge of AWS storage options (S3, EFS, Glacier) and integration with analytics services like Redshift.

"All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.”