Senior Data Engineer - Luxoft Holding, Inc.

We are seeking a talented and motivated Senior Data Engineer to join our data engineering team. In this role, you will play a critical part in designing, developing, and optimizing data pipelines and solutions that enable efficient data processing and analysis. As a Senior Data Engineer, you will collaborate with cross-functional teams to drive data-driven decision-making and contribute to the continuous improvement of our data infrastructure.

Responsibilities

• Design, develop, and maintain new data capabilities and infrastructure for utilizing Mastercard, third-party, and partner data to enhance Mastercards data products and solutions

• Create new data pipelines, data transfers, and compliance-oriented infrastructure to facilitate seamless data utilization within cloud environments

• Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation

• Collaborate with technical team and business stakeholders to understand data requirements and translate them into technical solutions

• Work with large datasets, ensuring data quality, accuracy, and performance

• Implement data transformation, integration, and validation processes to support analytics and reporting needs

• Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency

• Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security

• Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes

• Document data processes, data lineage, and technical specifications for future reference

• Participate in code reviews, ensuring adherence to coding standards and best practices

• Collaborate with DevOps teams to automate deployment and monitoring of data pipelines

• Additional tasks as required

Skills

Must have

• Bachelors or Masters degree in Computer Science, Engineering, or a related field

• Proven experience in data engineering, with a strong track record of designing and implementing data solutions

• Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks (Spark, Hadoop, etc.)

• In-depth understanding of data warehousing concepts, cloud platforms (AWS, Azure, GCP), and data modeling techniques

• Strong knowledge of SQL and NoSQL databases, as well as data integration and transformation tools

• Passion for and engagement with emerging trends in data, AI/ML, analytics, and digital experiences

• Experience in data product development, analytical models, and model governance

• Experience in anonymizing data and managing the use of data

• Experience in data hygiene procedures, identity resolution capabilities or data management a plus

• Ability to create strategies and plans that define how information can be utilized to support an organizations overall business strategy, and how that information and data is organized, and governed inside an organization

• Strong project management skills and a demonstrated ability to understand complex information product constructs

• Familiarity with industry best practices for collection and use of data

• Outstanding problem-solving skills and the ability to navigate complex data challenges

• Effective communication and collaboration skills to work with both technical and non-technical stakeholders

• Experience with agile methodologies and DevOps practices

Nice to have

• Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts

• Experience in working with Cloud APIs (e.g., Azure, AWS)

• Experience participating in complex engineering projects in an Agile setting e.g. Scrum