Lead/Senior Data Engineer - ATech Placement

We are looking for a Lead Python/Data Engineer who will play a critical role in designing, developing, and optimizing our data pipelines and databases. You will lead the technical development of complex data solutions, ensuring they meet high standards of performance, scalability, and reliability. Your responsibilities will include mentoring junior engineers, promoting best practices, and collaborating closely with cross-functional teams to deliver robust data solutions.

Key Responsibilities:

• Technical Leadership: Lead the development and optimization of data pipelines, ensuring they are efficient, scalable, and aligned with business goals. Provide technical guidance and mentorship to junior engineers, fostering a collaborative and growth-oriented environment.
• Database Expertise: Utilize your expertise in Snowflake and other columnar databases to design, implement, and optimize database schemas, queries, and data models. Apply advanced techniques such as indexing, clustering, partitioning, and caching to enhance performance and scalability.
• Code Quality and Review: Maintain high standards of code quality through thorough testing, review, and documentation. Provide constructive feedback during code reviews, ensuring that best practices are followed and technical debt is minimized.
• Problem Solving: Demonstrate strong problem-solving skills, independently identifying and resolving technical challenges. Use your deep understanding of Python, data engineering, and database concepts to deliver innovative and effective solutions.
• Collaboration and Communication: Work closely with product, engineering, and business teams to gather requirements, provide technical insights, and ensure alignment on project goals. Communicate effectively, listening to feedback, and integrating it into your work.
• Project Management: Oversee the timely delivery of projects by setting realistic deadlines, prioritizing tasks, and managing resources effectively. Balance multiple priorities while ensuring the quality and completeness of deliverables.
• Continuous Improvement: Stay up-to-date with the latest advancements in data engineering, database technologies, and best practices. Actively seek out opportunities to improve existing processes, tools, and systems.

Required Qualifications:

• Technical Skills: Extensive experience with Python programming and data engineering. Strong expertise in Snowflake, including hands-on experience with performance optimization techniques like indexing, clustering, and partitioning. Familiarity with other columnar databases is recommended.
• Database Management: Proficient in designing, optimizing, and managing large-scale databases. Experience with database performance tuning, query optimization, and troubleshooting.
• Problem-Solving Ability: Demonstrated ability to independently resolve complex technical challenges, with a strong understanding of best practices in data engineering and software development.
• Collaboration Skills: Proven ability to work effectively within a team, including mentoring others, integrating feedback, and contributing to a positive team culture.
• Communication: Strong verbal and written communication skills, with the ability to clearly explain technical concepts to non-technical stakeholders and actively listen to feedback.
• Project Management: Experience managing multiple projects simultaneously, with a track record of delivering high-quality work on time.

Preferred Qualifications:

• Industry Experience: Experience in the procurement or supply chain industry is a plus.
• Leadership: Previous experience in a lead engineering role, with a proven ability to guide and inspire a technical team.

Why Join Us?

• Impact: Contribute to projects that directly impact our clients success and drive innovation in the procurement industry.
• Growth: Join a team that values learning and development, offering opportunities to expand your skills and advance your career.
• Culture: Be part of a collaborative, supportive, and forward-thinking team that values diversity and inclusion.