Sr. TPM, Neuron Compiler at Amazon Development Center U.S., Inc.
Federal Way, WA 98063
About the Job
The AWS Neuron Compiler team is seeking an experienced and motivated Sr TPM to lead and increase efficiency and predictability of our LLM model enablement program. This is a unique opportunity for someone who is passionate about machine learning, compilers, chip design, and software development.
Your mission is to enable software developers and leaders developing machine learning models on Inferentia and Trainium chips to more efficiently plan, develop, and deploy advanced machine learning models. You will work backward to understand the needs our our engineering teams and create a compelling vision and strategy to improve requirement gathering, execution, and disseminating roadmaps and results. You will turn that vision into actionable plans that are written as clear, compelling narratives that leaders at all levels can understand. You will break that plan into easy to understand tasks and deliverables and work with engineering leaders to quickly and efficiently prioritize and implement the most important compiler capabilities, and deliver them together with customers, inference, and training teams.
This role is hands-on and requires a mix of individual delivery and scaling through others. To be successful in this role you must be customer obsessed, understand concepts of low-level computer hardware and large language models. You need to be able to quickly learn about and deeply understand the needs of developers. You will be expected to invent on behalf of our developers and create new and innovative ideas that accelerate the development of delivery of new model and model variants on the current and future Trainium/Inferentia hardware. You must care deeply about operations and the developer experience and should be comfortable working with senior engineers and leaders to establish new concepts and best practices.
Inside Amazon you will be a recognized expert in your field and will be responsible for effectively and reliably communicating project status to senior leaders and stakeholders. In this role, you will also write monthly and weekly business reviews and participate in strategic planning documents such as 3 Year plans, OP1 and Yearly Goals and present them to senior leaders across Amazon.
The right candidate will possess a strong operations background as well as program management experience. You must excel at written and verbal communications. You will have experience with developer tools and software development processes. You must be able to thrive and succeed in an entrepreneurial environment, and not be hindered by ambiguity or competing priorities. This means anticipating bottlenecks, making tradeoffs and balancing the needs of the business versus technical constraints. Cross-team coordination, project management and an ability to learn and understand new technology are essential.
Mentor
We have a formal mentor search application that lets you find a mentor that works best for you based on location, job family, job level etc. Your manager can also help you find a mentor or two, because two is better than one. In addition to formal mentors, we work and train together so that we are always learning from one another, and we celebrate and support the career progression of our team members.
Inclusion
Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and we host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon's culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust.
Work-Life Balance
We offer flexibility in working hours and encourage you to find your own balance between your work and personal life.
A day in the life
Work backward from the customer or partner to build a compelling vision and strategy
Take input from business and engineer leaders to prioritize plans
Develop frameworks, processes and practices with engineers, managers, and business leaders
Manage cross org delivery program and backlog helping teams make strategic trade-offs on how to prioritize work
Identify and prioritize investments in engineering excellence
Mentor other program managers and engineers
Communicate program updates through narratives and reports
BASIC QUALIFICATIONS - 7+ years of experience working directly with engineering teams
- Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules
- 5+ years of technical program management experience
- Knowledge of machine learning concepts and development tools (such as compilers, profilers, debuggers).
- Knowledge of developer tooling across the software development life cycle (task management, source code, building, deployment, operations, real-time communication)
- Experience planning and delivering of software components (such as compilers and debugging tools).
PREFERRED QUALIFICATIONS - 5+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience
- Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules
- Experience defining KPI's/SLA's used to drive multi-million dollar businesses and reporting to senior leadership
- Experience in delivering machine learning models, compilers, or chips.
- Working with a team across geographies, team cultures, and multiple time zones.
- Ability to excel in a fast-paced, startup-like environment
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $133,900/year in our lowest geographic market up to $231,400/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.
Your mission is to enable software developers and leaders developing machine learning models on Inferentia and Trainium chips to more efficiently plan, develop, and deploy advanced machine learning models. You will work backward to understand the needs our our engineering teams and create a compelling vision and strategy to improve requirement gathering, execution, and disseminating roadmaps and results. You will turn that vision into actionable plans that are written as clear, compelling narratives that leaders at all levels can understand. You will break that plan into easy to understand tasks and deliverables and work with engineering leaders to quickly and efficiently prioritize and implement the most important compiler capabilities, and deliver them together with customers, inference, and training teams.
This role is hands-on and requires a mix of individual delivery and scaling through others. To be successful in this role you must be customer obsessed, understand concepts of low-level computer hardware and large language models. You need to be able to quickly learn about and deeply understand the needs of developers. You will be expected to invent on behalf of our developers and create new and innovative ideas that accelerate the development of delivery of new model and model variants on the current and future Trainium/Inferentia hardware. You must care deeply about operations and the developer experience and should be comfortable working with senior engineers and leaders to establish new concepts and best practices.
Inside Amazon you will be a recognized expert in your field and will be responsible for effectively and reliably communicating project status to senior leaders and stakeholders. In this role, you will also write monthly and weekly business reviews and participate in strategic planning documents such as 3 Year plans, OP1 and Yearly Goals and present them to senior leaders across Amazon.
The right candidate will possess a strong operations background as well as program management experience. You must excel at written and verbal communications. You will have experience with developer tools and software development processes. You must be able to thrive and succeed in an entrepreneurial environment, and not be hindered by ambiguity or competing priorities. This means anticipating bottlenecks, making tradeoffs and balancing the needs of the business versus technical constraints. Cross-team coordination, project management and an ability to learn and understand new technology are essential.
Mentor
We have a formal mentor search application that lets you find a mentor that works best for you based on location, job family, job level etc. Your manager can also help you find a mentor or two, because two is better than one. In addition to formal mentors, we work and train together so that we are always learning from one another, and we celebrate and support the career progression of our team members.
Inclusion
Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and we host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon's culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust.
Work-Life Balance
We offer flexibility in working hours and encourage you to find your own balance between your work and personal life.
A day in the life
Work backward from the customer or partner to build a compelling vision and strategy
Take input from business and engineer leaders to prioritize plans
Develop frameworks, processes and practices with engineers, managers, and business leaders
Manage cross org delivery program and backlog helping teams make strategic trade-offs on how to prioritize work
Identify and prioritize investments in engineering excellence
Mentor other program managers and engineers
Communicate program updates through narratives and reports
BASIC QUALIFICATIONS - 7+ years of experience working directly with engineering teams
- Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules
- 5+ years of technical program management experience
- Knowledge of machine learning concepts and development tools (such as compilers, profilers, debuggers).
- Knowledge of developer tooling across the software development life cycle (task management, source code, building, deployment, operations, real-time communication)
- Experience planning and delivering of software components (such as compilers and debugging tools).
PREFERRED QUALIFICATIONS - 5+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience
- Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules
- Experience defining KPI's/SLA's used to drive multi-million dollar businesses and reporting to senior leadership
- Experience in delivering machine learning models, compilers, or chips.
- Working with a team across geographies, team cultures, and multiple time zones.
- Ability to excel in a fast-paced, startup-like environment
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $133,900/year in our lowest geographic market up to $231,400/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.
