Principal Technical Program Manager , Annapurna ML

Principal Technical Program Manager , Annapurna ML

Annapurna ML Neuron is the team that delivers the software that powers the existing and upcoming Trainum families of Machine Learning Accelerated EC2 instances. We build a Compiler, Collective Communication, Drivers, Runtime and a fully integrated suite of Pytorch and JAX stacks, providing the highest-scale, distributed Training and Inference servers available. We work from the lowest level collaborating with chip and server design up to and including massive scale inference and training for frontier models.

We're seeking a Principal Program Manager for the Annapurna ML, Neuron core team. In this role you will be owning the software technology bring up lifecycle from early hardware design ideation, to landing hardware in labs and data centers, developing, debugging, and qualifying full servers for customer and Neuron developers.

You will work stakeholders to secure and allocate prototype and production Trainium instances. Establish and maintain dashboards, utilization metrics, and recurring review mechanisms to proactively identify new usecases, gaps, and drive resolution. You will be responsible for scoping and delivering large projects end-to-end. Responsibilities include collection of business and systems requirements from internal and external customers, writing specifications, driving project schedules from design to release, and managing the production launch. You will lead and coordinate design/implementation efforts between Neuron, Trainium hardware teams, as well as internal teams and external customers. You will be expected to make appropriate tradeoffs to optimize time-to-production, clearly communicate goals, roles, responsibilities, and desired outcomes to internal cross-functional and remote project teams.

The right candidate will possess a strong technical and program management background, demonstrate experience in new hardware design and bringup, will have demonstrated experience leading medium to large projects, and will have a well-rounded technical background in at most of the following: current machine learning technologies, products spanning multiple technical domains from higher performance networking/compute and drivers to compilers and software development programs. You must be able to thrive and succeed in an entrepreneurial environment and not be hindered by ambiguity or competing priorities. This means you are not only able to develop and drive high-level strategic initiatives, but can also roll up your sleeves, dig in and get the job done.

As a Principal TPM, you will anticipate bottlenecks, provide escalation management, anticipate and make trade-offs, and balance the business needs versus technical constraints. An ability to take large, complex projects and break them down into manageable pieces, develop functional specifications, then deliver them in a timely manner.

In this role you will:

• Drive execution of projects


• Provide technical direction with limited assistance


• Lead cross functional project meetings with VP level audience and stakeholders


• Lead milestone reviews


• Present project status to the executive team

Key job responsibilities

Work with Engineering leadership, Product Management, and Business Development to help define requirements and roadmaps, work with Engineering leadership to drive efficiencies in engineering development and ensure the right things are delivered to Customers at the right time. We work like a startup - moving fast and building new things.

About the team

Annapurna ML Neuron is the team that delivers the software that powers the existing and upcoming Trainum families of Machine Learning Accelerated EC2 instances. We build a Compiler, Collective Communication, Drivers, Runtime and a fully integrated suite of Pytorch and JAX stacks, providing the highest-scale, distributed Training and Inference servers available. We work from the lowest level collaborating with chip and server design up to and including massive scale inference and training for frontier models.

Basic Qualifications

• 7+ years of technical product or program management experience


• 10+ years of working directly with engineering teams experience


• 5+ years of software development experience


• Experience managing programs across cross functional teams, building processes and coordinating release schedules

Preferred Qualifications

• 8+ years of hands‑on work managing complex technology projects experience


• Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .

USA, CA, Cupertino - 203,500.00 - 275,300.00 USD annually
USA, WA, Seattle - 177,000.00 - 239,400.00 USD annually