Principal Technical Product Manager- Accelerator Optimization

Overview

Microsoft is building the infrastructure that powers the next generation of AI services at global scale. We are looking for a Principal Product Manager to own the AMD (Advanced Micros Devices) inference platform optimization strategy for Azure AI services, ensuring that advanced AI models are delivered on AMD GPUs (Graphics Processing Units) with strong performance, correctness, stability, compatibility, and release quality. This role is focused on making AMD a first-class production platform for AI inference through clear product strategy, disciplined execution, and deep partnership with engineering and external vendor teams.


This is a senior individual contributor role for someone who is comfortable operating at the intersection of AI models, GPU systems, compiler/runtime dependencies, model serving, performance engineering, and large-scale cloud deployment. The successful candidate will translate complex platform realities into a clear roadmap, measurable product outcomes, and sustained engineering improvements across the AMD stack.


Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.


Responsibilities

• Work with customers and AMD Partners to define and drive the product strategy, roadmap, and execution for AI model optimization on AMD GPU platforms, including current and future hardware generations.

• Partner closely with engineering teams across kernels, runtime, compiler, performance, quality, and service deployment to prioritize work across performance optimization, correctness, compatibility, stability, bug resolution, and release quality.

• Own AMD-specific technical product decisions across the inference stack, including platform tradeoffs involving throughput, latency, scalability, memory behavior, quality, reliability, cost efficiency, and time to delivery.

• Ensuring AMD implementations meet production standards for performance and operational quality. Own and drive improvements to KPIs related to throughput, latency, and hardware efficiency (e.g., GPU utilization, capacity savings), and track impact using standardized performance and cost metrics.

• Drive release readiness across the AMD release lifecycle, including planning, validation, regression prevention, deployment readiness, and production handoff.

• Use data from benchmarking, testing, production signals, and incident trends to inform prioritization and to improve platform performance, reliability, and predictability over time.

• Serve as the primary product lead working with AMD engineering and product counterparts, building strong operating rhythms and clear accountability for performance, feature readiness, and issue resolution.

• Partner with internal engineering and service teams to identify and resolve AMD-specific production issues and regressions and contribute to root cause analysis and long-term systemic improvements.

• Improve engineering systems and processes related to AMD releases, branch strategy, testing, and delivery so that the platform can scale with greater velocity and less operational fragility.

Qualifications

Required/Minimum Qualifications

• Bachelor's Degree AND 10+ years experience in product/service/program management or software development OR equivalent experience.

Other Requirements

• Ability to meet Microsoft, customer, and/or government security screening requirements are required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check. This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Additional or Preferred Qualifications

• Bachelor's Degree AND 12+ years experience engineering, product/technical program management, data analysis, or product development OR equivalent experience.

• 8+ years of experience managing cross-functional and/or cross-team projects.

• Technical depth in one or more of the following areas: AI/ML infrastructure, GPU systems, distributed systems, model serving, compilers, runtime systems, performance engineering, or cloud platform architecture.

• Proven ability to influence across organizational boundaries and drive clarity in complex, ambiguous environments.

• Familiarity with AMD and/or NVIDIA GPU ecosystems, model execution frameworks, compiler/runtime stacks, or hardware/software co-optimization

• Experience working with external ecosystem partners, silicon vendors, or platform partners on technical product delivery.

• Experience improving release readiness, CI quality, benchmarking, regression detection, or service reliability processes for technical products or platforms.

• 1+ year(s) of experience reading and/or writing code (for example, reviewing sample code, technical documentation, or product demos).

Product Management IC6 - The typical base pay range for this role across the U.S. is USD $165,600.00 - $296,400.00 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800.00 - $331,200.00 per year.


Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.