Senior Product Manager, Inference Platform
$208k - $327.75kNVIDIA Corporation
At NVIDIA, we are building the foundation & blueprints for how AI workloads are served at scale for NVIDIA employees and DSX Partners. As a Product Manager for Inference Platform, you will help define and drive the products and platform capabilities that enable large-scale models serving across a broad portfolio of models, both open source and proprietary. You will work at the intersection of AI research, infrastructure engineering, and real user needs, shaping how inference is delivered reliably, efficiently, and at scale. This is high-impact role. You will be expected to bring structure to undefined problem spaces, make progress without complete information, and build conviction through deep engagement with users, engineers, and the broader ecosystem of AI Cloud partners. The right candidate is equally comfortable discussing model serving architecture, token economics and writing a clear product brief. What you will be doing: Define product vision and strategy for inference platform capabilities — including APIs, capacity management, cost management, performance and optimization, and model serving infrastructure. Translate user needs and infrastructure constraints into clear requirements and prioritized roadmaps. Partner closely with engineering, research, and user groups teams to drive execution from concept through launch. Be responsible for end-to-end product lifecycle for inference-related products and platform investments. Develop deep understanding of the inference ecosystem — model formats, serving frameworks, API formats, and the tradeoffs that matter at scale. Drive clarity in ambiguous situations by framing the problem, identifying what is known and unknown, and proposing a path forward. Represent the voice of the user and ensure product decisions are grounded in real needs, not assumptions. Track and synthesize developments across the inference landscape: open source model releases, serving frameworks, competitive dynamics, and emerging use cases. What we need to see: 12+ years of experience with a track record of delivering complex technical products. Bachelors degree or higher, or equivalent experience Strong written and verbal communication, you are able to write clear, concise product documents, specs, and strategies. Ability to operate in ambiguous, fast paced environments and make progress without a full playbook. Analytical professional who can break down complex problems, identify the right questions, and drive toward decisions. Strong user empathy — able to synthesize qualitative and quantitative signals into a coherent picture of what users need and why. Deep familiarity with AI/ML systems and inference serving frameworks (such as TensorRT-LLM, vLLM, or Triton Inference Server), tradeoffs involved, and what matters to model publishers, application developers and cloud operators. Experience with inference APIs- design, versioning, performance, hardware efficiency, and developer experience. Familiarity with open source as well as commercial model ecosystems and the different considerations each brings to a serving platform. Ways to stand out from the crowd: Experience with sophisticated inference techniques: disaggregated prefill/decode, KV cache management, speculative decoding, or continuous batching. Background in large scale systems and developer platforms, cloud infrastructure, or MLOps tooling. Exposure to capacity planning, quota management, or resource scheduling in large-scale compute environments. #LI-Hybrid Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 208,000 USD - 327,750 USD for Level 5, and 240,000 USD - 379,500 USD for Level 6. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until October 2, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA. #J-18808-Ljbffr NVIDIA Corporation
- NVIDIA Corporation is seeking a Product Manager for Inference Platform to define and drive products enabling large-scale model serving across open source and proprietary models. This role sits at the intersection of AI research, infrastructure engineering, and real user...PlatformSenior
$208k - $327.75k
...building the foundation & blueprints for how AI workloads are served at scale for NVIDIA employees and DSX Partners. As a Product Manager for Inference Platform, you will help define and drive the products and platform capabilities that enable large-scale models serving...PlatformSeniorFull time$168k - $258.75k
Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our daily... ...algorithms, usecases, and deployment techniques. As a Senior Product Manager for AI Platform Inference you will be responsible for building the tools...PlatformSenior$208k - $327.75k
...NVIDIA is looking for a highly technical Product Manager to own the products that help customers... ...running on NVIDIA hardware. Every inference deployment — from a single-GPU workstation... ...what we adopt, and what we retire.Build platforms, not one-offs. Deliver capabilities...PlatformSeniorFull time$208k - $327.75k
...supply-chain provenance. NVIDIA is hiring a product manager to lead the accelerated runtime that... ..., and workloads, from training and inference to agentic AI. Keep the stack current and... ...infrastructure, Kubernetes, or developer and platform tooling. A bachelor's or master's...PlatformSenior$208k - $327.75k
...impact on the world.NVIDIA is seeking a Product Manager to drive product planning, roadmap... ...simulation capabilities with model training, inference, testing, and evaluation needs.Drive... ...rendering, sensor simulation, and developer platform priorities.Experience working with APIs...PlatformSeniorFull time- ...industry-leading training and inference speeds; over 10 times faster... ...AI inference. As the Product Manager for AI Models, you'll lead the... ...and ensure every model on our platform delivers exceptional quality... ...currently at or above the level of Senior PM.5+ years of total...PlatformSeniorWork experience placementWork at officeRemote workShift work
$168k - $258.75k
...AI - from frontier model training and inference to accelerated data analytics,... ...looking for a technical and hands-on Senior Product Manager who can turn the needs of developers,... ...Product Manager will make our Local AI platforms the best place to build and run modern...PlatformSeniorFull timeLocal area$165.12k - $414k
Senior Product Manager, Measurement (Experimentation) About the team TikTok's Measurement Product... ...and performance across our advertising platform by working with cross-functional teams... ...and methodology, from randomization to inference methods Define success metrics and...PlatformSeniorTemporary workLocal area- ...performance, low-power generative AI inference systems. Our mission,... ...the latest research and product improvements for generative... ...Director of Technical Product Management who is passionate and deeply... ...understanding of AI compute platforms, including: Cost-performance...PlatformSeniorRemote workFlexible hours
- ...scales. Qualifications: 10+ years of product management experience in semiconductors, embedded... ...knowledge of BMC/RMC or other data center platform management SW/firmware - platform... ...externally Nice to have edge AI/ML - inference on resource-constrained HW or AI focused...PlatformSenior
- NVIDIA is seeking a Senior Product Manager for AI Platform Inference to build tools, SDKs, and libraries that enable developers to deploy inference on NVIDIA GPUs. You will craft product strategy, roadmaps, and go-to-market plans while partnering with developers to shape...Platform
$175.5k - $311.7k
...have a way of becoming great products, services, and customer experiences... ...building out a multi-cloud platform that will power Apple's key... ...core platform services and managed services required for on-prem... ...platforms, tools and frameworks for inference, training, MLOps, agent...PlatformSeniorRelocation- Tensordyne is seeking a Sr. Director of Technical Product Management to lead AI inference compute initiatives spanning silicon to software. You will shape the product roadmap, engage with external partners, customers, and internal teams, and drive GTM alignment for multimodal...PlatformSenior
- Walmart Inc. in Sunnyvale, CA is seeking a Distinguished Product Manager to steer the vision and enterprise strategy for our associate-facing AI and agent platform. You will translate strategy into a road map that cross-functional teams can execute, shaping how conversational...PlatformSenior
$204k - $255k
A leading streaming platform in California is seeking a Senior Product Manager for Consumer Payments and Retention. You will own payment experiences and drive subscription retention. Ideal candidates will have over 5 years in product management and engage deeply with engineering...PlatformSenior- Intuitive Surgical, Inc. is seeking a Product Manager for the Future Forward team to define and champion new product concepts from exploration... ...ideas and build business cases for innovative procedures and platforms. You will drive market research, shape requirements, and plan...PlatformSenior
- Apptronik in Sunnyvale, CA seeks a Technical Product Manager - Simulation to bridge hardware and software as you drive the product vision... ...across the simulated robotics stack. You will own the simulation platforms roadmap, define use cases for perception, autonomy &...PlatformSenior
- A leading social media platform is seeking a Senior Product Manager to lead product development for the API Product Team in San Jose, CA. The role involves collaboration with engineering and design teams, understanding customer needs, and defining product success metrics...PlatformSenior
- A leading tech company in San Jose seeks a Product Manager to develop innovative advertising solutions through user-generated content. Responsibilities... ...in product roles, preferably in Brand Ads or Creator Platforms, and strong communication skills. Competitive compensation...PlatformSenior
- A leading social media platform is seeking a Product Manager for their User Growth team to develop and implement effective SEO strategies for the TikTok Web product. This role involves collaborating with external search engine teams, managing end-to-end product strategies...PlatformSenior
- Amazon Bedrock AgentCore is seeking a Principal Technical Product Manager to own one or more in-production products and drive revenue and adoption for Agentic AI services at scale. You will partner with AWS leadership to shape strategy and GTM, while delivering customer...PlatformSenior
- Expedia Group Advertising—Travel Supply Campaigns is seeking a Senior Product Manager to shape how supply campaigns are planned, configured,... ...scalable, advertiser-focused experiences and drive measurable outcomes in a complex multi-sided platform. #J-18808-Ljbffr ExpediaPlatformSenior
- TikTok Inc. in San Jose, CA is seeking an experienced product manager to define and execute end-to-end consumer tech product development strategies balancing user satisfaction, content quality, and platform integrity. You will analyze technologies to derive insights, build...PlatformSenior
- NVIDIA is seeking a Senior Product Manager to own Local AI offerings—from architecture to launch—driving cross-functional collaboration across compute, networking, storage, and security. You’ll translate workloads into capacity, latency, and power targets and work with...PlatformSeniorLocal area
- Palo Alto Networks is seeking a Senior Product Manager for Web Proxy & Secure Web Gateway to lead strategy, roadmap, and customer adoption for enterprise proxy capabilities across NGFW platforms. You will align PAN-OS, Panorama, and Strata Cloud Manager with customer requirements...PlatformSenior
- Everpure seeks a Senior Product Manager for FlashArray Foundation to own the Purity//FA OS roadmap, bridging software and hardware co-design. You’ll own controller enablement, flash media integration, high availability, and non-disruptive upgrades, partnering with Engineering...PlatformSeniorWork at office
- NVIDIA in Santa Clara seeks a Senior Product Manager to own the Local AI offerings—from architecture through launch and scale. You will translate... ...work across Windows and Linux workflows to optimize NVIDIA platforms. Partner with OEMs and customers to capture requirements,...PlatformSeniorLocal area
- TikTok Inc. in Los Angeles County seeks an experienced Product Manager for the TikTok Business Center Product team to build and innovate features that help organizations manage multiple ad accounts, assets, and finances securely. You will collaborate with engineering, design...PlatformSenior
- TikTok Inc. is seeking a lead for an overseas POI data production platform within Local Services, responsible for end-to-end lifecycle from collection to quality evaluation and international expansion. You will collaborate with engineering and product teams to optimize...PlatformSeniorLocal areaOverseas
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Product Manager, Inference Platform. Be the first to apply!
- sr technical product manager Santa Clara, CA
- director product management Santa Clara, CA
- remote associate product manager Santa Clara, CA
- ux product manager Santa Clara, CA
- director global product management Santa Clara, CA
- product line manager Santa Clara, CA
- product manager remote Santa Clara, CA
- product launch manager Santa Clara, CA
- senior director product management Santa Clara, CA
- product security manager Santa Clara, CA


