Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Product Manager, Inference Platform

$208k - $327.75k

NVIDIA Corporation

At NVIDIA, we are building the foundation & blueprints for how AI workloads are served at scale for NVIDIA employees and DSX Partners. As a Product Manager for Inference Platform, you will help define and drive the products and platform capabilities that enable large-scale models serving across a broad portfolio of models, both open source and proprietary. You will work at the intersection of AI research, infrastructure engineering, and real user needs, shaping how inference is delivered reliably, efficiently, and at scale. This is high-impact role. You will be expected to bring structure to undefined problem spaces, make progress without complete information, and build conviction through deep engagement with users, engineers, and the broader ecosystem of AI Cloud partners. The right candidate is equally comfortable discussing model serving architecture, token economics and writing a clear product brief. What you will be doing: Define product vision and strategy for inference platform capabilities — including APIs, capacity management, cost management, performance and optimization, and model serving infrastructure. Translate user needs and infrastructure constraints into clear requirements and prioritized roadmaps. Partner closely with engineering, research, and user groups teams to drive execution from concept through launch. Be responsible for end-to-end product lifecycle for inference-related products and platform investments. Develop deep understanding of the inference ecosystem — model formats, serving frameworks, API formats, and the tradeoffs that matter at scale. Drive clarity in ambiguous situations by framing the problem, identifying what is known and unknown, and proposing a path forward. Represent the voice of the user and ensure product decisions are grounded in real needs, not assumptions. Track and synthesize developments across the inference landscape: open source model releases, serving frameworks, competitive dynamics, and emerging use cases. What we need to see: 12+ years of experience with a track record of delivering complex technical products. Bachelors degree or higher, or equivalent experience Strong written and verbal communication, you are able to write clear, concise product documents, specs, and strategies. Ability to operate in ambiguous, fast paced environments and make progress without a full playbook. Analytical professional who can break down complex problems, identify the right questions, and drive toward decisions. Strong user empathy — able to synthesize qualitative and quantitative signals into a coherent picture of what users need and why. Deep familiarity with AI/ML systems and inference serving frameworks (such as TensorRT-LLM, vLLM, or Triton Inference Server), tradeoffs involved, and what matters to model publishers, application developers and cloud operators. Experience with inference APIs- design, versioning, performance, hardware efficiency, and developer experience. Familiarity with open source as well as commercial model ecosystems and the different considerations each brings to a serving platform. Ways to stand out from the crowd: Experience with sophisticated inference techniques: disaggregated prefill/decode, KV cache management, speculative decoding, or continuous batching. Background in large scale systems and developer platforms, cloud infrastructure, or MLOps tooling. Exposure to capacity planning, quota management, or resource scheduling in large-scale compute environments. #LI-Hybrid Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 208,000 USD - 327,750 USD for Level 5, and 240,000 USD - 379,500 USD for Level 6. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until October 2, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA. #J-18808-Ljbffr NVIDIA Corporation

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Product Manager, Inference Platform in Santa Clara, CA vacancy
  • NVIDIA Corporation is seeking a Product Manager for Inference Platform to define and drive products enabling large-scale model serving across open source and proprietary models. This role sits at the intersection of AI research, infrastructure engineering, and real user... 
    Platform
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $208k - $327.75k

     ...building the foundation & blueprints for how AI workloads are served at scale for NVIDIA employees and DSX Partners. As a Product Manager for Inference Platform, you will help define and drive the products and platform capabilities that enable large-scale models serving... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $168k - $258.75k

    Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our daily...  ...algorithms, usecases, and deployment techniques. As a Senior Product Manager for AI Platform Inference you will be responsible for building the tools... 
    Platform
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $208k - $327.75k

     ...NVIDIA is looking for a highly technical Product Manager to own the products that help customers...  ...running on NVIDIA hardware. Every inference deployment — from a single-GPU workstation...  ...what we adopt, and what we retire.Build platforms, not one-offs. Deliver capabilities... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $208k - $327.75k

     ...supply-chain provenance. NVIDIA is hiring a product manager to lead the accelerated runtime that...  ..., and workloads, from training and inference to agentic AI. Keep the stack current and...  ...infrastructure, Kubernetes, or developer and platform tooling. A bachelor's or master's... 
    Platform
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $208k - $327.75k

     ...impact on the world.NVIDIA is seeking a Product Manager to drive product planning, roadmap...  ...simulation capabilities with model training, inference, testing, and evaluation needs.Drive...  ...rendering, sensor simulation, and developer platform priorities.Experience working with APIs... 
    Platform
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...industry-leading training and inference speeds; over 10 times faster...  ...AI inference. As the Product Manager for AI Models, you'll lead the...  ...and ensure every model on our platform delivers exceptional quality...  ...currently at or above the level of Senior PM.5+ years of total... 
    Platform
    Senior
    Work experience placement
    Work at office
    Remote work
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $168k - $258.75k

     ...AI - from frontier model training and inference to accelerated data analytics,...  ...looking for a technical and hands-on Senior Product Manager who can turn the needs of developers,...  ...Product Manager will make our Local AI platforms the best place to build and run modern... 
    Platform
    Senior
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    11 days ago
  • $165.12k - $414k

    Senior Product Manager, Measurement (Experimentation) About the team TikTok's Measurement Product...  ...and performance across our advertising platform by working with cross-functional teams...  ...and methodology, from randomization to inference methods Define success metrics and... 
    Platform
    Senior
    Temporary work
    Local area

    TikTok Inc.

    San Jose, CA
    1 day ago
  •  ...performance, low-power generative AI inference systems. Our mission,...  ...the latest research and product improvements for generative...  ...Director of Technical Product Management who is passionate and deeply...  ...understanding of AI compute platforms, including: Cost-performance... 
    Platform
    Senior
    Remote work
    Flexible hours

    Tensordyne

    Sunnyvale, CA
    1 day ago
  •  ...scales. Qualifications: 10+ years of product management experience in semiconductors, embedded...  ...knowledge of BMC/RMC or other data center platform management SW/firmware - platform...  ...externally Nice to have edge AI/ML - inference on resource-constrained HW or AI focused... 
    Platform
    Senior

    Everforth CyberCoders

    San Jose, CA
    1 day ago
  • NVIDIA is seeking a Senior Product Manager for AI Platform Inference to build tools, SDKs, and libraries that enable developers to deploy inference on NVIDIA GPUs. You will craft product strategy, roadmaps, and go-to-market plans while partnering with developers to shape... 
    Platform

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $175.5k - $311.7k

     ...have a way of becoming great products, services, and customer experiences...  ...building out a multi-cloud platform that will power Apple's key...  ...core platform services and managed services required for on-prem...  ...platforms, tools and frameworks for inference, training, MLOps, agent... 
    Platform
    Senior
    Relocation

    Apple

    Cupertino, CA
    2 days ago
  • Tensordyne is seeking a Sr. Director of Technical Product Management to lead AI inference compute initiatives spanning silicon to software. You will shape the product roadmap, engage with external partners, customers, and internal teams, and drive GTM alignment for multimodal... 
    Platform
    Senior

    Tensordyne

    Sunnyvale, CA
    1 day ago
  • Walmart Inc. in Sunnyvale, CA is seeking a Distinguished Product Manager to steer the vision and enterprise strategy for our associate-facing AI and agent platform. You will translate strategy into a road map that cross-functional teams can execute, shaping how conversational... 
    Platform
    Senior

    Walmart

    Sunnyvale, CA
    1 day ago
  • $204k - $255k

    A leading streaming platform in California is seeking a Senior Product Manager for Consumer Payments and Retention. You will own payment experiences and drive subscription retention. Ideal candidates will have over 5 years in product management and engage deeply with engineering... 
    Platform
    Senior

    Roku, Inc.

    San Jose, CA
    1 day ago
  • Intuitive Surgical, Inc. is seeking a Product Manager for the Future Forward team to define and champion new product concepts from exploration...  ...ideas and build business cases for innovative procedures and platforms. You will drive market research, shape requirements, and plan... 
    Platform
    Senior

    Intuitive Surgical, Inc.

    Sunnyvale, CA
    1 day ago
  • Apptronik in Sunnyvale, CA seeks a Technical Product Manager - Simulation to bridge hardware and software as you drive the product vision...  ...across the simulated robotics stack. You will own the simulation platforms roadmap, define use cases for perception, autonomy &... 
    Platform
    Senior

    Apptronik

    Sunnyvale, CA
    1 day ago
  • A leading social media platform is seeking a Senior Product Manager to lead product development for the API Product Team in San Jose, CA. The role involves collaboration with engineering and design teams, understanding customer needs, and defining product success metrics... 
    Platform
    Senior

    TikTok Inc.

    San Jose, CA
    1 day ago
  • A leading tech company in San Jose seeks a Product Manager to develop innovative advertising solutions through user-generated content. Responsibilities...  ...in product roles, preferably in Brand Ads or Creator Platforms, and strong communication skills. Competitive compensation... 
    Platform
    Senior

    TikTok Inc.

    San Jose, CA
    1 day ago
  • A leading social media platform is seeking a Product Manager for their User Growth team to develop and implement effective SEO strategies for the TikTok Web product. This role involves collaborating with external search engine teams, managing end-to-end product strategies... 
    Platform
    Senior

    TikTok Inc.

    San Jose, CA
    1 day ago
  • Amazon Bedrock AgentCore is seeking a Principal Technical Product Manager to own one or more in-production products and drive revenue and adoption for Agentic AI services at scale. You will partner with AWS leadership to shape strategy and GTM, while delivering customer... 
    Platform
    Senior

    Amazon Inc.

    Santa Clara, CA
    1 day ago
  • Expedia Group Advertising—Travel Supply Campaigns is seeking a Senior Product Manager to shape how supply campaigns are planned, configured,...  ...scalable, advertiser-focused experiences and drive measurable outcomes in a complex multi-sided platform. #J-18808-Ljbffr Expedia
    Platform
    Senior

    Expedia

    San Jose, CA
    1 day ago
  • TikTok Inc. in San Jose, CA is seeking an experienced product manager to define and execute end-to-end consumer tech product development strategies balancing user satisfaction, content quality, and platform integrity. You will analyze technologies to derive insights, build... 
    Platform
    Senior

    TikTok Inc.

    San Jose, CA
    1 day ago
  • NVIDIA is seeking a Senior Product Manager to own Local AI offerings—from architecture to launch—driving cross-functional collaboration across compute, networking, storage, and security. You’ll translate workloads into capacity, latency, and power targets and work with... 
    Platform
    Senior
    Local area

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • Palo Alto Networks is seeking a Senior Product Manager for Web Proxy & Secure Web Gateway to lead strategy, roadmap, and customer adoption for enterprise proxy capabilities across NGFW platforms. You will align PAN-OS, Panorama, and Strata Cloud Manager with customer requirements... 
    Platform
    Senior

    Palo Alto Networks, Inc.

    Santa Clara, CA
    1 day ago
  • Everpure seeks a Senior Product Manager for FlashArray Foundation to own the Purity//FA OS roadmap, bridging software and hardware co-design. You’ll own controller enablement, flash media integration, high availability, and non-disruptive upgrades, partnering with Engineering... 
    Platform
    Senior
    Work at office

    Everpure

    Santa Clara, CA
    1 day ago
  • NVIDIA in Santa Clara seeks a Senior Product Manager to own the Local AI offerings—from architecture through launch and scale. You will translate...  ...work across Windows and Linux workflows to optimize NVIDIA platforms. Partner with OEMs and customers to capture requirements,... 
    Platform
    Senior
    Local area

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • TikTok Inc. in Los Angeles County seeks an experienced Product Manager for the TikTok Business Center Product team to build and innovate features that help organizations manage multiple ad accounts, assets, and finances securely. You will collaborate with engineering, design... 
    Platform
    Senior

    TikTok Inc.

    San Jose, CA
    1 day ago
  • TikTok Inc. is seeking a lead for an overseas POI data production platform within Local Services, responsible for end-to-end lifecycle from collection to quality evaluation and international expansion. You will collaborate with engineering and product teams to optimize... 
    Platform
    Senior
    Local area
    Overseas

    TikTok Inc.

    San Jose, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Product Manager, Inference Platform. Be the first to apply!