Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Manager - AI Inference

Virtual Vocations Inc

Owning the product strategy and lifecycle for AI inference and model serving, the full-time Product Manager - AI Inference will lead technical discovery and collaborate with engineering teams to optimize performance across GPU, network, and storage infrastructures in a remote environment. Key responsibilities Own product strategy, roadmap, and lifecycle for inference and model serving, including serverless inference and autoscaling Lead technical discovery with NeoClouds and enterprise teams, translating findings into prioritized requirements Drive go-to-market execution, including pricing, packaging, and direct engagement with customers and partners Required qualifications 7+ years in product management or a senior technical role focused on AI/ML and inference products Strong understanding of production AI inference, including model serving and observability Proven ability to evaluate performance trade-offs across GPU, network, and storage layers Working knowledge of modern inference runtimes and optimization patterns in production Credibility with engineering leaders and comfort in technical discussions with platform engineering buyers

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Product Manager - AI Inference in United States vacancy
  • $147.05k - $230.85k

     ...Senior Product Manager - Edge AI, Computer Vision & Multimodal Inference Description - About Us Innovation is in HP's DNA. From our origins in a Palo Alto garage in 1939, to our current position as one of the world's leading technology companies, HP has grown... 
    Suggested
    Full time
    Temporary work
    Local area
    Relocation
    Flexible hours
    Shift work

    HP Development Company, L.P.

    Fort Collins, CO
    3 days ago
  •  ...Job Description Job Summary Mirantis is looking for a commercially driven, deeply technical Product Manager to own AI inference and model serving for k0rdent AI, our control plane for GPU infrastructure and distributed AI workloads. This role sits at the intersection... 
    Suggested
    Remote work

    Mirantis

    Austin, TX
    1 day ago
  •  ...Mirantis, Inc. is seeking a full-time Product Manager - AI Inference to own the product strategy and lifecycle for AI inference and model serving. This role involves leading technical discovery and collaborating with engineering teams to optimize performance across GPU... 
    Suggested
    Full time
    Remote work

    Mirantis

    New York, NY
    12 hours ago
  •  ...Mirantis in Austin, Texas, is hiring a Product Manager to drive AI inference and model serving for k0rdent AI. The role requires a blend of technical expertise and commercial acumen to optimize performance in cloud-native infrastructure. Ideal candidates will have 7+ years... 
    Suggested

    Mirantis

    Austin, TX
    1 hour ago
  •  ...Systems builds the world's largest AI chip, 56 times larger than...  ...industry-leading training and inference speeds and empowers machine...  ...applications, without the hassle of managing hundreds of GPUs or TPUs....  ...attention. As Senior Product Marketing Manager, you'll own... 
    Suggested
    Shift work
    Night shift

    CEREBRAS SYSTEMS INC.

    Sunnyvale, CA
    4 days ago
  • $148k - $235.75k

     ...We are looking for a Senior Technical Product Marketing Manager. This role will be located in our rapidly...  ...center business and pivotal in our inference marketing. You will be focused on working...  ...showcase our leadership position in AI inference. Want to join a fun,... 

    NVIDIA

    Santa Clara, CA
    3 days ago
  •  ...leading sustainable technology company in San Francisco is seeking a seasoned Product Manager for their AI Services team. You will manage the complete product lifecycle for our Managed Inference offerings and work on launching scalable AI services. The ideal candidate... 

    Crusoe Energy Systems LLC

    San Francisco, CA
    1 day ago
  • Senior Technical Product Marketing Manager This role will be located in our rapidly growing data center business and will be pivotal in our inference marketing. You will work closely with engineering...  ...showcase our leadership position in AI inference. What You’ll Be Doing... 

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  •  ...AI Product Owner – Enterprise AI Center of Excellence Mexico 3M Health Care is now Solventum...  ..., and user workflows. Prioritize and manage the product backlog to maximize business...  ...(e.g., model lifecycle, training vs. inference, data dependencies, performance metrics)... 
    Remote work

    Solventum

    United States
    1 day ago
  •  ...Product Manager, Data Science Platform (AI/ML) Chicago, IL Why Project44? At project44, we believe in better. We challenge the status quo because...  .... Partner with engineering on batch + real-time inference architectures, streaming/event-time feature needs, and... 
    Work at office

    project44

    Chicago, IL
    4 days ago
  •  ...Role Anyscale is seeking a Senior/Staff Product Manager to lead Ray Data, our scalable data processing library for ML and AI workloads. This is a uniquely challenging...  ...data processing. It enables offline batch inference and data preprocessing for ML training, scaling... 
    Relocation
    Flexible hours

    Anyscale

    Palo Alto, CA
    5 days ago
  • $104.15k - $170k

     ...of a partner company. We are currently looking for a Senior Product Manager - AI Platform in United States. This role is responsible for...  ...Strong technical fluency in AI/ML concepts, including LLMs, inference systems, embeddings, and model lifecycle management. ~... 
    Remote job
    Full time
    Flexible hours

    jobgether

    United States
    4 days ago
  • Join to apply for the Mid-Level IT Product Owner role at Jobright.ai 1 day ago Be among the first 25 applicants...  ...of product engineering and product management process using agile methodology. •...  ...interviewing at Jobright.ai by 2x Inferred from the description for this job Medical... 
    Full time
    Temporary work
    Internship
    H1b
    Remote work

    Jobright.ai

    Durham, NC
    2 days ago
  • Join to apply for the Mid-Level IT Product Owner role at Jobright.ai 2 days ago Be among the first 25 applicants...  ...the value of the product by managing the backlog, collaborating with stakeholders...  ...interviewing at Jobright.ai by 2x Inferred from the description for this job... 
    Full time
    Night shift

    Jobright.ai

    Austin, TX
    2 days ago
  • $169.8k - $233.5k

     ...Uniphore is one of the largest B2B AI-native companies-decades-proven, built-for-scale...  ...Job Description: Job Title: Senior Product Manager - Data and AI agents Location: Palo...  ...for model training and real-time inference. ~ Define user journey and create User... 
    Full time
    2 days per week

    Uniphore

    Palo Alto, CA
    1 day ago
  • $172.6k - $237.33k

     ...running the world's best data and AI infrastructure platform so our...  ...at scale on Databricks. Our products span the full ML lifecycle -...  ...recommendation systems, real-time inference, large-scale distributed...  ...years of experience as a Product Manager working on platform or... 
    Worldwide

    Databricks

    Seattle, WA
    1 day ago
  • $140k - $200k

     ...Staff Product Manager, AI PlatformThe Opportunity: Define the Future of Agentic AI in the Enterprise Invoca is the leading AI-native platform...  ...real-time systems such as voice, streaming, or low-latency inference. Background in enterprise SaaS or compliance-heavy domains.... 
    Contract work
    Remote work
    Flexible hours

    Invoca

    Santa Barbara, CA
    4 days ago
  • $205.5k - $278k

     ...Overview We are seeking a Sr. Staff Product Manager to lead the strategy and roadmap for our data and AI capabilities within the Consumer Group (CG). In this role...  ...and roadmap for the recommendations and model inference platform, ensuring it delivers the right... 
    Local area

    Intuit

    Mountain View, CA
    1 day ago
  • $165k - $200k

     ...Senior AI Product Manager El Segundo HiveWatch is a tech-forward, inclusive organization fostering the evolution of the physical security...  ...and performance trade-offs ~ model deployment and inference optimization, particularly understanding how to balance compute... 

    HiveWatch

    El Segundo, CA
    4 days ago
  • $160k - $275k

     ...Who We Are Lightning AI is the company behind PyTorch Lightning...  ...take ideas from research to production with less friction....  ...experimentation, training, and production inference, with security, observability...  ...for a Founding Product Manager for Inference who will own... 
    Work at office
    Work from home
    Flexible hours
    2 days per week

    Lightning AI

    New York, NY
    1 hour ago
  • $185k - $235k

     ...Senior Product Manager — Agentic AI Experiences Remote - USA About Wizard Wizard is the top-performing AI Shopping Agent, delivering...  ...and product requirements. Partner with engineering on inference pipelines, agent planning, retrieval, and orchestration logic... 
    Remote work
    Flexible hours

    Wizard

    United States
    1 day ago
  • $225k - $300k

     ...Description The Role The AI Product Manager is a pivotal connector between business strategy and intelligent product delivery-translating...  ...outputs; understanding ML pipelines (training, validation, inference); working with model evaluation concepts such as precision/... 
    Temporary work
    Local area
    Visa sponsorship
    Work visa
    Flexible hours

    WTW inc.

    Denver, CO
    3 days ago
  • $162k - $182k

     ...Sr. Product Manager, AI Liquid Cooling & Rack-Scale Solutions Date: May 26, 2026 Location: San Jose, California, United States Company...  ...ensuring 99.99% uptime for mission-critical AI training and inference workloads. Qualifications: BS/MS in Mechanical,... 
    Worldwide

    Super Micro Computer

    San Jose, CA
    12 hours ago
  •  ...Systems builds the world's largest AI chip, 56 times larger than...  ...industry-leading training and inference speeds and empowers machine...  ...applications, without the hassle of managing hundreds of GPUs or TPUs....  ...fastest AI inference. As the Product Manager for AI Models, you'll... 
    Work experience placement
    Work at office
    Remote work
    Shift work

    CEREBRAS SYSTEMS INC.

    Sunnyvale, CA
    12 hours ago
  •  ...Core Product Manager Baseten powers mission-critical inference for the world's most dynamic AI companies. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge... 
    Remote work
    Flexible hours

    Baseten

    United States
    12 hours ago
  • $148.7k - $240.53k

     ...Product Management Or Pdm To stay ahead of the curve, it's critical to know where the curve is...  ...strategy of security products for Edge AI. This individual will be responsible for...  ...~ Direct experience with real-time inference at the edge ~ Direct experience with... 

    Palo Alto Networks

    Hawthorne, CA
    1 day ago
  • $168k - $258.75k

     ...Product Manager For Ai Platform Recommender Systems At NVIDIA we meet customers where they are on their AI journey on our GPUs - this means...  ...you'll be doing: Create and optimize pre-training/inference and post-training frameworks for RecSys and Generative Recommender... 

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $200k - $260k

     ...Function Product Our Company We're Hitachi Vantara, the data foundation trusted...  ...description Job Title: Senior Product Manager - AI Platforms (Hitachi iQ & iQ Studio)...  ...of: o AI/ML workflows (training, inference, RAG concepts, Agentic AI) o Data architectures... 
    Remote work
    Flexible hours

    Hitachi Data Systems

    Grizzly Flats, CA
    4 days ago
  •  ...About the job The goal of a Product Manager is to bridge the gap between technical capabilities...  ...enterprises to build, train, and deploy AI/ML models at scale while supporting the...  ...involving model training, fine‑tuning, inference optimization, and quantization workflows... 
    Remote work

    Framework Ventures

    United States
    4 days ago
  •  ...Artificial Intelligence (AI) Product Manager Central Operations - Rancho Mirage, CA Overview Position Type Full Time - Exempt Category...  ...Understanding of ML pipelines for training, validation, and inference. Knowledge of model evaluation concepts such as precision... 
    Full time
    Work at office
    Shift work
    Weekend work

    Agua Caliente Inc

    Rancho Mirage, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Manager - AI Inference. Be the first to apply!