Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Manager - Dedicated Inference

Baseten

Core Product Manager

Baseten powers mission-critical inference for the world's most dynamic AI companies. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. Join us and help build the platform engineers turn to to ship AI products.

As a Core Product Manager at Baseten, you'll shape the core developer experience that powers how users build, deploy, and manage AI applications on our platform. You'll drive the roadmap for user-facing APIs, SDKs, UI workflows, and integration surfaces, turning complex ML infrastructure into a seamless, intuitive product. Your work will directly impact how teams interact with Baseten day-to-day, ensuring that our platform is both powerful and a joy to use.

Example initiatives include:

  • Chains for multi-component workflows
  • Asynchronous inference
  • Model APIs for frontier models
  • Model training built for production inference

Responsibilities include:

  • Owning the roadmap for Baseten's core product surface, including APIs, UI, and developer workflows
  • Partnering with design and engineering to deliver elegant, intuitive developer experiences
  • Collaborating with customers to deeply understand pain points and define solutions that simplify AI deployment
  • Driving new product launches and improving onboarding, observability, and management experiences
  • Aligning product initiatives with company strategy and ensuring measurable product adoption and retention

Requirements include:

  • 4+ years of Product Management experience in developer tools, SaaS, or ML platforms
  • Engineering background (e.g., degree in Computer Science, Electrical Engineering, or related field; or equivalent hands-on experience as a software engineer)
  • Deep empathy for developers and an ability to translate technical complexity into simple, usable products
  • Experience driving cross-functional alignment across design, engineering, and GTM teams
  • Proven ability to define product success metrics and iterate based on data and feedback

Nice to have includes:

  • Familiarity with AI/ML workflows and inference products
  • Experience building products for technical users (e.g., APIs, SDKs, dashboards)
  • Background in developer experience or product-led growth

Benefits include:

  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law.

Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Product Manager - Dedicated Inference in United States vacancy
  •  ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI...  ...of AI to bring cutting-edge models into production. We're growing quickly and recently raised...  ...products. THE ROLE As a Core Product Manager at Baseten, you'll shape the core... 
    Suggested
    Flexible hours

    BaseTen

    New York, NY
    2 days ago
  • $160k - $275k

     ...take ideas from research to production with less friction. Through...  ..., training, and production inference, with security,...  ...looking for a Founding Product Manager for Inference who will own...  ...protected characteristic. We are dedicated to building a culture where... 
    Suggested
    Work at office
    Work from home
    Flexible hours
    2 days per week

    Lightning AI

    New York, NY
    5 hours ago
  •  ...is looking for a commercially driven, deeply technical Product Manager to own AI inference and model serving for k0rdent AI, our control plane for...  ...environments. The scope includes serverless inference, dedicated endpoints, workload placement, autoscaling, routing, lifecycle... 
    Suggested
    Remote work

    Mirantis

    Austin, TX
    1 day ago
  • $163k - $296.4k

     ...Overview We are seeking a Principal Product Manager/Architect to define and guide the technical architecture of Microsoft Foundry as the...  ...Own the product direction for Microsoft Foundry inference, with a primary mandate to make the platform the most reliable... 
    Suggested
    Ongoing contract
    Local area

    Microsoft Corporation

    Redmond, WA
    3 days ago
  • $147.05k - $230.85k

     ...Senior Product Manager – Edge AI, Computer Vision & Multimodal Inference Innovation is in HP's DNA. From our origins in a Palo Alto garage in 1939, to our current position as one of the world's leading technology companies, HP has grown to become a leader in technology... 
    Suggested
    Temporary work
    Local area
    Flexible hours

    HP

    Fort Collins, CO
    3 days ago
  •  ...Owning the product strategy and lifecycle for AI inference and model serving, the full-time Product Manager - AI Inference will lead technical discovery and collaborate with engineering teams to optimize performance across GPU, network, and storage infrastructures in... 
    Full time
    Remote work

    Virtual Vocations Inc

    United States
    1 day ago
  • $148k - $235.75k

     ...We are looking for a Senior Technical Product Marketing Manager. This role will be located in our rapidly growing data center business and pivotal in our inference marketing. You will be focused on working with engineering to understand the technical capabilities of our... 

    NVIDIA

    Santa Clara, CA
    3 days ago
  • Product Marketing Manager, Owner & Public Sector, Mid-Level Join to apply for the Product Marketing...  ...Trimble Inc. is a technology company dedicated to delivering innovative solutions for...  ...of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical... 
    Full time
    Work experience placement
    H1b
    Local area

    Jobright.ai

    Westminster, CO
    3 days ago
  •  ...Mirantis, Inc. is seeking a full-time Product Manager - AI Inference to own the product strategy and lifecycle for AI inference and model serving. This role involves leading technical discovery and collaborating with engineering teams to optimize performance across GPU... 
    Full time
    Remote work

    Mirantis

    New York, NY
    16 hours ago
  • $156k - $234k

     ...in AI and multi-cloud data management at scale. Our cutting-edge data...  ...bring their expertise and dedication to every project. This is a...  ...looking for a Sr. Technical Product Manager, AI Data Platforms who...  ...database partners, LLM and inference platform vendors, and enterprise... 
    Local area
    Shift work

    DataDirect Networks Inc

    San Francisco, CA
    1 day ago
  • Senior Technical Product Marketing Manager This role will be located in our rapidly growing data center business and will be pivotal in our inference marketing. You will work closely with engineering to understand the technical capabilities of our inference stack—including... 

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  •  .... Now we’re hiring our first dedicated Staff PM to own it all – pricing...  ...should look like in a product-led, AI-native world. You’ll...  ...price capabilities with variable inference cost underneath. You internalize...  ...Work Option: Work with your manager to choose between working 5... 
    Full time
    Immediate start
    Remote work

    Close

    United States
    2 days ago
  • $204k - $247k

     ...Crusoe Cloud is seeking a visionary Staff Product Manager to spearhead the development of our...  ...ingestion and fine-tuning to high-performance inference and agentic workflows. Trend...  ...AI/ML Product Leadership: 5+ years of dedicated experience in AI/ML product management,... 
    Full time
    Temporary work

    Crusoe

    Sunnyvale, CA
    1 day ago
  •  ...to deliver industry-leading training and inference speeds and empowers machine learning...  ...ML applications, without the hassle of managing hundreds of GPUs or TPUs. Cerebras...  ...are paying attention. As Senior Product Marketing Manager, you'll own realtime product... 
    Shift work
    Night shift

    CEREBRAS SYSTEMS INC.

    Sunnyvale, CA
    4 days ago
  •  ...Mirantis in Austin, Texas, is hiring a Product Manager to drive AI inference and model serving for k0rdent AI. The role requires a blend of technical expertise and commercial acumen to optimize performance in cloud-native infrastructure. Ideal candidates will have 7+ years... 

    Mirantis

    Austin, TX
    6 hours ago
  • Sr Technical Product Manager, AI & Data Platforms (AiDP) Austin, Texas, United States Corporate...  ...very quickly. Bring passion and dedication to your job and there's no telling what...  ...and land the next-generation of GenAI inferences for Apple Enterprise Teams. Own the product... 

    Apple Inc.

    Austin, TX
    2 days ago
  • $300 per month

     ..., transformative cloud infrastructure. About the Role: As a core member of the Crusoe Managed AI Services team, you will own the complete product lifecycle for our Managed Inference offerings, from initial concept and strategic roadmap to successful execution and market... 
    Temporary work

    Crusoe Energy Systems LLC

    San Francisco, CA
    1 day ago
  •  ...Market Product Manager (remote), Mid-Level Join to apply for the Market Product Manager (remote...  ...leader in measurement instrumentation, dedicated to shaping the future of process...  ...chances of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical... 
    Full time
    H1b
    Remote work

    jobright.com

    Denver, CO
    4 days ago
  • $150k - $350k

     ...Senior Product Manager About the Institute of Foundation Models We are a dedicated research lab for building, understanding, using, and risk-managing foundation models...  ...the stack. You can discuss context windows, inference latency, and specific benchmarks with... 
    Flexible hours

    Institute of Foundation Models

    Sunnyvale, CA
    4 days ago
  • $200k - $250k

     ...is targeted to run neural network (NN) inference workloads in a wide variety of edge and...  ...Quadric is seeking a Senior Principal Product Manager, Hardware to own the Chimera GPNPU IP...  ...contested architecture decisions (e.g., dedicated requant unit vs. wider MAC array), run... 
    Work at office
    Worldwide
    Relocation
    Flexible hours

    quadric.io, Inc

    Burlingame, CA
    5 days ago
  • $150k - $190k

     ...startup looking for their first product hire. Well-funded, steady...  ...remainder of the role will be dedicated to internal product initiatives...  ...experience, hands-on software product management, etc) Familiarity with LLMs, fine-tuning, model inference, agents, etc. 3 to 5+ years of... 
    Local area

    Jobot

    San Francisco, CA
    4 days ago
  • $206.9k - $279.9k

     ...is looking for an experienced Technical Product Manager to define and drive product strategy...  .... Inferentia delivers best-in-class ML inference performance at the lowest cost in the cloud...  ...About the team Our team is dedicated to supporting new members. We have a broad... 
    Flexible hours

    Amazon

    Seattle, WA
    5 days ago
  • $250.97k - $274k

    ## Staff mNAND Product Line ManagerSan Jose, California, United States...  ...Business Unit (AEBU) as a managed NAND (mNAND) product line...  ...semiconductor industry, Micron is dedicated to your personal wellbeing...  ...how closely your stated and inferred skills match the requirements... 
    16 hours
    Full time
    Work experience placement
    Local area
    Immediate start

    Micron Memory Malaysia Sdn Bhd

    Boise, ID
    16 hours ago
  •  ...outdoor and action camera technology, dedicated to providing high-quality products that enhance the outdoor...  ...Product Owner, technical partner manager, and integration architect. The...  ..., including APIs, data pipelines, inference workflows, and performance trade-offs... 

    Tactacam

    Billings, MT
    4 days ago
  •  ...Product Owner II The Product Owner II will be responsible for...  ...roadmap. Works with Product Managers, Business Leaders, and a cross...  ...logic and intuition to make inferences about the meaning of data and...  ..., productivity, and service. Dedicates required time and energy to assignments... 
    Work experience placement

    PamTen

    Atlanta, GA
    16 hours ago
  • $100k - $200k

     ...patients more efficient and productive. We are looking for an experienced technical product manager to design and deliver high-value...  ...in MLR Review Cycles", "Inference Accuracy", and "Automated Reference...  ...days a week, you will have a dedicated office workspace. Our offices... 
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours
    3 days per week

    Veeva Systems

    Boston, MA
    3 days ago
  •  ...Technical Product Owner, Mid Level (Remote) Join to apply for the...  ...Responsibilities: • Product Roadmap Management: Own, prioritize, and...  ...healthcare cost containment company dedicated to achieving superior results...  ...at Jobright.ai by 2x Inferred from the description for this... 
    Full time
    Remote work

    jobright.com

    New York, NY
    2 days ago
  •  ...Product Manager Shape the strategy. Guide the story. Drive the outcome. At UDig, strategy...  ...beyond the explicit client requests to infer underlying needs by understanding...  ...UDig is a technology consulting firm dedicated to delivering high-impact solutions that... 

    UDig

    Richmond, VA
    16 hours ago
  •  ...Product Manager San Mateo, CA Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed...  ...refining and expanding Parasail's core offerings – dedicated nodes, serverless inference, and dedicated serverless – based on deep customer... 

    Parasail

    San Mateo, CA
    3 days ago
  •  ...Product Manager For Open Models Ready to drive transformation in AI models? At NVIDIA, our...  .... Join our team known for their dedication to collaboration and outstanding performance...  ...-class support for open models across inference, fine-tuning, and evaluation.... 
    Work experience placement

    NVIDIA

    Encino, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Manager - Dedicated Inference. Be the first to apply!