Product Manager - Dedicated Inference
Baseten
Core Product Manager
Baseten powers mission-critical inference for the world's most dynamic AI companies. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. Join us and help build the platform engineers turn to to ship AI products.
As a Core Product Manager at Baseten, you'll shape the core developer experience that powers how users build, deploy, and manage AI applications on our platform. You'll drive the roadmap for user-facing APIs, SDKs, UI workflows, and integration surfaces, turning complex ML infrastructure into a seamless, intuitive product. Your work will directly impact how teams interact with Baseten day-to-day, ensuring that our platform is both powerful and a joy to use.
Example initiatives include:
- Chains for multi-component workflows
- Asynchronous inference
- Model APIs for frontier models
- Model training built for production inference
Responsibilities include:
- Owning the roadmap for Baseten's core product surface, including APIs, UI, and developer workflows
- Partnering with design and engineering to deliver elegant, intuitive developer experiences
- Collaborating with customers to deeply understand pain points and define solutions that simplify AI deployment
- Driving new product launches and improving onboarding, observability, and management experiences
- Aligning product initiatives with company strategy and ensuring measurable product adoption and retention
Requirements include:
- 4+ years of Product Management experience in developer tools, SaaS, or ML platforms
- Engineering background (e.g., degree in Computer Science, Electrical Engineering, or related field; or equivalent hands-on experience as a software engineer)
- Deep empathy for developers and an ability to translate technical complexity into simple, usable products
- Experience driving cross-functional alignment across design, engineering, and GTM teams
- Proven ability to define product success metrics and iterate based on data and feedback
Nice to have includes:
- Familiarity with AI/ML workflows and inference products
- Experience building products for technical users (e.g., APIs, SDKs, dashboards)
- Background in developer experience or product-led growth
Benefits include:
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Company-facilitated 401(k)
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law.
- ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI... ...of AI to bring cutting-edge models into production. We're growing quickly and recently raised... ...products. THE ROLE As a Core Product Manager at Baseten, you'll shape the core...SuggestedFlexible hours
$160k - $275k
...take ideas from research to production with less friction. Through... ..., training, and production inference, with security,... ...looking for a Founding Product Manager for Inference who will own... ...protected characteristic. We are dedicated to building a culture where...SuggestedWork at officeWork from homeFlexible hours2 days per week- ...is looking for a commercially driven, deeply technical Product Manager to own AI inference and model serving for k0rdent AI, our control plane for... ...environments. The scope includes serverless inference, dedicated endpoints, workload placement, autoscaling, routing, lifecycle...SuggestedRemote work
$163k - $296.4k
...Overview We are seeking a Principal Product Manager/Architect to define and guide the technical architecture of Microsoft Foundry as the... ...Own the product direction for Microsoft Foundry inference, with a primary mandate to make the platform the most reliable...SuggestedOngoing contractLocal area$147.05k - $230.85k
...Senior Product Manager – Edge AI, Computer Vision & Multimodal Inference Innovation is in HP's DNA. From our origins in a Palo Alto garage in 1939, to our current position as one of the world's leading technology companies, HP has grown to become a leader in technology...SuggestedTemporary workLocal areaFlexible hours- ...Owning the product strategy and lifecycle for AI inference and model serving, the full-time Product Manager - AI Inference will lead technical discovery and collaborate with engineering teams to optimize performance across GPU, network, and storage infrastructures in...Full timeRemote work
$148k - $235.75k
...We are looking for a Senior Technical Product Marketing Manager. This role will be located in our rapidly growing data center business and pivotal in our inference marketing. You will be focused on working with engineering to understand the technical capabilities of our...- Product Marketing Manager, Owner & Public Sector, Mid-Level Join to apply for the Product Marketing... ...Trimble Inc. is a technology company dedicated to delivering innovative solutions for... ...of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical...Full timeWork experience placementH1bLocal area
- ...Mirantis, Inc. is seeking a full-time Product Manager - AI Inference to own the product strategy and lifecycle for AI inference and model serving. This role involves leading technical discovery and collaborating with engineering teams to optimize performance across GPU...Full timeRemote work
$156k - $234k
...in AI and multi-cloud data management at scale. Our cutting-edge data... ...bring their expertise and dedication to every project. This is a... ...looking for a Sr. Technical Product Manager, AI Data Platforms who... ...database partners, LLM and inference platform vendors, and enterprise...Local areaShift work- Senior Technical Product Marketing Manager This role will be located in our rapidly growing data center business and will be pivotal in our inference marketing. You will work closely with engineering to understand the technical capabilities of our inference stack—including...
- .... Now we’re hiring our first dedicated Staff PM to own it all – pricing... ...should look like in a product-led, AI-native world. You’ll... ...price capabilities with variable inference cost underneath. You internalize... ...Work Option: Work with your manager to choose between working 5...Full timeImmediate startRemote work
$204k - $247k
...Crusoe Cloud is seeking a visionary Staff Product Manager to spearhead the development of our... ...ingestion and fine-tuning to high-performance inference and agentic workflows. Trend... ...AI/ML Product Leadership: 5+ years of dedicated experience in AI/ML product management,...Full timeTemporary work- ...to deliver industry-leading training and inference speeds and empowers machine learning... ...ML applications, without the hassle of managing hundreds of GPUs or TPUs. Cerebras... ...are paying attention. As Senior Product Marketing Manager, you'll own realtime product...Shift workNight shift
- ...Mirantis in Austin, Texas, is hiring a Product Manager to drive AI inference and model serving for k0rdent AI. The role requires a blend of technical expertise and commercial acumen to optimize performance in cloud-native infrastructure. Ideal candidates will have 7+ years...
- Sr Technical Product Manager, AI & Data Platforms (AiDP) Austin, Texas, United States Corporate... ...very quickly. Bring passion and dedication to your job and there's no telling what... ...and land the next-generation of GenAI inferences for Apple Enterprise Teams. Own the product...
$300 per month
..., transformative cloud infrastructure. About the Role: As a core member of the Crusoe Managed AI Services team, you will own the complete product lifecycle for our Managed Inference offerings, from initial concept and strategic roadmap to successful execution and market...Temporary work- ...Market Product Manager (remote), Mid-Level Join to apply for the Market Product Manager (remote... ...leader in measurement instrumentation, dedicated to shaping the future of process... ...chances of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical...Full timeH1bRemote work
$150k - $350k
...Senior Product Manager About the Institute of Foundation Models We are a dedicated research lab for building, understanding, using, and risk-managing foundation models... ...the stack. You can discuss context windows, inference latency, and specific benchmarks with...Flexible hours$200k - $250k
...is targeted to run neural network (NN) inference workloads in a wide variety of edge and... ...Quadric is seeking a Senior Principal Product Manager, Hardware to own the Chimera GPNPU IP... ...contested architecture decisions (e.g., dedicated requant unit vs. wider MAC array), run...Work at officeWorldwideRelocationFlexible hours$150k - $190k
...startup looking for their first product hire. Well-funded, steady... ...remainder of the role will be dedicated to internal product initiatives... ...experience, hands-on software product management, etc) Familiarity with LLMs, fine-tuning, model inference, agents, etc. 3 to 5+ years of...Local area$206.9k - $279.9k
...is looking for an experienced Technical Product Manager to define and drive product strategy... .... Inferentia delivers best-in-class ML inference performance at the lowest cost in the cloud... ...About the team Our team is dedicated to supporting new members. We have a broad...Flexible hours$250.97k - $274k
## Staff mNAND Product Line ManagerSan Jose, California, United States... ...Business Unit (AEBU) as a managed NAND (mNAND) product line... ...semiconductor industry, Micron is dedicated to your personal wellbeing... ...how closely your stated and inferred skills match the requirements...16 hoursFull timeWork experience placementLocal areaImmediate start- ...outdoor and action camera technology, dedicated to providing high-quality products that enhance the outdoor... ...Product Owner, technical partner manager, and integration architect. The... ..., including APIs, data pipelines, inference workflows, and performance trade-offs...
- ...Product Owner II The Product Owner II will be responsible for... ...roadmap. Works with Product Managers, Business Leaders, and a cross... ...logic and intuition to make inferences about the meaning of data and... ..., productivity, and service. Dedicates required time and energy to assignments...Work experience placement
$100k - $200k
...patients more efficient and productive. We are looking for an experienced technical product manager to design and deliver high-value... ...in MLR Review Cycles", "Inference Accuracy", and "Automated Reference... ...days a week, you will have a dedicated office workspace. Our offices...Work at officeLocal areaRemote workWork from homeFlexible hours3 days per week- ...Technical Product Owner, Mid Level (Remote) Join to apply for the... ...Responsibilities: • Product Roadmap Management: Own, prioritize, and... ...healthcare cost containment company dedicated to achieving superior results... ...at Jobright.ai by 2x Inferred from the description for this...Full timeRemote work
- ...Product Manager Shape the strategy. Guide the story. Drive the outcome. At UDig, strategy... ...beyond the explicit client requests to infer underlying needs by understanding... ...UDig is a technology consulting firm dedicated to delivering high-impact solutions that...
- ...Product Manager San Mateo, CA Parasail is redefining AI infrastructure by enabling seamless deployment across a distributed... ...refining and expanding Parasail's core offerings – dedicated nodes, serverless inference, and dedicated serverless – based on deep customer...
- ...Product Manager For Open Models Ready to drive transformation in AI models? At NVIDIA, our... .... Join our team known for their dedication to collaboration and outstanding performance... ...-class support for open models across inference, fine-tuning, and evaluation....Work experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Product Manager - Dedicated Inference. Be the first to apply!
- product manager data analytics United States
- product manager United States
- ux product manager United States
- senior product manager mobile United States
- product brand manager United States
- product test manager United States
- workday product manager United States
- regulatory product manager United States
- product manager - entry level United States
- iot product manager United States

