Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Product Manager - Inference Platform

Full-time

Nebius

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI. Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D. The role We’re building Nebius Token Factory, an AI inference platform for high-performance, cost-efficient workloads at scale, serving both developers and managed enterprise customers. As a Senior/Principal Product Manager, Inference Platform, you’ll join a team of PMs under the Inference Platform lead and own a core platform stream end to end, from strategy and roadmap to launch and adoption. The scope evolves quickly with the market (new models, modalities, hardware and customer needs), with a strong emphasis on scalability and reliability. You are welcome to work remotely from the US. Your responsibilities will include: - Own the roadmap and outcomes for a part of the inference platform, aligning several cross-functional engineering teams across public API, routing, performance, reliability and enterprise enablement features. - Work with engineering and research to make inference more scalable, reliable and cost-efficient, and turn that into capabilities customers can depend on. - Stay close to customers through research, interviews and hands-on PoCs, especially in managed enterprise. - Track the market: open-source models, inference economics, and how businesses actually apply AI. Turn what you see into product bets.

We expect you to have: - Experience shipping technical platform products, with the seniority to lead work across multiple engineering teams. - Real technical depth in how AI inference works, including model serving, distributed systems and production infrastructure. You think problems through yourself rather than relying on engineers to define them. - Strong communication and expectations management across engineering, research, sales, support and leadership. You write crisp PRDs, RFCs and release notes. - B2B/enterprise experience with technical buyers. - Comfort with ambiguity and shifting scope It will be an added bonus if you have: - Post-training experience, including training draft models. - Experience with third-party technical partnerships. Key employee benefits in the US: - Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families. - 401(k) plan: Up to 4% company match with immediate vesting. - Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers. - Remote work reimbursement: Up to $85/month for mobile and internet. - Disability & life insurance : Company-paid short-term, long-term and life insurance coverage. Pay Transparency We offer competitive compensation and benefits packages. Actual compensation will be determined based on job-related factors, including experience, skills, qualifications, the level at which the candidate is hired, and geographic location, consistent with applicable law.

Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Senior Product Manager - Inference Platform in Remote vacancy
  •  ...JobGether is seeking a Senior Product Manager for the Inference Platform to own strategy, roadmap, and measurable outcomes for core capabilities. You will coordinate multiple engineering teams focused on APIs, routing, performance, and enterprise enablement, partnering... 
    Platform
    Senior
    Remote work

    Jobgether

    United States
    5 days ago
  • $228k - $285k

     ...Senior Product Manager – Inference PlatformTake ownership of a core product stream within a high-performance AI inference platform designed to make large-scale AI workloads more efficient, reliable, and accessible. In this role, you will shape product strategy and roadmaps... 
    Platform
    Senior
    Temporary work
    Immediate start
    Remote work

    Jobgether

    Schererville, IN
    2 days ago
  •  ...industry-leading training and inference speeds; over 10 times faster...  ...AI inference. As the Product Manager for AI Models, you'll lead the...  ...and ensure every model on our platform delivers exceptional quality...  ...currently at or above the level of Senior PM.5+ years of total... 
    Platform
    Senior
    Work experience placement
    Work at office
    Remote work
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $100k - $200k

    Team: Product Management & AlliancesCity: BostonState: MA Veeva Systems is...  ...Reduction in MLR Review Cycles”, “Inference Accuracy”, and “Automated...  ...of the Veeva Vault platform.Process Automation: Partner...  ...conversation with our group's Senior Leader.Once all interviews are... 
    Platform
    Senior
    Work at office
    Local area
    Remote work
    Work from home
    3 days per week

    Veeva Systems

    Boston, MA
    2 days ago
  • $197.27k - $267.04k

     ...197,268 - $267,036Company: Siemens Senior Principal Product Manager Job ID 526690 Posted since...  ...invent and launch novel interfaces and platforms.This is a high-leverage role for a...  ...environments Familiarity with LLMs, inference systems, feedback pipelines, or agentic... 
    Platform
    Senior
    Permanent employment
    Full time
    Work at office
    Local area
    Immediate start
    Remote work

    Siemens

    Bellevue, WA
    4 days ago
  • $151.2k - $204.6k

     ...a simpler world — one product, one barcode, one country...  ....We are looking for a Senior PMT to drive the...  ...incremental feature. It is a platform shift that touches 600...  ...detection, and inference across complex product...  ...a product- Experience managing technical products or... 
    Platform
    Senior
    Flexible hours
    Shift work
    Day shift

    Amazon

    Bellevue, WA
    5 days ago
  • $202k - $230k

     ...Asana is building the platform for human and agent collaboration...  ...of Agentic Work Management (AWM), AI is now a...  ...our suite of AI products, rather than inside any...  ...workflows. About You Senior IC product management...  ...hosted: model providers, inference hosting choices, evals... 
    Platform
    Senior
    Work at office
    Local area
    Work from home
    Worldwide
    Shift work

    Jobleads-US

    New York, NY
    3 days ago
  •  ...performance, low-power generative AI inference systems. Our mission,...  ...the latest research and product improvements for generative...  ...Director of Technical Product Management who is passionate and deeply...  ...understanding of AI compute platforms, including: Cost-performance... 
    Platform
    Senior
    Remote work
    Flexible hours

    Tensordyne

    Sunnyvale, CA
    4 days ago
  •  ...Etsy to discover.We’re looking for a Senior Staff Product Manager, User & Content Understanding to lead...  ...Recommendations, Ads, Buyer Experience, and ML Platform teams to set our broader...  ...and cohort signals, and other forms of inference.Deepen Etsy’s understanding of its inventoryEstablish... 
    Platform
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Visa sponsorship

    Etsy

    Brooklyn, NY
    4 days ago
  •  ...Join to apply for the Senior Cash Management Product Owner role at Jobright.ai 2 days ago Be among the...  ...features. Jobright is an AI-powered career platform that helps job seekers discover the...  ...interviewing at Jobright.ai by 2x Inferred from the description for this job... 
    Platform
    Senior
    Full time
    Temporary work
    H1b
    Remote work

    jobright.com

    New York, NY
    2 days ago
  • $135k - $150k

     ...impactful legal technology products. Our leadership continually...  ...) of snacks. The Role As a Senior Product Manager at Smokeball, you’ll drive...  ...management experience with SaaS platforms, preferably in B2B markets....  ...environment for everyone. Inferred from the description for... 
    Platform
    Senior
    Work at office
    Local area
    Remote work
    Monday to Friday
    Night shift

    Smokeball - Legal Software

    Chicago, IL
    3 days ago
  • $190.8k - $267.1k

     ...Machine Learning infrastructure. The Ads ML Platform team is at the core of this mission,...  ...build smarter. The Role: As the Senior Product Manager for the Ads ML Platform, you will hold...  ...machine learning lifecycle (training, inference, deployment, monitoring). Genuine... 
    Platform
    Senior
    For contractors
    Work experience placement
    Work at office
    Remote work
    Home office
    Flexible hours

    GrabJobs

    Orem, UT
    3 days ago
  • $131.2k - $164k

     ...passionate about creating products that millions of developers...  ...love. We're looking for a Senior Product Manager to lead the vision, strategy...  ...building and scaling cloud-native platforms that enable developers to...  ...space, including AI inference requirements on Kubernetes,... 
    Platform
    Senior
    Local area
    Remote work
    Worldwide
    Flexible hours

    DigitalOcean

    Seattle, WA
    5 days ago
  • $175k - $210k

    Senior Product Manager, Custom Algorithms New York, NY | Bellevue, WA | San Mateo, CA Are you ready...  ...buying with our Deep Learning Advertising Platform. Since 2015, we have harnessed the...  ...ranking, marketplace matching. High-volume inference, noisy feedback, and a real commercial... 
    Platform
    Senior
    Work at office
    Remote work
    Work from home

    Cognitiv

    Bellevue, WA
    4 days ago
  • $134k - $175k

    Join to apply for the Senior Global Product Manager role at Fresenius Kabi USA Join to apply for the Senior...  ...at Fresenius Kabi USA by 2x Inferred from the description for this job Medical...  ...Technical Product Manager - Loyalty Platform & Digital Coupons Bannockburn, IL $85... 
    Platform
    Senior
    Full time
    Work at office
    Remote work
    3 days per week

    Fresenius Kabi USA

    Lake Zurich, IL
    3 days ago
  •  ...Hewlett Packard Enterprise Development LP is seeking a Senior Software Engineer to advance the model runtime for our AI inference platform. You will design and implement core components, optimize batching and KV cache strategies, and collaborate with cross-functional teams... 
    Platform
    Senior
    Remote work

    Hewlett Packard Enterprise

    Fort Collins, CO
    3 days ago
  • $196.5k - $291.5k

     ...completion of payments on our platform on behalf of our customers....  ...PayPal and Venmo branded credit products, a credit card, a debit card,...  ...exchanges and returns, and manage risk. We enable consumers to...  ...recommendation engines, real-time inference systems, or ML/AI... 
    Platform
    Senior
    Work at office
    Local area
    Immediate start
    Flexible hours

    Jobleads-US

    San Jose, CA
    5 days ago
  •  ...Senior Principal Outbound Product Manager, Service Collection Product Management | Seattle, United States...  ...move from fragmented or incumbent platforms to a modern Service Collection operating...  ...you know how to distinguish fact, inference, hypothesis, and anecdote, and you... 
    Platform
    Senior
    Permanent employment
    Work at office
    Remote work

    Atlassian

    New York, NY
    2 days ago
  • $40 - $52 per hour

    DescriptionKforce has a client seeking a Senior Product Manager to join their team for a remote role.Summary:The Senior Product Manager will...  ...trust, including the continued development of a centralized platform designed to support multiple customer-facing experiences across... 
    Platform
    Senior
    Remote work

    KForce

    Atlanta, GA
    4 days ago
  • VirtualVocations is seeking a Product Manager for AI Inference to own the strategy and lifecycle of AI inference and model serving. You will collaborate...  ...The role demands experience in production AI inference and strong communication with platform #J-18808-Ljbffr AIToolboard
    Platform
    Remote work

    AIToolboard

    Alexandria, VA
    5 days ago
  •  ...Development LP in the United States seeks a Senior Software Engineer to design and evolve the model runtime for the AI inference platform, focusing on low tail latency and high...  ...inference teams, and enhance batching, KV cache management, and distributed execution across GPUs.... 
    Platform
    Senior
    Work at office
    Remote work
    2 days per week

    Hewlett Packard Enterprise

    Spring, Montgomery County, TX
    3 days ago
  •  ...Priority Commerce seeks a Senior Product Manager to own the Priority Commerce Engine (PCE) Platform & APIs, directing product strategy, roadmaps, and developer experience across platforms and partners. This hands-on role moves from strategy to execution, translating complex... 
    Platform
    Senior
    Remote work

    Priority-Technology-Holdings,-LL

    United States
    3 days ago
  • # Product Manager - AI InferenceVirtualVocationsAlexandria, USFull-time##...  ...and lifecycle for AI inference and model serving, the full-...  ...in product management or a senior technical role focused on AI...  ...technical discussions with platform engineering buyersApply on Company... 
    Platform
    Full time
    Remote work

    AIToolboard

    Alexandria, VA
    5 days ago
  •  ...continued expansion across clients and product offerings. What They Offer You:Become the...  ...Fits:7+ years of experience in product management, product development, or a related role....  ...workflow tools, decisioning, or communications platforms.Experience building products in... 
    Platform
    Senior
    Remote work

    AccruePartners

    Charlotte, NC
    4 days ago
  • $200k - $250k

     ...Senior Product Manager, AI Infrastructure Who We Are Lightning AI is the company behind PyTorch...  ...in 2019, we build an end-to-end platform for developing, training, and deploying...  ...experimentation, training, and production inference, with security, observability, and... 
    Platform
    Senior
    Work at office
    Work from home
    Flexible hours
    2 days per week

    Jobleads-US

    New York, NY
    4 days ago
  • $155k - $200k

     ...have reached sustained production, despite billions of...  ...monitors performance, manages drift, and sustains systems...  ...leave the lab. As a Senior Product Manager-AI...  ...also ensure that our platform meets the evolving needs...  ...gateways, model routing, inference infrastructure, or... 
    Platform
    Senior
    Work at office

    Striveworks

    Austin, TX
    1 day ago
  •  ...the grid.Our Emerald Conductor software platform makes data centers flexible and...  ...the era of large-scale AI training and inference. We believe cloud infrastructure should...  ...virtual machines.We're looking for a Senior Product Manager, AI Cloud Services to lead the definition... 
    Platform
    Senior
    Work from home
    Flexible hours
    2 days per week

    Emerald AI

    Washington DC
    2 days ago
  •  ...partnering with AppFolio and senior leadership. What You Own...  ...discovery and iteration across the product org. What You Bring:...  ...~7+ years in PM with partner-platform and B2B2C experience. ~...  ...services effortless for property managers. They are a team of 200+ with... 
    Platform
    Senior
    Remote work

    Second Nature

    United States
    2 days ago
  •  ...ABC Fitness is seeking a Sr. Principal Product Manager to define and lead the company-wide vision and strategy for AI Agents across the platform. You will work with product and engineering to translate strategy into market-ready capabilities and establish standards... 
    Platform
    Senior
    Remote work

    ABC Financial

    United States
    4 days ago
  •  ...Nucleus Security, Inc is seeking a Senior Product Manager to define and execute product strategy, roadmap, development, and GTM for the UI/UX platform. You will prioritize high-impact solutions based on customer feedback and market trends, guiding the direction of a rapidly... 
    Platform
    Senior
    Remote work

    Nucleus Security, Inc

    United States
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Product Manager - Inference Platform. Be the first to apply!