Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Product Manager - GPU & AI Infrastructure

DeepRec.ai

You’ll own the product that decides where and when AI workloads run. This is an opportunity to take ownership of an AI Scheduling product at a growing AI infrastructure business. You’ll define the multi-year product vision, decide what gets built and work closely with engineers, infrastructure teams and enterprise customers to solve the challenges of running AI at scale. The product focuses on some of the biggest challenges in AI infrastructure: how jobs are queued, how expensive GPU resources are allocated, and how performance, latency and reliability are managed as workloads grow. You’ll have real ownership of the roadmap, translating customer needs into clear product decisions and working closely with Engineering, Sales and leadership to bring those decisions to life. This could suit you if you’re already a Technical Product Manager working on cloud infrastructure, platforms, developer tooling or cluster management and want to take ownership of a product at the centre of the AI infrastructure market. You’ll need: 5+ years of Product Management experience, including ownership of infrastructure, platform or developer tooling products. Experience with technologies such as Kubernetes, Slurm, OpenStack, VMware or similar. A good understanding of cloud, compute infrastructure and how AI/ML workloads run. Experience defining multi-year product roadmaps and working closely with engineers and technical customers. Strong communication skills and the ability to make product decisions in a technically complex environment. Experience in AI/ML infrastructure, GPU scheduling or MLOps would be particularly relevant. You’ll be based in the San Francisco Bay Area , working in a hybrid setup, ideally 1–3 days per week in the office, with some flexibility. The role also involves travel between the US and Germany, up to 30% as business needs require. #J-18808-Ljbffr

Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Senior Product Manager - GPU & AI Infrastructure in San Francisco, CA vacancy
  • $200k - $250k

     ...Senior Product Manager, AI Infrastructure Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end...  ...Infrastructure to own the product experience for Lightning AI’s GPU cloud, from capacity and provisioning through workload... 
    Senior
    Work at office
    Work from home
    Flexible hours
    2 days per week

    Lightning AI

    San Francisco, CA
    4 days ago
  •  ...Hyperbolic is seeking a very senior Infrastructure Engineer to scale a GPU cloud marketplace. You will build a multi...  ...inventories into an orchestrated pool for AI developers and researchers. You...  ...to optimize integrations across production cloud infrastructure. #J-18808-Ljbffr... 
    Senior

    Hyperbolic

    San Francisco, CA
    3 days ago
  •  ...seeking a seasoned engineering leader to own and scale the GPU and data center infrastructure powering our neocloud platform. This hands-on leadership...  ...define reliability metrics, partner across Engineering, Product, Finance, and the executive team, and build a team that... 
    Senior

    US Health Partners, LLC

    San Francisco, CA
    3 days ago
  •  ...mission to democratize AI by breaking down the...  ...offer an innovative GPU marketplace and AI inference...  ...We’re seeking a Senior Infrastructure Engineer to help...  ...provisioning and lifecycle management, including IPMI/...  ...distributed systems in production environments #J-188... 
    Senior
    Remote work

    Devopsroles

    San Francisco, CA
    4 days ago
  •  ...Labs is building a scalable GPU Cloud Marketplace designed to democratize AI compute. We seek a Senior Infrastructure Engineer to architect multi-tenant provisioning, manage GPU orchestration, and craft...  ...networking, and vendor workflows in production-scale #J-18808-Ljbffr... 
    Senior

    Devopsroles

    San Francisco, CA
    4 days ago
  • Flexion Robotics is seeking a senior ML engineer to own and optimize its GPU compute platforms on-site in San Francisco...  ...GPU clusters and collaborate with AI engineers to improve training...  ...pipelines, and work with leadership and infrastructure teams to advance Flexion’s... 
    Senior

    Flexion Robotics

    San Francisco, CA
    3 days ago
  • $189k - $260k

    Secure Every Identity, from AI to HumanIdentity is the key to...  ...building the trusted, neutral infrastructure that enables organizations to...  ...cloud infrastructure management is essential for ensuring the...  ...technology. We are looking for a Sr Product Manager who will be responsible... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    6 days ago
  • $150k - $300k

     ...superintelligence stack: the infrastructure frontier AI labs build internally, made...  ...and continuously improving production models. We are building...  ...requirements and design optimal GPU cluster architectures...  ...Optimize GPU utilization, memory management, and inter-node... 
    Senior

    Prime Intellect, Inc.

    San Francisco, CA
    1 day ago
  • $285k - $335k

     ...only vertically integrated AI infrastructure company built from the ground...  ...their models. As a Principal Product Manager on our AI Infrastructure...  ...work as a peer to our most senior infrastructure engineers and...  ...including network cost per GPU and per server.Connectivity... 
    Temporary work

    Crusoe

    San Francisco, CA
    4 days ago
  •  ...Description:DataRobot delivers AI that maximizes impact...  ...agents and models in production for enterprises that...  ...-gapped and customer-managed clusters.The control...  ...management for infrastructure, developer platforms,...  ...technical understanding of GPU and accelerator behavior... 
    Full time
    Contract work
    Local area
    Remote work
    Worldwide
    Flexible hours

    DataRobot

    San Francisco, CA
    8 days ago
  •  ...fal.ai is seeking a Security Engineer, Infrastructure to secure its AI platform across multi-cloud environments, GPUs, and data pipelines. You’ll design...  ...spanning cloud, Kubernetes, networking, and secrets management, enabling secure by-default workflows for fast developers... 
    Senior

    The Consensus

    San Francisco, CA
    4 days ago
  • $215k - $260k

     ...only vertically integrated AI infrastructure company built from the ground...  ...Crusoe.About the Role:The Staff Product Manager, Fleet Management owns the...  ...systems that keep Crusoe's GPU and CPU fleet running...  ...ambiguity, with support from senior leadership as the initiative... 
    Temporary work

    Crusoe

    San Francisco, CA
    8 days ago
  • $175k - $220k

     ...Together AI is looking for a Product Manager to join our fast-growing team in San Francisco. In this role, you will drive day-to-day product work across our AI infrastructure, focusing on observability and GPU clusters. The ideal candidate will possess strong data skills... 

    Together AI

    San Francisco, CA
    3 days ago
  •  ...CoreWeave, the AI Hyperscaler™, acquired Weights...  ...-leading cloud infrastructure with the best-in-class...  ...that. W&B can now build products that connect application...  ...the Director of Product Management, this Staff Product Manager...  ...or Kubernetes for GPU-intensive workloads.... 
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Weights & Biases

    San Francisco, CA
    4 days ago
  • $160k - $210k

     ...What We're Looking ForWe're looking for a Senior Product Manager, Enterprise who thrives at the intersection of customer empathy, technical depth...  ...Science, Engineering, or related field.Bonus: Experience in AI cloud platforms, model training, or inference.Benefits and PerksWe... 
    Senior
    Work at office
    Work from home
    Flexible hours

    Lightning AI

    San Francisco, CA
    3 days ago
  • $205k - $270k

     ...Meter's hardware, firmware, and infrastructure platforms to include Ethernet...  ...to automation at meter.ai . What success looks like...  ...customers - enterprises standing up GPU clusters, not hyperscalers - about...  ...grows into leading a larger product and engineering organization for... 
    Senior

    Meter

    San Francisco, CA
    3 days ago
  • $300k - $375k

     ...Procurement | Reporting to: VP, AI Infrastructure Supply Chain | Work...  ...large-scale data centers and GPU clusters for AI training and...  ...communities we operate in. The Senior Director, AI Infrastructure...  ...’s degree in Supply Chain Management, Operations, Engineering,... 
    Senior
    Full time
    Contract work
    Temporary work
    Work at office
    Remote work

    Iris Energy

    San Francisco, CA
    4 days ago
  •  ...now part of Superhuman, the AI productivity platform on a mission to...  ...collaborative workspaces, Mail’s inbox management, and Go, the proactive AI...  ...employees. We’re hiring a Senior Product Manager to own the...  ...technical platform, data, infrastructure, or AI-enabling products.... 
    Senior
    Worldwide
    Home office
    Flexible hours

    Superhuman

    San Francisco, CA
    8 days ago
  •  ...Flodesk, a remote-first email marketing company, seeks a product leader for its AI systems and core experience. You will shape behavior, prompts, and evaluation, working with engineers on code and infrastructure to improve member experiences. You’ll translate research... 
    Senior
    Remote work

    Flodesk

    San Francisco, CA
    2 days ago
  • $205.6k - $257k

    Scale has been the leading AI data foundry, helping fuel the most exciting advancements...  ...the launch set.We're looking for a Senior AI Product Manager to own and scale this Coding...  ...initiatives, driving task design, environment infrastructure, expert contributor quality, customer... 
    Senior
    Full time

    Scale AI

    San Francisco, CA
    7 days ago
  •  ...A technology company is seeking a Senior / Staff Product Manager to lead the Ray Data product. This challenging...  ..., ensuring strong adoption in the AI data processing ecosystem. The ideal...  ...in distributed systems and ML infrastructure. The position offers an opportunity... 
    Senior
    Relocation

    Anyscale

    San Francisco, CA
    3 days ago
  • $190k - $240k

     ...is Ryder ’s in-house product development group focused...  ...$10B in freight under management, our technology...  ...looking for a visionary Senior Product Manager to own...  ...Learning pod. Baton's ML infrastructure and model portfolio...  ...prediction to Generative AI models — and this role... 
    Senior
    Full time
    Temporary work
    For contractors
    Work at office
    Immediate start
    Remote work
    Visa sponsorship
    Work visa
    Relocation package
    Monday to Friday
    3 days per week

    Baton

    San Francisco, CA
    4 days ago
  • $210k - $240k

    About the RoleAnyscale is seeking a Senior / Staff Product Manager to lead Ray Data, our scalable data processing library for ML and AI workloads.This is a uniquely challenging...  ...background in distributed systems, ML infrastructure, or data processingExperience working... 
    Senior
    Work at office
    Relocation
    Flexible hours

    Anyscale

    San Francisco, CA
    7 days ago
  • $189k - $260k

    Secure Every Identity, from AI to HumanIdentity is the key to unlocking the potential...  ...AI by building the trusted, neutral infrastructure that enables organizations to safely...  .... If you are too, let's talk.As a Senior Product Manager, Okta for AI Agents, you will drive the... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    5 days ago
  • $194.6k - $285.7k

     ...external) and field teams to understand product gaps and translate them into clear priorities...  ...with SplunkExperience with agentic AI, Model Context Protocol, enterprise RAG...  ...Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the... 
    Senior
    Full time
    Temporary work
    Work experience placement
    Local area
    Flexible hours

    CISCO Systems

    San Francisco, CA
    3 days ago
  •  ...the industry’s largest cloud managed networking platform and dataset...  ...organization with access to product analytics that enable teams...  ...the Meraki platform Drive the AI Assistant strategy for networking...  ...learning methods and data infrastructure investments Partner with our... 
    Senior
    Temporary work

    Cisco

    San Francisco, CA
    3 days ago
  •  ...Seekr is hiring a Senior AI Infrastructure Engineer to design, build, and operate platforms for training, serving, evaluation, and deployment of...  ...agents. You will work across distributed systems, Kubernetes, GPU infrastructure, and enterprise AI platforms to build... 
    Senior

    Seekr

    San Francisco, CA
    3 days ago
  • $153k - $203k

     ...Senior Product Manager, Data FoundationsPrimary: Bay Area (San Francisco/Peninsula)About UsBeast Industries...  ..., a small high-output team, and an AI-native way of working that lets one...  ..., high-output team building the data infrastructure and BI foundation that powers decision... 
    Senior

    Mrbeast

    San Francisco, CA
    5 days ago
  • $150k - $250k

     ...DDN is hiring an AI Engineer to work on critical infrastructure for AI systems in San Francisco. This role focuses on optimizing performance across GPU and CPU pathways and building systems that efficiently...  ...has a strong background in production AI systems and experience with... 
    Senior

    DDN

    San Francisco, CA
    3 days ago
  •  ...Firmus Technologies seeks a Senior Kubernetes Engineer, AI Infrastructure, to own the backend infrastructure of the Firmus Kubernetes platform. This hands-...  ..., storage, security, observability, and automation for GPU-accelerated bare-metal environments. You will set platform... 
    Senior

    FirmUS LLC

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Product Manager - GPU & AI Infrastructure. Be the first to apply!