Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Manager, AI Infrastructure

$175k - $220k
Full-time

Together AI

About the Role

Our product surface is expanding fast - GPU clusters, managed storage, networking, and observability - and we're adding a Product Manager to the Together Cloud team to own the day-to-day product work that keeps these AI infrastructure products moving. You'll start across the full surface, with an early focus on observability and GPU Clusters, partnering closely with engineering to ship the feature work that customers feel every day.

This is a role for someone who runs toward problems. You won't be handed a backlog and asked to coordinate it - you'll find the issues others haven't spotted yet, drive them to resolution, and use data and experimentation to decide what to build. You'll have real autonomy from day one, and the breadth of working across compute, storage, and observability that few PM roles offer.

It's also a role with a clear path. Within roughly nine months, the goal is for you to grow into full ownership of a complete product area — observability or storage as your own. You'll report directly to a Staff Product Manager, and our product leadership (including our CPO) is closely involved with this team. If you want to build infrastructure that the AI ecosystem runs on, and earn ownership quickly by proving you can operate, this is that seat.

Responsibilities

  • Own the day-to-day product and feature work across Together's AI infrastructure products - GPU Clusters, Managed Storage, and observability - with an early focus on observability and storage.
  • Find and drive problems to resolution with minimal guidance, including issues that aren't yet on anyone's radar.
  • Run structured, hypothesis-driven experiments - reading the data yourself and driving the data collection and instrumentation needed to answer open questions.
  • Partner across engineering, product, and partner teams to ship improvements and unblock work without waiting for permission.
  • Translate a deep understanding of customers operating in fast-moving, high-ambiguity markets into product decisions.
  • Juggle multiple priorities and workstreams across a broad infrastructure surface.
  • Grow into end-to-end ownership of a complete product area (observability or storage) as you ramp.

Requirements

  • Deep empathy for customers operating in high-ambiguity, fast-evolving markets; we work with AI Native startups and model labs that move at high pace
  • Strong, hands-on data and analytics skills with a hypothesis-driven approach - you design experiments, read the data yourself, and can drive the data collection needed to get answers.
  • High agency: you find problems, push through resistance, and drive resolution without waiting to be told what to do.
  • A real technical foundation -whether from an AI/infrastructure background, hands-on software development, or strong working knowledge of cloud and infrastructure.
  • A track record of collaborating across orgs and product lines to get things done.
  • Comfortable managing multiple priorities and workstreams at once.
  • Familiarity with the AI stack, especially at the infrastructure layer, is a strong plus.
  • Cloud platform experience (AWS, Azure, GCP, or similar) - with extra weight if you've helped build such products.
  • Bonus: working knowledge of the Nvidia/AMD GPU stack (InfiniBand, NCCL, GPU operator, etc.), or experience with AI training or inference workloads.

About Together AI

Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $ 175,000 - 220,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Product Manager, AI Infrastructure in San Francisco, CA vacancy
  • $200k - $250k

     ...Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in...  ...designed to take ideas from research to production with less friction. Through our...  ...For We’re looking for a Product Manager, AI Infrastructure to own the product experience for Lightning... 
    Suggested
    Full time
    Work at office
    Work from home
    Flexible hours
    2 days per week

    Lightning AI

    San Francisco, CA
    3 days ago
  • Sierra is seeking a highly skilled technical product leader to shape the infrastructure platform in their San Francisco office. Responsibilities include shaping infrastructural abstractions, ensuring performance and reliability, and driving system architecture decisions... 
    Suggested
    Work at office
    Flexible hours

    Sierra

    San Francisco, CA
    9 hours ago
  • About Cartesia Our mission is to architect AI that learns from and interacts with the...  ...paired with a design‑minded product engineering team to build and ship cutting...  ...the Role Cartesia is hiring a Product Manager, Infrastructure to own the platform our customers and internal... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours

    Cartesia

    San Francisco, CA
    4 days ago
  • $250k

     ...plenty of growth opportunities? Join a rapidly scaling AI cloud infrastructure provider building a next-generation GPU platform designed...  ...United States. An exciting opportunity has opened for a Product Manager AI Infrastructure to drive the roadmap for GPU compute,... 
    Suggested
    Full time
    San Francisco, CA
    more than 2 months ago
  • $211k - $251k

     ...Requirements: Deep experience creating highly technical products, ideally in infrastructure, platform, or developer tooling Strong systems...  ...platforms, APIs, or SDKs Bonus: familiarity with modern AI/ML infrastructure or real-time systems Bonus: coding experience... 
    Suggested
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    18 days ago
  • About the role We’re hiring a Product Manager to own the financial infrastructure that underpins the Thatch member experience, and to define its future for the...  ...experience (e.g. HSAs, portable health accounts, AI-powered personalization) and partner with leadership... 

    Thatch

    San Francisco, CA
    4 days ago
  • $188k - $275k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by...  ...CoreWeave combines superior infrastructure performance with deep technical...  ...that. W&B can now build products that connect application-level...  ...Reporting to the Director of Product Management, this Staff Product Manager... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave Europe

    San Francisco, CA
    2 days ago
  • $175k - $350k

     ..., more human customer experiences with AI. We are primarily an in-person company...  ...Bret was also one of Google's earliest product managers and co-creator of Google Maps. Before founding...  ...Workspace. What you’ll doDefine the infrastructure platform: Shape the abstractions that... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    3 days ago
  • $227k - $307k

    We are rebuilding biotech for the AI era.When a breakthrough is delayed, the world waits. Getting...  ...you use today.ROLE OVERVIEWWe're hiring a Product Manager to own prioritization and roadmap for Benchling’s core infrastructure teams. You'll turn engineering constraints,... 
    Work at office
    Local area
    Flexible hours
    3 days per week

    Benchling

    San Francisco, CA
    2 days ago
  • Code Metal is seeking a Senior Product Manager to lead product strategy and execution for mission-critical software platforms. You will work...  ...the intersection of high-fidelity simulation, geospatial data, AI, and real-time decision-making—environments where product... 

    Code Metal

    San Francisco, CA
    9 hours ago
  • $165k - $185k

     ...Learn more about working at Avive: We are seeking a Senior Product Manager to oversee software products at Avive. This includes both...  ...range: $165,000 - $185,000 We may use artificial intelligence (AI) tools to support parts of the hiring process, such as... 
    Local area

    Avive

    Brisbane, CA
    10 days ago
  • $189k - $260k

     ...Secure Every Identity, from AI to Human Identity is the key...  ...the trusted, neutral infrastructure that enables organizations to...  ...efficient cloud infrastructure management is essential for ensuring the...  ....  We are looking for a Sr Product Manager who will be responsible... 
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    19 days ago
  • $285k - $335k

     ...energy and intelligence . As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each...  ...in AI rely on to train and run their models. As a Principal Product Manager on our AI Infrastructure team, you will own the long-term... 
    Temporary work

    Crusoe

    San Francisco, CA
    1 day ago
  •  ...Description:DataRobot delivers AI that maximizes impact and...  ...We run agents and models in production for enterprises that cannot move...  ...deployments, air-gapped and customer-managed clusters.The control plane is...  ...in product management for infrastructure, developer platforms, or... 
    Full time
    Contract work
    Local area
    Remote work
    Worldwide
    Flexible hours

    DataRobot

    San Francisco, CA
    4 days ago
  • $200k - $240k

     ...energy and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate each layer...  ...storage tier a physical AI customer depends on. As a Staff Product Manager on our Cloud Infrastructure team, you will own the storage... 
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  • $186.1k - $300.55k

     ...Lead Product Manager Docusign brings agreements to life. Over 1.5 million customers and more than a billion people in over 180 countries...  ...experience in product management, including meaningful work on AI/ML products, B2B SaaS platforms, or CRM/CS ecosystems (e.g., Salesforce... 
    Contract work
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    19 hours ago
  • $240k - $300k

     ...technology firm based in San Francisco is seeking an experienced Product Manager to drive growth and retention initiatives. You will own...  ...and partner with cross-functional teams to reshape the GTM infrastructure. The ideal candidate has experience in high-growth... 
    Work at office
    3 days per week

    Brex

    San Francisco, CA
    2 days ago
  • Clera, a fast-growing fintech platform, is seeking a Senior Product Manager, Growth to own the full growth funnel—from acquisition to retention...  ...to design and run experiments, optimize conversion, and apply AI for faster discovery and impact. This on-site SF role offers... 

    Clera

    San Francisco, CA
    2 days ago
  • $340k - $425k

    Why join us Brex is the AI-powered spend platform. We help companies spend with confidence...  ...support you need to grow your career. Product at Brex The Product team is at the...  ...potential. What you’ll do As a Group Product Manager at Brex, you will be the driving force... 
    Work at office
    Remote work
    3 days per week

    Brex

    San Francisco, CA
    2 days ago
  • $155k - $195k

     ...unprecedented speed and accuracy. Our AI-enabled platform turns siloed...  ...unified picture. The visible product is a small fraction of the...  ...in B2B SaaS, AI, or data infrastructure. You have authored...  ...that moved real deals. ~ Management consulting experience can add... 
    Full time
    Work experience placement
    Local area

    Peregrine Technologies

    San Francisco, CA
    2 days ago
  • $180k - $230k

     ...create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial...  ...significant, sustained investment in compute infrastructure to support our AI safety mission. We are looking for a Senior Manager, Infrastructure Tax to work alongside the... 
    Remote job
    Permanent employment
    Contract work
    For contractors
    For subcontractor
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    San Francisco, CA
    3 days ago
  • B Capital is seeking a Research Program Manager to scale research infrastructure for frontier model development in San Francisco. The ideal candidate will...  ...of experience in technical program management within ML/AI, possessing deep technical knowledge and strong... 

    B Capital

    San Francisco, CA
    9 hours ago
  • $170k - $200k

     ...platform. We are looking for an experienced Senior Digital Product Manager to independently lead strategic initiatives across media-...  ...What's Great About This Role? Shape the future of AI-powered claim experiences by leveraging customer- provided signals... 
    Contract work
    Work at office
    Work visa
    Flexible hours

    SquareTrade

    San Francisco, CA
    3 days ago
  • $220k

     ...standard and our team is building its AI-native future.About The RoleSentry's Infrastructure Engineering team is what makes...  ...routing, and automation that let product engineers operate services safely...  ...themselves.As the Engineering Manager for Infrastructure Engineering, you... 

    Sentry

    San Francisco, CA
    13 hours ago
  • $307k - $352k

     ...Engineering Manager, InfrastructureSan FranciscoKikoff: The Fintech...  ..., we've built a suite of products that help millions of people...  ...impact.About the RoleKikoff's infrastructure team builds the systems that...  ...engineer across all five areas.AI is increasing the amount of code... 
    Permanent employment
    Local area
    Immediate start

    Kikoff

    San Francisco, CA
    4 days ago
  •  ...ManagerOur mission is to architect AI that learns from and...  ...paired with a design-minded product engineering team to build and...  ....We're hiring an Engineering Manager to lead one of Cartesia's core...  ...Background in machine learning, AI infrastructure, or generative models.Note:... 
    Work at office
    Visa sponsorship

    Cartesia, Inc.

    San Francisco, CA
    3 days ago
  • $290k - $365k

     ...interpretable, and steerable AI systems. We want AI to be safe...  ...the Role Anthropic's Infrastructure organization is the engine that...  ...for training frontier models, production infrastructure serving...  ...things. As a Technical Program Manager for Infrastructure, you'll work... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    1 day ago
  •  ...Description: Job Title : Technical Project Manager (GPU Infrastructure & Data Center) Job Type : W2/C2C...  .... ~ Experience with large-scale AI data center / GPU deployment programs....  ...Experience managing commissioning and production handoff activities. ~ Strong... 

    Artmac Soft LLC

    San Francisco, CA
    1 day ago
  • Anthropic is seeking a Product Manager for the Research team to own ideation and deployment of frontier AI models and products, collaborating with research to productize applied work and identify high-potential use cases grounded in customer needs. You will translate complex... 

    Anthropic

    San Francisco, CA
    1 day ago
  • $144.5k - $230k

     ...AI Product ManagerWe are the better way to work in finance. As private equity's value creation partner, we sit at the heart of PE where...  ...and their portfolio companies.We're looking for an AI Product Manager to join one of Accordion's new AI-augmented delivery pods—purpose... 
    Work at office
    Local area
    Remote work
    2 days per week

    Accordion USA

    San Francisco, CA
    19 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Manager, AI Infrastructure. Be the first to apply!