Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr./Staff TPM - Inference Capacity

Jobleads-US

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.
This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.
Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

About the role

As demand for AI continues to accelerate, intelligent capacity management becomes one of the company's most strategic challenges. Every customer commitment, model launch, and infrastructure investment depends on making the right capacity decisions at the right time.

We're looking for an experienced Technical Program Manager to lead capacity planning and fleet strategy for our Inference Service organization. This is a highly visible role working directly with Engineering, Product, Infrastructure, SRE, Operations, and executive leadership to maximize utilization of one of the world's most advanced AI inference fleets.

What you'll own

Capacity planning and forecasting . Build and maintain the 6 / 12 / 26-week rolling capacity model across every cluster. Work with product team to translate customer contracts and sales pipeline asks into capacity requirements. Forecast model replicas, system-hours, and spares by customer and by model. Reconcile against actuals weekly. Maintain the source-of-truth doc.

New Datacenter Capacity bring-up. Collaborate with datacenter infrastructure and operations teams to support new datacenter bringup and ensure production readiness. Drive engineering efforts and related automation to ensure on-time and quality delivery.

Allocation and cluster placement. Partner closely with the SRE and product team to run the weekly capacity review across different customers/models/clusters. Decide model placement and re-balancing: which customer tenants land where, which clusters absorb new launches, which freezes are in effect etc. Run the weekly capacity and utilization report for the Inference Service leadership. Post capacity allocation, drive downstream tasks w.r.t deploying models across the allocated capacity with SRE team.

Drive capacity planning tool adoption. Partner with console engineering team to drive stakeholder adoption of the inhouse built capacity planning and allocation tool, including user acceptance testing, issue resolution, tracking changes, pilot testing and deployment. In general, Contribute to the continuous process improvement and development of internal capacity management tools.

Incident tracking and postmortems. Proactively identify and mitigate capacity bottlenecks, risks, and dependencies. In case of any SLA drop due to capacity misallocations, drive related resolution and postmortem.

Key Responsibilities

  • Run weekly capacity planning and daily capacity and deployment tracking with Engineering, product and operations team. Own fleet utilization reporting and forecasting

  • Drive capacity planning for new customer deployments and major model launches

  • Drive continuous improvement and stakeholder adoption of new capacity management platform

  • Drive org level strategic initiatives related to capacity expansion, improving fleet efficiency and maximizing effective utilization of available systems

  • Lead planning around major infrastructure events including but not limited to new customer commits, new model releases, change to DC/cluster architecture, etc. that impacts capacity and fleet utilization. Update capacity plans and forecasts accordingly.

  • Maintain Jira EPICs and Confluence pages related to capacity planning, reporting and change management to ensure execution transparency across teams

Qualifications

  • 5+ years of TPM, technical program management, or product operations experience in cloud infrastructure, large-scale ML serving, or hyperscaler capacity planning

  • Experience leading large cross-functional programs involving Engineering, Product, and Operations

  • Comfort with the inference serving stack: model replicas, batching, prefill/decode, KV cache, accelerator scheduling

  • Strong data fluency: SQL, Grafana, basic Python or Flux to pull your own numbers without waiting for an analyst

  • Track record of running a recurring cross-functional ritual involving senior engineers and LT

  • Direct experience with AI accelerator fleet operations such as Habana, TPU pods, Inferentia, Trainium

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  1. Build a breakthrough AI platform beyond the constraints of the GPU.

  2. Publish and open source their cutting-edge AI research.

  3. Work on one of the fastest AI supercomputers in the world.

  4. Enjoy job stability with startup vitality.

  5. Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

#J-18808-Ljbffr Jobleads-US
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Sr./Staff TPM - Inference Capacity in Sunnyvale, CA vacancy
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...AI continues to accelerate, intelligent capacity management becomes one of the company's...  ...transparency across teamsQualifications5+ years of TPM, technical program management, or product... 
    Senior
    Remote work

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  •  ...Cerebras Systems is seeking an experienced Technical Program Manager to lead capacity planning and fleet strategy for our Inference Service. You will work closely with Engineering, Product, Infrastructure, SRE, and senior leadership to maximize utilization of our AI inference... 
    Senior

    Jobleads-US

    Sunnyvale, CA
    3 days ago
  • $230k - $280k

     ...build with us at Crusoe. About the Role: At Crusoe, the Capacity Planning & Efficiency team operates at the critical...  ...genuinely unknown. You will be the technical authority the exec staff, the board, and Crusoe's capital partners rely on for the capacity... 
    Senior
    Temporary work

    Crusoe

    Sunnyvale, CA
    5 days ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...high-speed inference.About the RoleAs a Staff GPU Inference SDET, you will be the founding...  ...throughput, tail latency (P99), and capacity efficiency. Numerical Correctness & Quality... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $160k - $265k

     ...This role will be based in Mountain View, CA.We are looking for a Sr Commodity Manager / NPI lead to drive sourcing strategy, cost...  ...footprint. In this role, you will collaborate closely with engineering, Capacity planning, finance, OxMs, and our global vendor ecosystem to... 
    Senior
    Contract work
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    4 days ago
  • $175k - $275k

     ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...with ultra high-speed inference.Senior Staff AI Accelerator Performance ArchitectWafer...  ...space in which compute placement, memory capacity and bandwidth, communication, kernel execution... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $175k - $265k

     ...possibilities of AI. Role Overviewd-Matrix is seeking a Senior Staff ML Researcher to join our Algorithms team and develop new methods...  ..., and implement algorithmic techniques that improve LLM inference performance while preserving model quality, with a focus on challenges... 
    Senior

    d-Matrix

    Santa Clara, CA
    4 days ago
  • $106.8k - $160k

     ...corrective actions to achieve target goalsWhat We're Looking For• Minimum 15 years of relevant experience with 5 years in a managerial capacity, preferably in the Semiconductor industry.• BS/BA in Business Administration, Engineering, Finance, or Operations. MBA/MS... 
    Senior
    Permanent employment
    Full time
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    4 days ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...inference.About the RoleWe're hiring a Staff Engineer to help lead, drive, and contribute...  ...improvements in latency, throughput, capacity efficiency, and resilience under unpredictable... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $183k - $247.6k

     ...most advanced cloud for AI training and inference — where multi-billion-parameter models come...  ...while providing seemingly infinite capacity at the lowest possible cost for our customers...  ...with other employees, supervisors, and staff; adhere to standards of excellence... 
    Senior
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  • Amazon Web Services (AWS) Hardware Engineering is seeking a Senior Technical Program Manager to lead cross-functional hardware programs in Cupertino. You will drive end-to-end delivery across hardware design, firmware, test, and external partners to scale enterprise cloud...
    Senior

    Jobleads-US

    Cupertino, CA
    3 days ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ...fleet through self-service delivery, shared observability, capacity orchestration, rollout safety, and operational automation.... 
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ...) with clear SLOs. Drive improvements in latency, throughput, capacity efficiency, and resilience under unpredictable demand. Code &... 

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $189k - $274k

     ...make mobility more efficient and accessible for all.The Senior Staff Technical Lead Manager (TLM) for Hardware Test Infrastructure leads...  ...chain, purchasing, and hardware design teams to align on capacity planning, test rack design, and component procurement.Root Cause... 
    Senior
    For contractors
    Work at office
    Local area
    Shift work
    3 days per week

    Aurora Innovation

    Mountain View, CA
    5 days ago
  • $127.63k - $191.2k

    About Marvell Marvell’s semiconductor solutions are the essential building blocks of the data infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is enabling new possibilities. At Marvell, you can...
    Senior
    Permanent employment
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    2 days ago
  •  ...part of a high-performing team that believes in each other, come build with us at Crusoe. About the Role: At Crusoe, the Capacity Planning & Efficiency team operates at the critical intersection of all Crusoe products, services, and underlying physical infrastructure... 
    Temporary work

    Crusoe

    Sunnyvale, CA
    13 days ago
  • $106.8k - $160k

     ...including direct experience managing the optics/optical technology supply base (e.g., supplier qualification, contract negotiation, capacity planning)Strong understanding of manufacturing processes and capacity planning specific to the optics industryExperience with... 
    Senior
    Permanent employment
    Full time
    Contract work
    Internship
    Work from home
    Worldwide

    Marvell

    Santa Clara, CA
    3 days ago
  • $208k - $327.75k

     ...for NVIDIA employees and DSX Partners. As a Product Manager for Inference Platform, you will help define and drive the products and...  ...strategy for inference platform capabilities — including APIs, capacity management, cost management, performance and optimization, and... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $165k - $265k

     ...come find your playground? Together, we can help shape the endless possibilities of AI. Role Overviewd-Matrix is looking for a Senior Staff Power Performance Architect to own pre-silicon power estimation across our next-generation AI accelerators. In this role, you will... 
    Senior

    d-Matrix

    Santa Clara, CA
    4 days ago
  • $183k - $247.6k

     ...largest fleet of GPU-accelerated servers powering AI/ML training and inference at cloud scale. Our team defines the server architectures,...  ...and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions... 
    Senior
    Local area
    Worldwide
    Flexible hours
    Day shift

    Amazon

    Cupertino, CA
    1 day ago
  • $139.6k - $225.78k

     ...relationships, and the kind of precision that drives great outcomes.Job SummaryJob SummaryWe are seeking a passionate and self-driven Sr. Staff Researcher to join our Cloud-Delivered Security Services team. In this role, you will be pivotal in developing and refining the... 
    Senior
    Full time
    Work experience placement
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    2 days ago
  • $208k - $327.75k

     ...AI models and applications running on NVIDIA hardware. Every inference deployment — from a single-GPU workstation to a multi-thousand...  ...Server, or Dynamo. Production experience at scale counts too: capacity planning, autoscaling, SLA management, or stateful multi-turn... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $124.5k - $272k

     ...us on LinkedIn and Instagram.Positions are available at Senior Staff and above. Candidates are assessed individually and leveled according...  ...roleAs a Senior Staff Machine Learning Scientist, you own the inference and optimization layer that makes AI in agentic workflows fast,... 
    Senior

    Netskope

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...application is built. We are seeking a Senior Software Engineer - AI Inference Performance to advance innovative LLM and VLM inference. You...  ...-end latency, processing efficiency, and key-value (KV) cache capacity. For multimodal models, isolate preprocessing, encoder, and... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • Company DescriptionIt started with a simple idea: what if surgery could be less invasive and recovery less painful? Nearly 30 years later, that question still fuels everything we do at Intuitive. As a global leader in robotic-assisted surgery and minimally invasive care...
    Senior
    Work at office
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    4 days ago
  • $212k - $340k

     ...products; spanning software, hardware, and services.As a Senior Staff Security Product Architect, you will serve as a primary technical...  ...cryptographic key management, and hardware security module (HSM/TPM) integrations and secure protocols to protect data at rest, in transit... 
    Senior
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week

    Aurora Innovation

    Mountain View, CA
    3 days ago
  •  ...the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ..., reviewable, and safe.Improve infrastructure reliability, capacity, performance, cost efficiency, monitoring, and operational... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $139.6k - $225.78k

     ...real-time problem-solving, stronger relationships, and the kind of precision that drives great outcomes.Job SummaryYour CareerAs a Sr Staff Security Researcher, you will work at the forefront of AI-assisted vulnerability research, focusing on the design, implementation,... 
    Senior
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    23 hours ago
  • Qualcomm in Santa Clara, CA, seeks a Lead Server Product Architect to define the architecture of a high-performance, energy-efficient server SoC. You will collaborate with chip and platform teams to shape product roadmaps, KPIs, and architectural decisions for datacenter...
    Senior

    Jobleads-US

    Santa Clara, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr./Staff TPM - Inference Capacity. Be the first to apply!