Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr./Staff TPM - Inference Capacity

Cerebras Systems

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.About the roleAs demand for AI continues to accelerate, intelligent capacity management becomes one of the company's most strategic challenges. Every customer commitment, model launch, and infrastructure investment depends on making the right capacity decisions at the right time. We're looking for an experienced Technical Program Manager to lead capacity planning and fleet strategy for our Inference Service organization. This is a highly visible role working directly with Engineering, Product, Infrastructure, SRE, Operations, and executive leadership to maximize utilization of one of the world's most advanced AI inference fleets. What you'll ownCapacity planning and forecasting. Build and maintain the 6 / 12 / 26-week rolling capacity model across every cluster. Work with product team to translate customer contracts and sales pipeline asks into capacity requirements. Forecast model replicas, system-hours, and spares by customer and by model. Reconcile against actuals weekly. Maintain the source-of-truth doc. New Datacenter Capacity bring-up. Collaborate with datacenter infrastructure and operations teams to support new datacenter bringup and ensure production readiness. Drive engineering efforts and related automation to ensure on-time and quality delivery. Allocation and cluster placement. Partner closely with the SRE and product team to run the weekly capacity review across different customers/models/clusters. Decide model placement and re-balancing: which customer tenants land where, which clusters absorb new launches, which freezes are in effect etc. Run the weekly capacity and utilization report for the Inference Service leadership. Post capacity allocation, drive downstream tasks w.r.t deploying models across the allocated capacity with SRE team. Drive capacity planning tool adoption. Partner with console engineering team to drive stakeholder adoption of the inhouse built capacity planning and allocation tool, including user acceptance testing, issue resolution, tracking changes, pilot testing and deployment. In general, Contribute to the continuous process improvement and development of internal capacity management tools. Incident tracking and postmortems. Proactively identify and mitigate capacity bottlenecks, risks, and dependencies. In case of any SLA drop due to capacity misallocations, drive related resolution and postmortem. Key ResponsibilitiesRun weekly capacity planning and daily capacity and deployment tracking with Engineering, product and operations team. Own fleet utilization reporting and forecastingDrive capacity planning for new customer deployments and major model launchesDrive continuous improvement and stakeholder adoption of new capacity management platformDrive org level strategic initiatives related to capacity expansion, improving fleet efficiency and maximizing effective utilization of available systemsLead planning around major infrastructure events including but not limited to new customer commits, new model releases, change to DC/cluster architecture, etc. that impacts capacity and fleet utilization. Update capacity plans and forecasts accordingly.Maintain Jira EPICs and Confluence pages related to capacity planning, reporting and change management to ensure execution transparency across teamsQualifications5+ years of TPM, technical program management, or product operations experience in cloud infrastructure, large-scale ML serving, or hyperscaler capacity planningExperience leading large cross-functional programs involving Engineering, Product, and OperationsComfort with the inference serving stack: model replicas, batching, prefill/decode, KV cache, accelerator schedulingStrong data fluency: SQL, Grafana, basic Python or Flux to pull your own numbers without waiting for an analystTrack record of running a recurring cross-functional ritual involving senior engineers and LTDirect experience with AI accelerator fleet operations such as Habana, TPU pods, Inferentia, TrainiumWhy Join CerebrasPeople who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:Build a breakthrough AI platform beyond the constraints of the GPU.Publish and open source their cutting-edge AI research.Work on one of the fastest AI supercomputers in the world.Enjoy job stability with startup vitality.Our simple, non-corporate work culture that respects individual beliefs.Find out more about what it's like to work at Cerebras here! Apply today and become part of the forefront of groundbreaking advancements in AI!Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.LocationSunnyvale, CA; Remote; Toronto, CANEmployment TypeFull timeLocation TypeHybridDepartmentSoftware Engineering

Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Sr./Staff TPM - Inference Capacity in Sunnyvale, CA vacancy
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...high-speed inference.About the RoleAs a Staff GPU Inference SDET, you will be the founding...  ...throughput, tail latency (P99), and capacity efficiency. Numerical Correctness & Quality... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $160k - $265k

     ...This role will be based in Mountain View, CA.We are looking for a Sr Commodity Manager / NPI lead to drive sourcing strategy, cost...  ...footprint. In this role, you will collaborate closely with engineering, Capacity planning, finance, OxMs, and our global vendor ecosystem to... 
    Senior
    Contract work
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    2 days ago
  • $169k

     ...experience in this always-on, high-tech, and hyper-connected world.Role OverviewWe are seeking a highly skilled and experienced Senior Staff Technical Program Manager to lead company-wide technically complex programs with high impact and urgency.Do you see building Tech... 
    Senior
    Temporary work

    Coupang

    Mountain View, CA
    4 days ago
  • $175k - $265k

     ...at our Santa Clara, CA, headquarters 3 days per week.The role: Sr. Staff, ML Researcher - LLM Algorithmic OptimizationWhat You Will Do:...  ...algorithms that will be used to optimize large language model inference on DNN accelerators we develop. You would be part of a close-... 
    Senior
    3 days per week

    d-Matrix

    Santa Clara, CA
    2 days ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...inference.About the RoleWe're hiring a Staff Engineer to help lead, drive, and contribute...  ...improvements in latency, throughput, capacity efficiency, and resilience under unpredictable... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $230k - $250k

    Cerebras Systems in Sunnyvale, CA, seeks a Sr. Member of Technical Staff to develop resilient software for their AI chip. Responsibilities include designing robust software features, maintaining deployment workflows using AWS, and debugging software issues. Candidates should... 
    Senior
    Remote job

    Cerebras

    Sunnyvale, CA
    2 days ago
  •  ...Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...speed inference.About The RoleThe DC Delivery E2E TPM is the single-threaded owner for delivering data center capacity from forecast site strategy design construction... 
    Senior
    Contract work
    Remote work

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ...fleet through self-service delivery, shared observability, capacity orchestration, rollout safety, and operational automation.... 
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ...) with clear SLOs. Drive improvements in latency, throughput, capacity efficiency, and resilience under unpredictable demand. Code &... 

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $189k - $274k

     ...make mobility more efficient and accessible for all.The Senior Staff Technical Lead Manager (TLM) for Hardware Test Infrastructure leads...  ...chain, purchasing, and hardware design teams to align on capacity planning, test rack design, and component procurement.Root Cause... 
    Senior
    For contractors
    Work at office
    Local area
    Shift work
    3 days per week

    Aurora Innovation

    Mountain View, CA
    2 days ago
  • $106.8k - $160k

     ...including direct experience managing the optics/optical technology supply base (e.g., supplier qualification, contract negotiation, capacity planning)Strong understanding of manufacturing processes and capacity planning specific to the optics industryExperience with... 
    Senior
    Permanent employment
    Full time
    Contract work
    Internship
    Work from home
    Worldwide

    Marvell

    Santa Clara, CA
    1 day ago
  • $208k - $327.75k

     ...AI models and applications running on NVIDIA hardware. Every inference deployment — from a single-GPU workstation to a multi-thousand...  ...Server, or Dynamo. Production experience at scale counts too: capacity planning, autoscaling, SLA management, or stateful multi-turn... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $183k - $247.6k

     ...largest fleet of GPU-accelerated servers powering AI/ML training and inference at cloud scale. Our team defines the server architectures,...  ...and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions... 
    Senior
    Local area
    Worldwide
    Flexible hours
    Day shift

    Amazon

    Cupertino, CA
    3 days ago
  • $165k - $265k

    At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.We...
    Senior
    3 days per week

    d-Matrix

    Santa Clara, CA
    2 days ago
  • $124.5k - $272k

     ...us on LinkedIn and Instagram.Positions are available at Senior Staff and above. Candidates are assessed individually and leveled according...  ...roleAs a Senior Staff Machine Learning Scientist, you own the inference and optimization layer that makes AI in agentic workflows fast,... 
    Senior

    Netskope

    Santa Clara, CA
    2 days ago
  • $139.6k - $225.78k

     ...relationships, and the kind of precision that drives great outcomes.Job SummaryJob SummaryWe are seeking a passionate and self-driven Sr. Staff Researcher to join our Cloud-Delivered Security Services team. In this role, you will be pivotal in developing and refining the... 
    Senior
    Full time
    Work experience placement
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    6 hours ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ..., reviewable, and safe.Improve infrastructure reliability, capacity, performance, cost efficiency, monitoring, and operational... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  •  ...the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    5 hours ago
  • Qualcomm in Santa Clara, CA, seeks a Lead Server Product Architect to define the architecture of a high-performance, energy-efficient server SoC. You will collaborate with chip and platform teams to shape product roadmaps, KPIs, and architectural decisions for datacenter...
    Senior

    Jobleads-US

    Santa Clara, CA
    5 days ago
  • $212k - $340k

     ...products; spanning software, hardware, and services.As a Senior Staff Security Product Architect, you will serve as a primary technical...  ...cryptographic key management, and hardware security module (HSM/TPM) integrations and secure protocols to protect data at rest, in transit... 
    Senior
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week

    Aurora Innovation

    Mountain View, CA
    1 day ago
  • $193.3k - $261.5k

     ...models to run really fast on the Trainium hardware.As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize...  ...cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $284.9k - $427.3k

    Role Overview Qualcomm Data Center team is developing high‑performance, energy‑efficient server solutions for data center applications. We are looking for a highly experienced Server Product Architect to define the architecture of a Server SoC that meets critical KPIs...
    Senior
    Work from home

    Qualcomm

    Santa Clara, CA
    6 hours ago
  • $272k - $425.5k

     ...NVIDIA is seeking a strong technology leader to manage our Server Software Technical Program Management (TPM) team. This role is at the cross-section of execution and strategy, leading a team of Senior TPMs who drive the firmware and system software for NVIDIA's next-generation... 

    Segment (Twilio)

    Santa Clara, CA
    2 days ago
  • $272k - $425.5k

     ...NVIDIA Gruppe is seeking a skilled technology leader to manage our Server Software Technical Program Management (TPM) team. This role focuses on leading Senior TPMs driving firmware and system software for our advanced server platforms, ensuring alignment with hardware... 

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • $248k - $396.75k

     ...knowledge of high-performance networking technologies, Ethernet, RoCE/RDMA, GPU accelerated computing, generative AI, LLM training and inference, Network SerDes, in-network compute, PCIe, and CXL.Technical knowledge of NVIDIA products and services, plus hyperscaler... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    6 hours ago
  •  ...Location:Hybrid, working onsite at our Santa Clara, CA, headquarters 3 days per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat you will do:The role requires you to be part of the team that helps productize the SW stack for our AI compute... 
    3 days per week

    d-Matrix

    Santa Clara, CA
    1 day ago
  • $284.9k - $427.3k

    ## Lead Server Product Architect- Sr DirectorSanta Clara, California, United States of AmericaApply NowFind out how well you match with this jobJob ID3089742## **Company:**Qualcomm Technologies, Inc.## **Job Area:**Engineering Group, Engineering Group CPU Engineering*... 
    Senior
    Work experience placement
    Work from home

    Qualcomm

    Santa Clara, CA
    6 hours ago
  • $168k - $258.75k

    Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our daily life, and where ever bit of accuracy and performance matters for quality, safety, and cost. Inference is also constantly evolving, with new acceleration... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

    We are looking for an architect that wants to change how the AI inference industry works. With agent adoption taking off and GPUs in shortage, NVIDIA has a key part to play in solving the technical challenges that scale token generation on finite resources. Our ISP (inference... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $157k - $210k

     ...traded company (Nasdaq: CRWV) in March 2025. Learn more at  About the role: As a Technical Program Manager focused on Networking Capacity Delivery, you will own the end-to-end delivery of our data center network infrastructure. You will be responsible for translating... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    11 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr./Staff TPM - Inference Capacity. Be the first to apply!