Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr./Staff TPM - Inference Capacity

Cerebras Systems

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.About the roleAs demand for AI continues to accelerate, intelligent capacity management becomes one of the company's most strategic challenges. Every customer commitment, model launch, and infrastructure investment depends on making the right capacity decisions at the right time. We're looking for an experienced Technical Program Manager to lead capacity planning and fleet strategy for our Inference Service organization. This is a highly visible role working directly with Engineering, Product, Infrastructure, SRE, Operations, and executive leadership to maximize utilization of one of the world's most advanced AI inference fleets. What you'll ownCapacity planning and forecasting. Build and maintain the 6 / 12 / 26-week rolling capacity model across every cluster. Work with product team to translate customer contracts and sales pipeline asks into capacity requirements. Forecast model replicas, system-hours, and spares by customer and by model. Reconcile against actuals weekly. Maintain the source-of-truth doc. New Datacenter Capacity bring-up. Collaborate with datacenter infrastructure and operations teams to support new datacenter bringup and ensure production readiness. Drive engineering efforts and related automation to ensure on-time and quality delivery. Allocation and cluster placement. Partner closely with the SRE and product team to run the weekly capacity review across different customers/models/clusters. Decide model placement and re-balancing: which customer tenants land where, which clusters absorb new launches, which freezes are in effect etc. Run the weekly capacity and utilization report for the Inference Service leadership. Post capacity allocation, drive downstream tasks w.r.t deploying models across the allocated capacity with SRE team. Drive capacity planning tool adoption. Partner with console engineering team to drive stakeholder adoption of the inhouse built capacity planning and allocation tool, including user acceptance testing, issue resolution, tracking changes, pilot testing and deployment. In general, Contribute to the continuous process improvement and development of internal capacity management tools. Incident tracking and postmortems. Proactively identify and mitigate capacity bottlenecks, risks, and dependencies. In case of any SLA drop due to capacity misallocations, drive related resolution and postmortem. Key ResponsibilitiesRun weekly capacity planning and daily capacity and deployment tracking with Engineering, product and operations team. Own fleet utilization reporting and forecastingDrive capacity planning for new customer deployments and major model launchesDrive continuous improvement and stakeholder adoption of new capacity management platformDrive org level strategic initiatives related to capacity expansion, improving fleet efficiency and maximizing effective utilization of available systemsLead planning around major infrastructure events including but not limited to new customer commits, new model releases, change to DC/cluster architecture, etc. that impacts capacity and fleet utilization. Update capacity plans and forecasts accordingly.Maintain Jira EPICs and Confluence pages related to capacity planning, reporting and change management to ensure execution transparency across teamsQualifications5+ years of TPM, technical program management, or product operations experience in cloud infrastructure, large-scale ML serving, or hyperscaler capacity planningExperience leading large cross-functional programs involving Engineering, Product, and OperationsComfort with the inference serving stack: model replicas, batching, prefill/decode, KV cache, accelerator schedulingStrong data fluency: SQL, Grafana, basic Python or Flux to pull your own numbers without waiting for an analystTrack record of running a recurring cross-functional ritual involving senior engineers and LTDirect experience with AI accelerator fleet operations such as Habana, TPU pods, Inferentia, TrainiumWhy Join CerebrasPeople who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:Build a breakthrough AI platform beyond the constraints of the GPU.Publish and open source their cutting-edge AI research.Work on one of the fastest AI supercomputers in the world.Enjoy job stability with startup vitality.Our simple, non-corporate work culture that respects individual beliefs.Find out more about what it's like to work at Cerebras here! Apply today and become part of the forefront of groundbreaking advancements in AI!Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.LocationSunnyvale, CA; Remote; Toronto, CANEmployment TypeFull timeLocation TypeHybridDepartmentSoftware Engineering

Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Sr./Staff TPM - Inference Capacity in Sunnyvale, CA vacancy
  •  ...seeking an experienced Technical Program Manager in Sunnyvale, California. In this role, you will oversee capacity planning and fleet strategy for the AI Inference Service organization, collaborating closely with teams across Engineering, Product, and Operations. Your responsibilities... 
    Senior

    Cerebras

    Sunnyvale, CA
    4 days ago
  • $160k - $265k

     ...This role will be based in Mountain View, CA.We are looking for a Sr Commodity Manager / NPI lead to drive sourcing strategy, cost...  ...footprint. In this role, you will collaborate closely with engineering, Capacity planning, finance, OxMs, and our global vendor ecosystem to... 
    Senior
    Contract work
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    2 days ago
  • CoreWeave is seeking a Technical Program Manager focused on Networking Capacity Delivery to own end-to-end data center network infrastructure programs. You will translate capacity forecasts into actionable requirements and lead cross-functional teams across Network Engineering... 
    Senior

    CoreWeave

    Sunnyvale, CA
    3 days ago
  • $169k

     ...experience in this always-on, high-tech, and hyper-connected world.Role OverviewWe are seeking a highly skilled and experienced Senior Staff Technical Program Manager to lead company-wide technically complex programs with high impact and urgency.Do you see building Tech... 
    Senior
    Temporary work

    Coupang

    Mountain View, CA
    14 hours ago
  •  ...at our Santa Clara, CA, headquarters 3 days per week.The role: Sr. Staff, ML Researcher - LLM Algorithmic OptimizationWhat You Will Do:...  ...algorithms that will be used to optimize large language model inference on DNN accelerators we develop. You would be part of a close-... 
    Senior
    3 days per week

    d-Matrix

    Santa Clara, CA
    3 days ago
  • Intuit is seeking a Sr Staff Technical Program Manager to drive AI-native planning for the Tech Ecosystem. You will partner with program managers, business operations and Finance to design processes and leadership mechanisms that inform senior leaders and shape C-suite... 
    Senior

    Intuit

    Mountain View, CA
    5 days ago
  • $230k - $250k

    Cerebras Systems in Sunnyvale, CA, seeks a Sr. Member of Technical Staff to develop resilient software for their AI chip. Responsibilities include designing robust software features, maintaining deployment workflows using AWS, and debugging software issues. Candidates should... 
    Senior
    Remote job

    Cerebras

    Sunnyvale, CA
    3 days ago
  • A global data and AI company is seeking a Senior Staff Technical Program Manager to lead Reliability initiatives within product engineering teams. This role requires over 10 years of experience in managing cloud infrastructure programs and driving improvements in reliability... 
    Senior
    Local area

    Databricks

    Mountain View, CA
    1 day ago
  • $189k - $210k

     ...computing with light! We are hiring a Sr Technical Program Manager (TPM) to drive program execution across...  ...Manage team-wide resource loading and capacity visibility, partnering with...  ...role is open to two different levels. Staff: $189,000 - $210,000 Sr Staff: $217,... 
    Senior
    Full time
    Contract work
    Temporary work
    Flexible hours
    Shift work

    Socket.dev

    Mountain View, CA
    2 days ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...inference.About the RoleWe're hiring a Staff Engineer to help lead, drive, and contribute...  ...improvements in latency, throughput, capacity efficiency, and resilience under unpredictable... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    11 hours ago
  • Intuit Inc. is seeking a Senior Staff Technical Program Manager within the Fintech PMO to drive multiple complex SaaS programs, align technical outcomes with business strategy, and deliver at scale across cross-functional teams. You will define repeatable program frameworks... 
    Senior

    Intuit Inc.

    Mountain View, CA
    5 days ago
  • $183k - $247.6k

     ...most advanced cloud for AI training and inference — where multi-billion-parameter models come...  ...while providing seemingly infinite capacity at the lowest possible cost for our customers...  ...with other employees, supervisors, and staff; adhere to standards of excellence... 
    Senior
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  •  ...Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...speed inference.About The RoleThe DC Delivery E2E TPM is the single-threaded owner for delivering data center capacity from forecast site strategy design construction... 
    Senior
    Contract work
    Remote work

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  •  ...and Forbes World's Best Banks. Visit our Institutional Page About the role We are looking for a Technical Program Manager (TPM) at the Senior Staff level to take ownership of our global identity frontier. At Nubank, a TPM is an Outcome Owner- an engineer at heart with... 
    Senior
    Work at office
    Local area
    Immediate start
    Worldwide
    Flexible hours

    Nubank

    Palo Alto, CA
    5 days ago
  •  ...our Santa Clara, CA, headquarters 3 days per week. The role: Sr. Staff, ML Researcher - LLM Algorithmic Optimization What You Will Do...  ...algorithms that will be used to optimize large language model inference on DNN accelerators we develop. You would be part of a close-knit... 
    Senior
    3 days per week

    Entrada Ventures

    Santa Clara, CA
    2 days ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ...fleet through self-service delivery, shared observability, capacity orchestration, rollout safety, and operational automation.... 
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    14 hours ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ...) with clear SLOs. Drive improvements in latency, throughput, capacity efficiency, and resilience under unpredictable demand. Code &... 

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • Databricks is seeking a Staff TPM to lead complex, cross-functional programs at their Mountain View location. This pivotal role involves defining program structures, aligning engineering and business teams, and ensuring successful product launches. Ideal candidates will... 

    Databricks

    Mountain View, CA
    4 days ago
  • $106.8k - $160k

     ...including direct experience managing the optics/optical technology supply base (e.g., supplier qualification, contract negotiation, capacity planning)Strong understanding of manufacturing processes and capacity planning specific to the optics industryExperience with... 
    Senior
    Permanent employment
    Full time
    Contract work
    Internship
    Work from home
    Worldwide

    Marvell

    Santa Clara, CA
    2 days ago
  • $165k - $265k

    At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.We...
    Senior
    3 days per week

    d-Matrix

    Santa Clara, CA
    3 days ago
  • $93.9k - $140.7k

     ...and enduring innovation, above and beyond fleeting trends, Marvell is a place to thrive, learn, and lead. Your Team, Your ImpactThe Sr. Staff Global Mobility and Immigration Specialist supports global mobility, U.S. immigration, and relocation programs to ensure... 
    Senior
    Permanent employment
    Full time
    Internship
    H1b
    Work from home
    Relocation

    Marvell

    Santa Clara, CA
    2 days ago
  • $139.6k - $225.78k

     ...relationships, and the kind of precision that drives great outcomes.Job SummaryJob SummaryWe are seeking a passionate and self-driven Sr. Staff Researcher to join our Cloud-Delivered Security Services team. In this role, you will be pivotal in developing and refining the... 
    Senior
    Full time
    Work experience placement
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    1 day ago
  • $168k - $258.75k

    We are seeking a Technical Program Manager to lead recurring capacity operations for large-scale AI infrastructure programs and support...  ...operations, workload bring-up, or large-scale AI training and inference environments.Experience with demand and supply roadmaps,... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $208k - $327.75k

     ...AI models and applications running on NVIDIA hardware. Every inference deployment — from a single-GPU workstation to a multi-thousand...  ...Server, or Dynamo. Production experience at scale counts too: capacity planning, autoscaling, SLA management, or stateful multi-turn... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $124.5k - $272k

     ...us on LinkedIn and Instagram.Positions are available at Senior Staff and above. Candidates are assessed individually and leveled according...  ...roleAs a Senior Staff Machine Learning Scientist, you own the inference and optimization layer that makes AI in agentic workflows fast,... 
    Senior

    Netskope

    Santa Clara, CA
    3 days ago
  • Garuda Ventures is seeking a Senior Staff Technical Program Manager to play a crucial role in the development of Mind Robotics' core platform. This role involves leading program management across hardware, software, and data collection teams to ensure efficiency from prototype... 
    Senior

    Garuda Ventures

    Palo Alto, CA
    4 days ago
  • $184k - $287.5k

     ...application is built. We are seeking a Senior Software Engineer - AI Inference Performance to advance innovative LLM and VLM inference. You...  ...-end latency, processing efficiency, and key-value (KV) cache capacity. For multimodal models, isolate preprocessing, encoder, and... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $144k - $230k

     ...ambitious team driving digital transformation at NVIDIA? As a Sr. Staff Business Systems Analyst, you will play a pivotal role in crafting...  ....Outstanding analytical and systems thinking skills, with the capacity to synthesize complex information, recognize patterns and root... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $212k - $340k

     ...products; spanning software, hardware, and services.As a Senior Staff Security Product Architect, you will serve as a primary technical...  ...cryptographic key management, and hardware security module (HSM/TPM) integrations and secure protocols to protect data at rest, in transit... 
    Senior
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week

    Aurora Innovation

    Mountain View, CA
    2 days ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ..., reviewable, and safe.Improve infrastructure reliability, capacity, performance, cost efficiency, monitoring, and operational... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr./Staff TPM - Inference Capacity. Be the first to apply!