Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr./Staff TPM - Inference Capacity

Cerebras Systems

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.About the roleAs demand for AI continues to accelerate, intelligent capacity management becomes one of the company's most strategic challenges. Every customer commitment, model launch, and infrastructure investment depends on making the right capacity decisions at the right time. We're looking for an experienced Technical Program Manager to lead capacity planning and fleet strategy for our Inference Service organization. This is a highly visible role working directly with Engineering, Product, Infrastructure, SRE, Operations, and executive leadership to maximize utilization of one of the world's most advanced AI inference fleets. What you'll ownCapacity planning and forecasting. Build and maintain the 6 / 12 / 26-week rolling capacity model across every cluster. Work with product team to translate customer contracts and sales pipeline asks into capacity requirements. Forecast model replicas, system-hours, and spares by customer and by model. Reconcile against actuals weekly. Maintain the source-of-truth doc. New Datacenter Capacity bring-up. Collaborate with datacenter infrastructure and operations teams to support new datacenter bringup and ensure production readiness. Drive engineering efforts and related automation to ensure on-time and quality delivery. Allocation and cluster placement. Partner closely with the SRE and product team to run the weekly capacity review across different customers/models/clusters. Decide model placement and re-balancing: which customer tenants land where, which clusters absorb new launches, which freezes are in effect etc. Run the weekly capacity and utilization report for the Inference Service leadership. Post capacity allocation, drive downstream tasks w.r.t deploying models across the allocated capacity with SRE team. Drive capacity planning tool adoption. Partner with console engineering team to drive stakeholder adoption of the inhouse built capacity planning and allocation tool, including user acceptance testing, issue resolution, tracking changes, pilot testing and deployment. In general, Contribute to the continuous process improvement and development of internal capacity management tools. Incident tracking and postmortems. Proactively identify and mitigate capacity bottlenecks, risks, and dependencies. In case of any SLA drop due to capacity misallocations, drive related resolution and postmortem. Key ResponsibilitiesRun weekly capacity planning and daily capacity and deployment tracking with Engineering, product and operations team. Own fleet utilization reporting and forecastingDrive capacity planning for new customer deployments and major model launchesDrive continuous improvement and stakeholder adoption of new capacity management platformDrive org level strategic initiatives related to capacity expansion, improving fleet efficiency and maximizing effective utilization of available systemsLead planning around major infrastructure events including but not limited to new customer commits, new model releases, change to DC/cluster architecture, etc. that impacts capacity and fleet utilization. Update capacity plans and forecasts accordingly.Maintain Jira EPICs and Confluence pages related to capacity planning, reporting and change management to ensure execution transparency across teamsQualifications5+ years of TPM, technical program management, or product operations experience in cloud infrastructure, large-scale ML serving, or hyperscaler capacity planningExperience leading large cross-functional programs involving Engineering, Product, and OperationsComfort with the inference serving stack: model replicas, batching, prefill/decode, KV cache, accelerator schedulingStrong data fluency: SQL, Grafana, basic Python or Flux to pull your own numbers without waiting for an analystTrack record of running a recurring cross-functional ritual involving senior engineers and LTDirect experience with AI accelerator fleet operations such as Habana, TPU pods, Inferentia, TrainiumWhy Join CerebrasPeople who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:Build a breakthrough AI platform beyond the constraints of the GPU.Publish and open source their cutting-edge AI research.Work on one of the fastest AI supercomputers in the world.Enjoy job stability with startup vitality.Our simple, non-corporate work culture that respects individual beliefs.Find out more about what it's like to work at Cerebras here! Apply today and become part of the forefront of groundbreaking advancements in AI!Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.LocationSunnyvale, CA; Remote; Toronto, CANEmployment TypeFull timeLocation TypeHybridDepartmentSoftware Engineering

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Sr./Staff TPM - Inference Capacity in Sunnyvale, CA vacancy
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...high-speed inference.About the RoleAs a Staff GPU Inference SDET, you will be the founding...  ...throughput, tail latency (P99), and capacity efficiency. Numerical Correctness & Quality... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $160k - $265k

     ...This role will be based in Mountain View, CA.We are looking for a Sr Commodity Manager / NPI lead to drive sourcing strategy, cost...  ...footprint. In this role, you will collaborate closely with engineering, Capacity planning, finance, OxMs, and our global vendor ecosystem to... 
    Senior
    Contract work
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    11 hours ago
  • $175k - $265k

     ...possibilities of AI. Role Overviewd-Matrix is seeking a Senior Staff ML Researcher to join our Algorithms team and develop new methods...  ..., and implement algorithmic techniques that improve LLM inference performance while preserving model quality, with a focus on challenges... 
    Senior

    d-Matrix

    Santa Clara, CA
    11 hours ago
  • $175k - $275k

     ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...with ultra high-speed inference.Senior Staff AI Accelerator Performance ArchitectWafer...  ...space in which compute placement, memory capacity and bandwidth, communication, kernel execution... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $106.8k - $160k

     ...corrective actions to achieve target goalsWhat We're Looking For• Minimum 15 years of relevant experience with 5 years in a managerial capacity, preferably in the Semiconductor industry.• BS/BA in Business Administration, Engineering, Finance, or Operations. MBA/MS... 
    Senior
    Permanent employment
    Full time
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    1 day ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...inference.About the RoleWe're hiring a Staff Engineer to help lead, drive, and contribute...  ...improvements in latency, throughput, capacity efficiency, and resilience under unpredictable... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ...fleet through self-service delivery, shared observability, capacity orchestration, rollout safety, and operational automation.... 
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ...) with clear SLOs. Drive improvements in latency, throughput, capacity efficiency, and resilience under unpredictable demand. Code &... 

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $189k - $274k

     ...make mobility more efficient and accessible for all.The Senior Staff Technical Lead Manager (TLM) for Hardware Test Infrastructure leads...  ...chain, purchasing, and hardware design teams to align on capacity planning, test rack design, and component procurement.Root Cause... 
    Senior
    For contractors
    Work at office
    Local area
    Shift work
    3 days per week

    Aurora Innovation

    Mountain View, CA
    1 day ago
  • $127.63k - $191.2k

    About Marvell Marvell’s semiconductor solutions are the essential building blocks of the data infrastructure that connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is enabling new possibilities. At Marvell, you can...
    Senior
    Permanent employment
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    3 days ago
  • $106.8k - $160k

     ...including direct experience managing the optics/optical technology supply base (e.g., supplier qualification, contract negotiation, capacity planning)Strong understanding of manufacturing processes and capacity planning specific to the optics industryExperience with... 
    Senior
    Permanent employment
    Full time
    Contract work
    Internship
    Work from home
    Worldwide

    Marvell

    Santa Clara, CA
    4 days ago
  • $208k - $327.75k

     ...for NVIDIA employees and DSX Partners. As a Product Manager for Inference Platform, you will help define and drive the products and...  ...strategy for inference platform capabilities — including APIs, capacity management, cost management, performance and optimization, and... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $165k - $265k

     ...come find your playground? Together, we can help shape the endless possibilities of AI. Role Overviewd-Matrix is looking for a Senior Staff Power Performance Architect to own pre-silicon power estimation across our next-generation AI accelerators. In this role, you will... 
    Senior

    d-Matrix

    Santa Clara, CA
    11 hours ago
  • $183k - $247.6k

     ...largest fleet of GPU-accelerated servers powering AI/ML training and inference at cloud scale. Our team defines the server architectures,...  ...and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions... 
    Senior
    Local area
    Worldwide
    Flexible hours
    Day shift

    Amazon

    Cupertino, CA
    2 days ago
  • $208k - $327.75k

     ...AI models and applications running on NVIDIA hardware. Every inference deployment — from a single-GPU workstation to a multi-thousand...  ...Server, or Dynamo. Production experience at scale counts too: capacity planning, autoscaling, SLA management, or stateful multi-turn... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $139.6k - $225.78k

     ...relationships, and the kind of precision that drives great outcomes.Job SummaryJob SummaryWe are seeking a passionate and self-driven Sr. Staff Researcher to join our Cloud-Delivered Security Services team. In this role, you will be pivotal in developing and refining the... 
    Senior
    Full time
    Work experience placement
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Santa Clara, CA
    3 days ago
  • $124.5k - $272k

     ...us on LinkedIn and Instagram.Positions are available at Senior Staff and above. Candidates are assessed individually and leveled according...  ...roleAs a Senior Staff Machine Learning Scientist, you own the inference and optimization layer that makes AI in agentic workflows fast,... 
    Senior

    Netskope

    Santa Clara, CA
    11 hours ago
  • $184k - $287.5k

     ...application is built. We are seeking a Senior Software Engineer - AI Inference Performance to advance innovative LLM and VLM inference. You...  ...-end latency, processing efficiency, and key-value (KV) cache capacity. For multimodal models, isolate preprocessing, encoder, and... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • Company DescriptionIt started with a simple idea: what if surgery could be less invasive and recovery less painful? Nearly 30 years later, that question still fuels everything we do at Intuitive. As a global leader in robotic-assisted surgery and minimally invasive care...
    Senior
    Work at office
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    11 hours ago
  • $212k - $340k

     ...products; spanning software, hardware, and services.As a Senior Staff Security Product Architect, you will serve as a primary technical...  ...cryptographic key management, and hardware security module (HSM/TPM) integrations and secure protocols to protect data at rest, in transit... 
    Senior
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week

    Aurora Innovation

    Mountain View, CA
    4 days ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ..., reviewable, and safe.Improve infrastructure reliability, capacity, performance, cost efficiency, monitoring, and operational... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  •  ...the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  •  ...Intuit, Inc. is seeking a Principal Technical Program Manager (TPM) to lead the most critical, high-impact technical initiatives in the t4i team. You will drive programs at the intersection of technology, strategy, and execution with AI-enabled insights to accelerate... 

    Jobleads-US

    Mountain View, CA
    2 days ago
  • Qualcomm in Santa Clara, CA, seeks a Lead Server Product Architect to define the architecture of a high-performance, energy-efficient server SoC. You will collaborate with chip and platform teams to shape product roadmaps, KPIs, and architectural decisions for datacenter...
    Senior

    Jobleads-US

    Santa Clara, CA
    3 days ago
  • $193.3k - $261.5k

     ...models to run really fast on the Trainium hardware.As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize...  ...cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    4 days ago
  • $193.3k - $261.5k

     ...looking for an engineer to work at the frontier of disaggregated inference: splitting LLM serving into separate prefill and decode pools...  ...safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $193.3k - $261.5k

     ...popular ML frameworks like PyTorch and JAX enabling unparalleled ML inference and training performance.The High-Performance Inference Systems...  ...and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions... 
    Senior
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  •  ...Location:Hybrid, working onsite at our Santa Clara, CA, headquarters 3 days per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat you will do:The role requires you to be part of the team that helps productize the SW stack for our AI compute... 
    3 days per week

    d-Matrix

    Santa Clara, CA
    4 days ago
  •  ...NVIDIA Corporation is seeking a Senior Product Manager to lead Switchyard, our adaptive inference runtime for models and runtimes. You will drive strategy, work with engineers and researchers, and translate research advances into scalable developer products. You will... 
    Senior

    Jobleads-US

    Santa Clara, CA
    2 days ago
  •  ...NVIDIA Corporation is hiring a Solutions Architect focused on AI inference to design and deploy scalable inference pipelines on Kubernetes and GPU clusters. You will collaborate with engineering and customer teams to deliver enterprise AI solutions and production-grade... 
    Senior

    Jobleads-US

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr./Staff TPM - Inference Capacity. Be the first to apply!