Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technical Program Manager, InferenceNew

Full-time

Anthropic

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

Anthropic’s Inference organization serves Claude to millions of users and enterprise customers, across our own products and the world’s largest cloud platforms, with the speed, reliability, and efficiency that frontier AI demands. The stack that makes this possible is deep and tightly coupled: accelerator kernels, an in-house inference engine that manages the entire token path for both production and research workloads, distributed routing, autoscaling, and capacity management. Every layer affects the others, often in ways that are hard to see in isolation. We build across GPUs, TPUs, and Trainium, and the complexity of building, testing, and shipping inference software grows with every platform we add. We're looking for a Technical Program Manager to drive the programs that scale it. The work spans four closely coupled areas:
  • Scaling and infrastructure. Routing, autoscaling, and capacity management for the serving fleet, and bringing new capacity online.
  • Velocity. The toolchains, development environments, and CI/CD that let inference engineers build, test, and ship across every accelerator platform.
  • Inference engine. The software between the accelerator kernels and the routing layer that serves every request.
  • Performance. Improving throughput, latency, cost, and reliability across the stack, with correctness treated as part of performance.
This is not a status-tracking role. You'll own outcomes end to end, often where no single team is accountable for the whole picture. Much of your value comes from crossing boundaries into Research, Safeguards, Security, Compute, Infrastructure, API, and our cloud and silicon partners, and bringing back the requirements and dependencies that no team sees from inside its own space. There is little process to inherit, and we want to keep it that way: you'll build the minimum machinery the work needs and remove it when it stops helping. And because this is Anthropic, you'll have Claude as a collaborator. We expect TPMs on this team to push hard on what AI-assisted program management and fleet operations can look like.

Key responsibilities

  • Own the programs that scale Claude’s serving fleet across accelerator and cloud platforms, from early direction through delivery.
  • Drive new capacity online end to end, working across compute, infrastructure, security, networking, and inference teams so one person is accountable for the whole path.
  • Build visibility into supply, demand, and utilization with capacity and finance partners, and drive trade-offs among utilization, cost, latency, and reliability to a clear decision.
  • Lead reliability programs and large migrations without disrupting production traffic or research, and make sure incident follow-ups land in team roadmaps.
  • Drive the programs that make inference engineers faster: define the productivity metrics that matter, find the bottlenecks, and improve how software is built, tested, and released across platforms, in step with Anthropic’s central Infrastructure org.
  • Coordinate roadmaps and priorities across the production, research, and safeguards needs that depend on the same teams.
  • Track performance and efficiency work from opportunity to measured impact in production, with correctness held as a release criterion.
  • Own inference readiness for model launches alongside our launch TPMs.

Minimum qualifications

  • 7+ years of experience as a TPM, or in an equivalent engineering or SRE lead role, owning large multi-team infrastructure programs end to end in production distributed systems, ML infrastructure, or cloud platforms. You can speak to the outcomes in detail, including where a program slipped and what you did about it.
  • Technical fluency in large-scale serving infrastructure, including request routing and load balancing, autoscaling, capacity planning, cluster orchestration, deployment and rollout, and observability. You know enough to challenge a design, find the real risk, and add value beyond tracking.
  • A working understanding of how LLM inference uses hardware (prefill and decode, batching, caching, compute versus memory bandwidth versus interconnect), or a track record of getting deep in an unfamiliar technical domain quickly.
  • A track record of building program mechanisms from scratch on ambiguous, fast-moving efforts, and of retiring process that has stopped earning its keep.
  • The ability to drive outcomes across organizations you don't manage, with competing priorities and unclear decision ownership. You read people and rooms well, know when to push and when to listen, and earn the trust of senior engineers and researchers.
  • Strong written communication, including plans, reviews, and executive updates that many teams depend on.
  • Low ego and high ownership. You do whatever the program needs, whether that is writing a script, running an incident bridge, or chasing a quota, and you care more about the outcome than about scope or credit.
  • Care about Anthropic's mission and about serving frontier AI safely and reliably.

Preferred qualifications

  • Direct experience with LLM or ML inference serving at scale, such as model servers, batching and scheduling, KV caching, quantization, speculative decoding, or multi-model routing.
  • Experience with accelerator infrastructure (GPU, TPU, or Trainium), including cluster bring-up, hardware qualification, or running one workload across more than one accelerator platform.
  • Experience managing capacity across multiple clouds or regions, including demand forecasting, headroom policy, cost modeling, or unit economics for compute-heavy services.
  • Experience with developer productivity, release engineering, or CI/CD at scale, especially for hardware-dependent workloads, and with using engineering metrics to measurably raise velocity.
  • Experience running performance or efficiency programs, with enough grounding in rooflines, kernels, ML compilers (XLA, Triton, Neuron), numerics, or collective communication to reason about trade-offs with the engineers doing the work.
  • Familiarity with Kubernetes-based orchestration and job scheduling.
  • Experience working with research teams and turning their needs into infrastructure requirements.
  • Practical experience using AI tools in your own workflow, including building automations or agents, and clear ideas about where they help and where they don't.

Logistics

Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit [anthropic.com/careers]( directly for confirmed position openings.

How we're different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about [our policy]( for using AI in our application process.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file. As set forth in Anthropic’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law. If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows: A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability. A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service. An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense. An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Technical Program Manager, InferenceNew in Seattle, WA vacancy
  • $55 - $65 per hour

     ...Title: Technical Program Manager Location: Onsite Bellevue, WA Duration: 6 months Compensation: $55-65/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. We are seeking an experienced Technical Program Manager (TPM) to lead... 
    Suggested
    Local area
    Immediate start
    Flexible hours

    INSPYR Solutions

    Bellevue, WA
    12 hours ago
  •  ...Job Title: Technical Program Manager – Hardware Accessories Duration: 12 Months (Potential for extension) Location: Seattle, WA Work Arrangement: Hybrid – 3 days onsite per week. This is an innovative program focused on creating a world-class hardware licensing... 
    Suggested
    3 days per week

    SPECTRAFORCE

    Seattle, WA
    9 days ago
  • $70 - $75 per hour

     ...181072 Job Description: As a Technical Compliance Specialist, candidates will work...  ...on building and supporting a compliance program for client Product Design and Marketing...  ...years of experience in program or project management, ideally in privacy, security, or data... 
    Suggested
    Full time
    Remote work
    Worldwide

    Pinnacle Group

    Seattle, WA
    3 days ago
  • $144k - $216k

     ...customers, and their customers, better. And it means we prioritize a diverse F5 community where each individual can thrive. Technical Program Manager Role Summary The Technical Program Manager (TPM) leads complex, cross-functional, and often cross-organizational... 
    Suggested
    Local area

    F5

    Seattle, WA
    1 hour ago
  • $148.7k - $201.2k

     ...Description Employer: Amazon Web Services, Inc. Position: Technical Program Manager III - AMZ27045.1 Location: Seattle, WA Multiple Positions Available: Coordinate and manage technical project and program development of large-scale, distributed software applications... 
    Suggested
    Relocation package

    Amazon

    Seattle, WA
    4 days ago
  •  ...Principal Technical Program Manager The Strategic Customers Engineering organization within Oracle Cloud Infrastructure (OCI) sits at the center of the fastest-growing and most technically demanding part of the cloud: building at scale for the world's leading AI innovators... 
    Temporary work
    Flexible hours

    Oracle

    Seattle, WA
    2 days ago
  •  ...Technical Program Manager (Java Microservices & AWS) | Seattle, WA We're actively hiring a Technical Program Manager to lead large-scale application modernization and enterprise payment transformation initiatives for a leading client. Location: Seattle, WA... 
    3 days per week

    SIMARN Solutions

    Seattle, WA
    9 days ago
  •  ...Technical Program Manager I Location: Seattle Hybrid Duration: 12 months with possible extension Partner with the Industrial Design, Color Material Finish, Product Design Engineering teams to enable the definition and execution of next generation hardware products... 

    Infotech Sourcing

    Seattle, WA
    1 day ago
  •  ...including geographical location, experience, knowledge, skills, and abilities of the applicant. This role serves as a Sr. Technical Program Manager (TPM) in charge of handling program management aspects of one or more designated product teams for Virtuoso software products... 

    Digitailor

    Renton, WA
    2 days ago
  •  ...Overview: Must Have Technical/Functional Skills • Proven experience delivering SAP S/4HANA implementations...  ...integration landscapes • Experience managing large, multi vendor, multi geography SAP S4 HANA programs • Excellent communication and stakeholder management... 
    Contract work

    Trans.eu

    Seattle, WA
    3 days ago
  • $151.71k - $242.74k

     ...change. Constantly grow as you work hard for a mission that matters at a company where you matter. Your Impact As a Technical Program Manager, you will leverage your leadership skills and expertise to partner with engineering and product management teams to drive... 
    Work experience placement
    Work at office
    Remote work

    Axon

    Seattle, WA
    2 days ago
  • $148.7k - $201.2k

     ...Ring is looking for a Sr. Technical Program Manager to deliver cross-functional programs and lead the growth of business across multiple sales channels & geographies. In this role, you will be a highly visible leader that will own the communication, coordination, and execution... 
    Flexible hours

    Amazon

    Bellevue, WA
    1 hour ago
  •  ...Senior Technical Program Manager AeroVect is transforming ground handling with autonomy, redefining how airlines and ground service providers around the globe run day-to-day operations. We are a Series A company backed by top-tier venture capital investors in aviation... 

    AeroVect

    Seattle, WA
    2 days ago
  •  ...Technical Trainer & Program Manager Location: Hybrid/ Remote / Seattle, WA Preferred Employment Type: Contract Role Overview SkillUp is seeking a highly motivated Technical Trainer & Program Manager who can combine technical training expertise with program... 
    Contract work
    Remote work

    SkillUp Online

    Seattle, WA
    12 days ago
  • $131.25k - $210k

     ...change. Constantly grow as you work hard for a mission that matters at a company where you matter. Your impact Senior Technical Program Manager, Axon Vision. A \"startup\" within Axon turning live video streams into intelligent, real-time sensors across public... 
    For contractors
    Work experience placement

    Axon Enterprise

    Seattle, WA
    4 days ago
  •  ...retirement plan, disability coverage, EAP (Employee Assistance Program), life insurance, health insurance, paid vacation and sick...  ...organizations operate, we believe the role of the Senior Technical Program Manager must evolve beyond coordination and reporting into a... 
    Work at office

    Biblioso Corporation

    Seattle, WA
    8 days ago
  • $182k - $242k

     ...CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into...  ...at extraordinary speed. We are seeking a Senior Technical Program Manager to lead the delivery of our compute fleet—the GPU and CPU infrastructure... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    8 days ago
  •  ...Technical Program Manager With Microsoft Dynamics 365 Location: Bellevue, WA (Onsite) Fulltime Required Skills & Experience Core Experience 10+ years of IT experience with 5+ years in Technical Program / Engineering Program Management. Hands-on experience... 
    Full time

    Ace Stack

    Bellevue, WA
    12 hours ago
  • $145.19k - $203.26k

     ...Technical Program Manager At Blue Origin, we envision millions of people living and working in space for the benefit of Earth. We're working to develop reusable, safe, and low-cost space vehicles and systems within a culture of safety, collaboration, and inclusion.... 
    Permanent employment
    Temporary work
    Work at office
    Shift work

    Blue Origin

    Seattle, WA
    2 hours ago
  •  ...Senior Technical Product/Program Manager We're looking for a Senior Technical Product/Program Manager to own a portfolio of business-facing products and programs end to end: shaping what each one should do and for whom, driving its design and delivery with engineering... 

    AWS

    Seattle, WA
    2 hours ago
  • $157k - $210k

     ...Sr. Technical Program Manager CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups,... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    2 days ago
  •  ...Job Description Job Description Job title: Technical Program Manager Work Location with Zip code: Seattle, WA 98101 - Hybrid Duration of the project: 12 Months Would you require the candidates to meet you for an in-person interview?: Should be open for both... 

    Diverse Lynx

    Seattle, WA
    21 days ago
  • $218.88k - $328.32k

     ...information, visit  Follow Shield AI on LinkedIn, X, Instagram, and YouTube.  Job Description: Shield AI is seeking a Senior Technical Program Manager to lead execution within the XBAT organization. This role is responsible for driving cross-functional integration,... 
    Full time
    Temporary work
    Part time
    Worldwide

    Shield

    Seattle, WA
    3 days ago
  •  ...years of experience to lead large-scale application development and modernization programs using Java Microservices and AWS. The role involves driving delivery, stakeholder management, solution alignment, team coordination, and successful execution of cloud-native initiatives... 
    Permanent employment
    Work at office
    Local area

    Danta Technologies

    Seattle, WA
    21 days ago
  •  ...Job Description Job Description Title: Technical Program Manager Location: Seattle, WA Job Type: Long Term Contract Job Details: Tech PM with 10 years of experience to lead large-scale application development and modernization programs using Java Microservices... 
    Long term contract

    Diverse Lynx

    Seattle, WA
    21 days ago
  • $157k - $210k

     ...Senior Technical Program Manager Fleet Operations & Reliability CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    3 days ago
  • $204.3k - $266.73k

     ...Principal Technical Program Manager We are seeking a Principal Technical Program Manager to drive technical strategy, infrastructure planning, and cross-functional execution across our LLM inference platform. In this role, you will lead end-to-end programs spanning... 
    Work at office
    Local area

    Atlassian

    Seattle, WA
    2 days ago
  • (USA) Principal, Technical Program Manager Multiple locations Regular/ Permanent Salaried Position Summary... What you'll do... Role summary: The Principal, Technical Program Manager leads the planning and execution of complex, large-scale technical programs... 
    Permanent employment

    Walmart

    Bellevue, WA
    3 days ago
  • $207k - $331.2k

     ...grow as you work hard for a mission that matters at a company where you matter. Your Impact As a Senior Principal Technical Program Manager on the Real-Time Operations team, you will lead some of Axon's most complex, ambiguous and high-risk programs across R&D and... 
    Temporary work
    Work experience placement
    Immediate start

    Axon

    Seattle, WA
    1 hour ago
  • $157k - $210k

     ...CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into...  ...across every function. We're looking for a Technical Program Manager to join the CIO organization and drive programs that connect... 
    Full time
    Temporary work
    Casual work
    Work at office
    Immediate start
    Flexible hours

    CoreWeave

    Bellevue, WA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technical Program Manager, InferenceNew. Be the first to apply!