Technical Program Manager, InferenceNew
Anthropic
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
Anthropic’s Inference organization serves Claude to millions of users and enterprise customers, across our own products and the world’s largest cloud platforms, with the speed, reliability, and efficiency that frontier AI demands. The stack that makes this possible is deep and tightly coupled: accelerator kernels, an in-house inference engine that manages the entire token path for both production and research workloads, distributed routing, autoscaling, and capacity management. Every layer affects the others, often in ways that are hard to see in isolation. We build across GPUs, TPUs, and Trainium, and the complexity of building, testing, and shipping inference software grows with every platform we add. We're looking for a Technical Program Manager to drive the programs that scale it. The work spans four closely coupled areas:- Scaling and infrastructure. Routing, autoscaling, and capacity management for the serving fleet, and bringing new capacity online.
- Velocity. The toolchains, development environments, and CI/CD that let inference engineers build, test, and ship across every accelerator platform.
- Inference engine. The software between the accelerator kernels and the routing layer that serves every request.
- Performance. Improving throughput, latency, cost, and reliability across the stack, with correctness treated as part of performance.
Key responsibilities
- Own the programs that scale Claude’s serving fleet across accelerator and cloud platforms, from early direction through delivery.
- Drive new capacity online end to end, working across compute, infrastructure, security, networking, and inference teams so one person is accountable for the whole path.
- Build visibility into supply, demand, and utilization with capacity and finance partners, and drive trade-offs among utilization, cost, latency, and reliability to a clear decision.
- Lead reliability programs and large migrations without disrupting production traffic or research, and make sure incident follow-ups land in team roadmaps.
- Drive the programs that make inference engineers faster: define the productivity metrics that matter, find the bottlenecks, and improve how software is built, tested, and released across platforms, in step with Anthropic’s central Infrastructure org.
- Coordinate roadmaps and priorities across the production, research, and safeguards needs that depend on the same teams.
- Track performance and efficiency work from opportunity to measured impact in production, with correctness held as a release criterion.
- Own inference readiness for model launches alongside our launch TPMs.
Minimum qualifications
- 7+ years of experience as a TPM, or in an equivalent engineering or SRE lead role, owning large multi-team infrastructure programs end to end in production distributed systems, ML infrastructure, or cloud platforms. You can speak to the outcomes in detail, including where a program slipped and what you did about it.
- Technical fluency in large-scale serving infrastructure, including request routing and load balancing, autoscaling, capacity planning, cluster orchestration, deployment and rollout, and observability. You know enough to challenge a design, find the real risk, and add value beyond tracking.
- A working understanding of how LLM inference uses hardware (prefill and decode, batching, caching, compute versus memory bandwidth versus interconnect), or a track record of getting deep in an unfamiliar technical domain quickly.
- A track record of building program mechanisms from scratch on ambiguous, fast-moving efforts, and of retiring process that has stopped earning its keep.
- The ability to drive outcomes across organizations you don't manage, with competing priorities and unclear decision ownership. You read people and rooms well, know when to push and when to listen, and earn the trust of senior engineers and researchers.
- Strong written communication, including plans, reviews, and executive updates that many teams depend on.
- Low ego and high ownership. You do whatever the program needs, whether that is writing a script, running an incident bridge, or chasing a quota, and you care more about the outcome than about scope or credit.
- Care about Anthropic's mission and about serving frontier AI safely and reliably.
Preferred qualifications
- Direct experience with LLM or ML inference serving at scale, such as model servers, batching and scheduling, KV caching, quantization, speculative decoding, or multi-model routing.
- Experience with accelerator infrastructure (GPU, TPU, or Trainium), including cluster bring-up, hardware qualification, or running one workload across more than one accelerator platform.
- Experience managing capacity across multiple clouds or regions, including demand forecasting, headroom policy, cost modeling, or unit economics for compute-heavy services.
- Experience with developer productivity, release engineering, or CI/CD at scale, especially for hardware-dependent workloads, and with using engineering metrics to measurably raise velocity.
- Experience running performance or efficiency programs, with enough grounding in rooflines, kernels, ML compilers (XLA, Triton, Neuron), numerics, or collective communication to reason about trade-offs with the engineers doing the work.
- Familiarity with Kubernetes-based orchestration and job scheduling.
- Experience working with research teams and turning their needs into infrastructure requirements.
- Practical experience using AI tools in your own workflow, including building automations or agents, and clear ideas about where they help and where they don't.
Logistics
Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit [anthropic.com/careers]( directly for confirmed position openings.How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about [our policy]( for using AI in our application process.Voluntary Self-Identification
For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file. As set forth in Anthropic’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law. If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows: A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability. A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service. An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense. An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.$140k - $200k
...the first time ever, safety, operations and finance teams can manage their drivers, vehicles, equipment, and fleet related spend... ...sector.Visit gomotive.com to learn more.About the RoleAs a Senior Technical Program Manager on Motive’s embedded Technical Program Management (...SuggestedTemporary workWork experience placement- ...software, payment processing, device fleet management, and hardware. Our hardware portfolio... ...someone who can connect customer needs, technical constraints, business strategy, and execution... ....Responsibilities Independently define programs across Terminal including scoping,...SuggestedLocal area
$200k - $270k
...business’s system of record to making and managing AI agents to automating away the busy... ...design leaders at Notion to help run the programs and operating rhythms that keep EPD focused... ...outcomeForge strong partnerships with technical and business leaders across the company,...SuggestedLocal area$116k - $148k
We are seeking a motivated and experienced Technical Program Manager to join Datadog’s Technical Solutions organization. This organization is made up of 1,200+ customer-facing technical experts around the world — including Sales Engineers, Technical Account Managers, Support...SuggestedWork at office- RESPONSIBILITIES: Kforce has a client that is seeking a Senior Technical Program Manager in San Francisco, CA. Summary: The Technical Program Manager will be a key member of the Enterprise Program Management team responsible for managing a portfolio of projects...SuggestedHourly payContract work
- ...research and communication that help people understand how quickly AI is progressing and what that could mean. We're hiring a Technical Program Manager to run Pacing. It spans many projects led by people across Safety, Research, Policy, Legal, Communications, and...Full timeFor contractorsWork at officeLocal areaVisa sponsorshipFlexible hours
$80.5 - $90 per hour
...culture, deliver the technology they need to increase their velocity and impact. We're seeking an experienced Senior TechOps Program Manager / Technical Program Manager to drive Finance Technology related initiatives.. The ideal candidate will partner cross-functionally...Hourly payFull timeFor contractorsLocal areaFlexible hours$145k - $185k
...Astranis designs, builds, and operates its satellites out of its 153,000 sq. ft. headquarters in Northern California, USA. Technical Program Manager, USG Space Relays Astranis is developing the next generation relay capability for the USG Government delivering Ka-band...Permanent employmentFlexible hours- ...If you’re looking for something easier –this isn’t it. The Role We are looking for a passionate Hardware Engineering Program Manager who will help lead the development of new and innovative products. This role is based out of our San Francisco Office 5 days...Full timeWork at officeImmediate startWorldwideFlexible hours
- ...coupled: accelerator kernels, an in-house inference engine that manages the entire token path for both production and research... ...software grows with every platform we add. We're looking for a Technical Program Manager to drive the programs that scale it. The work spans four...
$150k - $280k
...team in San Francisco. You are highly technical - regardless of the role you are in. We... ...the vision and strategy of our vehicle program, working directly with engineering leadership... ...technical leadership (TPM, engineering management, or equivalent) on complex...$207k - $285k
Technical Program Manager, Capacity Analytics & Tooling Technical Program Management - San Francisco About the Team The Compute Infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting...Work at officeLocal areaRelocation packageFlexible hours- ...to bring modern AI into regulated industries where precision, reliability, and performance matter. The Role We’re hiring a Technical Program Manager to help scale Taylor, our flagship product, as we launch with new customers - from large lenders to smaller institutions....Full timeWork at office
$56.66 - $66.66 per hour
...work qualifications: Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience. 5+ years of experience in Technical Program Management, managing complex, cross-functional software development programs....Hourly payContract workTemporary workWork experience placementLocal areaRemote work- ...both in and out of the office. Oura is looking for a Packaging Program Manager to lead the development and delivery of packaging across new... ...Chain, Quality, Regulatory, Creative, and Marketing to align technical, business, and brand requirements.Translate product,...Contract workWork at officeLocal areaRemote workFlexible hours
$164k - $210k
...models, better models power more useful products, and what we learn from people using those products shapes what we build next.TECHNICAL PROGRAM MANAGER, FIELDWe're looking for our first Technical Program Manager to work with our largest enterprise customers and help them...Temporary work$165k - $210k
Candid Health is looking for a Technical Program Manager - Implementation to serve as the connective tissue between our Engineering, Product, and Operations teams. This is a high-impact role designed for someone who thrives on organization and can navigate the complexities...Work at officeRemote workShift work$163k - $236k
...understand or identify defined work problems and program goals, obtain prioritized deliverables,... ...of projects and develop, execute, or manage project plans for supported programs.... ...qualifications:Bachelor's degree in a technical field, or equivalent practical experience...$148k - $185k
...thrive.Lyft connects people to transportation to change the way we live and get around our communities. We are looking for Technical Program Managers who bring exceptional technical and analytical skills to drive execution. Come be part of a team at Lyft focused on...Hourly payWork at officeLocal area3 days per week$80 - $90 per hour
DescriptionKforce has a client in San Francisco, CA that is seeking an experienced Technical Program Manager - GTM Partnerships. The Technical Program Manager will help drive the Go to Market and product strategy, enabling us to execute quickly and scale the program to...$165k - $210k
The RoleAt Candid Health, we’re searching for a Platform Technical Program Manager (TPM) to drive operational strategy alongside engineering and product leadership. As a dedicated partner embedded within our Platform Engineering team, you will own the team's long-term roadmap...Temporary workWork at officeRemote work- ...Job title: Senior Technical Program Manager HYBRID ONSITE- SAN FRANCISCO, CA ****looking for a TPM to manage the marketing / technology portfolio and a series of marketing / tech projects.**** MUST HAVE EXCELLENT COMMS SKILLS!!!!! Fanatical drive...Full time
$159k - $196k
...autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states. Waymo’s Technical Program Managers and Program Managers are accountable for Waymo’s roadmap execution by providing thoughtful cross-functional planning,...Full timeRemote work$180k - $210k
...functional collaboration where your contributions are vital to our success. SUMMARY We are seeking an experienced Senior Technical Program Manager (Electronics) with a strong background in electrical engineering, firmware architecture, embedded electronics, medical...For contractorsImmediate start$290k
...s API is the foundation that customers, developers, and our own products build on, and it is scaling fast. We're hiring a Technical Program Manager to drive the scaling and core efficiency programs for the API stack, working at the intersection of the API and the infrastructure...Work at officeLocal areaVisa sponsorshipFlexible hours- Baseten is seeking a Forward Deployed Engineer Manager to lead top customer programs in a technical, fast-paced environment. You will own operating rhythms, bridge gaps between engineering, sales, and product, and drive multi-team initiatives for high-impact customers....
$365k
...developer products: the common foundation that Claude, Cowork, Claude Code, and future surfaces are built on. We're hiring a Technical Program Manager to be the connective tissue for this effort, someone who ensures we're building the platform the rest of Anthropic's...Work at officeVisa sponsorshipFlexible hours- Notion is hiring a Technical Program Manager to partner with Engineering, Product, and Design leadership across a portfolio of internal and external programs. You will ensure alignment, cadence, and delivery on multi-team initiatives that impact global users, with anchor...
- Anthropic Limited seeks a Technical Program Manager for Life Sciences Research (Genetic Medicine) in Boston. You will coordinate cross-functional teams including scientists, engineers, clinicians, and external partners to move complex genetic medicine programs forward....
$257k - $335k
# Technical Program Manager, People Innovation LabsOpenAISan Francisco (Hybrid)Full-time$257,000 - $335,000 / yearUpload your resume once and Scout applies for youApply with ScoutShare this job:LinkedInXSave imageThis role leads cross-functional execution for AI-powered...Permanent employmentFull timeWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technical Program Manager, InferenceNew. Be the first to apply!
- senior technical director San Francisco, CA
- technical manager food San Francisco, CA
- sr technical product manager San Francisco, CA
- director technical accounting San Francisco, CA
- technical business manager San Francisco, CA
- technical superintendent San Francisco, CA
- technical lead manager San Francisco, CA
- director of technical services San Francisco, CA
- technical manager concrete San Francisco, CA
- technical director engineering San Francisco, CA


