Technical Program Manager, Inference
EngineersOfAI
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic’s Inference organization serves Claude to millions of users and enterprise customers, across our own products and the world’s largest cloud platforms, with the speed, reliability, and efficiency that frontier AI demands. The stack that makes this possible is deep and tightly coupled: accelerator kernels, an in-house inference engine that manages the entire token path for both production and research workloads, distributed routing, autoscaling, and capacity management. Every layer affects the others, often in ways that are hard to see in isolation. We build across GPUs, TPUs, and Trainium, and the complexity of building, testing, and shipping inference software grows with every platform we add. We're looking for a Technical Program Manager to drive the programs that scale it. The work spans four closely coupled areas: Scaling and infrastructure. Routing, autoscaling, and capacity management for the serving fleet, and bringing new capacity online. Velocity. The toolchains, development environments, and CI/CD that let inference engineers build, test, and ship across every accelerator platform. Inference engine. The software between the accelerator kernels and the routing layer that serves every request. Performance. Improving throughput, latency, cost, and reliability across the stack, with correctness treated as part of performance. This is not a status-tracking role. You'll own outcomes end to end, often where no single team is accountable for the whole picture. Much of your value comes from crossing boundaries into Research, Safeguards, Security, Compute, Infrastructure, API, and our cloud and silicon partners, and bringing back the requirements and dependencies that no team sees from inside its own space. There is little process to inherit, and we want to keep it that way: you'll build the minimum machinery the work needs and remove it when it stops helping. And because this is Anthropic, you'll have Claude as a collaborator. We expect TPMs on this team to push hard on what AI-assisted program management and fleet operations can look like. Key responsibilities Own the programs that scale Claude’s serving fleet across accelerator and cloud platforms, from early direction through delivery. Drive new capacity online end to end, working across compute, infrastructure, security, networking, and inference teams so one person is accountable for the whole path. Build visibility into supply, demand, and utilization with capacity and finance partners, and drive trade-offs among utilization, cost, latency, and reliability to a clear decision. Lead reliability programs and large migrations without disrupting production traffic or research, and make sure incident follow-ups land in team roadmaps. Drive the programs that make inference engineers faster: define the productivity metrics that matter, find the bottlenecks, and improve how software is built, tested, and released across platforms, in step with Anthropic’s central Infrastructure org. Coordinate roadmaps and priorities across the production, research, and safeguards needs that depend on the same teams. Track performance and efficiency work from opportunity to measured impact in production, with correctness held as a release criterion. Own inference readiness for model launches alongside our launch TPMs. Minimum qualifications 7+ years of experience as a TPM, or in an equivalent engineering or SRE lead role, owning large multi-team infrastructure programs end to end in production distributed systems, ML infrastructure, or cloud platforms. You can speak to the outcomes in detail, incl #J-18808-Ljbffr EngineersOfAI
$290k
...products build on, and it is scaling fast. We're hiring a Technical Program Manager to drive the scaling and core efficiency programs for the... ...infrastructure it runs on (compute, databases, networking, and inference). Today this work spans many teams and many...SuggestedWork at officeLocal areaVisa sponsorshipFlexible hours$200k - $240k
...center design through IaaS products to managed inference at scale, enabling AI-native companies... ...a Staff TPM who will own deployment programs. You will be helping us build out new... ...same Engineering pool without a plan.Technical LeadershipOwns real-time execution dashboards...SuggestedTemporary work- ...at the intersection of product demand, model deployment, inference, research, fleet, and capacity. The team translates changing... ...safe, scalable launches. About the Role We are seeking a Technical Program Manager to lead the operating system for Chat capacity and model...SuggestedWork at officeRelocation package
- ...Role You will be part of an engineer-first TPM team as a Technical Program Manager for Compute Infrastructure who owns the end-to-end... ...ecosystem while supporting capacity planning for training and inference. Ability to contextually drive multi-threaded bring-up...SuggestedFull timeWork at officeRelocation package
- ...ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence... ...products. THE ROLE At Baseten, we’re looking for a Technical Program Manager to drive our most complex, cross-cutting infrastructure...SuggestedFull timeFlexible hours
- ...sustainable future. What the job involves The Principal Technical Program Manager will lead the development and execution of a portfolio of... ...engineering to ensure hardware programs account for the full edge inference stack - thermal envelope, compute constraints, sensor...
- ...experiences to developers, consumers, and businesses alike. Technical Program Managers at OpenAI play a key leadership role in scaling these... ...through partner platforms or marketplaces. Experience with inference systems, model serving, accelerator-backed infrastructure,...Full timeWork at officeRelocation package
$203.5k - $275.3k
...technologies to accomplish this mission, including Generative AI, classical ML, Causal Inference, Natural Language Processing, and Computer Vision. As a Principal Technical Program Manager on the team, you will be at the forefront of innovation, driving program execution...Local areaFlexible hours$140k - $200k
...the first time ever, safety, operations and finance teams can manage their drivers, vehicles, equipment, and fleet related spend... ...sector.Visit gomotive.com to learn more.About the RoleAs a Senior Technical Program Manager on Motive’s embedded Technical Program Management (...Temporary workWork experience placement- ...software, payment processing, device fleet management, and hardware. Our hardware portfolio... ...someone who can connect customer needs, technical constraints, business strategy, and execution... ....Responsibilities Independently define programs across Terminal including scoping,...Local area
$200k - $270k
...business’s system of record to making and managing AI agents to automating away the busy... ...design leaders at Notion to help run the programs and operating rhythms that keep EPD focused... ...outcomeForge strong partnerships with technical and business leaders across the company,...Local area$116k - $148k
We are seeking a motivated and experienced Technical Program Manager to join Datadog’s Technical Solutions organization. This organization is made up of 1,200+ customer-facing technical experts around the world — including Sales Engineers, Technical Account Managers, Support...Work at office- RESPONSIBILITIES: Kforce has a client that is seeking a Senior Technical Program Manager in San Francisco, CA. Summary: The Technical Program Manager will be a key member of the Enterprise Program Management team responsible for managing a portfolio of projects...Hourly payContract work
- ...research and communication that help people understand how quickly AI is progressing and what that could mean. We're hiring a Technical Program Manager to run Pacing. It spans many projects led by people across Safety, Research, Policy, Legal, Communications, and...Full timeFor contractorsWork at officeLocal areaVisa sponsorshipFlexible hours
$80.5 - $90 per hour
...culture, deliver the technology they need to increase their velocity and impact. We're seeking an experienced Senior TechOps Program Manager / Technical Program Manager to drive Finance Technology related initiatives.. The ideal candidate will partner cross-functionally...Hourly payFull timeFor contractorsLocal areaFlexible hours- ...If you’re looking for something easier –this isn’t it. The Role We are looking for a passionate Hardware Engineering Program Manager who will help lead the development of new and innovative products. This role is based out of our San Francisco Office 5 days...Full timeWork at officeImmediate startWorldwideFlexible hours
$145k - $185k
...Astranis designs, builds, and operates its satellites out of its 153,000 sq. ft. headquarters in Northern California, USA. Technical Program Manager, USG Space Relays Astranis is developing the next generation relay capability for the USG Government delivering Ka-band...Permanent employmentFlexible hours$150k - $280k
...team in San Francisco. You are highly technical - regardless of the role you are in. We... ...the vision and strategy of our vehicle program, working directly with engineering leadership... ...technical leadership (TPM, engineering management, or equivalent) on complex...$207k - $285k
Technical Program Manager, Capacity Analytics & Tooling Technical Program Management - San Francisco About the Team The Compute Infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting...Work at officeLocal areaRelocation packageFlexible hours- ...to bring modern AI into regulated industries where precision, reliability, and performance matter. The Role We’re hiring a Technical Program Manager to help scale Taylor, our flagship product, as we launch with new customers - from large lenders to smaller institutions....Full timeWork at office
$56.66 - $66.66 per hour
...work qualifications: Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience. 5+ years of experience in Technical Program Management, managing complex, cross-functional software development programs....Hourly payContract workTemporary workWork experience placementLocal areaRemote work- ...Technical Program Manager Location: Remote/SF-Hybrid · Full-Time About Andromeda Andromeda is a market and infrastructure platform... ...delivering reliable capacity to model builders, research labs, and inference providers when they need it. We believe every spare...Remote jobFull timeContract work
- ...systems. About the role Anthropic’s Inference organization serves Claude to millions... ...kernels, an in-house inference engine that manages the entire token path for both... ...every platform we add. We're looking for a Technical Program Manager to drive the programs that scale...Full timeFor contractorsWork at officeVisa sponsorshipFlexible hours
- ...Technical Program Manager, Public Sector About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems... ...sequencing, dependencies, and tradeoffs across research, inference and capacity, cloud partners, safeguards, and compliance teams...Full timeWork at officeLocal areaVisa sponsorshipFlexible hours
- ...together to build beneficial AI systems. About the Role As a Technical Program Manager on the Compute team, you will help drive the planning,... ...on which every model training run, evaluation, and inference workload depends. You'll join a small, high-impact TPM team...Full timeWork at officeVisa sponsorshipFlexible hours
- ...both in and out of the office. Oura is looking for a Packaging Program Manager to lead the development and delivery of packaging across new... ...Chain, Quality, Regulatory, Creative, and Marketing to align technical, business, and brand requirements.Translate product,...Contract workWork at officeLocal areaRemote workFlexible hours
$148k - $185k
...thrive.Lyft connects people to transportation to change the way we live and get around our communities. We are looking for Technical Program Managers who bring exceptional technical and analytical skills to drive execution. Come be part of a team at Lyft focused on...Hourly payWork at officeLocal area3 days per week$163k - $236k
...understand or identify defined work problems and program goals, obtain prioritized deliverables,... ...of projects and develop, execute, or manage project plans for supported programs.... ...qualifications:Bachelor's degree in a technical field, or equivalent practical experience...$164k - $210k
...models, better models power more useful products, and what we learn from people using those products shapes what we build next.TECHNICAL PROGRAM MANAGER, FIELDWe're looking for our first Technical Program Manager to work with our largest enterprise customers and help them...Temporary work$165k - $210k
Candid Health is looking for a Technical Program Manager - Implementation to serve as the connective tissue between our Engineering, Product, and Operations teams. This is a high-impact role designed for someone who thrives on organization and can navigate the complexities...Work at officeRemote workShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technical Program Manager, Inference. Be the first to apply!
- senior technical director San Francisco, CA
- technical manager food San Francisco, CA
- sr technical product manager San Francisco, CA
- director technical accounting San Francisco, CA
- technical business manager San Francisco, CA
- technical superintendent San Francisco, CA
- technical lead manager San Francisco, CA
- director of technical services San Francisco, CA
- technical manager concrete San Francisco, CA
- technical director engineering San Francisco, CA



