Technical Program Manager, Cloud Inference
$290kUnited States Digital Space LLC
About the company the company’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role We are seeking an experienced Technical Program Manager to support our critical cloud deployments. In this role you will be an execution owner, driving coordination and collaboration across multiple engineering teams. You will also support the collaboration and technical execution between our internal engineering teams and our major cloud partners including Amazon Bedrock, Google Vertex, and Microsoft Foundry. Your primary focus will be on ensuring tight coordination on engineering deliverables both within our internal teams and between our partner teams, enabling repeatable and efficient product development and launch pipelines for our AI models on third-party platforms. You will be responsible for aligning a range of business and technical stakeholders to drive execution of technical roadmaps, with a particular emphasis on optimizing our presence and performance. This position offers the opportunity to make a significant impact on the company's growth and success in the cloud AI market, while working at the forefront of AI development and innovation. Responsibilities Partner with engineering leaders to define, scope, and sequence major technical initiatives for cloud partnerships and AI model deployment, and own the plans, timelines, and resourcing to land them. Own launch readiness for Claude models on partner cloud platforms: checklist, blocker tracking, joint go/no-go with the partner, and post-launch stability follow-through. Act as the primary technical interface to cloud partner engineering orgs — owning the relationship, the shared roadmap, and day-to-day coordination on deployment, capacity, and incidents. Drive cross-functional alignment across internal engineering, product, and go-to-market teams to land joint deliverables with the partner. Provide clear and transparent reporting on program status, issues, and risks to executives and stakeholders. You may be a good fit if you Have several years of experience in technical program management, with a track record of successfully delivering complex technical programs, preferably involving cloud platforms and AI technologies. Have strong understanding of cloud computing architectures, AI/ML deployment, and integration challenges. Have exceptional interpersonal and communication skills, enabling you to influence without authority and build cross-organizational support. Have a high threshold for navigating ambiguity and ability to balance strategic priorities with rapid, high-quality execution. Thrive in fast-paced, scaling environments with the ability to bring order to chaos. Are passionate about the company's mission and committed to ensuring AI is developed safely. Strong candidates may also have Direct experience with a hyperscaler's managed AI platform — Amazon Bedrock, Google Vertex AI, or Azure AI Foundry — including how partners list, launch, and onboard customers on it. Background in ML inference, model serving infrastructure, or accelerator-based compute. Have owned joint engineering roadmap or dependency tracking, driving incident follow-through, and converting open issues into a prioritized plan both sides commit to Experience with release engineering, deployment automation, or CI/CD for systems that ship to multiple targets or environments. LogisticsMinimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. Annual Salary:
$290,000—$435,000 USD
How we're different We believe that the highest-impact AI research will be big science. At the company we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long‑term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our #J-18808-Ljbffr United States Digital Space LLC$198k - $264k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave... ...performance with deep technical expertise to accelerate breakthroughs... ...enterprise customers. As a Technical Program Manager focused on inference, you will lead complex, cross-functional...SuggestedPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- Google Cloud seeks a Mid-level Technical Program Manager to drive cross-functional programs in New York. You will define goals, build charters, and manage plans with stakeholders across engineering and business teams. You will develop dashboards, analyze data using SQL,...Suggested
- Nebius is seeking a Senior Technical Project Manager to drive cross‑team engineering initiatives spanning runtime infrastructure and cloud services. You’ll own project goals, timelines, and the orchestration of complex programs that impact our AI cloud platform. You will...Suggested
$183k - $252k
AlphaSense, Inc. in New York, NY is looking for a Staff Technical Program Manager to improve engineering velocity and lead complex initiatives across teams. The ideal candidate has over 8 years of experience in TPM or engineering management and a strong technical background...Suggested- ...grow, the size and complexity of our programs has continued increasing over time. To help us manage this, we are looking to bring in exceptional Technical Program Managers (TPM) to manage... ...Manage the program portfolio covering inference, efficiency, serving, and endpoints...SuggestedFull timeWork at officeLocal areaRemote workHome office
$177k - $237k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers... ...infrastructure performance with deep technical expertise to accelerate... .... As a Technical Program Manager, you will lead complex, cross... ...validation for training and inference workloads ~ Familiarity...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$177k - $237k
CoreWeave is The Essential Cloud for AI. Built for pioneers by... ...infrastructure performance with deep technical expertise to accelerate... ...customers.As a Technical Program Manager, you will lead complex,... ...validation for training and inference workloadsFamiliarity with GPU...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- ...Technical Program Manager, Compute San Francisco, CA | New York City, NY | Seattle, WA About Anthropic... ...model training run, evaluation, and inference workload depends. You'll join a... ...workloads, and managing decommissions across cloud providers and hardware platforms...Work at officeVisa sponsorshipFlexible hours
$160k - $220k
...experimentation, training, and production inference, with security, observability, and... ...We are seeking an experienced Senior Technical Program Manager to lead complex, cross-functional programs... ...Program Manager in infrastructure, cloud, or distributed systems environments...Work at officeWork from homeFlexible hoursShift work$211.2k - $264k
...As a Technical Program Manager for the Platform team, you will partner with engineering teams to directly... ...complex infrastructure metrics (LLM inference optimization, GPU utilization, compute... ...from scratch (e.g., internal cloud infrastructure, developer APIs, distributed...Full time$198k - $264k
...Technical Program Manager, InferenceCoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools,... ...customers.As a Technical Program Manager focused on inference, you will lead complex, cross-functional...Full timeCasual workWork at office$194.7k - $263.4k
...technologies to accomplish this mission, including Generative AI, classical ML, Causal Inference, Natural Language Processing, and Computer Vision.As a Principal Technical Program Manager on the team, you will be at the forefront of innovation, driving program execution...Flexible hours- Mirantis is seeking a Technical Product Manager to own networking for k0rdent AI, our control plane for GPU infrastructure and distributed AI... ...networks across GPU clusters running large-scale training and inference. You will work closely with engineering, marketing, and...
$365k
...design authority over it ourselves. We're looking for a Technical Program Manager to own end-to-end execution of our silicon, from architecture... ...: hardware systems for package/board/bring‑up, and inference/kernels/compiler teams for hardware‑software co‑design, so...Work at officeVisa sponsorshipFlexible hours- ...Banking & Payments, Wealth Management, Telecom, Hi-Tech, and Life... ...quantifiable business KPI-driven programs. Business and technology... ...RAG pipelines, embeddings, inference endpoints, and more. Partner... ...sprints, and elevate the team’s technical bar. Work closely with...
$160k - $220k
...software solutions helps customers manage emergency communications,... ...Solutions, the Principal Technical Program Manager will be a critical,... ...includes building enterprise-scale cloud and edge AI platforms,... ...-time video processing, and inference optimization. ~...Immediate startRemote workRelocation$200k - $240k
...supports AI training, inference, and HPC workloads, with... ...processes Manage dependencies across multiple... ...concurrent infrastructure programs Own execution... ...Coach junior TPMs on technical depth, risk identification... ...within a hyperscaler, GPU cloud provider, or AI...Full time$163.6k - $221.3k
...experience it. Join us in building AI-powered guidance and personalization for sellers, vendors, and offsite advertisers. As a Sr. Technical Program Manager on GPS, you will drive programs that directly shape how millions of advertisers interact with the Amazon Ads console...WorldwideFlexible hours$160k - $180k
...per day, Madhive is driving the evolution of local media. Technical Program Manager (Client Solutions)Position OverviewThe primary orchestrator... ...servers) and hands-on experience with enterprise APIs and cloud technologies (GCP/AWS).Communication: Exceptional ability to...Local area3 days per week$138k - $198k
...with stakeholders to define program goals, prioritize deliverables... ...pivots and progress.Develop and manage comprehensive change... ...escalations and independently triage technical issues, assessing their... ...Management Profession)Google Cloud accelerates every organization...Full timeWork at office$112k - $175k
...wellness tools, DailyPay helps employees manage their finances and helps employers... ...the Role DailyPay is looking for a Technical Program Manager (TPM) to drive the development... ...software architectures (e.g., microservices, cloud-native applications). ~ Strong...Full timeTemporary workLocal area$117.58k - $154.32k
Hi, we're Oscar. We're hiring a Technical Program Manager, Infra to join our Tech Strategy & Ops team.Oscar is the first health insurance company... ..., reliable, and scalable products. Our portfolio includes cloud and compute infrastructure, identity and access management,...Full timeWork experience placementWork at officeFlexible hours$10k
...deserves the same.If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it.About the RoleWe're looking for a Technical Program Manager who can operate at the intersection of engineering, product, and business —...Full timeWork at officeHome officeFlexible hours$225k - $300k
...About the Position We are looking for a highly-driven Technical Program Manager who can provide organization and coordination support for our engineering initiatives. Technology is core to our business, and this role is an opportunity to work alongside our engineers...Full timeSecond jobImmediate startFlexible hours$163.6k - $221.3k
We are looking for a Technical Program Manager to join the PV Ads - Ad Tech Ops team, a newly formed centralized operational backbone for advertising technology across Prime Video Channels (PVC) and FAST partnerships. This TPM will drive scalable processes for partner onboarding...Flexible hours$420k
...propositions that help us differentiate from the competition and become a market leader in record time.We are looking for a Technical Program Manager with Ads domain experience to drive high impact cross-functional ads programs. This role requires strong collaboration...Hourly payFull timeImmediate startFlexible hours$290k - $365k
...billing engineering, GTM systems, finance, and support teams. Today much of it runs on escalations rather than programs. We're hiring a Technical Program Manager to own the cross-functional programs in this space. You'll partner closely with billing engineering, GTM...Full timeWork at officeVisa sponsorshipFlexible hours$237k - $261k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave... ...superior infrastructure performance with deep technical expertise to accelerate breakthroughs... ...CoreWeave is seeking a Technical Program Manager to lead complex, cross-functional programs...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$177k - $237k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...infrastructure performance with deep technical expertise to accelerate... ...you'll lead cross-functional programs that convert product strategy... ...end-to-end technical program management for critical cloud...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$184k - $230k
...require humans, and drive the company’s most technically complex and consequential bets to completion.Technical Program Management at Datadog operates at the intersection of... ...programs with real unit economics implications - cloud cost, capacity, marginDatadog values people...Work at officeLocal areaShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technical Program Manager, Cloud Inference. Be the first to apply!
- director of technical services New York, NY
- technical writing manager New York, NY
- sr technical product manager New York, NY
- technical account manager New York, NY
- technical business manager New York, NY
- technical services manager New York, NY
- technical manager New York, NY
- technical operations manager New York, NY
- technical training manager New York, NY
- technical product manager New York, NY


