Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technical Program Manager, Cloud Inference

$290k

United States Digital Space LLC

About the company the company’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role We are seeking an experienced Technical Program Manager to support our critical cloud deployments. In this role you will be an execution owner, driving coordination and collaboration across multiple engineering teams. You will also support the collaboration and technical execution between our internal engineering teams and our major cloud partners including Amazon Bedrock, Google Vertex, and Microsoft Foundry. Your primary focus will be on ensuring tight coordination on engineering deliverables both within our internal teams and between our partner teams, enabling repeatable and efficient product development and launch pipelines for our AI models on third-party platforms. You will be responsible for aligning a range of business and technical stakeholders to drive execution of technical roadmaps, with a particular emphasis on optimizing our presence and performance. This position offers the opportunity to make a significant impact on the company's growth and success in the cloud AI market, while working at the forefront of AI development and innovation. Responsibilities Partner with engineering leaders to define, scope, and sequence major technical initiatives for cloud partnerships and AI model deployment, and own the plans, timelines, and resourcing to land them. Own launch readiness for Claude models on partner cloud platforms: checklist, blocker tracking, joint go/no-go with the partner, and post-launch stability follow-through. Act as the primary technical interface to cloud partner engineering orgs — owning the relationship, the shared roadmap, and day-to-day coordination on deployment, capacity, and incidents. Drive cross-functional alignment across internal engineering, product, and go-to-market teams to land joint deliverables with the partner. Provide clear and transparent reporting on program status, issues, and risks to executives and stakeholders. You may be a good fit if you Have several years of experience in technical program management, with a track record of successfully delivering complex technical programs, preferably involving cloud platforms and AI technologies. Have strong understanding of cloud computing architectures, AI/ML deployment, and integration challenges. Have exceptional interpersonal and communication skills, enabling you to influence without authority and build cross-organizational support. Have a high threshold for navigating ambiguity and ability to balance strategic priorities with rapid, high-quality execution. Thrive in fast-paced, scaling environments with the ability to bring order to chaos. Are passionate about the company's mission and committed to ensuring AI is developed safely. Strong candidates may also have Direct experience with a hyperscaler's managed AI platform — Amazon Bedrock, Google Vertex AI, or Azure AI Foundry — including how partners list, launch, and onboard customers on it. Background in ML inference, model serving infrastructure, or accelerator-based compute. Have owned joint engineering roadmap or dependency tracking, driving incident follow-through, and converting open issues into a prioritized plan both sides commit to Experience with release engineering, deployment automation, or CI/CD for systems that ship to multiple targets or environments. LogisticsMinimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. Annual Salary:

$290,000—$435,000 USD

How we're different We believe that the highest-impact AI research will be big science. At the company we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long‑term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our #J-18808-Ljbffr United States Digital Space LLC

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Technical Program Manager, Cloud Inference in New York, NY vacancy
  • $198k - $264k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...performance with deep technical expertise to accelerate breakthroughs...  ...enterprise customers. As a Technical Program Manager focused on inference, you will lead complex, cross-functional... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • Google Cloud seeks a Mid-level Technical Program Manager to drive cross-functional programs in New York. You will define goals, build charters, and manage plans with stakeholders across engineering and business teams. You will develop dashboards, analyze data using SQL,... 
    Suggested

    Google Inc.

    New York, NY
    3 days ago
  • Nebius is seeking a Senior Technical Project Manager to drive cross‑team engineering initiatives spanning runtime infrastructure and cloud services. You’ll own project goals, timelines, and the orchestration of complex programs that impact our AI cloud platform. You will... 
    Suggested

    Nebius

    New York, NY
    3 days ago
  • $183k - $252k

    AlphaSense, Inc. in New York, NY is looking for a Staff Technical Program Manager to improve engineering velocity and lead complex initiatives across teams. The ideal candidate has over 8 years of experience in TPM or engineering management and a strong technical background... 
    Suggested

    AlphaSense, Inc.

    New York, NY
    3 days ago
  •  ...grow, the size and complexity of our programs has continued increasing over time. To help us manage this, we are looking to bring in exceptional Technical Program Managers (TPM) to manage...  ...Manage the program portfolio covering inference, efficiency, serving, and endpoints... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    4 days ago
  • $177k - $237k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers...  ...infrastructure performance with deep technical expertise to accelerate...  .... As a Technical Program Manager, you will lead complex, cross...  ...validation for training and inference workloads ~ Familiarity... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $177k - $237k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by...  ...infrastructure performance with deep technical expertise to accelerate...  ...customers.As a Technical Program Manager, you will lead complex,...  ...validation for training and inference workloadsFamiliarity with GPU... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  •  ...Technical Program Manager, Compute San Francisco, CA | New York City, NY | Seattle, WA About Anthropic...  ...model training run, evaluation, and inference workload depends. You'll join a...  ...workloads, and managing decommissions across cloud providers and hardware platforms... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    5 days ago
  • $160k - $220k

     ...experimentation, training, and production inference, with security, observability, and...  ...We are seeking an experienced Senior Technical Program Manager to lead complex, cross-functional programs...  ...Program Manager in infrastructure, cloud, or distributed systems environments... 
    Work at office
    Work from home
    Flexible hours
    Shift work

    Lightning AI

    New York, NY
    1 day ago
  • $211.2k - $264k

     ...As a Technical Program Manager for the Platform team, you will partner with engineering teams to directly...  ...complex infrastructure metrics (LLM inference optimization, GPU utilization, compute...  ...from scratch (e.g., internal cloud infrastructure, developer APIs, distributed... 
    Full time

    Scale AI

    New York, NY
    5 days ago
  • $198k - $264k

     ...Technical Program Manager, InferenceCoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools,...  ...customers.As a Technical Program Manager focused on inference, you will lead complex, cross-functional... 
    Full time
    Casual work
    Work at office

    CoreWeave

    New York, NY
    2 days ago
  • $194.7k - $263.4k

     ...technologies to accomplish this mission, including Generative AI, classical ML, Causal Inference, Natural Language Processing, and Computer Vision.As a Principal Technical Program Manager on the team, you will be at the forefront of innovation, driving program execution... 
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • Mirantis is seeking a Technical Product Manager to own networking for k0rdent AI, our control plane for GPU infrastructure and distributed AI...  ...networks across GPU clusters running large-scale training and inference. You will work closely with engineering, marketing, and... 

    Doist

    New York, NY
    3 days ago
  • $365k

     ...design authority over it ourselves. We're looking for a Technical Program Manager to own end-to-end execution of our silicon, from architecture...  ...: hardware systems for package/board/bring‑up, and inference/kernels/compiler teams for hardware‑software co‑design, so... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    2 days ago
  •  ...Banking & Payments, Wealth Management, Telecom, Hi-Tech, and Life...  ...quantifiable business KPI-driven programs. Business and technology...  ...RAG pipelines, embeddings, inference endpoints, and more. Partner...  ...sprints, and elevate the team’s technical bar. Work closely with... 

    Incedo Inc.

    New York, NY
    5 days ago
  • $160k - $220k

     ...software solutions helps customers manage emergency communications,...  ...Solutions, the Principal Technical Program Manager will be a critical,...  ...includes building enterprise-scale cloud and edge AI platforms,...  ...-time video processing, and inference optimization. ~... 
    Immediate start
    Remote work
    Relocation

    Motorola Solutions

    New York, NY
    4 days ago
  • $200k - $240k

     ...supports AI training, inference, and HPC workloads, with...  ...processes Manage dependencies across multiple...  ...concurrent infrastructure programs Own execution...  ...Coach junior TPMs on technical depth, risk identification...  ...within a hyperscaler, GPU cloud provider, or AI... 
    Full time
    New York, NY
    9 days ago
  • $163.6k - $221.3k

     ...experience it. Join us in building AI-powered guidance and personalization for sellers, vendors, and offsite advertisers. As a Sr. Technical Program Manager on GPS, you will drive programs that directly shape how millions of advertisers interact with the Amazon Ads console... 
    Worldwide
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • $160k - $180k

     ...per day, Madhive is driving the evolution of local media. Technical Program Manager (Client Solutions)Position OverviewThe primary orchestrator...  ...servers) and hands-on experience with enterprise APIs and cloud technologies (GCP/AWS).Communication: Exceptional ability to... 
    Local area
    3 days per week

    MadHive

    New York, NY
    3 days ago
  • $138k - $198k

     ...with stakeholders to define program goals, prioritize deliverables...  ...pivots and progress.Develop and manage comprehensive change...  ...escalations and independently triage technical issues, assessing their...  ...Management Profession)Google Cloud accelerates every organization... 
    Full time
    Work at office

    Google

    New York, NY
    3 days ago
  • $112k - $175k

     ...wellness tools, DailyPay helps employees manage their finances and helps employers...  ...the Role DailyPay is looking for a Technical Program Manager (TPM) to drive the development...  ...software architectures (e.g., microservices, cloud-native applications). ~ Strong... 
    Full time
    Temporary work
    Local area

    DailyPay

    New York, NY
    2 days ago
  • $117.58k - $154.32k

    Hi, we're Oscar. We're hiring a Technical Program Manager, Infra to join our Tech Strategy & Ops team.Oscar is the first health insurance company...  ..., reliable, and scalable products. Our portfolio includes cloud and compute infrastructure, identity and access management,... 
    Full time
    Work experience placement
    Work at office
    Flexible hours

    Oscar Health Insurance

    New York, NY
    7 hours ago
  • $10k

     ...deserves the same.If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it.About the RoleWe're looking for a Technical Program Manager who can operate at the intersection of engineering, product, and business —... 
    Full time
    Work at office
    Home office
    Flexible hours

    Ramp

    New York, NY
    4 days ago
  • $225k - $300k

     ...About the Position We are looking for a highly-driven Technical Program Manager who can provide organization and coordination support for our engineering initiatives. Technology is core to our business, and this role is an opportunity to work alongside our engineers... 
    Full time
    Second job
    Immediate start
    Flexible hours

    Jane Street

    New York, NY
    3 days ago
  • $163.6k - $221.3k

    We are looking for a Technical Program Manager to join the PV Ads - Ad Tech Ops team, a newly formed centralized operational backbone for advertising technology across Prime Video Channels (PVC) and FAST partnerships. This TPM will drive scalable processes for partner onboarding... 
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • $420k

     ...propositions that help us differentiate from the competition and become a market leader in record time.We are looking for a Technical Program Manager with Ads domain experience to drive high impact cross-functional ads programs. This role requires strong collaboration... 
    Hourly pay
    Full time
    Immediate start
    Flexible hours

    Netflix

    New York, NY
    1 day ago
  • $290k - $365k

     ...billing engineering, GTM systems, finance, and support teams. Today much of it runs on escalations rather than programs. We're hiring a Technical Program Manager to own the cross-functional programs in this space. You'll partner closely with billing engineering, GTM... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    4 days ago
  • $237k - $261k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...superior infrastructure performance with deep technical expertise to accelerate breakthroughs...  ...CoreWeave is seeking a Technical Program Manager to lead complex, cross-functional programs... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $177k - $237k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...infrastructure performance with deep technical expertise to accelerate...  ...you'll lead cross-functional programs that convert product strategy...  ...end-to-end technical program management for critical cloud... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $184k - $230k

     ...require humans, and drive the company’s most technically complex and consequential bets to completion.Technical Program Management at Datadog operates at the intersection of...  ...programs with real unit economics implications - cloud cost, capacity, marginDatadog values people... 
    Work at office
    Local area
    Shift work

    Datadog

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technical Program Manager, Cloud Inference. Be the first to apply!