Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Technical Program Manager - AI Infrastructure

$200k - $240k
Full-time

Keen to join a company that champions growth and development?

Join an AI infrastructure company building and operating large-scale GPU infrastructure for research labs, hyperscalers, enterprises, and institutions. The platform supports AI training, inference, and HPC workloads, with over 1GW of capacity in active development.

This company is looking for someone to own infrastructure deployment programmes end-to-end, from hardware vendor engagement and architecture through to commissioning and first customer cluster delivery. The role also involves defining deployment frameworks, commissioning processes, and operating models across GPU hardware, firmware, networking, storage, orchestration, and observability.

Don’t miss out on this exciting opportunity and apply today!

Responsibilities:

  • Own new deployments and site expansions end-to-end, including hardware vendors, OEM dependencies, architecture, platform foundations, commissioning, and customer delivery
  • Define firmware targets, commissioning gates, DRI structures, and deployment processes
  • Manage dependencies across multiple hardware generations and concurrent infrastructure programs
  • Own execution dashboards and provide data-driven updates to executive stakeholders
  • Drive cross-functional alignment across engineering and infrastructure teams
  • Coach junior TPMs on technical depth, risk identification, and program execution
  • Use AI tools for program tracking, risk detection, dependency mapping, analysis, and executive communication

Skills/Must Have:

  • 10+ years of Technical Program Management experience
  • Experience owning infrastructure deployment programs within a hyperscaler, GPU cloud provider, or AI infrastructure company
  • Deep understanding of GPU/accelerator architecture, firmware, drivers, BIOS/BMC, compute orchestration, networking, storage, and monitoring
  • Strong knowledge of leaf-spine networking, ZTP, and fabric commissioning
  • Direct experience managing GPU/OEM certification and validation timelines
  • Experience creating deployment frameworks and operating models from scratch
  • Experience driving VP/SVP-level alignment without formal authority

Benefits:

  • Bonus + Equity

Salary:

  • $200,000 - $240,000 base salary
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Staff Technical Program Manager - AI Infrastructure in New York, NY vacancy
  •  ...security-first enterprise AI company. We build...  ...and complexity of our programs has continued increasing...  ...over time. To help us manage this, we are looking...  ...bring in exceptional Technical Program Managers (TPM)...  ...for Machine Learning Infrastructure, you will:Manage the program... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    3 days ago
  • $185k - $317k

     ...translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...engineering efforts, and we are looking for a Technical Program Manager (TPM) to partner with our Infrastructure team. The TPM provides oversight of the most... 
    Suggested
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    New York, NY
    2 days ago
  • $194.7k - $263.4k

     ...advertising landscape through advanced generative AI technologies and AI agents, revolutionizing...  ...team is seeking a highly skilled Technical Program Manager (TPM) to lead strategic programs for Amazon Ads' AI infrastructure core services that accelerate agentic AI development... 
    Suggested
    Flexible hours

    Amazon

    New York, NY
    2 days ago
  • $107k - $148k

     ...Country: USA  Summary Celestica is seeking a Technical Program Manager – Data Center Infrastructure to lead the development and deployment of modular data...  ...Celestica enables critical data center infrastructure for AI, cloud, and hybrid cloud and advances technologies in... 
    Suggested
    Contract work
    Work at office
    Local area
    Remote work
    Worldwide
    Shift work

    Celestica

    New York, NY
    1 day ago
  • $200k - $240k

     ...and development? Join an AI infrastructure company building and operating...  ...and deployment processes Manage dependencies across multiple...  ...concurrent infrastructure programs Own execution dashboards...  ...teams Coach junior TPMs on technical depth, risk identification,... 
    Suggested
    Full time
    New York, NY
    13 days ago
  • $138k - $197k

    Manage projects and data analysis to ensure computing power is...  ...across the company, leading programs that reduce waste to achieve...  ...ensuring that each team’s specific technical needs are met during the...  ...supply chain, data center infrastructure, and software engineering to... 

    Google

    New York, NY
    4 days ago
  • $184k - $230k

     ...drive the company’s most technically complex and...  ...completion.Technical Program Management at Datadog operates at...  ...technical judgment. We use AI to surface risks...  ...domains — observability, infrastructure, data platforms, or AI...  ...own in the room with staff engineers and senior... 
    Work at office
    Local area
    Shift work

    Datadog

    New York, NY
    3 days ago
  • $237k - $261k

     ...CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers,...  ..., CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs...  ...:CoreWeave is seeking a Technical Program Manager to lead complex, cross-functional... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    4 days ago
  • $10k

     ...RampRamp is building the smart infrastructure for finance teams, embedded...  ...how companies move and manage billions, Ramp is the place...  ...the RoleWe're looking for a Technical Program Manager who can operate at the...  ..., deeply curious about what AI can unlock for engineering teams... 
    Full time
    Work at office
    Home office
    Flexible hours

    Ramp

    New York, NY
    3 days ago
  • $143k - $210k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers,...  ..., CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs...  ...What You'll Do:As a Sr. Technical Program Manager on the Capacity Delivery team, you... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $139.9k - $189.2k

    We're seeking a Technical Program Manager to join the Data Infrastructure and Generative Intelligence (DIGI) team within Advertising Finance. In this role, you will...  ...cross-functional projects end-to-end that enable AI-powered insights and data-driven decision-making across... 
    Remote work
    Flexible hours
    Shift work

    Amazon

    New York, NY
    23 hours ago
  • $117.58k - $154.32k

    Hi, we're Oscar. We're hiring a Technical Program Manager, Infra to join our Tech Strategy & Ops team...  ...portfolio includes cloud and compute infrastructure, identity and access management,...  ...workflow platforms, developer tooling, AI infrastructure and tooling, and data... 
    Full time
    Work experience placement
    Work at office
    Flexible hours

    Oscar Health Insurance

    New York, NY
    4 days ago
  • $163.6k - $221.3k

     ...advertisers experience it. Join us in building AI-powered guidance and personalization...  ..., and offsite advertisers. As a Sr. Technical Program Manager on GPS, you will drive programs that...  ...the UX components, low-code delivery infrastructure, feedback mechanisms, telemetry, and... 
    Worldwide
    Flexible hours

    Amazon

    New York, NY
    4 hours ago
  • $163k - $236k

    Manage the full product lifecycle from feature concept...  ...across a portfolio of programs and drive stakeholder...  ...and integration with technical dependencies.Assess...  ...and trends. Leverage AI tools to develop streamlined...  ...Models (LLM), infrastructure.Preferred qualifications... 

    Google

    New York, NY
    3 days ago
  • $116k - $145k

     ...seeking a motivated and experienced Technical Program Manager II to join Datadog’s Technical Solutions...  ...plans as circumstances change.Apply AI tools to streamline your own program...  ...complexity at scale. It brings applications, infrastructure, data, models, and security into one... 
    Work at office

    Datadog

    New York, NY
    4 hours ago
  • $157k - $210k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers,...  ..., CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs...  ...at .About the role:As a Technical Program Manager focused on Networking Capacity Delivery... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  • $180.8k - $226k

    As a Technical Program Manager, you will partner with our Frontier Agent Engineering teams on enterprise...  ...in a hyper-growth, demanding AI environment, you will translate technical...  ...focused directly on core engineering infrastructure, platform services, or distributed systems... 
    Full time

    Scale AI

    New York, NY
    1 day ago
  • $150k - $300k

     ...OverviewWe are seeking a Vice President - Technical Program Manager (TPM) to drive the vision, program...  ..., this ecosystem enables autonomous AI/ML agents and quaVntitative...  ...deploying a modular, extensible central infrastructure that seamlessly integrates into the existing... 
    Full time
    Temporary work
    Part time
    Flexible hours

    Goldman Sachs

    New York, NY
    23 hours ago
  • $138k - $197k

     ...Identify, design, and deploy AI solutions, custom...  ...qualifications:Bachelor's degree in a technical field or equivalent...  ...experience.2 years of experience in program management.2 years of experience in...  ...built by the Technical Infrastructure team to keep it running. From... 
    Contract work

    Google

    New York, NY
    23 hours ago
  • Leverage your deep technical expertise and leadership to guide cutting-edge projects, fostering growth and innovation in a dynamic environment.  As a Lead Technical Program Manager in Corporate Technology, AI/ML Data Platforms team, you will drive the successful delivery... 

    JP Morgan Chase

    New York, NY
    2 days ago
  •  ...Technical Program Manager For Deployments As a Technical Program Manager for Deployments, you will own the end-to-end program delivery required to bring data center infrastructure and AI clusters online. You will operate in a highly ambiguous environment, coordinating... 
    Contract work
    For contractors
    Local area

    Fluidstack

    New York, NY
    1 day ago
  • $135.4k - $181.6k

     ...Senior Technical Program Manager Technology is at the heart of Disney's past, present, and future. Disney Entertainment and ESPN Product & Technology...  .... To learn more about Disney's policies on the use of AI for candidates, click here. DISABILITY ACCOMMODATION FOR... 
    Local area

    The Walt Disney Studios

    New York, NY
    3 days ago
  • $290k - $365k

     ...Technical Program Manager, Compute San Francisco, CA | New York City, NY | Seattle...  ..., and steerable AI systems. We want AI to be safe...  ...that keep Anthropic's compute infrastructure running efficiently at scale...  ...: Currently, we expect all staff to be in one of our offices... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    4 days ago
  •  ...Technical Product Manager FTAI owns and maintains commercial jet engines with...  ...power to data centers and AI hyperscalers worldwide....  ...by artificial intelligence infrastructure. As AI hyperscalers and cloud...  ...lifecycle of complex hardware programs — from concept and design through... 
    Immediate start
    Worldwide
    Flexible hours

    FTAI Aviation

    New York, NY
    4 days ago
  •  ...Senior Technical Program Manager Highbeam is building the future of business banking and cash management. Our platform combines AI agents, automated financial workflows, and integrated financial products that save brands time and money. Customers have generated... 
    Work at office

    Highbeam, Inc

    New York, NY
    1 day ago
  • $170k - $210k

     ...Sr Technical Program Manager New York Office About Parloa Parloa's mission is to make every...  ...the companies serving them. As agentic AI accelerates, Parloans are shaping the...  ...delivery across integrations, infrastructure, environments, testing, and deployment... 
    Work at office

    Parloa

    New York, NY
    2 days ago
  • $177k - $237k

     ...Technical Program Manager CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams...  ...enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $155k - $233k

     ...for job seekers. Day to Day Manage the program plan to ensure timely, quality completion...  ...in handling multi-year, highly technical programs (e.g., infrastructure migration, platform programs, re-...  ...a resume for that opening. AI Notice Indeed is committed to ensuring... 
    Work experience placement
    Local area

    Indeed

    New York, NY
    1 day ago
  •  ...Detailed JD (Roles and Responsibilities) The Technical Program Manager will be part of the U.S. Consumer Services Technology (USCS Tech)...  ...cutting-edge digital capabilities across customer experience, AI/ML, marketing technology, enterprise communications, and automation... 

    Spruce Infotech

    New York, NY
    3 days ago
  • $211.2k - $264k

     ...As a Technical Program Manager for the Platform team, you will partner with engineering teams to directly...  ...maturity of the Scale Generative AI Platform (SGP) . We are looking for a...  ...-end execution of our most critical infrastructure initiatives-from initial scoping to... 
    Full time

    Scale AI

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Technical Program Manager - AI Infrastructure. Be the first to apply!