Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Technical Program Manager (TPM) - AI Infrastructure Operations New Houston; New York; San

Greenhouse Software, Inc.

Principal Technical Program Manager (TPM) - AI Infrastructure Operations Houston; New York; San Francisco; Seattle Role Overview As a Technical Program Manager (TPM) for AI Infrastructure Operations, you will be the operational backbone of our high-scale, high-performance AI and High-Performance Computing (HPC) environment. You will be responsible for driving complex, cross-functional programs that ensure the stability, availability, and growth of our cutting-edge GPU fleet and Infiniband network fabrics. This role requires a blend of deep technical understanding, rigorous program management, and a relentless focus on delivering against key operational metrics (SLAs, Uptime, Availability). You will bridge the gap between engineering execution and strategic business goals, directly impacting our ability to serve customer workloads at scale. Key Responsibilities Program Leadership: Own the planning, execution, and delivery of strategic operational programs, including new data center AI infrastructure build-outs, large-scale fleet software/firmware rollouts, and the implementation of new operational tooling (in partnership with SRE). Metrics and Reporting: Establish, track, and drive accountability against critical infrastructure KPIs, specifically focusing on Availability (Target 97.5%) and Uptime (Target 99%) . Develop clear dashboards and communication rhythms to provide leadership with real-time visibility into operational health, program status, and risk. Process Engineering: Analyze and optimize operational workflows across Fleet Operations, Network Operations, and SRE teams. Drive the standardization of incident management, change management, and postmortem processes to reduce toil and improve Mean Time to Recovery (MTTR). Cross-Functional Coordination: Serve as the primary liaison between engineering teams (Hardware, Compute Platform, Network), Data Center Operations, and external vendors (GPU, Network hardware). Proactively identify and resolve dependencies, risks, and roadblocks. Capacity and Readiness: Partner with Data Science/Operation Programs to translate capacity planning models into actionable infrastructure delivery and readiness roadmaps. Ensure that new hardware (GPUs, NICs, switches) is successfully integrated into the operational control plane and meets go-live criteria. Risk Management: Proactively identify technical, schedule, and resource risks related to AI infrastructure scaling and stability. Develop mitigation strategies and communicate impacts clearly to stakeholders. Required Qualifications Experience: 5+ years of experience in a Technical Program Management role, successfully driving large-scale, complex infrastructure or software engineering programs. Technical Domain Knowledge: Strong foundational understanding of data center infrastructure, distributed systems, Linux, and networking concepts. Program Management Rigor: Proven expertise in modern program management methodologies (Agile, Scrum, PMP certification preferred). Exceptional organizational, communication, and presentation skills. Metrics-Driven Approach: Demonstrable experience in defining, tracking, and improving system performance based on operational metrics (e.g., Uptime, Availability, MTTR, SLOs/SLIs). Execution in Ambiguity: Ability to thrive in a fast-paced, high-growth environment, managing multiple priorities and adapting to evolving technical requirements. Preferred Qualifications Direct experience managing programs related to data center infrastructure build-outs and hardware commissioning processes. Specific domain knowledge of AI/HPC infrastructure , including NVIDIA GPUs, InfiniBand/RDMA networks, and the challenges of tightly-coupled systems. Experience in a hyperscale or public cloud environment supporting 24/7 mission-critical services. Familiarity with SRE principles, automation tooling, and continuous integration/continuous deployment (CI/CD) pipelines for infrastructure. A Bachelor's or Master's degree in a technical field (Computer Science, Engineering, etc.) or equivalent practical experience. What We Can Offer You At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core. Highly competitive package (base + equity) with reviews every 12 months. Join the fastest-growing tech startup, your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI. Expect a dynamic progression plan tailored to your ambitions. Grow by trying new things, leading, challenging the status quo, and owning your impact, always with our full support. For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here. Nscale does not accept unsolicited candidate submissions from recruitment agencies. #J-18808-Ljbffr Greenhouse Software, Inc.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal Technical Program Manager (TPM) - AI Infrastructure Operations New Houston; New York; San in New York, NY vacancy
  • $190k - $225k

     ...Technical Program Manager - Cyber Defense, Metrics and...  ...Intelligence Houston; New York; San Francisco; Seattle...  ...engineered for AI. We provide...  ...high-performance infrastructure for AI start-ups...  ...strong TPM execution with...  ...trust, compliance, operational resilience, and... 
    Operations
    Flexible hours

    Jobleads-US

    New York, NY
    1 day ago
  • $157k - $210k

     ...Essential Cloud for AI. Built for...  ...combines superior infrastructure performance with deep technical expertise to accelerate...  .... You will not manage people — you will manage programs, processes, and...  ...that makes each new site usable....  ..., and Operations: track commitments... 
    Operations
    Permanent employment
    Full time
    Temporary work
    For contractors
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  • $194.7k - $263.4k

     ...advanced generative AI technologies and AI agents...  ...a highly skilled Technical Program Manager (TPM) to lead strategic programs...  ...for Amazon Ads' AI infrastructure core services that...  ...and scaling) of new and existing systems-...  ...benefits at .USA, NY, New York - 194,700.00 - 263,40... 
    Principal
    Flexible hours

    Amazon

    New York, NY
    5 days ago
  • $200k - $230k

     ...digital asset infrastructure company delivering...  ...onsite at our New York City (40 Wall...  ..., asset managers, protocols, corporates...  ...: delivery operating rhythm, cross-...  ...remediation programs, etc that cut...  ...and build the Technical Program Management...  ...to fudge. The TPM team. You... 
    Operations
    Full time
    Contract work
    For contractors
    For subcontractor
    Live in
    Work at office
    Worldwide

    BitGo, Inc.

    New York, NY
    1 day ago
  • $157k - $210k

     ...Essential Cloud for AI. Built for...  ...combines superior infrastructure performance with deep technical expertise to accelerate...  ...Senior FW Technical Program Manager (TPM) to join our...  ...team focused on the New Product Introduction...  ...Manufacturing, Quality, and Operations teams to ensure... 
    Operations
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    5 days ago
  • $203.5k - $275.3k

     ...models will unlock new, actionable...  ...including Generative AI, classical ML, Causal...  ...Vision.As a Principal Technical Program Manager on the team, you...  ...mitigate technical and operational risks across...  ....Pursuant to the San Francisco Fair Chance...  ..., NY, New York - 194,700.00 - 26... 
    Operations
    Principal
    Local area
    Flexible hours

    Amazon

    New York, NY
    4 days ago
  • $250k - $350k

     ...Senior Infrastructure Engineer, AI Platform Location New York, NY Level Senior Reports To Leadership...  ...without drowning in the operational complexity of model management, cost optimization, and...  ...comfortable diving into unfamiliar technical domains and have the... 
    Operations
    Immediate start

    Jobleads-US

    New York, NY
    4 days ago
  • $203.5k - $275.3k

     ...advanced generative AI technologies and AI agents...  ...brands online. As a Principal Technical Program Manager, you’ll lead large-...  ...technical and operational risks across large-scale...  ...reliability and scaling) of new and existing systems-...  ...annuallyUSA, NY, New York - 194,700.00 - 263,40... 
    Operations
    Principal
    Local area
    Flexible hours

    Amazon

    New York, NY
    4 days ago
  • $194.7k - $263.4k

     ...leading generative AI technologies,...  ...TeamThe SPB Vertical Program serves as the...  ...2028. We seek a Principal Technical Program Manager with strong technical...  ...to shape a new function from the...  ...responsibilities- Own and operate the vertical...  ...at .USA, NY, New York - 194,700.00 - 26... 
    Operations
    Principal
    Flexible hours

    Amazon

    New York, NY
    2 days ago
  •  ...headquarters in London and New York, Fitch Group is...  ...the Executive Program Management Office (EPMO)....  ...like AI and cloud solutions...  ...group is seeking a Principal Data Scientist...  ...(AWS and Azure) infrastructure & services e.g....  ...our day-to-day operations, helping teams work... 
    Operations
    Principal
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch Group

    New York, NY
    27 days ago
  • $160k - $270k

     ...engineered for AI. We provide...  ...high-performance infrastructure for AI start-...  ...cloud bolsters technical capabilities...  ...including cost management, rapid innovation...  ...standards and operational performance of...  ...that support new offices,...  ...or commission programs. Nscale may offer... 
    Operations
    For contractors
    Work at office
    Local area
    Remote work
    Flexible hours

    Jobleads-US

    New York, NY
    1 day ago
  • $200k - $250k

     ...InstaLILY is an AI products and infrastructure company that puts...  ...Headquartered in New York, with offices in San Francisco, London...  ...healthcare, and other operationally intensive...  ...-backed security program. This is a player...  ...policies, secrets management, and least-privilege... 
    Operations
    Live in
    Work at office

    Jobleads-US

    New York, NY
    1 day ago
  • $138k - $197k

     ...design, and deploy AI solutions,...  ...portfolio operations globally.Synthesize...  ...s degree in a technical field or...  ...experience in program management.2 years of experience...  ...the Technical Infrastructure team to keep...  ...Applicants in San Francisco:...  ...the following: New York, NY, USA; San... 
    Operations
    Contract work

    Google

    New York, NY
    5 days ago
  • $200k - $250k

    New York / Austin, Texas / Toronto / San FranciscoG&A - Legal /Full Time /HybridJoin Pigment: The AI Platform Redefining Business PlanningPigment is...  ...planning and performance management platform built for agility...  ...Pigment’s commercial operations and strategic initiatives... 
    Operations
    Full time
    Contract work
    Flexible hours

    Pigment

    New York, NY
    3 days ago
  • $125.5k - $157k

     ...Intelligent Content Management. Our platform...  ...with enterprise AI. We help...  ...companies thrive in the new AI-first era of...  ...capabilities. As the Program Manager,...  ...the day-to-day operations of this early-stage...  ...to applicants in San Francisco: Box,...  ...Provision .  New York City Pay Range$1... 
    Operations
    Full time
    Live in
    Work at office
    Shift work
    3 days per week

    Box

    New York, NY
    3 days ago
  • $206.1k - $309.15k

     ...documentation, mentors technical staff, and...  ...and resource management.Job...  ...including Application Infrastructure) teams, providing...  ...observability, and operational readiness....  ...Lead adoption of AI-assisted software...  ...new applications with...  ...PrinciplesCompensationNew York Pay Range: $206... 
    Principal
    Full time
    Night shift
    Weekend work

    Comcast

    New York, NY
    2 days ago
  • $128k - $146.1k

    Overview Principal Associate, Airport Lounge...  ...team that manages the end-to-end operations of the Capital One...  ...Lounges. In this new role, you will lead...  ...position. New York, NY: $128,000 -...  ...Correction Law; San Francisco, California...  .... For technical support or questions... 
    Operations
    Principal
    Full time
    Part time
    Local area
    Flexible hours
    Afternoon shift

    Comunidade Metodista

    New York, NY
    4 days ago
  •  ...steering multi-faceted tech programs, integrating innovative...  ...impact across global operations. As a Principal Technical Program Manager in Cards, you will lead complex...  ...to the development of new policies and processes, shaping...  ...enterprise-authorized AI capabilities within the... 
    Operations
    Principal
    Shift work

    JP Morgan Chase

    New York, NY
    4 days ago
  • $103.97k - $214.04k

     ...ideas, dream about new possibilities and plan...  .... At Pinterest, AI isn't just a feature...  ...Looking For: 2-4 years of program or project management experience (or...  ...), ideally touching infrastructure, platform, or cloud...  ...accelerate planning, program operations, and stakeholder... 
    Operations
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    New York, NY
    4 days ago
  • $191k - $225k

     ...Brokerage TPM team drives...  ...engineering programs in the company. We operate at the intersection...  ...As a Staff Technical Program Manager, you will...  ...operations principal — crafting...  ...in our New York City or...  ...AWS and core infrastructure concepts, and...  ...the best AI tools on the... 
    Operations
    Permanent employment
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robinhood

    New York, NY
    4 days ago
  • $210.2k - $284.3k

     ...AWS Applied AI Solutions organization...  ...worldwide to manage day-to-day operations. We will...  ...experienced Principal AI/ML HPC...  ...to join our Technical Account Manager...  ...advisor for AI/ML infrastructure decisions...  ...Pursuant to the San Francisco...  ...annuallyUSA, NY, New York - 201,000.00... 
    Operations
    Principal
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    New York, NY
    1 day ago
  • $202k - $280k

     ...New York, NY, USA; San Francisco, CA, USA About the role The way people...  ...lives. We’re looking for a Principal Product Designer to make those...  ...app, from how members manage money day to day to how they...  ...are part of our fully remote program, you’ll stay engaged with... 
    Principal
    Full time
    Work at office
    Local area
    Remote work

    Jobleads-US

    New York, NY
    3 days ago
  • $165 - $180 per hour

     ...3x in office/week); New York, NY - Hybrid (3x in...  ...with partner goals and operational priorities. Acting...  ...business challenges and technical/product solutions,...  ...to shape infrastructure for growth, manage new initiative intake...  ...Artificial Intelligence (AI) to streamline work,... 
    Operations
    Temporary work
    Work at office
    Flexible hours

    Jobleads-US

    New York, NY
    3 days ago
  •  ...steering multi-faceted tech programs, integrating innovative...  ...impact across global operations. As a Principal Technical Program Manager in Cards, you will lead complex...  ...to the development of new policies and processes, shaping...  ...enterprise-authorized AI capabilities within the... 
    Operations
    Principal
    Shift work

    Jobleads-US

    New York, NY
    3 days ago
  • $365k

     ...interpretable, and steerable AI systems. We want...  ...'s data center programs from construction...  ...and day-to-day operations. Partnering with...  ...own the program management that delivers...  ...develop the DC infrastructure TPM team; hire and build...  ...headquartered in San Francisco. We... 
    Operations
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    Jobleads-US

    New York, NY
    18 hours ago
  • $164k - $205k

     ...trained and coached manager, the most amazing team...  ...: Austin, TX; New York City, NY; San Francisco, CA; and the...  ...Contributor to join our Technical Program Management team in...  ...project management and operational excellence, then...  ...-standard tools and AI capabilities creatively... 
    Operations
    Work experience placement
    Summer holiday
    Work at office
    Local area
    Flexible hours
    2 days per week

    SupportFinity

    New York, NY
    1 day ago
  • $140k - $165k

     ...Runpod is the AI Developer Cloud. More than...  ...inflection point for AI infrastructure, and we're building...  ...: We're seeking a Technical Program Manager (TPM) who combines strong...  ...early (host churn, new capacity coming...  ...planning, data center operations, or vendor/partner management... 
    Operations
    Remote work
    Home office
    Visa sponsorship
    Work visa
    Flexible hours

    The POD Network

    New York, NY
    2 days ago
  •  ...Technical Product ManagerFTAI owns and...  ..., repair, and operations customer base....  ...has offices in New York, Miami, Montré...  ...centers and AI hyperscalers worldwide...  ...intelligence infrastructure. As AI...  ...Technical Product Manager with deep...  ...complex hardware programs — from concept... 
    Operations
    Immediate start
    Worldwide
    Flexible hours

    FTAI Aviation

    New York, NY
    3 days ago
  • $151.2k - $189k

     ...tests the most capable AI models in the world...  .... We are hiring a Technical Program Manager to own day-to-day...  ...researchers, and operationally rigorous. You will...  ...conversations, scope new engagements, and grow...  ...the locations of San Francisco, New York, Seattle is:$151,20... 
    Operations
    Full time

    Scale AI

    New York, NY
    5 days ago
  • $211.2k - $264k

     ...As a Technical Program Manager for the Platform team...  ...Scale Generative AI Platform (SGP...  ...for a TPM who has actively...  ...most critical infrastructure initiatives—...  ...leadership. Operating in a hyper-growth...  ...target for new hire salaries...  ...locations of San Francisco, New York, Seattle is:... 
    Full time

    United States Digital Space LLC

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Technical Program Manager (TPM) - AI Infrastructure Operations New Houston; New York; San. Be the first to apply!