Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Technical Program Manager (TPM) - AI Infrastructure Operations

Nscale

Role Overview

As a Technical Program Manager (TPM) for AI Infrastructure Operations, you will be the operational backbone of our high-scale, high-performance AI and High-Performance Computing (HPC) environment. You will be responsible for driving complex, cross-functional programs that ensure the stability, availability, and growth of our cutting-edge GPU fleet and Infiniband network fabrics. This role requires a blend of deep technical understanding, rigorous program management, and a relentless focus on delivering against key operational metrics (SLAs, Uptime, Availability). You will bridge the gap between engineering execution and strategic business goals, directly impacting our ability to serve customer workloads at scale.

Key Responsibilities

  • Program Leadership: Own the planning, execution, and delivery of strategic operational programs, including new data center AI infrastructure build-outs, large-scale fleet software/firmware rollouts, and the implementation of new operational tooling (in partnership with SRE).
  • Metrics and Reporting: Establish, track, and drive accountability against critical infrastructure KPIs, specifically focusing on Availability (Target 97.5%) and Uptime (Target 99%) . Develop clear dashboards and communication rhythms to provide leadership with real-time visibility into operational health, program status, and risk.
  • Process Engineering: Analyze and optimize operational workflows across Fleet Operations, Network Operations, and SRE teams. Drive the standardization of incident management, change management, and postmortem processes to reduce toil and improve Mean Time to Recovery (MTTR).
  • Cross-Functional Coordination: Serve as the primary liaison between engineering teams (Hardware, Compute Platform, Network), Data Center Operations, and external vendors (GPU, Network hardware). Proactively identify and resolve dependencies, risks, and roadblocks.
  • Capacity and Readiness: Partner with Data Science/Operation Programs to translate capacity planning models into actionable infrastructure delivery and readiness roadmaps. Ensure that new hardware (GPUs, NICs, switches) is successfully integrated into the operational control plane and meets go-live criteria.
  • Risk Management: Proactively identify technical, schedule, and resource risks related to AI infrastructure scaling and stability. Develop mitigation strategies and communicate impacts clearly to stakeholders.

Required Qualifications

  • Experience: 5+ years of experience in a Technical Program Management role, successfully driving large-scale, complex infrastructure or software engineering programs.
  • Technical Domain Knowledge: Strong foundational understanding of data center infrastructure, distributed systems, Linux, and networking concepts.
  • Program Management Rigor: Proven expertise in modern program management methodologies (Agile, Scrum, PMP certification preferred). Exceptional organizational, communication, and presentation skills.
  • Metrics-Driven Approach: Demonstrable experience in defining, tracking, and improving system performance based on operational metrics (e.g., Uptime, Availability, MTTR, SLOs/SLIs).
  • Execution in Ambiguity: Ability to thrive in a fast-paced, high-growth environment, managing multiple priorities and adapting to evolving technical requirements.

Preferred Qualifications

  • Direct experience managing programs related to data center infrastructure build-outs and hardware commissioning processes.
  • Specific domain knowledge of AI/HPC infrastructure , including NVIDIA GPUs, InfiniBand/RDMA networks, and the challenges of tightly-coupled systems.
  • Experience in a hyperscale or public cloud environment supporting 24/7 mission-critical services.
  • Familiarity with SRE principles, automation tooling, and continuous integration/continuous deployment (CI/CD) pipelines for infrastructure.
  • A Bachelor's or Master's degree in a technical field (Computer Science, Engineering, etc.) or equivalent practical experience.

What We Can Offer You

At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core.

  • Highly competitive package (base + equity) with reviews every 12 months. 
  • Join the fastest-growing tech startup, your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI. 
  • Expect a dynamic progression plan tailored to your ambitions. Grow by trying new things, leading, challenging the status quo, and owning your impact, always with our full support.

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice:  Here.

Nscale does not accept unsolicited candidate submissions from recruitment agencies.

Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Principal Technical Program Manager (TPM) - AI Infrastructure Operations in Houston, TX vacancy
  • $190k - $300k

     ...PMO Nscale builds and operates large-scale AI infrastructure, delivering GPU clusters...  ...role The Deployment TPM owns the last mile of every...  ..., from network edge and management connectivity through to...  ..., service transition or technical program management for large-scale... 
    Operations
    Work at office
    Flexible hours

    Nscale

    Houston, TX
    4 hours ago
  •  ..., and multi-site technical projects, serving...  ...teams, manufacturing operations, IT, engineering...  ...and milestone management, dependency tracking...  ...automation. The TPM is expected to...  ...system interfaces, IT infrastructure, and automation...  ...common programming logic and assist... 
    Operations
    Afternoon shift
    Early shift

    Foxconn Industrial Internet - FII

    Houston, TX
    2 days ago
  • $15k - $20k

     ...delivering specialized tech solutions in Gen AI, Data Engineering, and Backend Systems....  ...of our successes?    The Associate Technical Program Manager – AI Infrastructure supports the coordination, planning, and day-to-day operational management of enterprise AI factory and... 
    Operations
    Full time

    At Dawn Technologies

    Houston, TX
    19 days ago
  •  ...advanced technology, operational excellence, and a...  ...outcomes. Leverages AI as a force...  ...backend, and cloud infrastructure while reducing technical debt. Execution...  ...business units. Program Leadership: Lead complex...  ...expertise in product management, API ecosystems,... 
    Operations
    Principal
    For contractors
    Work at office
    Shift work

    Empower Pharmacy

    Houston, TX
    5 days ago
  •  ...technology covering rate management across Air Ocean...  ...investment. Technical Design...  ...Measurement) Define operational KPIs: quote turnaround...  ...Pricing within the TPM and engineering teams...  ...fundamentals of AI across modalities....  ...of technical program or product management... 
    Operations
    Full time
    Contract work
    Work at office

    . Crane Worldwide Logistics .

    Houston, TX
    2 days ago
  • $127.1k - $171.9k

    We’re seeking an experienced Technical Infrastructure Program Manager to oversee data center build projects in Texas. Technical Infrastructure Program...  ...Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re... 
    Operations
    Flexible hours

    Amazon

    Houston, TX
    9 hours ago
  • $150k - $250k

     ...engineered for AI. We provide...  ...high-performance infrastructure for AI start-...  ...cloud bolsters technical capabilities...  ...including cost management, rapid innovation...  ...Operations team keeps one...  ...looking for a Principal Site Reliability...  ...or commission programs. Nscale may offer... 
    Operations
    Principal
    Remote work
    Flexible hours

    Nscale

    Houston, TX
    2 days ago
  •  ...engineered for AI. We provide...  ...high-performance infrastructure for AI start-...  ...cloud bolsters technical capabilities...  ...including cost management, rapid innovation...  ...The Network Operations and...  ...for a Senior Principal Front End Network...  ...or commission programs. Nscale may offer... 
    Operations
    Principal
    Flexible hours

    Nscale

    Houston, TX
    4 hours ago
  • Position Title: TECHNICAL PROGRAM MANAGERLocation: HOUSTON, TXFLSA Class...  ...Summary: The Technical Program Manager (TPM) is responsible for leading...  ...'s environment, TPMs operate at the intersection of engineering...  ..., oil and gas, energy infrastructure, EPC, or heavy industrial operations... 
    Operations
    Full time
    Local area

    VoltaGrid

    Houston, TX
    9 hours ago
  •  ...Overview As a Principal Infrastructure Engineer, AI Cluster Performance &...  ...AI Infrastructure Operations team, responsible for...  ...Responsibilities Own the technical definition of "...  ...other tech leads, managers, and senior...  ...new hardware product programs, and explore AI-driven... 
    Operations
    Principal

    Nscale

    Houston, TX
    4 hours ago
  • $90.1k - $209.5k

     ...Principal Program Manager Oracle Cloud Infrastructure (OCI) is seeking a Principal Program Manager to lead strategic operational improvement initiatives within our Repair Services organization...  ...leadership, vendor management, and technical problem-solving skills. You will... 
    Operations
    Principal
    Contract work
    Temporary work
    Flexible hours

    Hackajob

    Houston, TX
    3 days ago
  •  ...Leverage your deep technical expertise and leadership to...  ...As a Lead Technical Program Manager in Corporate Sector – Infrastructure Platforms, you will drive...  ...contribute to the development of operational plans and risk...  ...Uses enterprise-authorized AI capabilities within the... 

    JP Morgan Chase

    Houston, TX
    9 hours ago
  • Technical Program Manager Location: Houston, TX (Hybrid 4 days/week in office & 1 day/ week from home) The Technical Program Manager will lead...  ...experience, architecture, engineering, data, compliance, operations, and go-to-market teams to deliver an integrated, reliable... 
    Operations
    Work at office
    1 day per week

    Inizio Partners Corp

    Houston, TX
    5 days ago
  •  ...automation, ML and AI. We built...  ...customer priorities, technical objections, and design...  ...incident management, with a focus on...  ...and application infrastructure required to implement...  ...enterprise transformation programs/projectsMinimum...  ..., Network Operations, Software Development... 
    Operations
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Houston, TX
    9 hours ago
  • $90.1k - $209.5k

     ...experienced Electrical Engineer and Technical Program Manager to lead GPU and CPU server platform development...  ...Oracle brings together the data, infrastructure, applications, and expertise to power...  ...to life-saving care. And with AI embedded across our products and services... 
    Temporary work
    For contractors
    Immediate start
    Flexible hours

    Oracle Corporation

    Houston, TX
    3 days ago
  • $114.6k - $234.6k

    Oracle Cloud Infrastructure (OCI) is seeking a Senior Technical Program Manager to lead operational improvement programs across our global Repair Services organization. In this...  ...industry innovations to life-saving care. And with AI embedded across our products and services, we... 
    Operations
    Principal
    Temporary work
    Flexible hours

    Oracle Corporation

    Houston, TX
    1 day ago
  • $104.9k - $199.07k

     ...healthcare cost and care management.MedInsight is a...  ...is seeking a Technical Product Manager...  ...healthcare analytics and AI products. This...  ...build, ship, and operate MedInsight...  ...developer platforms, infrastructure services, APIs,...  ...partnersEmployee Assistance Program (EAP) -... 
    Operations
    Full time
    Work experience placement
    Remote work
    Flexible hours

    Milliman

    Houston, TX
    4 days ago
  •  ...unleashing the power of AI to create value at...  ...specifically within the Asset Management and Reliability...  ...maintenance, reliability, and operations functions through IBM...  ...serve as the primary technical authority for IBM MAS...  ...and Oracle Cloud Infrastructure (OCI)Design and implement... 
    Operations
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Houston, TX
    9 hours ago
  •  ...most important technology and AI companies on their most...  ...companies: hyperscalers building the infrastructure that powers the global...  ...scale? How do you build and operate data center infrastructure fast...  ...beyond a single engagement. As a Principal Director you are a true... 
    Operations
    Principal
    Live in
    Work at office
    Local area
    Shift work

    Accenture

    Houston, TX
    9 hours ago
  •  ...distinctive investment management capabilities,...  ...who innovate, operate effectively in...  .... As Senior Principal Solutions...  ...automation, AI, and advanced...  ...objectives and technical execution.Develop...  ..., and infrastructure teams to ensure...  ...Lead enablement programs for data stewards... 
    Operations
    Principal
    Full time
    Work experience placement
    Work at office
    Flexible hours

    Invesco

    Houston, TX
    4 days ago
  • $190k - $220k

     ...complex, multi-service infrastructure or transformation...  ...data center and/or AI infrastructure programs, with a strong...  ...Proven governance, risk management and escalation...  ...together strategy, deep technical expertise and world...  ...management, and operational excellence.Key ResponsibilitiesOwn... 
    Operations
    Full time
    Relocation
    Flexible hours
    Shift work

    World Wide Technology

    Houston, TX
    1 day ago
  • $106k - $133k

     ...problems.Slalom’s AI Systems &...  ...clearly articulate technical decisions, delivery...  ..., and production operating considerations.*...  ...AWS, Azure, or GCP infrastructure and data services...  ...monitoring, logging, cost management, or production...  ...,000, and at the Principal level is $157,000... 
    Operations
    Principal
    Temporary work
    Work at office
    Local area

    Slalom

    Houston, TX
    2 days ago
  • $198k - $247k

     ...automation, and AI-native...  ...platforms that can operate safely at enterprise...  ...’ll Do* Set technical direction for...  ...and lifecycle management.* Define...  ...across complex programs.* Drive business...  ...test automation, infrastructure as code, and...  ...range for Senior Principal is $198,000 to... 
    Operations
    Principal
    Temporary work
    Local area

    Slalom

    Houston, TX
    4 days ago
  •  ...distinctive investment management capabilities, we...  ...the Role:The Principal AI Platform Infrastructure Architect owns the...  ...contributor role sets the technical direction for...  ...infrastructure decisions across programs, products, and...  ...use.Define operational readiness and lifecycle... 
    Principal
    Full time
    Work at office
    Flexible hours

    Invesco

    Houston, TX
    9 hours ago
  • $131.3k - $177.6k

     ...AWS Applied AI Solutions (AAIS) is building...  ...Enterprise Support Technical Account Managers (TAM) support our customers...  ...to be the principal technical advisor and...  ...customers AWS environments operationally healthy and...  ...- Knowledge of AWS Infrastructure - Bachelors degree... 
    Operations
    Full time
    Work experience placement
    Flexible hours

    Amazon

    Houston, TX
    29 days ago
  •  ..., delivering SAP programs faster through modern...  ...approaches and AI-enabled...  ...along with deep SAP technical or functional expertise...  ...and application infrastructure for a complete solution...  ..., product management, and engineering...  ...administration, network operations, software... 
    Operations
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Houston, TX
    4 days ago
  •  ...distinctive investment management capabilities, we...  ...the Role:The Principal Automation & AI Engineer serves as the technical leader...  ...analytics, and operational intelligence capabilities...  ...enable Cloud & Infrastructure leadership team...  ...Engineering: Strong programming skills in Python... 
    Operations
    Principal
    Full time
    Work at office
    Flexible hours

    Invesco

    Houston, TX
    2 days ago
  • $168.5k - $206k

     ...Job Title Principal Solution Architect...  ...& Research, Management Consulting,...  ...identity, data, AI, and enterprise...  ..., and operating models that enable...  ...offs. Translate technical cyber risks and...  ...transformation programs. Design secure...  ..., data, infrastructure, and AI-enabled... 
    Operations
    Principal
    Permanent employment
    Full time
    Work at office
    Local area
    Home office
    3 days per week

    Bain & Company

    Houston, TX
    5 days ago
  • $163.38k - $261.41k

     ...up commercial operations so companies run...  ...line.Role: Principal Software EngineerReports...  ...to: Manager, Product Development...  ..., set technical direction for...  ...Engineering, AI, and Product Security...  ...platform or infrastructure services.Deep...  ...compensation programs that are fair... 
    Operations
    Principal
    Full time
    Immediate start
    Worldwide
    Flexible hours

    Conga

    Houston, TX
    2 days ago
  • $176k - $220k

     ...secure, and future-ready infrastructure across hybrid...  ...Enable Secure Cloud Operations: Champion cloud data security...  ...cost controls, including managing consumption and rate limits for AI-driven workloads....  ...while clearly articulating technical concepts to diverse audiences... 
    Operations
    Local area
    Immediate start
    Worldwide
    Flexible hours

    Kirkland & Ellis LLP

    Houston, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Technical Program Manager (TPM) - AI Infrastructure Operations. Be the first to apply!