Principal Technical Program Manager (TPM) - AI Infrastructure Operations
Nscale
Role Overview
As a Technical Program Manager (TPM) for AI Infrastructure Operations, you will be the operational backbone of our high-scale, high-performance AI and High-Performance Computing (HPC) environment. You will be responsible for driving complex, cross-functional programs that ensure the stability, availability, and growth of our cutting-edge GPU fleet and Infiniband network fabrics. This role requires a blend of deep technical understanding, rigorous program management, and a relentless focus on delivering against key operational metrics (SLAs, Uptime, Availability). You will bridge the gap between engineering execution and strategic business goals, directly impacting our ability to serve customer workloads at scale.
Key Responsibilities
- Program Leadership: Own the planning, execution, and delivery of strategic operational programs, including new data center AI infrastructure build-outs, large-scale fleet software/firmware rollouts, and the implementation of new operational tooling (in partnership with SRE).
- Metrics and Reporting: Establish, track, and drive accountability against critical infrastructure KPIs, specifically focusing on Availability (Target 97.5%) and Uptime (Target 99%) . Develop clear dashboards and communication rhythms to provide leadership with real-time visibility into operational health, program status, and risk.
- Process Engineering: Analyze and optimize operational workflows across Fleet Operations, Network Operations, and SRE teams. Drive the standardization of incident management, change management, and postmortem processes to reduce toil and improve Mean Time to Recovery (MTTR).
- Cross-Functional Coordination: Serve as the primary liaison between engineering teams (Hardware, Compute Platform, Network), Data Center Operations, and external vendors (GPU, Network hardware). Proactively identify and resolve dependencies, risks, and roadblocks.
- Capacity and Readiness: Partner with Data Science/Operation Programs to translate capacity planning models into actionable infrastructure delivery and readiness roadmaps. Ensure that new hardware (GPUs, NICs, switches) is successfully integrated into the operational control plane and meets go-live criteria.
- Risk Management: Proactively identify technical, schedule, and resource risks related to AI infrastructure scaling and stability. Develop mitigation strategies and communicate impacts clearly to stakeholders.
Required Qualifications
- Experience: 5+ years of experience in a Technical Program Management role, successfully driving large-scale, complex infrastructure or software engineering programs.
- Technical Domain Knowledge: Strong foundational understanding of data center infrastructure, distributed systems, Linux, and networking concepts.
- Program Management Rigor: Proven expertise in modern program management methodologies (Agile, Scrum, PMP certification preferred). Exceptional organizational, communication, and presentation skills.
- Metrics-Driven Approach: Demonstrable experience in defining, tracking, and improving system performance based on operational metrics (e.g., Uptime, Availability, MTTR, SLOs/SLIs).
- Execution in Ambiguity: Ability to thrive in a fast-paced, high-growth environment, managing multiple priorities and adapting to evolving technical requirements.
Preferred Qualifications
- Direct experience managing programs related to data center infrastructure build-outs and hardware commissioning processes.
- Specific domain knowledge of AI/HPC infrastructure , including NVIDIA GPUs, InfiniBand/RDMA networks, and the challenges of tightly-coupled systems.
- Experience in a hyperscale or public cloud environment supporting 24/7 mission-critical services.
- Familiarity with SRE principles, automation tooling, and continuous integration/continuous deployment (CI/CD) pipelines for infrastructure.
- A Bachelor's or Master's degree in a technical field (Computer Science, Engineering, etc.) or equivalent practical experience.
What We Can Offer You
At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core.
- Highly competitive package (base + equity) with reviews every 12 months.
- Join the fastest-growing tech startup, your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI.
- Expect a dynamic progression plan tailored to your ambitions. Grow by trying new things, leading, challenging the status quo, and owning your impact, always with our full support.
For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here. Nscale does not accept unsolicited candidate submissions from recruitment agencies.
$190k - $300k
...PMO Nscale builds and operates large-scale AI infrastructure, delivering GPU clusters... ...role The Deployment TPM owns the last mile of every... ..., from network edge and management connectivity through to... ..., service transition or technical program management for large-scale...OperationsWork at officeFlexible hours- ..., and multi-site technical projects, serving... ...teams, manufacturing operations, IT, engineering... ...and milestone management, dependency tracking... ...automation. The TPM is expected to... ...system interfaces, IT infrastructure, and automation... ...common programming logic and assist...OperationsAfternoon shiftEarly shift
$15k - $20k
...delivering specialized tech solutions in Gen AI, Data Engineering, and Backend Systems.... ...of our successes? The Associate Technical Program Manager – AI Infrastructure supports the coordination, planning, and day-to-day operational management of enterprise AI factory and...OperationsFull time- ...advanced technology, operational excellence, and a... ...outcomes. Leverages AI as a force... ...backend, and cloud infrastructure while reducing technical debt. Execution... ...business units. Program Leadership: Lead complex... ...expertise in product management, API ecosystems,...OperationsPrincipalFor contractorsWork at officeShift work
- ...technology covering rate management across Air Ocean... ...investment. Technical Design... ...Measurement) Define operational KPIs: quote turnaround... ...Pricing within the TPM and engineering teams... ...fundamentals of AI across modalities.... ...of technical program or product management...OperationsFull timeContract workWork at office
$127.1k - $171.9k
We’re seeking an experienced Technical Infrastructure Program Manager to oversee data center build projects in Texas. Technical Infrastructure Program... ...Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re...OperationsFlexible hours$150k - $250k
...engineered for AI. We provide... ...high-performance infrastructure for AI start-... ...cloud bolsters technical capabilities... ...including cost management, rapid innovation... ...Operations team keeps one... ...looking for a Principal Site Reliability... ...or commission programs. Nscale may offer...OperationsPrincipalRemote workFlexible hours- ...engineered for AI. We provide... ...high-performance infrastructure for AI start-... ...cloud bolsters technical capabilities... ...including cost management, rapid innovation... ...The Network Operations and... ...for a Senior Principal Front End Network... ...or commission programs. Nscale may offer...OperationsPrincipalFlexible hours
- Position Title: TECHNICAL PROGRAM MANAGERLocation: HOUSTON, TXFLSA Class... ...Summary: The Technical Program Manager (TPM) is responsible for leading... ...'s environment, TPMs operate at the intersection of engineering... ..., oil and gas, energy infrastructure, EPC, or heavy industrial operations...OperationsFull timeLocal area
- ...Overview As a Principal Infrastructure Engineer, AI Cluster Performance &... ...AI Infrastructure Operations team, responsible for... ...Responsibilities Own the technical definition of "... ...other tech leads, managers, and senior... ...new hardware product programs, and explore AI-driven...OperationsPrincipal
$90.1k - $209.5k
...Principal Program Manager Oracle Cloud Infrastructure (OCI) is seeking a Principal Program Manager to lead strategic operational improvement initiatives within our Repair Services organization... ...leadership, vendor management, and technical problem-solving skills. You will...OperationsPrincipalContract workTemporary workFlexible hours- ...Leverage your deep technical expertise and leadership to... ...As a Lead Technical Program Manager in Corporate Sector – Infrastructure Platforms, you will drive... ...contribute to the development of operational plans and risk... ...Uses enterprise-authorized AI capabilities within the...
- Technical Program Manager Location: Houston, TX (Hybrid 4 days/week in office & 1 day/ week from home) The Technical Program Manager will lead... ...experience, architecture, engineering, data, compliance, operations, and go-to-market teams to deliver an integrated, reliable...OperationsWork at office1 day per week
- ...automation, ML and AI. We built... ...customer priorities, technical objections, and design... ...incident management, with a focus on... ...and application infrastructure required to implement... ...enterprise transformation programs/projectsMinimum... ..., Network Operations, Software Development...OperationsWork experience placementLive inWork at officeLocal area
$90.1k - $209.5k
...experienced Electrical Engineer and Technical Program Manager to lead GPU and CPU server platform development... ...Oracle brings together the data, infrastructure, applications, and expertise to power... ...to life-saving care. And with AI embedded across our products and services...Temporary workFor contractorsImmediate startFlexible hours$114.6k - $234.6k
Oracle Cloud Infrastructure (OCI) is seeking a Senior Technical Program Manager to lead operational improvement programs across our global Repair Services organization. In this... ...industry innovations to life-saving care. And with AI embedded across our products and services, we...OperationsPrincipalTemporary workFlexible hours$104.9k - $199.07k
...healthcare cost and care management.MedInsight is a... ...is seeking a Technical Product Manager... ...healthcare analytics and AI products. This... ...build, ship, and operate MedInsight... ...developer platforms, infrastructure services, APIs,... ...partnersEmployee Assistance Program (EAP) -...OperationsFull timeWork experience placementRemote workFlexible hours- ...unleashing the power of AI to create value at... ...specifically within the Asset Management and Reliability... ...maintenance, reliability, and operations functions through IBM... ...serve as the primary technical authority for IBM MAS... ...and Oracle Cloud Infrastructure (OCI)Design and implement...OperationsWork experience placementLive inWork at officeLocal area
- ...most important technology and AI companies on their most... ...companies: hyperscalers building the infrastructure that powers the global... ...scale? How do you build and operate data center infrastructure fast... ...beyond a single engagement. As a Principal Director you are a true...OperationsPrincipalLive inWork at officeLocal areaShift work
- ...distinctive investment management capabilities,... ...who innovate, operate effectively in... .... As Senior Principal Solutions... ...automation, AI, and advanced... ...objectives and technical execution.Develop... ..., and infrastructure teams to ensure... ...Lead enablement programs for data stewards...OperationsPrincipalFull timeWork experience placementWork at officeFlexible hours
$190k - $220k
...complex, multi-service infrastructure or transformation... ...data center and/or AI infrastructure programs, with a strong... ...Proven governance, risk management and escalation... ...together strategy, deep technical expertise and world... ...management, and operational excellence.Key ResponsibilitiesOwn...OperationsFull timeRelocationFlexible hoursShift work$106k - $133k
...problems.Slalom’s AI Systems &... ...clearly articulate technical decisions, delivery... ..., and production operating considerations.*... ...AWS, Azure, or GCP infrastructure and data services... ...monitoring, logging, cost management, or production... ...,000, and at the Principal level is $157,000...OperationsPrincipalTemporary workWork at officeLocal area$198k - $247k
...automation, and AI-native... ...platforms that can operate safely at enterprise... ...’ll Do* Set technical direction for... ...and lifecycle management.* Define... ...across complex programs.* Drive business... ...test automation, infrastructure as code, and... ...range for Senior Principal is $198,000 to...OperationsPrincipalTemporary workLocal area- ...distinctive investment management capabilities, we... ...the Role:The Principal AI Platform Infrastructure Architect owns the... ...contributor role sets the technical direction for... ...infrastructure decisions across programs, products, and... ...use.Define operational readiness and lifecycle...PrincipalFull timeWork at officeFlexible hours
$131.3k - $177.6k
...AWS Applied AI Solutions (AAIS) is building... ...Enterprise Support Technical Account Managers (TAM) support our customers... ...to be the principal technical advisor and... ...customers AWS environments operationally healthy and... ...- Knowledge of AWS Infrastructure - Bachelors degree...OperationsFull timeWork experience placementFlexible hours- ..., delivering SAP programs faster through modern... ...approaches and AI-enabled... ...along with deep SAP technical or functional expertise... ...and application infrastructure for a complete solution... ..., product management, and engineering... ...administration, network operations, software...OperationsWork experience placementLive inWork at officeLocal area
- ...distinctive investment management capabilities, we... ...the Role:The Principal Automation & AI Engineer serves as the technical leader... ...analytics, and operational intelligence capabilities... ...enable Cloud & Infrastructure leadership team... ...Engineering: Strong programming skills in Python...OperationsPrincipalFull timeWork at officeFlexible hours
$168.5k - $206k
...Job Title Principal Solution Architect... ...& Research, Management Consulting,... ...identity, data, AI, and enterprise... ..., and operating models that enable... ...offs. Translate technical cyber risks and... ...transformation programs. Design secure... ..., data, infrastructure, and AI-enabled...OperationsPrincipalPermanent employmentFull timeWork at officeLocal areaHome office3 days per week$163.38k - $261.41k
...up commercial operations so companies run... ...line.Role: Principal Software EngineerReports... ...to: Manager, Product Development... ..., set technical direction for... ...Engineering, AI, and Product Security... ...platform or infrastructure services.Deep... ...compensation programs that are fair...OperationsPrincipalFull timeImmediate startWorldwideFlexible hours$176k - $220k
...secure, and future-ready infrastructure across hybrid... ...Enable Secure Cloud Operations: Champion cloud data security... ...cost controls, including managing consumption and rate limits for AI-driven workloads.... ...while clearly articulating technical concepts to diverse audiences...OperationsLocal areaImmediate startWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Technical Program Manager (TPM) - AI Infrastructure Operations. Be the first to apply!
- technical director Houston, TX
- director of technical services Houston, TX
- technical product manager Houston, TX
- technical coordinator Houston, TX
- technical account manager Houston, TX
- technical writing manager Houston, TX
- technical services manager Houston, TX
- senior technical director Houston, TX
- technical integration manager Houston, TX
- senior technical manager Houston, TX





