Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Validation Technical Program Manager, Logical Deployment

Nscale

About Nscale and the Deployment PMO

Nscale builds and operates large-scale AI infrastructure, delivering GPU clusters for leading hyperscalers, AI labs and enterprises across North America, EMEA and APAC.

The Deployment PMO turns signed contracts into live AI infrastructure, coordinating the many teams and partners involved in bringing large GPU clusters online.

About the role

The Validation TPM owns the proof that a cluster is ready for the customer. You take the customer’s acceptance criteria and turn them into a test plan, run it at cluster scale, and deliver results that stand up to scrutiny. You track the state of validation for every cluster, from first test run to signed acceptance.

You come from software validation and test frameworks, not only program management. You go deep into any test, question outputs that look too good or too bad, and write the script yourself when that is the fastest way to unblock testing. You sit between engineering, OEM partners and the customer, and your results decide when a cluster is handed off.

This is an individual contributor role reporting to the Director, Logical Deployment. Expect to travel up to 50% of the time, primarily to data center sites.

What you’ll do

Turn acceptance criteria into tests

  • Translate each customer’s acceptance criteria into a clear test plan: what is run, at what scale, and with what pass thresholds.
  • Agree the plan with the customer and engineering before testing starts, so there are no surprises at handoff.
  • Map every acceptance criterion to the test result that proves it, and keep that traceability current.

Run and own cluster validation

  • Drive acceptance validation end to end: cluster-wide performance, interconnect, storage, stability and burn-in.
  • Track validation status for every cluster, with a clear view of what has passed, what has failed and what is blocked.
  • Coordinate test windows with fabric, provisioning and OEM teams so validation runs without idle time.

Go deep and unblock

  • Read raw test output, not just summaries. Question results that don’t make sense and find the root cause.
  • Write or modify scripts when a test, harness or data collection step is missing or broken.
  • Triage failures to the right owner (hardware, fabric, firmware, software or configuration) with evidence, and drive them to closure.
  • Re-run and verify fixes before marking anything as passed.

Close out with the customer

  • Produce acceptance reports that tie results to criteria, explain exceptions plainly and support sign-off.
  • Brief the customer and leadership on validation status, with an honest view of risk to the handoff date.
  • Feed what you learn back into the validation playbook, test suites and automation, so each cluster validates faster than the last.

What success looks like in your first 6–12 months

  • Every active cluster has a test plan mapped to its customer’s acceptance criteria, agreed before testing starts.
  • Validation status is visible for every cluster without manual chasing.
  • Failures are triaged to an owner with evidence within a day, and no cluster reaches handoff with an unexplained result.
  • Customers sign off on acceptance reports without rework.
  • A reusable acceptance test suite and reporting automation are in use on every new cluster.

What you bring

  • 7-10+ years in software validation, test engineering or QA for infrastructure or distributed systems, including program or project ownership.
  • Hands-on experience building and running test frameworks, and reading and debugging their output.
  • Strong scripting in Python and Bash, and comfort modifying test harnesses and data pipelines.
  • Working knowledge of GPU cluster performance and validation, such as NCCL collectives, HPL, DCGM diagnostics and burn-in.
  • Familiarity with cluster networking and storage testing, including InfiniBand or RoCE bandwidth and latency, and storage throughput.
  • Experience turning requirements or acceptance criteria into test plans with clear pass/fail evidence.
  • Clear, concise communication with engineers and customers, in writing and in the room.
  • Ability to travel up to 50% of the time, primarily to data center sites.

How you work

  • Rigorous: You trust data, not dashboards. A pass needs evidence, and a strange number gets investigated, not explained away.
  • Bold: You call a cluster not ready when the results say so, even close to a handoff date, and you put a path to ready next to it.
  • Assertive with partners: You hold engineering, OEM partners and vendors to fixing what the tests find. You escalate early, directly and with evidence.
  • Accountable: You own validation outcomes. Rather than “waiting on engineering,” you explain what you are doing to unblock it.
  • Steady under pressure: You keep testing moving when failures stack up and the handoff date is close.
  • Technically deep: You can read a test log, a performance trace or a script and know where the problem is.

Preferred qualifications

  • Experience validating NVIDIA GB200/GB300 or Vera Rubin NVL72-class clusters, including NVIDIA cluster validation tooling.
  • Experience with MLPerf or customer-defined training and inference benchmarks at scale.
  • Familiarity with Slurm or Kubernetes for scheduling large test jobs.
  • Experience at a hyperscaler, neocloud or AI lab accepting 10K+ GPU clusters.
  • Background in CI/CD and test automation for infrastructure.

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice:  Here.

Nscale does not accept unsolicited candidate submissions from recruitment agencies.

Vacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the Senior Validation Technical Program Manager, Logical Deployment in San Francisco, CA vacancy
  • $200k - $240k

     ...design through IaaS products to managed inference at scale,...  ...hiring a Staff TPM who will own deployment programs. You will be helping us...  ...Engineering pool without a plan. Technical Leadership Owns real-...  ...or OEM certification and validation timelines, not coordination... 
    Senior
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  •  ...both in and out of the office.As the Senior Technical Program Manager (TPM) for Manufacturing, you will be...  ...process development and deployment within the PD program. Your mission...  ...tooling, and test equipment is designed, validated, and deployed on time to meet aggressive... 
    Senior
    Contract work
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week

    Oura

    San Francisco, CA
    3 days ago
  • $171k - $231.4k

     ...research & development, deployment and operation of...  ...fostering innovation, and managing multiple competing...  ...initiatives.* Own the program lifecycle for large,...  ...security engineers and senior technical leaders to perform...  ...-concept services to validate requirementsAmazon is... 
    Senior
    Temporary work
    Local area
    Flexible hours

    Amazon

    San Francisco, CA
    2 days ago
  •  ...liquid cooling systems, energy management, AI software orchestration,...  ...users to train and deploy AI models with unmatched efficiency...  ...a customer-centric Senior Technical Program Manager (TPM) to lead the...  ...answer customer questions and validate impact assessments.... 
    Senior
    Permanent employment
    Full time

    Firmus Technologies

    San Francisco, CA
    18 hours ago
  • $196k - $242k

     ...simulation across 15+ U.S. states. Waymo’s Technical Program Managers and Program Managers are accountable...  ...and drive work towards real-world deployments of the Waymo Driver across platforms...  ...training, offline evaluation, and validation Dependency & Risk Management :... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    3 days ago
  •  ...Role We are looking for a technically deep TPM to independently define and lead multiple programs across data platforms,...  ...requirements through architecture, deployment and validation. A data pipeline, database...  .... Evaluate physical versus logical footprint, index and... 
    Full time
    Work at office
    Relocation package

    openai

    San Francisco, CA
    3 days ago
  • $196k - $242k

     ...simulation across 15+ U.S. states. Waymo’s Technical Program Managers and Program Managers are accountable...  ...and drive work towards real-world deployments of the Waymo Driver across platforms...  ...for AV Expansion testing and validation across domestic & international markets... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    18 hours ago
  • $207k - $285k

     ...engineering, legal, policy, and product. Technical Program Managers (TPMs) play a critical leadership...  ...commitments.About the RoleWe’re seeking a Senior Technical Program Manager to drive...  ...OpenAIOpenAI is an AI research and deployment company dedicated to ensuring that general... 
    Senior
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $196k - $242k

     ...Senior Technical Program Manager, Fleet Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver...  ...Waymo to structure, own and drive work towards real-world deployments of the Waymo Driver across platforms and geographies.... 
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    3 days ago
  • $145k - $185k

     ...headquarters in Northern California, USA. Technical Program Manager, USG Space Relays Astranis is...  ...production, ground network deployment, launch, and on-orbit demonstration....  ...Review, and Demonstration Performance Validation Review) and manage formal Data Requirements... 
    Permanent employment
    Flexible hours

    Astranis

    San Francisco, CA
    3 days ago
  • $157k - $210k

     ...infrastructure performance with deep technical expertise to accelerate...  ...'re looking for a Technical Program Manager to join the CIO organization...  ...competing priorities with senior stakeholders, manage...  ...affect delivery. Drive DCIM deployment and site onboarding programs... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Immediate start
    Flexible hours

    CoreWeave

    San Francisco, CA
    4 days ago
  •  ...In this role you'll own program delivery for Rad AI Reporting...  .... You'll sit within Product Management and split your time between...  ...the client integration and deployment programs that get Reporting...  ...-lives end to end and being technical enough to roll up your sleeves... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    radai

    San Francisco, CA
    3 days ago
  • $290k - $350k

     ...Nscale and the Deployment PMO Nscale...  ...As Director of Logical Deployment, you...  ...into a working, validated, customer-...  ...out-of-band and management networks, and...  ...of engineering program managers, networking...  ...to the VP and senior leadership,...  ...leaders. Technically deep: You can... 
    Work at office
    Flexible hours

    Nscale

    San Francisco, CA
    18 hours ago
  • $160k - $190k

     ...enables developers worldwide to run quantum programs on real hardware.We are seeking a Senior Technical Program Manager to drive execution across some of the most complex...  ...that bring these components together into deployable quantum systems.You will operate in a fast-... 
    Senior
    Full time
    Work experience placement
    Local area
    Worldwide

    Rigetti Computing

    Berkeley, CA
    1 day ago
  • $198k - $235.5k

     ...company.   About the Role: Glean is seeking a Senior Infrastructure Technical Program Manager (TPM) to lead large-scale, cross-functional initiatives...  ...teams to design orchestration systems, streamline deployments, and build the foundations that power our search and... 
    Senior
    Work at office
    Home office
    Flexible hours

    Glean

    San Francisco, CA
    18 hours ago
  •  ...training workloads. We seek to learn from deployment and distribute the benefits of AI,...  ...of an engineer-first TPM team as a Technical Program Manager for Compute Infrastructure who owns the...  ...and end-to-end physical and logical bring-up of OpenAI network Points-of-... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    9 days ago
  • RESPONSIBILITIES: Kforce has a client that is seeking a Senior Technical Program Manager in San Francisco, CA. Summary: The Technical Program Manager will be a key member of the Enterprise Program Management team responsible for managing a portfolio of projects... 
    Senior
    Hourly pay
    Contract work

    Kforce Technology Staffing

    San Francisco, CA
    2 days ago
  • $163.64k - $336.9k

     ...how we use AI in our recruiting process here.As a Sr. Staff Technical Program Manager for Search Signals at Pinterest, you will lead company-...  ...and safety-by-design—appropriately handling sensitive data, validating AI-generated outputs, documenting assumptions/limits, and... 
    Senior
    Work at office
    Local area
    Remote work
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago
  •  ...We seek to learn from deployment and distribute the benefits...  ...About the Role As a Technical Program Manager for Compute Infrastructure...  ...threaten deployment. Lead logical readiness across infrastructure...  ...automation, runbooks, validation, and deployment processes.... 
    Remote job
    Full time
    Work at office

    openai

    San Francisco, CA
    3 days ago
  • $116.6k - $264.1k

     ...seeking a Lead Principal Technical Program Manager to lead integrated technical...  ...experimentation.This senior individual contributor role...  ...customer teams. Drive integrated validation covering interfaces,...  ...production introductions, ensuring deployment, support, incident... 
    Temporary work
    Flexible hours

    Oracle Corporation

    San Francisco, CA
    1 day ago
  • $115k - $188k

     ...Customers, and we’re looking for a Program Manager who can help drive that...  ...of how our teams build, validate, and deliver AI‑powered experiences...  ...role requires a blend of technical fluency, structured program...  ...‑driven program updates for senior leadership.Communicate risks... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    2 days ago
  • $200k - $240k

     ...deliver for our customers. As a Staff Technical Program Manager, you will own the end-to-end release...  ...through phased rollout and production deployment. This is a builder role: you will run...  ...will design the release calendars, validation frameworks, and metrics that let Crusoe... 
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    23 hours ago
  • $125k - $153k

     ...San Francisco/Bay Area office up to 5 days a week.**Role: Senior Program Manager/Technical Project ManagerTitle: Senior ConsultantLocation: San...  ...business case development through planning, execution, deployment, and operational transition.* Solid technical foundation... 
    Senior
    Temporary work
    Work at office
    Local area

    Slalom

    San Francisco, CA
    23 hours ago
  •  ...what that could mean. We're hiring a Technical Program Manager to run Pacing. It spans many projects...  ...needs at key points in training and deployment, and make those reviews a dependable...  ...A track record of delivering through senior leaders and teams who don't report to... 
    Full time
    For contractors
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    2 days ago
  • $124k - $210k

     ...joining Zipline as an NPI Technical Program Manager based in South San...  ...link engineering milestones, validation test plans, build schedules...  ...material readiness, field deployment windows, and phased rollout...  ...Manager: $124,000 - $180,000 Senior Technical Program Manager:... 
    Local area

    Zipline

    South San Francisco, CA
    3 days ago
  • $180k - $210k

     ...our success. SUMMARY We are seeking an experienced Senior Technical Program Manager (Electronics) with a strong background in electrical...  ...embedded electronics, medical devices, design verification and validation (V&V), and knowledge of medical device design controls.... 
    Senior
    For contractors
    Immediate start

    Echo Neurotechnologies

    San Francisco, CA
    18 hours ago
  •  ...Senior Technical Program Manager, Hardware Hike Medical | San Francisco About Hike Medical Hike Medical is building the defining company...  ..., getting designs to freeze, through verification and validation, and into ramps. Every Hike device is made for one patient... 
    Senior
    Full time
    Contract work
    Work at office

    hike-medical

    San Francisco, CA
    3 days ago
  •  ...The Strategic Initiatives & Operations team is in need of a Technical Program Manager (TPM) to streamline our processes, including full safety...  ...any frontier models. This role is critical for driving safe deployment of our new models, synthesizing inputs from multiple... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    11 days ago
  •  ..., innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: The Senior Technical Program Manager, Platform Software owns program-level execution for software across Waabi's hardware platforms, with a focus on cross-... 
    Senior
    Full time

    waabi

    San Francisco, CA
    3 days ago
  • $159k - $196k

     ...across 15+ U.S. states. Waymo’s Technical Program Managers and Program Managers are accountable...  ...own and drive work towards real-world deployments of the Waymo Driver across platforms...  ...Experience organizing design validation across internal teams and suppliers... 
    Full time
    Contract work
    Remote work

    Waymo

    San Francisco, CA
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Validation Technical Program Manager, Logical Deployment. Be the first to apply!