Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Site Reliability Engineer, Infrastructure Architecture- AI Infrastructure Operations

$150k - $250k

Nscale

About Nscale

Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers.  Nscale enables AI-focused companies to achieve superior results by reducing the complexity of AI development. Our GPU cloud bolsters technical capabilities and directly supports strategic business outcomes, including cost management, rapid innovation, and environmental responsibility.

We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As an Nscaler, you’ll build trust through openness and transparency, where everyone is inspired to do their best work. If you join our team, you’ll be contributing to building the technology that powers the future.

 

About The Role

Nscale’s AI Infrastructure Operations team keeps one of the most demanding AI platforms in the industry running.  At our scale, the design decisions we make this year set the failure modes we live with for the next five.

We’re looking for a Principal Site Reliability Engineer, Infrastructure Architecture to be the architectural authority for how our platform is designed, connected, and recovered.

This is a design-first role.  You will own the reference architecture for Nscale’s GPU, network, and control-plane platforms; decide where failure domains and trust boundaries sit; and make sure every major system we build has a known blast radius, a tested recovery path, and a clear owner.  You'll work alongside the teams doing bring-ups, upgrades, and migrations, and you'll join major incidents when the cause turns out to be in the design.  You'll be a peer to our existing architecture lead, not a backup; the two of you share ownership of both the design and the operating model, so neither one is a single point of failure.

 

What You'll Be Doing

  • Owning the end-to-end reference architecture for Nscale’s AI and HPC infrastructure: compute, network fabric, storage, control plane, and the core services underneath them
  • Designing multi-site and multi-region topologies, including failure domains, tenant isolation, and secure service enclaves for sovereign and hyperscale customers
  • Separating control plane from data plane by design, so that a management-layer outage never takes customer workloads down with it
  • Defining the target-state architecture and the multi-year roadmap to reach it, including what we retire, consolidate, or rebuild
  • Leading architecture reviews across Engineering, Network Operations, and Fleet Operations; writing and approving the RFCs and architecture decision records (ADRs) that other teams build against
  • Setting the architectural standards every new system must meet before it ships: SLOs, observability, capacity models, dependency maps, and documented failure modes
  • Running pre-mortems and red-team reviews on major designs to find single points of failure and hidden coupling before production does
  • Joining major incidents when the root cause is architectural, and follow the fix through to the design
  • Co-owning the operating model with the SRE team: operational readiness reviews (ORR), incident severity and post-incident review (PIR) standards, and production access and break-glass policy
  • Making sure the teams running each system can deploy, upgrade, and recover it without needing you in the room
  • Planning and reviewing site bring-ups, fleet upgrades, and migrations of live customer workloads
  • Running DR tests and game days so we know recovery works
  • Using incident and on-call data to decide what to redesign next
  • Mentoring senior engineers in systems design, so that architectural knowledge and decision-making never sit with a single person

 

About You

  • 10+ years building and running large-scale production infrastructure, including on-call for systems you designed, and several years as a staff, principal, or architect-level engineer
  • A track record of architectures you designed that are running in production today; you can walk us through the tradeoffs, what broke, and what you would change
  • You've led major incidents and run large migrations or site bring-ups
  • Working knowledge of change management, staged rollouts, SLO-based alerting, and post-incident reviews
  • Deep expertise in distributed systems design: consistency models, consensus and replication, partition handling, and graceful degradation
  • Strong networking fundamentals at the design level, including L3 fabrics, BGP, EVPN/VXLAN, segmentation, and multi-site connectivity
  • Experience designing secure multi-tenant platforms: identity, PKI and secrets management, network isolation, and zero-trust boundaries
  • Clear technical writing; your design docs, RFCs, and ADRs hold up under scrutiny, and engineers can build directly from them
  • Proven ability to drive architectural decisions across teams without direct authority, including saying no to designs that will not hold up
  • Strong software engineering skills; you can prototype a design, review production code, and spot when an implementation has drifted from the intended architecture
  • Sound judgement when reliability, velocity, and cost pull in different directions, and the ability to explain the tradeoff to engineers and executives alike

Nice to Have

  • Architecting AI or HPC platforms at scale, including GPU clusters, InfiniBand or RoCE fabrics, and workload schedulers such as Slurm or Kubernetes-based GPU scheduling
  • Designing sovereign, regulated, or air-gapped cloud environments
  • Bare-metal and hybrid cloud architecture, including provisioning pipelines, a CMDB/DCIM as the source of truth, and hardware lifecycle automation
  • Observability architecture for high-cardinality, high-throughput environments
  • Kubernetes platform architecture across many clusters and sites
  • Structured design analysis methods such as failure mode and effects analysis (FMEA), threat modelling, or C4 diagrams
  • A history of step-change reliability or scalability gains that came from a redesign rather than a patch

 

On-Call and Pace

When an incident turns out to be a design problem, you'll be pulled in and you'll own the fix.

 

What We Can Offer You

 

At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core.

  • Highly competitive package (base + equity) with reviews every 12 months .
  • Join the fastest-growing tech startup , your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI. ✨
  • Expect a dynamic progression plan tailored to your ambitions. Grow by trying new things, leading, challenging the status quo, and owning your impact, always with our full support. 
  • Human-First Flexibility: We treat you as humans first . Our flexible workplace trusts Nscalers to deliver, giving you the autonomy to shape your day around life's moments.

Join our thriving remote-first team . Geography is no barrier to impact or connection. We build seamless virtual collaboration, empowering you, wherever you work.

 

Equal Opportunities Statement

We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio-economic backgrounds.

If there’s anything we can do to accommodate your specific situation, please let us know.

The responsibilities outlined in this job description are not exhaustive and are intended to provide a general overview of the position. The employee may be required to perform additional duties, tasks, and responsibilities as assigned by management, consistent with the skills and qualifications required for the role.

 

The range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.

Salary Range

$150,000—$250,000 USD

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice:  Here.

Nscale does not accept unsolicited candidate submissions from recruitment agencies.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal Site Reliability Engineer, Infrastructure Architecture- AI Infrastructure Operations in Houston, TX vacancy
  • We Are:The Global AI Infrastructure team is at the center of enabling infrastructure...  ...to design, build, and operate advanced infrastructure...  ...-from strategy and architecture through implementation and...  ...CUDA along with LLM inference engines (TensorRT-LLM), production... 
    Operations
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Houston, TX
    4 days ago
  • $170k - $265k

     ...the GPU cloud built for AI. We run high-performance, cost-efficient infrastructure for AI-native...  ...someone who sets the reliability bar and then pulls the...  ...the automation other engineers build on, the services...  ...on design reviews and architecture decisions, so reliability... 
    Operations
    Flexible hours

    Nscale

    Houston, TX
    3 days ago
  •  ...Overview As a Principal Infrastructure Engineer, AI Cluster Performance & Validation...  ...of the AI Infrastructure Operations team, responsible for ensuring...  ...at scale." Set the architecture, roadmap, and acceptance...  ...standards for reliability, observability, benchmarking... 
    Operations
    Principal

    Nscale

    Houston, TX
    3 days ago
  •  ...the GPU cloud engineered for AI. We provide cost...  ...high-performance infrastructure for AI start-...  ...The Network Operations and Engineering...  ...for a Senior Principal Front End Network...  ...on owning the reliability, scalability, and...  ...authority, influencing architecture, standards, and... 
    Operations
    Principal
    Flexible hours

    Nscale

    Houston, TX
    3 days ago
  • $133.4k - $238.4k

    Wolters Kluwer is seeking a hands-on Principal AI Solutions Engineer in our Architecture & Engineering Services (AES)...  ...closely with customers, Cloud Operations, Security, Compliance, and business...  ...solutions, networking, and infrastructure principlesAI/LLM & Agentic Systems... 
    Operations
    Principal
    Full time
    Work at office

    Wolters Kluwer

    Houston, TX
    2 days ago
  • $99k - $232k

     ...ApplicableSpecialismPlatform Engineering &...  ...OpportunityAs a Cloud Infrastructure and Operations Delivery Manager you...  ...support, and network architecture. As a Manager you will...  ...resolution, and help shape reliable AWS-based solutions...  ...tooling, and AI-enabled workflows- Building... 
    Operations
    Full time
    H1b

    PwC

    Houston, TX
    5 days ago
  •  ...Position Overview Client is seeking a  Senior Hybrid Infrastructure Engineer to design, implement, operate, and modernize enterprise infrastructure across on...  ...role combines infrastructure engineering, cloud architecture, automation, cybersecurity, and operational... 
    Operations
    Temporary work

    Delan Associates, Inc

    Houston, TX
    3 days ago
  •  ...As a Messaging Engineer - Enterprise Technology Infrastructure with Hines, you will...  ...candidate brings a strong AI-first mindset,...  ...to enhance operational efficiency, strengthen...  ...effort and improve reliability (PowerShell,...  ...configurationsDevelop architecture and process diagrams... 
    Operations
    Work at office

    Hines

    Houston, TX
    4 days ago
  • Infrastructure EngineerJob#: 3056962Job Description...  ..., TX (On-site)Role SummaryThe...  ...Infrastructure Engineer designs, deploys, operates, and supports the...  ...focus on reliability, security, and...  ...Write and maintain architecture diagrams, runbooks...  ...receive calls, AI-generated calls... 
    Operations
    Remote work

    Apex Systems

    Houston, TX
    3 days ago
  • $99.6k - $209.5k

     ...EnglishOracle Cloud Infrastructure (OCI) is looking for a Principal Application Software Engineer to help develop and evolve...  ...critical business operations. You will work across...  ...requirements into reliable, maintainable software...  ...preferred.Exposure to AI-assisted software development... 
    Operations
    Principal
    Temporary work
    Flexible hours

    Oracle Corporation

    Houston, TX
    2 days ago
  •  ...dealerships. Our Cloud Engineering team owns the infrastructure that powers those...  ...end-to-end, from architecture and design through...  ...and operational support.We believe...  ..., with or without AI-assisted tools.What...  ...system architecture, reliability, performance, and... 
    Operations
    Work from home
    2 days per week

    Reynolds & Reynolds

    Houston, TX
    2 days ago
  •  ...Artificial Intelligence (AI) Security Architect is...  ...'s security architecture strategy for Microsoft...  ...a global provider of engineered services and products,...  ...to decommissioning. We operate the world's premier fleet...  ...Enterprise Architecture, Infrastructure, Legal, Privacy, and Business... 
    Operations
    Permanent employment
    Work at office

    Oceaneering International

    Houston, TX
    1 day ago
  • Infrastructure & Network EngineerJob#: 3054802Job Description...  ...position for an engineer with at least ten...  ...engineering and operational support for global...  ...in complex, multi-site enterprise...  ...focus, ownership, and reliable follow-through...  ...to receive calls, AI-generated calls, text... 
    Operations

    Apex Systems

    Houston, TX
    3 days ago
  •  ...timeRemote:NoJob Description:Principal Site Reliability Engineer (SRE) Hitachi Energy is...  ...reliable, and efficient operation of cloud‑hosted...  ...Product Development (R&D), Architecture, and Customer Experience...  ...engage with peer cloud, infrastructure, and platform teams across... 
    Operations
    Principal
    Full time
    Work at office

    Hitachi

    Houston, TX
    16 hours ago
  •  ...Interactive, Technology, and Operations services, all powered by...  ...Visit us at . The Global AI Infrastructure team enables resilient,...  ...Our work spans strategy, architecture, modernization,...  ...including capacity management, reliability engineering, change management, and performance... 
    Operations
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Houston, TX
    4 days ago
  •  ...Role Overview As a Technical Program Manager (TPM) for AI Infrastructure Operations, you will be the operational backbone of our high-scale,...  ..., Uptime, Availability). You will bridge the gap between engineering execution and strategic business goals, directly impacting... 
    Operations
    Principal

    Nscale

    Houston, TX
    3 days ago
  •  ...the GPU cloud engineered for AI. We provide cost...  ...high-performance infrastructure for AI start-...  ...The Network Operations and Engineering...  ...looking for a Principal Network Engineer...  ...on owning the reliability, scalability, and...  ...authority, influencing architecture, standards, and... 
    Operations
    Principal

    Nscale

    Houston, TX
    3 days ago
  •  ...DoAs a ServiceNow Enterprise Architecture Business Process Consultant,...  ...Advise on enterprise architecture operating models, architecture review...  ..., IT Operations Management, AI, and Data Foundations to...  ...Francisco, Silicon Valley:* Senior Principal: $222,000-$271,000* San Diego... 
    Operations
    Principal
    Temporary work
    Local area
    Flexible hours

    Slalom

    Houston, TX
    3 days ago
  • $133.4k - $238.4k

    Principal CX/UX Designer (API Developer Platform...  ..., integrate, and operate our APIs. You will...  ..., SDKs, and AI workflows. As a senior...  ...influence across Product, Engineering, and senior...  .... Please view the site office location directory...  ...in information architecture, user flows, and... 
    Operations
    Principal
    Full time
    Work at office
    Worldwide

    Wolters Kluwer

    Houston, TX
    4 days ago
  • $165.7k - $355.4k

     ...EnglishAt Oracle Cloud Infrastructure (OCI), we're...  ...world's largest AI clusters and...  ...customers.Our hardware engineering organization is...  ..., hardware reliability, lifecycle management...  ...to ensure operational excellence and best...  ...and rack-level architecture in hyperscale... 
    Operations
    Temporary work
    Flexible hours

    Oracle Corporation

    Houston, TX
    2 days ago
  • $163.38k - $261.41k

     ...Principal Software Engineer At Conga, we've built a community...  ...up commercial operations so companies...  ...high-level architectural direction into...  ...performance, and reliability requirements....  ...Product Engineering, AI, and Product...  ...shared platform or infrastructure services. ~... 
    Operations
    Principal
    Full time
    Worldwide
    Flexible hours

    Conga

    Houston, TX
    1 day ago
  • $170k - $265k

     ...Developer Experience Engineer Houston; San Francisco...  ...GPU cloud built for AI. We run high-performance, cost-efficient infrastructure for AI-native startups...  ...on design reviews and architecture decisions across Engineering...  ...teams. ~ Reliability practices you put in place... 
    Operations
    Local area
    Remote work

    Nscale

    Houston, TX
    3 days ago
  • $198k - $247k

     ...design, product engineering, analytics, automation, and AI-native...  ...platforms that can operate safely at enterprise...  ...and governed architectures, and move AI...  ...into reliable business operations...  ...test automation, infrastructure as code, and...  ...range for Senior Principal is $198,000 to... 
    Operations
    Principal
    Temporary work
    Local area

    Slalom

    Houston, TX
    3 days ago
  •  ...release.Most engineering roles stop at...  ...organization, architecture, code quality,...  ...distance.This is an AI-augmented role...  ...at Staff or Principal levelBachelor'...  ...and with infrastructure defined as codeComfort operating in a Git-based...  ...commitment to safety, reliability, and... 
    Operations
    Principal
    Permanent employment
    Work at office
    Remote work
    Flexible hours

    ABS Group

    Houston, TX
    4 days ago
  •  ...Senior Platform & Infrastructure Engineer is the principal technical...  ...IT Platform & Operations team. This is a...  ...operationalizing AI and agentic automation...  ...operations are reliable, secure, and...  ...multi-agent AI architectures, LLM...  ...networking for a multi-site healthcare system... 
    Operations
    Shift work

    Nexus Health Systems Ltd

    Houston, TX
    28 days ago
  •  ...Houston area. The team brings operational data from field assets...  ...features, and support SCADA architecture, servers, infrastructure, and troubleshooting. They...  ...experience -Exposure to AI-driven analytics/automation -Computer Science, engineering, or technical degree is helpful... 
    Operations

    Insight Global

    Houston, TX
    1 day ago
  • $100k - $170k

     .... Developer Experience Engineer Houston; San Francisco; Seattle; New...  ...is the GPU cloud built for AI. We run high-performance, cost-efficient infrastructure for AI-native startups and global...  ...Keep the delivery platform reliable: troubleshoot pipeline and deployment... 
    Operations
    Local area
    Remote work
    Shift work

    Nscale

    Houston, TX
    3 days ago
  • $106k - $133k

     ...problems.Slalom’s AI Systems &...  ...diverse team of engineers, data...  ...contribute to solution architecture, own...  ...practices to deliver reliable, secure, maintainable...  ...production operating considerations...  ...Azure, or GCP infrastructure and data...  ...0, and at the Principal level is $157,... 
    Operations
    Principal
    Temporary work
    Work at office
    Local area

    Slalom

    Houston, TX
    1 day ago
  • $102.3k - $209.5k

     ...in supplier quality engineering, product engineering,...  ...durability.Assesses component reliability by analyzing supplier...  ...with Design, Operations, Quality, and Procurement...  ...together the data, infrastructure, applications, and...  ...saving care. And with AI embedded across our products... 
    Operations
    Principal
    Temporary work
    Flexible hours
    Shift work

    Oracle Corporation

    Houston, TX
    1 day ago
  •  ...strong emphasis on operational excellence,...  ...experienced Lead IT Infrastructure Engineer to oversee and...  ...responsible for ensuring reliable, secure, and...  ...cross-site high-availability...  ...disaster recovery architectures. Solid networking...  ...&M KPIs through AI and process... 
    Operations
    Work at office

    SEG MANUFACTURING INC

    Houston, TX
    28 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Site Reliability Engineer, Infrastructure Architecture- AI Infrastructure Operations. Be the first to apply!