Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Site Reliability Engineer (GPU Clusters) - Hosting

$250k
Full-time

Looking for a role with plenty of growth opportunities?

Join a rapidly scaling AI cloud infrastructure provider building a next-generation GPU platform designed for AI training, experimentation, and inference at scale. The company is developing a fully featured AI cloud platform powered by renewable energy and is already operating with strong momentum across Europe, while now significantly expanding its footprint in the United States.

The company is looking for a Senior / Staff Site Reliability Engineer to support and scale large-scale HPC and cloud environments powering GPU-intensive workloads. The role involves working closely with platform, ML, and infrastructure teams to improve reliability, automation, and observability across distributed compute environments while supporting long-term infrastructure growth and scalability.

Don’t miss out on this exciting opportunity and apply today!

Responsibilities:

  • Ensure the reliability, scalability, and performance of HPC and cloud infrastructure environments
  • Design, build, and maintain automation, observability, and monitoring frameworks for GPU compute clusters
  • Collaborate with ML, data, and platform engineering teams to deliver highly available infrastructure systems
  • Improve CI/CD pipelines, deployment workflows, and operational tooling
  • Contribute to infrastructure architecture discussions and long-term platform strategy
  • Diagnose performance bottlenecks across distributed systems and HPC workloads
  • Support and optimize Slurm-based GPU cluster environments
  • Participate in an on-call rotation supporting mission-critical infrastructure operations

Skills/Must Have:

  • Deep experience in Site Reliability Engineering, DevOps, Infrastructure Engineering, or related fields
  • Strong experience supporting HPC or large-scale distributed compute environments
  • Deep Linux expertise (Ubuntu/Debian preferred)
  • Strong scripting and automation skills using Python, Go, or Bash
  • Hands-on experience with public cloud platforms or modern GPU cloud providers
  • Strong understanding of networking fundamentals (DNS, TCP/IP, routing, performance optimization)
  • Experience with Infrastructure-as-Code tooling such as Terraform and Ansible
  • Proven experience operating Slurm-based GPU/HPC clusters
  • Ability to troubleshoot distributed systems and optimize workload scheduling/performance

Benefits:

  • Stock options
  • Bonus 
  • Remote working option and allowance 

Salary:

  • Circa $250,000 base salary 
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Site Reliability Engineer (GPU Clusters) - Hosting in San Francisco, CA vacancy
  • Inferact is seeking a hands-on cluster administration engineer to own and operate its high-performance GPU compute infrastructure. You will ensure health, availability, observability, and usability around the clock for HP compute clusters across providers. You will collaborate... 
    Senior

    Inferact

    San Francisco, CA
    4 days ago
  •  ...seeking an experienced SRE/Infrastructure Engineer to help build a seed-stage AI infrastructure company with large-scale GPU clusters for training and inference. You design,...  ...maintain compute environments and ensure reliability across Slurm and Kubernetes. You will implement... 
    Senior

    Hamilton Barnes Associates Limited

    San Francisco, CA
    1 day ago
  • STN Inc in San Francisco is seeking an experienced AI Infrastructure Engineer to design, deploy, and manage large-scale GPU clusters for AI training and inference workloads. You will optimize GPU utilization, tune NCCL, CUDA, UCX, and Slurm, and work across storage, networking... 
    Senior

    STN Inc

    San Francisco, CA
    2 days ago
  • $15k

     ...benefits packages, technology talks by our experts, a beautiful modern office, daily catered lunches, and more.As a Senior Cluster Site Reliability Engineer (SRE), you will help scale our research compute cluster to meet our growing needs, and you will leverage... 
    Senior
    Work at office
    Local area
    Remote work

    The Voleon Group

    Berkeley, CA
    6 days ago
  • Inferact Inc. is building a world-class GPU compute platform powering vLLM. We seek a hands-on cluster administration engineer to own the high-performance infrastructure that keeps our engineers productive. You will monitor GPU servers, manage scheduling with SLURM/Kubernetes... 
    Senior
    Remote work

    Inferact Inc.

    San Francisco, CA
    2 days ago
  • $175k - $250k

     ...50,000.00/yr Job Title: Senior Cloud Infrastructure Engineer Location: San Francisco,...  ...unavailable. Modality: On-Site only. Must live within...  ...scalability, performance, and reliability across environments....  ...Manage and automate GPU compute clusters using tools such as Python... 
    Senior
    Full time
    Remote work
    Relocation
    Relocation package

    The Recruiting Guy

    San Francisco, CA
    4 days ago
  • $153k - $191.3k

     ...data processing, and software engineering, our office is a truly...  ...environments, to guarantee the reliability, scalability, and availability...  ...optimization, management, and cluster tuning in a constrained environment...  ...: Experience with CUDA-based GPU programs Security expertise... 
    Senior
    Full time
    Temporary work
    For contractors
    Work at office
    Local area
    Remote work
    Home office
    3 days per week

    Planet Labs PBC

    San Francisco, CA
    14 hours ago
  • $215k - $285k

    Senior Software Engineer, GPU Sandboxes Location: San Francisco, CA Company Stage of Funding: Series A...  ...isolation, tenant boundaries, and shared-host environments. Investigate and...  ...observability, on-call, and ongoing reliability. Work closely with the GPU Sandboxes... 
    Senior
    Full time
    Work at office

    Recruiting From Scratch

    San Francisco, CA
    2 days ago
  • $240k - $280k

     ...looking for a Software Engineer to build the systems that...  ...running inference clusters without a human touching...  ...state of a cluster or host — shape, topology, software...  ...inference bring-up to GPU driver/CUDA stack,...  ...automatically. Own reliability of the pipeline: idempotency... 
    Full time

    Together Ai

    San Francisco, CA
    14 hours ago
  • $152.5k - $205k

     ...everyone is a stakeholder.What you’ll be responsible for:As a Senior Site Reliability Engineer on Circle’s platform team, you’ll design, build, and...  ...designing, operating, securing, and troubleshooting production clusters and containerized workloads at scale.Strong Terraform... 
    Senior
    Flexible hours

    Circle

    San Francisco, CA
    7 days ago
  • $127k - $249k

    The TeamPlatform Engineering is the department within SRE that is responsible for a range of critical infrastructure and operational...  ...fleet, alongside the critical components that ensure cluster reliability and security (e.g., CoreDNS, cert-manager, and Gatekeeper).... 
    Senior
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours

    MongoDB

    San Francisco, CA
    5 days ago
  •  ...intelligence. We are seeking a Software Engineer to join Crusoe’s Data Center Infrastructure...  ...on software for managing a fleet of GPU servers and the data centers that house them...  ...tooling for high‑performance GPU compute clusters. The successful candidate will be hands-on... 
    Senior

    Crusoe

    San Francisco, CA
    14 hours ago
  •  ...superintelligence. One person, one GPU. If you'd like to...  ...Lambda Infrastructure Engineering organization forges the...  ...of high-performance AI clusters by welding together the...  ...on petabytes of data hosted on large, high-...  ...looking for an experienced Senior Software Engineer to... 
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    14 hours ago
  •  ...The team is hiring a Head of Platform/AI Cluster Management to oversee the strategic...  ...), including multi-tenancy, quotas, and GPU/host fleet management. Lead cluster operations...  ...services that ensure workload SLOs and reliable runtime execution. Define and implement... 

    Hamilton Barnes Associates Limited

    San Francisco, CA
    1 day ago
  • $232k - $319k

     ...millions of users a day. The service is hosted on Amazon Web Services (AWS) across multiple...  ...scale the service with great people and reliable, cost-effective, and efficient...  ...serviceAccelerate the velocity of SRE and product engineering by developing robust platforms, powerful... 
    Senior
    Permanent employment
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    6 days ago
  • $300k

     ...training, or inference. As a Platform Engineer/Senior Site Reliability Engineer, you’ll own the reliability, performance, and automation of this GPU-powered infrastructure, ensuring...  ...operational backbone of one of the largest GPU clusters in private deployment. If you want... 
    Senior
    Permanent employment
    San Francisco, CA
    more than 2 months ago
  •  ...inference. About the Role We’re hiring engineers to scale and optimize OpenAI’s inference infrastructure across emerging GPU platforms. You’ll work across the stack - from...  ...of model execution on large GPU clusters. Collaborate with partner teams to design... 
    Full time

    OpenAI

    San Francisco, CA
    14 hours ago
  • $175k - $300k

     ...forward.   The Production Engineering Team Examples of...  ...: at our scale, a GPU failure isn't a ticket...  ...production-ready" before a site goes live, not after....  ...: we're converting clusters across production...  ...on. Own end-to-end reliability, scalability, and operation... 
    Full time
    Local area

    Fluidstack

    San Francisco, CA
    14 hours ago
  •  ...us and help build the platform engineers turn to to ship AI products....  ...Baseten is building its own GPU infrastructure for large-scale...  ...tuning, bad optics, RNIC issues, host kernel stalls, GPU driver problems...  ...Staff-level or senior staff-level experience building... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    14 hours ago
  •  ...Conviction. Join us and help build the platform engineers turn to to ship AI products. At...  ...for foundational engineers to lead our GPU Networking efforts, making RDMA a first-class...  ...networking performance on bleeding-edge clusters (H100/H200, B200/B300, GB200/300 NVL72),... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    14 hours ago
  • $220k

    Perplexity is looking for an engineer to join their team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience... 
    Senior

    Perplexity

    San Francisco, CA
    4 days ago
  • LeoForce is seeking a Global Inference Library Engineer to design and optimize a high‑performance inference library for modern AI models....  ...infrastructure. The role emphasizes deep knowledge of AI infrastructure, GPU programming, and low-level kernels, with exposure to frameworks... 
    Senior

    Leoforce

    San Francisco, CA
    14 hours ago
  • Hyperbolic is seeking a very senior Infrastructure Engineer to scale a GPU cloud marketplace. You will build a multi-tenant provisioning and virtualization layer, turning global GPU inventories into an orchestrated pool for AI developers and researchers. You will own the... 
    Senior

    Hyperbolic

    San Francisco, CA
    2 days ago
  •  ...these hyperscale supercomputers reliable and efficient during the training...  ...the Role We are looking for engineers to operate the next generation of compute clusters that power OpenAI’s frontier research...  ...bare-metal Linux environments, GPU hardware, and large-scale... 
    Full time

    OpenAI

    San Francisco, CA
    14 hours ago
  • Give every AI agent its own GPU Senior Software Engineer – GPU Sandboxes San Francisco onsite | Relocation considered | Equity offered AI agents...  ...and automated recovery Security boundaries across shared hosts They need someone who has built or debugged the... 
    Senior
    Full time
    Relocation

    nineDots Technology Recruitment

    San Francisco, CA
    10 days ago
  • $160k - $225k

    Cacheflow is seeking a Senior Software Engineer for AI Runtime at Databricks, located in San Francisco. You will be instrumental in building and scaling systems for large-scale GPU training, ensuring high throughput and resilience in training across expansive fleets of... 
    Senior

    Cacheflow

    San Francisco, CA
    2 days ago
  • iframe.ai is hiring a Customer Cluster Engineer to own three to five reserved-capacity accounts, managing their training and inference performance end-to-end. You will be embedded with the accounts, coordinating with the account manager for commercial aspects and with... 
    Senior
    Remote job

    iframe Corporation

    San Francisco, CA
    3 days ago
  • $250k - $300k

     ...Crusoe.About the Role:As a Senior Staff/Principal Deployment Automation Engineer for the Compute Team,...  ...-scale, multi-node GPU clusters. You will own the CI/CD...  ...virtualized GPU and CPU hosts across our AI Cloud. Your...  ...to quickly and reliably release, test, and deploy... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  • About the RoleWe’re looking for an experienced Site Reliability Engineer (SRE) to help us scale our platform with reliability, observability, and operational excellence at the core. You’ll partner with engineers and data scientists to build, automate, and maintain the infrastructure... 
    Senior

    Alembic

    San Francisco, CA
    3 days ago
  • $170k - $250k

     ...This company is looking for an engineer to work directly with the CTO on complex GPU virtualisation challenges. The role...  ...checkpointing, and distributed GPU cluster management You will be working...  ...early-stage equity On-site in San Francisco Salary: ~... 
    Full time
    Visa sponsorship
    Flexible hours
    San Francisco, CA
    23 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Site Reliability Engineer (GPU Clusters) - Hosting. Be the first to apply!