Senior Site Reliability Engineer (GPU Clusters) - Hosting
$250kLooking for a role with plenty of growth opportunities?
Join a rapidly scaling AI cloud infrastructure provider building a next-generation GPU platform designed for AI training, experimentation, and inference at scale. The company is developing a fully featured AI cloud platform powered by renewable energy and is already operating with strong momentum across Europe, while now significantly expanding its footprint in the United States.
The company is looking for a Senior / Staff Site Reliability Engineer to support and scale large-scale HPC and cloud environments powering GPU-intensive workloads. The role involves working closely with platform, ML, and infrastructure teams to improve reliability, automation, and observability across distributed compute environments while supporting long-term infrastructure growth and scalability.
Don’t miss out on this exciting opportunity and apply today!
Responsibilities:
- Ensure the reliability, scalability, and performance of HPC and cloud infrastructure environments
- Design, build, and maintain automation, observability, and monitoring frameworks for GPU compute clusters
- Collaborate with ML, data, and platform engineering teams to deliver highly available infrastructure systems
- Improve CI/CD pipelines, deployment workflows, and operational tooling
- Contribute to infrastructure architecture discussions and long-term platform strategy
- Diagnose performance bottlenecks across distributed systems and HPC workloads
- Support and optimize Slurm-based GPU cluster environments
- Participate in an on-call rotation supporting mission-critical infrastructure operations
Skills/Must Have:
- Deep experience in Site Reliability Engineering, DevOps, Infrastructure Engineering, or related fields
- Strong experience supporting HPC or large-scale distributed compute environments
- Deep Linux expertise (Ubuntu/Debian preferred)
- Strong scripting and automation skills using Python, Go, or Bash
- Hands-on experience with public cloud platforms or modern GPU cloud providers
- Strong understanding of networking fundamentals (DNS, TCP/IP, routing, performance optimization)
- Experience with Infrastructure-as-Code tooling such as Terraform and Ansible
- Proven experience operating Slurm-based GPU/HPC clusters
- Ability to troubleshoot distributed systems and optimize workload scheduling/performance
Benefits:
- Stock options
- Bonus
- Remote working option and allowance
Salary:
- Circa $250,000 base salary
- Inferact is seeking a hands-on cluster administration engineer to own and operate its high-performance GPU compute infrastructure. You will ensure health, availability, observability, and usability around the clock for HP compute clusters across providers. You will collaborate...Senior
- ...seeking an experienced SRE/Infrastructure Engineer to help build a seed-stage AI infrastructure company with large-scale GPU clusters for training and inference. You design,... ...maintain compute environments and ensure reliability across Slurm and Kubernetes. You will implement...Senior
- STN Inc in San Francisco is seeking an experienced AI Infrastructure Engineer to design, deploy, and manage large-scale GPU clusters for AI training and inference workloads. You will optimize GPU utilization, tune NCCL, CUDA, UCX, and Slurm, and work across storage, networking...Senior
$15k
...benefits packages, technology talks by our experts, a beautiful modern office, daily catered lunches, and more.As a Senior Cluster Site Reliability Engineer (SRE), you will help scale our research compute cluster to meet our growing needs, and you will leverage...SeniorWork at officeLocal areaRemote work- Inferact Inc. is building a world-class GPU compute platform powering vLLM. We seek a hands-on cluster administration engineer to own the high-performance infrastructure that keeps our engineers productive. You will monitor GPU servers, manage scheduling with SLURM/Kubernetes...SeniorRemote work
$175k - $250k
...50,000.00/yr Job Title: Senior Cloud Infrastructure Engineer Location: San Francisco,... ...unavailable. Modality: On-Site only. Must live within... ...scalability, performance, and reliability across environments.... ...Manage and automate GPU compute clusters using tools such as Python...SeniorFull timeRemote workRelocationRelocation package$153k - $191.3k
...data processing, and software engineering, our office is a truly... ...environments, to guarantee the reliability, scalability, and availability... ...optimization, management, and cluster tuning in a constrained environment... ...: Experience with CUDA-based GPU programs Security expertise...SeniorFull timeTemporary workFor contractorsWork at officeLocal areaRemote workHome office3 days per week$215k - $285k
Senior Software Engineer, GPU Sandboxes Location: San Francisco, CA Company Stage of Funding: Series A... ...isolation, tenant boundaries, and shared-host environments. Investigate and... ...observability, on-call, and ongoing reliability. Work closely with the GPU Sandboxes...SeniorFull timeWork at office$240k - $280k
...looking for a Software Engineer to build the systems that... ...running inference clusters without a human touching... ...state of a cluster or host — shape, topology, software... ...inference bring-up to GPU driver/CUDA stack,... ...automatically. Own reliability of the pipeline: idempotency...Full time$152.5k - $205k
...everyone is a stakeholder.What you’ll be responsible for:As a Senior Site Reliability Engineer on Circle’s platform team, you’ll design, build, and... ...designing, operating, securing, and troubleshooting production clusters and containerized workloads at scale.Strong Terraform...SeniorFlexible hours$127k - $249k
The TeamPlatform Engineering is the department within SRE that is responsible for a range of critical infrastructure and operational... ...fleet, alongside the critical components that ensure cluster reliability and security (e.g., CoreDNS, cert-manager, and Gatekeeper)....SeniorWork at officeLocal areaRemote workWorldwideFlexible hours- ...intelligence. We are seeking a Software Engineer to join Crusoe’s Data Center Infrastructure... ...on software for managing a fleet of GPU servers and the data centers that house them... ...tooling for high‑performance GPU compute clusters. The successful candidate will be hands-on...Senior
- ...superintelligence. One person, one GPU. If you'd like to... ...Lambda Infrastructure Engineering organization forges the... ...of high-performance AI clusters by welding together the... ...on petabytes of data hosted on large, high-... ...looking for an experienced Senior Software Engineer to...SeniorFull timeWork at officeLocal areaWork from homeFlexible hours
- ...The team is hiring a Head of Platform/AI Cluster Management to oversee the strategic... ...), including multi-tenancy, quotas, and GPU/host fleet management. Lead cluster operations... ...services that ensure workload SLOs and reliable runtime execution. Define and implement...
$232k - $319k
...millions of users a day. The service is hosted on Amazon Web Services (AWS) across multiple... ...scale the service with great people and reliable, cost-effective, and efficient... ...serviceAccelerate the velocity of SRE and product engineering by developing robust platforms, powerful...SeniorPermanent employmentLocal areaWorldwideFlexible hours$300k
...training, or inference. As a Platform Engineer/Senior Site Reliability Engineer, you’ll own the reliability, performance, and automation of this GPU-powered infrastructure, ensuring... ...operational backbone of one of the largest GPU clusters in private deployment. If you want...SeniorPermanent employment- ...inference. About the Role We’re hiring engineers to scale and optimize OpenAI’s inference infrastructure across emerging GPU platforms. You’ll work across the stack - from... ...of model execution on large GPU clusters. Collaborate with partner teams to design...Full time
$175k - $300k
...forward. The Production Engineering Team Examples of... ...: at our scale, a GPU failure isn't a ticket... ...production-ready" before a site goes live, not after.... ...: we're converting clusters across production... ...on. Own end-to-end reliability, scalability, and operation...Full timeLocal area- ...us and help build the platform engineers turn to to ship AI products.... ...Baseten is building its own GPU infrastructure for large-scale... ...tuning, bad optics, RNIC issues, host kernel stalls, GPU driver problems... ...Staff-level or senior staff-level experience building...Full timeFlexible hours
- ...Conviction. Join us and help build the platform engineers turn to to ship AI products. At... ...for foundational engineers to lead our GPU Networking efforts, making RDMA a first-class... ...networking performance on bleeding-edge clusters (H100/H200, B200/B300, GB200/300 NVL72),...Full timeFlexible hours
$220k
Perplexity is looking for an engineer to join their team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience...Senior- LeoForce is seeking a Global Inference Library Engineer to design and optimize a high‑performance inference library for modern AI models.... ...infrastructure. The role emphasizes deep knowledge of AI infrastructure, GPU programming, and low-level kernels, with exposure to frameworks...Senior
- Hyperbolic is seeking a very senior Infrastructure Engineer to scale a GPU cloud marketplace. You will build a multi-tenant provisioning and virtualization layer, turning global GPU inventories into an orchestrated pool for AI developers and researchers. You will own the...Senior
- ...these hyperscale supercomputers reliable and efficient during the training... ...the Role We are looking for engineers to operate the next generation of compute clusters that power OpenAI’s frontier research... ...bare-metal Linux environments, GPU hardware, and large-scale...Full time
- Give every AI agent its own GPU Senior Software Engineer – GPU Sandboxes San Francisco onsite | Relocation considered | Equity offered AI agents... ...and automated recovery Security boundaries across shared hosts They need someone who has built or debugged the...SeniorFull timeRelocation
$160k - $225k
Cacheflow is seeking a Senior Software Engineer for AI Runtime at Databricks, located in San Francisco. You will be instrumental in building and scaling systems for large-scale GPU training, ensuring high throughput and resilience in training across expansive fleets of...Senior- iframe.ai is hiring a Customer Cluster Engineer to own three to five reserved-capacity accounts, managing their training and inference performance end-to-end. You will be embedded with the accounts, coordinating with the account manager for commercial aspects and with...SeniorRemote job
$250k - $300k
...Crusoe.About the Role:As a Senior Staff/Principal Deployment Automation Engineer for the Compute Team,... ...-scale, multi-node GPU clusters. You will own the CI/CD... ...virtualized GPU and CPU hosts across our AI Cloud. Your... ...to quickly and reliably release, test, and deploy...SeniorTemporary work- About the RoleWe’re looking for an experienced Site Reliability Engineer (SRE) to help us scale our platform with reliability, observability, and operational excellence at the core. You’ll partner with engineers and data scientists to build, automate, and maintain the infrastructure...Senior
$170k - $250k
...This company is looking for an engineer to work directly with the CTO on complex GPU virtualisation challenges. The role... ...checkpointing, and distributed GPU cluster management You will be working... ...early-stage equity On-site in San Francisco Salary: ~...Full timeVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Site Reliability Engineer (GPU Clusters) - Hosting. Be the first to apply!
- site reliability engineer San Francisco, CA
- site reliability engineer sre San Francisco, CA
- site reliability engineer remote San Francisco, CA
- senior network engineer remote San Francisco, CA
- senior app developer San Francisco, CA
- senior manager legal San Francisco, CA
- sr project manager San Francisco, CA
- senior account executive San Francisco, CA
- senior manager strategic initiatives San Francisco, CA
- senior staff systems engineer San Francisco, CA



