Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Site Reliability Engineer (GPU Clusters) - Hosting

$250k
Full-time

Looking for a role with plenty of growth opportunities?

Join a rapidly scaling AI cloud infrastructure provider building a next-generation GPU platform designed for AI training, experimentation, and inference at scale. The company is developing a fully featured AI cloud platform powered by renewable energy and is already operating with strong momentum across Europe, while now significantly expanding its footprint in the United States.

The company is looking for a Senior / Staff Site Reliability Engineer to support and scale large-scale HPC and cloud environments powering GPU-intensive workloads. The role involves working closely with platform, ML, and infrastructure teams to improve reliability, automation, and observability across distributed compute environments while supporting long-term infrastructure growth and scalability.

Don’t miss out on this exciting opportunity and apply today!

Responsibilities:

  • Ensure the reliability, scalability, and performance of HPC and cloud infrastructure environments
  • Design, build, and maintain automation, observability, and monitoring frameworks for GPU compute clusters
  • Collaborate with ML, data, and platform engineering teams to deliver highly available infrastructure systems
  • Improve CI/CD pipelines, deployment workflows, and operational tooling
  • Contribute to infrastructure architecture discussions and long-term platform strategy
  • Diagnose performance bottlenecks across distributed systems and HPC workloads
  • Support and optimize Slurm-based GPU cluster environments
  • Participate in an on-call rotation supporting mission-critical infrastructure operations

Skills/Must Have:

  • Deep experience in Site Reliability Engineering, DevOps, Infrastructure Engineering, or related fields
  • Strong experience supporting HPC or large-scale distributed compute environments
  • Deep Linux expertise (Ubuntu/Debian preferred)
  • Strong scripting and automation skills using Python, Go, or Bash
  • Hands-on experience with public cloud platforms or modern GPU cloud providers
  • Strong understanding of networking fundamentals (DNS, TCP/IP, routing, performance optimization)
  • Experience with Infrastructure-as-Code tooling such as Terraform and Ansible
  • Proven experience operating Slurm-based GPU/HPC clusters
  • Ability to troubleshoot distributed systems and optimize workload scheduling/performance

Benefits:

  • Stock options
  • Bonus 
  • Remote working option and allowance 

Salary:

  • Circa $250,000 base salary 
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Site Reliability Engineer (GPU Clusters) - Hosting in San Francisco, CA vacancy
  • $250k

     ...provider building a next-generation GPU platform designed for AI training, experimentation...  .... The company is looking for a Senior / Staff Site Reliability Engineer to support and scale large-scale HPC...  ...frameworks for GPU compute clusters Collaborate with ML, data, and... 
    Senior
    Full time
    Remote work
    San Francisco, CA
    more than 2 months ago
  •  ...Description This hybrid role spans across platform reliability and infrastructure engineering. You'll be instrumental in ensuring high availability...  ...performance across internal research and external customers' GPU cluster environments. Responsibilities include automating GPU... 
    Senior

    Macpower Digital Assets Edge Private Limited

    San Francisco, CA
    14 days ago
  •  ...Nscale is seeking a Senior Validation Technical Program Manager, Logical Deployment, to validate large GPU clusters before handoff to customers. You will translate acceptance...  ...prove readiness. This role sits between engineering, OEM partners and customers and requires... 
    Senior

    Nscale

    San Francisco, CA
    23 hours ago
  •  ...A leading AI infrastructure company is looking for a Senior Site Reliability Engineer to design and operate large-scale GPU clusters. In this role, you will work closely with clients to troubleshoot and optimize AI infrastructure. The ideal candidate has extensive experience... 
    Senior

    Andromeda

    San Francisco, CA
    1 day ago
  •  ...Lambda is seeking a Senior Site Reliability Engineer to join our AI cloud infrastructure in San Francisco....  ...will design and operate monitoring for cluster health, deploy HPC clusters remotely,...  ...troubleshoot complex networking, GPU, and fabric issues and participate in... 
    Senior
    Remote work

    Applied Methods Inc

    San Francisco, CA
    4 days ago
  • $15k

     ...benefits packages, technology talks by our experts, a beautiful modern office, daily catered lunches, and more.As a Senior Cluster Site Reliability Engineer (SRE), you will help scale our research compute cluster to meet our growing needs, and you will leverage... 
    Senior
    Work at office
    Local area
    Remote work

    The Voleon Group

    Berkeley, CA
    1 day ago
  • $175k - $250k

     ...0,000.00/yr Job Title: Senior Cloud Infrastructure Engineer Location: San Francisco,...  ...unavailable. Modality: On-Site only. Must live within...  ...scalability, performance, and reliability across environments....  ...Manage and automate GPU compute clusters using tools such as Python... 
    Senior
    Full time
    Remote work
    Relocation
    Relocation package

    The Recruiting Guy

    San Francisco, CA
    4 days ago
  •  ...time. Behind that sits a large GPU fleet spread across several...  ...providers. Today, our inference engineers and researchers build models...  ...operating the underlying GPU clusters, responsibilities we want a...  ...provisioning, lifecycle management, reliability, and capacity integration... 
    Shift work

    IVP

    San Francisco, CA
    4 days ago
  • Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San Francisco · Full-Time About Andromeda Andromeda Cluster was founded by Nat Friedman and Daniel Gross to give early-stage...  ...operate, and debug large-scale GPU infrastructure used for... 
    Senior
    Full time
    Remote work

    Andromeda

    San Francisco, CA
    3 days ago
  •  ...technical infrastructure expert to lead the design, deployment, and optimization of large-scale GPU computing environments in San Francisco. You will work with an experienced engineering team building from the ground up on cutting-edge AI workloads. This role emphasizes... 
    Senior

    Blue Signal Search

    San Francisco, CA
    3 days ago
  •  ...Together AI in the United States is seeking a software engineer focused on reliability to own production for the Kubernetes-native control plane powering GPU inference fleets. You’ll manage SLOs, incident response, and automated remediation while improving efficiency... 
    Senior

    Fdetimes

    San Francisco, CA
    3 days ago
  • $160k - $280k

     ...EngineerWe're looking for a software engineer, reliability-minded but still a builder,...  ...provisions and runs our GPU inference fleet. The...  ...team declare what they need, a cluster, a model deployment, a capacity...  ...: own the health of the host lifecycle pipeline, discovery... 
    Senior
    Permanent employment
    Full time

    Together AI

    San Francisco, CA
    2 days ago
  • $127k - $249k

     ...The Team Platform Engineering is the department within SRE that is responsible for a range of critical infrastructure and operational...  ...fleet, alongside the critical components that ensure cluster reliability and security (e.g., CoreDNS, cert-manager, and Gatekeeper).... 
    Senior
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours

    MongoDB

    San Francisco, CA
    2 days ago
  • $127k - $196.5k

     ...providing first line operational support. We are looking for a Senior Site Reliability Engineer who is excited about establishing and advocating for best...  ...Hands on experience on FinOps and autoscaling Kubernetes clusters.Experience in Python or Go programming language.... 
    Senior
    Worldwide

    LiveRamp

    San Francisco, CA
    3 days ago
  • $152.5k - $205k

     ...everyone is a stakeholder.What you’ll be responsible for:As a Senior Site Reliability Engineer on Circle’s platform team, you’ll design, build, and...  ...designing, operating, securing, and troubleshooting production clusters and containerized workloads at scale.Strong Terraform... 
    Senior
    Flexible hours

    Circle

    San Francisco, CA
    4 days ago
  • $167.7k - $245.2k

     ...TeamJoin the Observability team within Cloud Network Platform Engineering’s Site Reliability Engineering organization. You will help design, build,...  ...Cloud infrastructure, including indexers, Search Head Clusters, heavy forwarders, deployment servers, and related integrations... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Francisco, CA
    2 days ago
  •  ...superintelligence. One person, one GPU.If you'd like to build the...  ...us.The Compute Software Engineering role plays a key part in the...  ...lifecycle, system health, host and cluster validation, and contribute to...  ...shipping software efficiently and reliably. The position works closely... 
    Senior
    Local area
    Flexible hours

    Lambda

    San Francisco, CA
    23 hours ago
  • $175k - $300k

     ...forward. The Production Engineering Team Examples of...  ...: at our scale, a GPU failure isn’t a ticket...  ...production‑ready” before a site goes live, not after....  ...: we’re converting clusters across production...  ...on. Own end‑to‑end reliability, scalability, and operation... 
    Local area

    Fluidstack

    San Francisco, CA
    4 days ago
  •  ...Career Movement is seeking a senior engineer to power the compute behind its research and products...  ...runs. You will build and operate GPU clusters across public clouds and owned data...  ...environments, and report on spend with a focus on reliability and #J-18808-Ljbffr
    Senior

    Career Movement

    San Francisco, CA
    7 hours ago
  • $126k - $248k

     ...Senior Software EngineerMongoDB is seeking a Senior Software Engineer to join the Atlas Clusters Organization. The organization is responsible for building MongoDB Atlas, our database as a service offering and fastest growing product. Atlas allows users to deploy fault... 
    Senior
    Work at office
    Local area
    Worldwide
    Flexible hours

    Realm

    San Francisco, CA
    4 days ago
  • $300k

     ...training, or inference. As a Platform Engineer/Senior Site Reliability Engineer, you’ll own the reliability, performance, and automation of this GPU-powered infrastructure, ensuring...  ...operational backbone of one of the largest GPU clusters in private deployment. If you want... 
    Senior
    Permanent employment
    San Francisco, CA
    more than 2 months ago
  • $160k - $280k

     ...looking for a software engineer to build the Kubernetes...  ...provisions and runs our GPU inference fleet. You'll...  ...need, whether that's a cluster, a model deployment, or...  ...of a physical host from discovery, inference...  ...automatically. Own reliability of the pipeline: idempotency... 
    Senior
    Full time

    Fdetimes

    San Francisco, CA
    3 days ago
  •  ...environments, including cloud-based hyperscalers, on-premise GPU clusters, field-deployed computers, and large supercomputing centers. Based...  .... Utilize tools such as Datadog and PagerDuty to establish reliable alerting andincident response processes. ETL Pipeline... 

    DHI-WFS

    San Francisco, CA
    1 day ago
  • $144.5k - $180.6k

     ...data processing, and software engineering, our office is a truly...  ...environments, to guarantee the reliability, scalability, and availability...  ...optimization, management, and cluster tuning in a constrained environmentAbility...  ...:Experience with CUDA-based GPU programsSecurity expertise in... 
    Full time
    Temporary work
    For contractors
    Work at office
    Local area
    Remote work
    Home office
    3 days per week

    Planet Labs

    San Francisco, CA
    23 hours ago
  •  ...Mercor is hiring a software engineer to own the accelerator platform end-to-end. You will operate GPU clusters across AWS, GCP, neoclouds and on-prem data centers, with custom Kubernetes and Slurm operators. The role focuses on design, deployment, and on-call ownership... 

    Mercor Inc

    San Francisco, CA
    1 day ago
  •  ...Vida is seeking a Site Reliability Engineer to join the Enablement Team. This fully remote role reports to the Engineering Manager and will modernize, consolidate, and scale infrastructure as Vida secures new enterprise contracts. You will own Terraform patterns, improve... 
    Senior
    Remote work

    Remote Services Inc.

    San Francisco, CA
    1 day ago
  •  ...Runlayer is seeking a Site Reliability Engineer to own reliability, performance, and scalability of our cloud infrastructure as we scale to serve...  ..., and BYOC. You will collaborate with founders and a senior engineering team, manage AWS/GCP workloads, Kubernetes, CI/... 
    Senior

    Runlayer

    San Francisco, CA
    2 days ago
  •  ...Parabola is seeking a Senior Site Reliability Engineer to measure and improve how our software runs, spanning performance, security, and architecture. You’ll be on-call and help scale workflows built on Temporal, with a hybrid NYC or SF office presence about 3 days a... 
    Senior
    Work at office
    3 days per week

    Prowork

    San Francisco, CA
    1 day ago
  •  ...Salesforce, Inc. seeks an experienced Production Support Engineer (SMTS) to join the embedded reliability team. You will drive scalability, reliability, and...  ...supply chain AI-powered platform, working with senior engineers and product owners. You will own the observability... 
    Senior
    Shift work

    Salesforce

    San Francisco, CA
    1 day ago
  • $175k - $200k

     ...Senior Infrastructure Operations Engineer New York, New York, United States; Remote; San...  ...one of the world's largest GPU fleets. Our...  ...the center of production reliability for Lightning's AI infrastructure...  ...storage, provisioning, and cluster orchestration, serving as... 
    Temporary work
    For contractors
    Work at office
    Remote work
    Work from home
    Relocation package
    Flexible hours
    2 days per week

    Lightning AI

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Site Reliability Engineer (GPU Clusters) - Hosting. Be the first to apply!