Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Site Reliability Engineer

Full-time

Andromeda Cluster

Senior Site Reliability Engineer

Location: Global Remote / San Francisco · Full-Time

About Andromeda

Andromeda is a market and infrastructure platform to buy, sell, and operate compute.

We believe demand for compute will grow exponentially. So fast that a handful of vertically integrated providers won't be able to scale across operations, capital, supply chains, and politics to serve it. The result is a massive wave of fragmentation, with AI factories of every shape and size coming to market to fill this demand. Our job is to enable all of that fragmented compute to flow through one platform, delivering reliable capacity to model builders, research labs, and inference providers when they need it. We believe every spare electron should be made productive for AI and we're building the platform that makes that possible.


We sit at the center of three forces:

  • Companies that need reliable, high-performance compute fast

  • A fragmented global supply of GPUs across hyperscalers, neoclouds, and independent data centers

  • Capital, risk, and operational complexity that most teams are not equipped to manage

When we succeed, trillions of dollars of compute will flow through Andromeda. Builders get capacity when they need it. Providers get a reliable way to monetize, operate, and finance infrastructure at scale. Capital gets an easy way to deploy, hedge, and underwrite.

In five years, Andromeda won't just participate in the AI infrastructure market. We will shape it.

The Role

This is not a generalist SRE role.

You will design, operate, and debug large-scale GPU infrastructure used for distributed training and inference, working directly with customers pushing the limits of modern AI systems.

We’re looking for engineers who have personally run GPU clusters in production, understand the failure modes of distributed training, and can reason about performance from network fabric → kernel → framework.

What You’ll Own

  • GPU Cluster Architecture: Design and evolve multi-provider, multi-region GPU compute clusters optimized for large-scale training. Make topology-aware scheduling, networking, and storage decisions that directly impact training throughput and cost efficiency.

  • Customer Technical Partnership: Serve as the primary technical point of contact for customers running large-scale training workloads. Onboard, troubleshoot, and optimize, often in real time.

  • Reliability & Performance Engineering: Define SLOs and error budgets that account for the unique failure modes of GPU infrastructure (ECC errors, NVLink degradation, NCCL timeouts). Own capacity planning across heterogeneous GPU fleets optimized for training throughput.

  • Networking & Fabric Health: Ensure the health and performance of high-speed interconnects (InfiniBand, RoCE, NVLink) that underpin distributed training. Diagnose and resolve fabric-level issues that degrade collective operations.

  • Observability: Build deep visibility into GPU utilization, memory pressure, interconnect throughput, training job performance, and hardware health. Go well beyond standard infrastructure metrics.

  • Automation & Tooling: Build production-grade automation for cluster provisioning, GPU health checks, job scheduling, self-healing, and firmware/driver lifecycle management.

  • Incident Leadership: Lead incident response for complex, multi-layer failures spanning hardware, networking, orchestration, and ML frameworks. Drive blameless postmortems and systemic fixes.

What We’re Looking For

  • GPU Systems Expertise: Deep, hands-on experience operating large-scale GPU clusters (NVIDIA A100/H100/B200 or equivalent). You understand GPU memory hierarchies, ECC behavior, thermal throttling, and hardware failure modes from direct experience not documentation.

  • High-Performance Networking: Production experience with InfiniBand, RoCE, or NVLink fabrics in the context of distributed training. You can diagnose why an all-reduce is slow, identify a degraded link in a fat-tree topology, and reason about congestion control at scale.

  • Distributed Training & ML Frameworks: Working knowledge of how large training jobs actually run — NCCL, CUDA, PyTorch distributed, DeepSpeed, Megatron, FSDP, or similar. You don't need to write the models, but you need to understand what's happening at the systems level when a 1,000-GPU training run stalls.

  • Linux & Systems Internals: Expert-level Linux knowledge: kernel tuning, driver management (NVIDIA drivers, CUDA toolkit), cgroup/namespace internals, performance profiling at the syscall and hardware level.

  • Kubernetes & Orchestration: Strong experience running Kubernetes in production with GPU workloads, including device plugins, topology-aware scheduling, multi-cluster federation, and custom operators. Experience with Slurm or other HPC schedulers is equally valued.

  • Automation & Software Engineering: Strong engineering skills in Python, Go, or Bash. You build production-grade tools and services, not just scripts. Infrastructure-as-Code proficiency (Terraform, Helm, Ansible, or equivalent).

  • Observability & Monitoring: Hands-on experience building monitoring and alerting for GPU infrastructure, not just Prometheus/Grafana basics, but GPU-specific telemetry (DCGM, nvidia-smi, fabric manager metrics) integrated into actionable dashboards.

  • Incident Management: Proven track record leading incident response for complex distributed systems where the failure could be in hardware, firmware, networking, drivers, orchestration, or application code and you need to narrow it down fast.

Strong Candidates May Have

  • Distributed Storage: Experience with high-performance parallel file systems (VAST, Weka, Lustre, GPFS) and the checkpoint I/O and data-loading bottlenecks that come with large training runs.

  • Training Optimization: Experience profiling and optimizing distributed training performance: identifying stragglers, tuning collective communication strategies, improving MFU (Model FLOPs Utilization), and reducing idle GPU time across large runs.

  • Cluster Buildout & Hardware: Experience involved in physical cluster design - rack layout, power/cooling constraints, network topology design, and hardware validation/burn-in at scale.

  • Team Leadership: Experience leading or mentoring a team of infrastructure engineers. We're growing and need people who raise the bar for everyone around them.

Why You’ll Love It Here

This is a high-impact, senior builder’s role. You’ll have significant ownership and autonomy to shape how our systems run at a foundational level, working directly with customers and providers while architecting the infrastructure backbone for reliable, scalable AI compute. You’ll influence technical direction and help define what world-class AI infrastructure operations look like.

Andromeda Cluster is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the Senior Site Reliability Engineer in Remote vacancy
  • Job Title: Senior Site Reliability Engineer Location: (City, State & Zip code): Louisville, KY, United States [Hybrid - 50% Remote] Duration: 10/19/2026 - 04/18/2027 Pre-Screening Question: Do you have 6+ years of IT infrastructure experience, including 3+ years focused... 
    Senior
    Remote work

    Mindlance

    Louisville, KY
    1 hour ago
  •  ...We are seeking a Senior Platform Engineer to help evolve and scale a modern Kubernetes-based infrastructure platform supporting mission-critical...  ...and engineering teams. This role is focused on platform reliability, automation, infrastructure engineering, and improving... 
    Senior
    Full time
    Remote work
    Flexible hours

    The Cypress Group

    United States
    14 hours ago
  •  ...performance with AI-powered conversation intelligence and AI agents that act like your best reps. They are looking for a Site Reliability Engineer to join a team that builds - not just supports - an AI-native platform, and they own exciting domains like platform and harness... 
    Senior
    Full time
    Remote work

    Jecona

    United States
    4 days ago
  •  ...To enhance the reliability and operational performance of a mission-critical application platform, the full-time Senior Site Reliability Engineer will manage production Azure Kubernetes Service clusters, lead incident response efforts, and establish Site Reliability Engineering... 
    Senior
    Full time
    Remote work

    Virtual Vocations Inc

    United States
    20 hours ago
  •  ...Senior Engineering Role This senior engineering position plays a central role in transforming how software reliability and observability are delivered across our entire product landscape. You will help set technical direction and build standardised, intelligent observability... 
    Senior
    Work at office
    Remote work
    Work from home
    Flexible hours

    Xero

    United States
    4 days ago
  • $120k - $175k

     ...level of sports fandom. Ready to reimagine the DFS industry together?  We are seeking a highly skilled and experienced Senior Site Reliability Engineer to join our team. We are passionate about delivering cutting-edge solutions and pushing the boundaries of what's... 
    Senior
    Full time
    Remote work
    Work visa
    Flexible hours

    PrizePicks

    Remote
    1 day ago
  •  ...Site Reliability Engineer Runware is building high-performance infrastructure and products to power the worlds intelligence. Our platform enables developers and businesses to run fast, scalable inference across image, video and emerging modalities, while our Serverless... 
    Senior
    Remote work

    Runware

    United States
    1 day ago
  • $146.4k - $263.6k

     ...Do you want to shape reliability practices for a new AI inference platform? Are you a senior technical leader who drives solutions...  ...architecture decisions with product engineering teams, and shape SRE practices...  ...at scale. As a Senior II Site Reliability Engineer, you will... 
    Senior
    Full time
    Work experience placement
    Work at office

    Akamai

    Remote
    2 days ago
  •  ...We need a Senior SRE to ensure Xident's verification platform runs at 99.99% uptime....  ...SLOs, incident response, and production reliability for a system that processes millions of...  ...structured logging Implement chaos engineering practices to proactively identify failure... 
    Senior
    Remote work

    Xident

    Union, NJ
    3 days ago
  • $160k - $200k

     ...your work helps shape the future of finance. What We're Looking For We are seeking a highly skilled and motivated Senior Site Reliability Engineer with 8+ years of hands-on experience ensuring the reliability, scalability, and performance of mission-critical... 
    Senior
    Full time
    Remote work
    Shift work

    Cross River

    Remote
    15 days ago
  •  ...TXEmployment Type: Full TimeCompany: SRI Tech SolutionsJob Title: Senior Site Reliability EngineerLocation: Plano , TX (remote)Years of...  ...SummaryWe are seeking a highly skilled Senior Site Reliability Engineer (SRE) to join our dynamic team. The ideal candidate will... 
    Senior
    Remote work

    Sri Tech

    Plano, TX
    20 hours ago
  •  ...visible impact and put something genuinely rare on your CV, keep reading . About The Role We're looking for a Senior Site Reliability Engineer who's passionate about building reliable, scalable infrastructure that helps developers ship better software faster. You... 
    Senior
    Remote work
    Worldwide
    Flexible hours

    Camunda

    New York, NY
    3 days ago
  • $120k - $125k

     ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Site Reliability Engineer based in the United States. We are looking for an experienced Senior Site Reliability Engineer to strengthen the... 
    Senior
    Full time
    Casual work
    Flexible hours

    Jobgether

    Remote
    3 days ago
  • $115k - $150k

     ...Description Senior Site Reliability Engineer About Us At Gifthealth, we're revolutionizing the way people experience healthcare by simplifying the process of managing prescriptions and health services. Our mission is to provide a seamless, personalized, and efficient... 
    Senior
    Full time
    Remote work

    Gifthealth Inc

    Remote
    3 days ago
  • $118k - $177k

     ...Senior Site Reliability Engineer Everforth ECS is seeking a Senior Site Reliability Engineer to work remotely. Everforth ECS is seeking talented professionals to join our successful and growing team in building the next-generation Continuous Diagnostics and Mitigation... 
    Senior
    Remote work

    ECS Limited

    United States
    2 days ago
  • $200k - $250k

     ...exceptional customer experiences, we are on a mission to set new standards in online gaming. We are seeking an experienced Senior Site Reliability Engineer (SRE) to design, build, and maintain highly reliable, scalable, and secure systems. You will play a critical role in... 
    Senior

    Bellota Labs

    Redwood City, CA
    19 hours ago
  •  ...Working closely with development teams, engineering teams, and product owners to foster seamless...  ...to maintain optimal performance and reliability. Change Execution and Collaboration:...  ...satisfaction. What We're Looking For: Site Reliability Star! Are you ready to... 
    Senior
    Remote work

    Grouper Technology Limited

    United States
    1 day ago
  • $146.4k - $263.6k

     ...analyze and measure the performance and reliability of our platform. We are networking data...  ...the factors that impact them, and engineer targeted solutions for improvement....  ...telemetry into platform improvements. As a Senior II Site Reliability Engineer, you will be responsible... 
    Senior
    Full time
    Work experience placement
    Work at office

    Akamai

    Remote
    9 days ago
  • $87k - $161.3k

     ...and maintaining optimum platform infrastructure performance, reliability, and security using SRE practices, observability tools, manual...  ...improved collaborative response in real-time Leads lower level Engineers in stress, security, and performance testing Resolves... 
    Senior
    Full time
    Part time
    H1b
    Work at office
    Remote work
    Flexible hours

    Centene Corporation

    Remote
    2 days ago
  • $120k - $125k

    A final in-person interview maybe required for this position. Senior Site Reliability Engineer & Duties: The Senior Site Reliability Engineer (Sr. SRE) ensures the reliability, performance, and scalability of all platform services. This role combines software engineering... 
    Senior
    Full time
    Part time
    For contractors
    Casual work
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    Foundation Finance Company, LLC

    Utah
    6 days ago
  • $116.63k - $181.24k

     ...Summary The Wikimedia Foundation is looking for a Senior Site Reliability Engineer to support and develop the platform serving the world’s favorite encyclopedia, Wikipedia, to millions of people around the globe. Wikimedia’s Site Reliability Engineering (SRE) team... 
    Senior
    Permanent employment
    Full time
    For contractors
    Currently hiring
    Local area
    Remote work

    Wikimedia Foundation

    Texas
    2 days ago
  •  ...Senior Site Reliability Engineer RateGain Travel Technologies Limited is a global provider of AI-powered SaaS solutions for travel and hospitality, working with 13,000+ customers and 700+ partners across 160+ countries. RateGain helps travel and hospitality businesses... 
    Senior
    Remote work

    Sojern

    United States
    19 hours ago
  •  ...Senior Site Reliability Engineer Italy - Remote At Ping Identity, we believe in making digital experiences both secure and seamless for all users, without compromise. We call this digital freedom. And it's not just something we provide our customers. It's something... 
    Senior
    Local area
    Remote work
    Worldwide
    Flexible hours

    ForgeRock (Acquired By Ping Identity)

    United States
    14 hours ago
  •  ...or Pacific Time Zones to be considered. Overview: The Site Reliability Engineer (SRE) is responsible for the reliability, performance, and...  ...the standards, tooling, and guidance to meet them. As a Senior SRE, this role is regarded as a platform expert across CCX,... 
    Senior
    Full time
    Work experience placement
    Remote work

    Precisely US Jobs

    Remote
    16 days ago
  • $106.3k - $150k

     ...elderly, and defend national interests on the battlefield. Our engineers, designers, and strategists cut through complexity to...  ...for a better tomorrow for all Americans. We are seeking a Senior Site Reliability Engineer to strengthen the availability, performance, and resilience... 
    Senior
    Full time
    Contract work
    Remote work

    eSimplicity

    Remote
    1 day ago
  • $150k - $180k

     ...experiences. Job Description About the opportunity AI Engineering builds the shared agent platform behind Xplor's AI...  ...features faster and safely. We're looking for a hands-on Site Reliability Engineer to own how our agent platform behaves in production... 
    Senior
    Full time
    For contractors
    Local area
    Remote work
    Visa sponsorship
    Flexible hours

    Xplor

    Oregon State
    7 days ago
  • $55 - $65 per hour

     ...integration problems. Support automation and platform improvements, including Akamai-MIG integrations. Strengthen platform reliability and stability through continuous troubleshooting, optimization, and proactive fixes. Required to work EST hours approximately... 
    Senior
    Remote work
    Flexible hours
    Shift work

    NTT Data Americas, Inc.

    Mahwah, NJ
    2 days ago
  •  ...Senior Site Reliability Engineer Do you like collaborating across teams to solve complex problems? Do you have a passion for cutting edge technologies and tackling system problems? Join our highly-skilled Site Reliability team! Our team designs, develops, and manages... 
    Senior
    Work at office
    Remote work

    India Augusta Building

    United States
    2 days ago
  • $151k - $206k

     ...Location: This position is remote within the United States or Canada Role Summary Censys is seeking a Senior Site Reliability Engineer to join our Infrastructure and Operations Platform team. Our engineers ship Go services from a single monorepo onto Kubernetes... 
    Senior
    Permanent employment
    Full time
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Censys

    Remote
    3 days ago
  • $160k - $208k

     ...chronic conditions.  We are looking for an experienced Site Reliability and Infrastructure Engineer to join our engineering team. You will support...  ...workloads. Kubernetes competency is highly valued. As a Senior Site Reliability Engineer, you will: Build systems... 
    Senior
    Full time
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Clover Health

    Remote
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Site Reliability Engineer. Be the first to apply!