Site Reliability Engineer (SRE) - AI Infrastructure
$300kFull-time
Are you looking for an exciting new opportunity?
Join a stealth-mode hyperscale data center startup building a next-generation AI and cloud platform designed for startups and advanced research, powered by thousands of H100, H200, and B200 GPUs available on demand. Their platform supports everything from rapid experimentation to full-scale model training and inference, with flexible orchestration via Slurm, Kubernetes, or direct SSH access.
This is a rare opportunity to work at the intersection of hyperscale infrastructure and AI, shaping the operational backbone of one of the largest GPU clusters in private deployment. If you want to build and operate infrastructure for frontier AI workloads, automate systems at petascale, and be part of a founding engineering team, this is the place to do it.
Responsibilities:
- Design, deploy, and maintain large-scale GPU clusters (H100/H200/B200) for training and inference workloads.
- Build automation pipelines for provisioning, scaling, and monitoring compute resources across Slurm and Kubernetes environments.
- Develop observability, alerting, and auto-healing systems for high-availability GPU workloads.
- Collaborate with ML, networking, and platform teams to optimise resource scheduling, GPU utilization, and data flow.
- Implement infrastructure-as-code, CI/CD pipelines, and reliability standards across thousands of nodes.
- Diagnose performance bottlenecks and drive continuous improvements in reliability, latency, and throughput.
Skills / Must Have:
- 7+ years of experience in SRE, DevOps, or Infrastructure Engineering roles supporting large-scale compute environments.
- Strong hands-on experience with Kubernetes and Slurm for cluster orchestration and workload management.
- Deep knowledge of Linux systems, networking, and GPU infrastructure (NVIDIA H100/H200/B200 preferred).
- Proficiency in Python, Go, or Bash for automation, tooling, and performance tuning.
- Experience with observability stacks (Prometheus, Grafana, Loki) and incident response frameworks.
- Familiarity with high-performance computing (HPC) or AI/ML training infrastructure at scale.
- Background in reliability engineering, distributed systems, or hardware acceleration environments is a strong plus.
Benefits:
- Equity
Salary:
- $300,000 gross per year
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Site Reliability Engineer (SRE) - AI Infrastructure in San Francisco, CA vacancy
$170k - $250k
...Site Reliability Engineer (SRE) Location: San Francisco, CA / Palo Alto, CA Company Stage of Funding: Growth-Stage AI Infrastructure Company ($80M Raised) Office Type: Onsite (4 Days Per Week) Salary: $170,000-$250,000 + Competitive Equity Company Description...SuggestedWork at officeVisa sponsorshipFlexible hoursRecruiting from Scratch
San Francisco, CA2 days ago- ...Site Reliability Engineer (SRE) FLUIX is building the AI operating system that plans, designs, and optimizes AI infrastructure. We are based in Silicon Valley. We specialize in providing AI-driven solutions for data centers and power providers, leveraging cutting-edge...SuggestedWork at officeWeekend work
Fluix AI
San Francisco, CA21 hours ago $170k - $230k
...Site Reliability Engineer (SRE) Palo Alto / San Francisco Bay Area About Mithril Mithril is an AI infrastructure platform built to make GPU compute more accessible and affordable for the world's leading enterprises, AI startups, and the AI research community,...SuggestedWork at officeLocal area1 day per weekMithril
San Francisco, CA21 hours ago- Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San Francisco • Full-Time About Andromeda Andromeda Cluster was founded by Nat... ...and engineering. The Role This is not a generalist SRE role. You will design, operate, and debug large‑scale GPU...SuggestedFull timeRemote work
- ...building the next hyperscaler for AI agents. About the role You... ...of sandboxes. Today our infrastructure runs on Nomad and Terraform across... ...for an infrastructure engineer who actually wants to live in... ...startup with in-person (4 days on-site, 1 day WFH) offices in San...SuggestedLive inWork from home
- Site Reliability Engineer - AI Infrastructure Location: Global Remote / San Francisco · Full-Time About Andromeda Andromeda Cluster was founded by Nat Friedman... .... What We’re Looking For 5+ years experience in SRE, DevOps, or infrastructure engineering roles. Strong Linux...Full timeRemote work
- ...these hyperscale supercomputers reliable and efficient during the... ...the Role We are looking for engineers to operate the next generation... ...systems engineering with hands-on infrastructure work on our largest... ...computing About OpenAI OpenAI is an AI research and deployment company...
- ...building the category-defining AI workflow automation platform... ...the role We’re hiring an SRE to join our engineering team at Plenful and take ownership of the reliability and performance of the... ...implemented and measured. Infrastructure and Platform Operations:...Work at officeRemote workFlexible hours2 days per week
Plenful
San Francisco, CA4 days ago $232k - $319k
...Every Identity, from AI to Human Identity is... ...the trusted, neutral infrastructure that enables organizations... ...with great people and reliable, cost-effective, and... ...initiatives across SRE & Infrastructure organization... ...and product engineering Build a world-class...Permanent employmentLocal areaWorldwideFlexible hours$200k - $250k
Overview Job Title: SRE & Data Engineer Location: Bay Area, CA, 3 days a week onsite... ...and maintain the foundational infrastructure, ensuring consistent, scalable, and reliable systems that support all... ...projects, pushing the boundaries of AI and machine learning. Join a team...Full timeH1b3 days per week- ...technology firm in San Francisco is seeking an experienced Infrastructure Engineer to lead the design and evolution of core services. You'll define... ...offers competitive compensation and opportunities for growth and mentorship. #J-18808-Ljbffr Hayden AI Technologies, Inc.
- ...next generation of Gen AI-driven code reviewers:... ...individual engineers. We combine language models... ...seeking an experienced Site Reliability Engineer to join our Platform... ...reliably. As an SRE at CodeRabbit, you'll... ...platforms, and owning the infrastructure that powers our AI-...
CodeRabbit
San Francisco, CA2 days ago - ...SRE Location: San Francisco, CA (5 Days In-Office) You are the infrastructure expert who enables our rapid product development... ...of our clinical AI platform for major... ...Look for in a Great Engineer You have the... ...maintaining the highest reliability. DevX Support:...Work at office
Latent
San Francisco, CA2 days ago - ...About the job Senior Site Reliability Engineer About the Company Stellar... ...systems, design and improve the infrastructure behind our production... ...based systems operations, as a SRE or DevOps engineer. ~... ...Experience experimenting with AI-driven approaches to operations...
TechChain Talent
San Francisco, CA1 day ago - ...through intelligent automation. We build AI-powered software that eliminates... ...About the role We're hiring a Site Reliability Engineer (SRE) to ensure the reliability, performance... ...at scale - not just building infrastructure, but deeply understanding how it behaves...Work at officeRemote workFlexible hours2 days per week
Plenful
San Francisco, CA21 hours ago $113.4k - $162k
...Site Reliability Engineer San Francisco, CA We believe communication belongs... ...Reliability Engineer to own infrastructure, monitoring, logging, ci/cd... ...operates its systems in an AI-first environment where intelligent... ...and implementation of new SRE best practices. You'll...Temporary workTextNow
San Francisco, CA1 day ago$205k - $305k
...SDF is looking for a Director of Site Reliability Engineering to lead a small, high-leverage SRE team and help shape how... ...for SRE while owning the core infrastructure services that help SDF engineering... ...engineering. Pragmatically evaluate AI-assisted and agentic workflows...Temporary workWork at officeLocal areaRemote workWorldwideFlexible hoursStellar
San Francisco, CA2 days ago- The role We're looking for a world-class Site Reliability Engineer to ensure the reliability, performance, and scalability of our AI infrastructure platform. You’ll be building and... ...decisions. Required skills 3+ years in SRE, DevOps, or infrastructure engineering...
$163k - $203k
...technical contributor on the SRE team, responsible for the reliability, scalability, and... ...is as much of a platform engineering role as it is SRE role —... ...are building an agentic AI‑first operations model where... ...compute (managed by the Infrastructure Engineering team) across...Work experience placementWork at officeLocal areaRemote workFlexible hours2 days per week- ...Heidi is building an AI Care Partner that works... ...re a team of doctors, engineers, designers, researchers... ...Improve operational reliability: Identify recurring issues... ...clusters, cloud infrastructure, and core platform services... ...for 3-6+ years in SRE, DevOps, Platform, or...Work at officeWorldwide
- # Senior Site Reliability EngineerHybrid - San Francisco**Our Mission... ...*Job Summary:**Drata's SRE team operates as both a central engineering function and an... ...approach reliability.Our infrastructure runs on AWS across multiple... ...with AIOps - using AI/ML-based tooling for anomaly...Work at officeImmediate startWorldwideMonday to FridayFlexible hours
- Sr. Site Reliability Engineer Job type: Full Time · Department: Platform · Work... ...Remote) Optura is healthcare’s AI orchestration platform. We... ...seamlessly with existing infrastructure, and offers both SaaS and... ...including 3+ years in a senior SRE, platform, or staff...Full timeRemote work
$60 per hour
Senior Site Reliability Engineer (Copy) Seattle Hybrid (Hybrid location). Full-time... ...Us Supio is a trusted AI platform purpose-built for... ...hotfixes — while also automating infrastructure, monitoring systems, and... ...If You Have 3-6+ years in SRE, DevOps, or infrastructure...Full timeWork at officeFlexible hours- ...Onsite in Menlo Park, CASite Reliability Engineering (SRE) is a discipline that... ...engineering and applies them to infrastructure and operations problems.... ...frictionless Customer Experience.Site Reliability Engineer RoleAs... ...in Python supported by Gen AI tooling to accelerate...Immediate startRemote workWorldwide
- ...and action layer for AI agents. We give agents... ...that context infrastructure for production-grade... ...includes AI agents. Engineering Hiring Sprint We're growing... ...Engineers Database Engineers Site Reliability Engineers... ...platform engineering, SRE, or DevOps. Hands‑on...Work at officeLocal areaFlexible hours
$300 per month
...We’re crafting the engine that powers a... ...ambitiously with AI — without sacrificing... ...transformative cloud infrastructure. About This Role... ...building the most reliable, energy-efficient,... ...that mission. As a Site Reliability... ...grow into advanced SRE responsibilities....Temporary work$127k - $249k
The Team Platform Engineering is the department within SRE that is responsible for a range of critical infrastructure and operational functions that... ...components that ensure cluster reliability and security (e.g.,... ...redefined the database for the AI era, enabling innovators...Work at officeLocal areaRemote workWorldwideFlexible hours- We are seeking a Sr. Site Reliability Engineer to join our team and run critical infrastructure for our blockchain and web applications. You’ll learn to deploy and maintain... ...development processes. DevOps Engineer/SRE Transitioning to Blockchain An experienced DevOps...Remote job
$166.9k - $225.9k
Job Summary Drata's SRE team operates as both a central engineering function and an embedded reliability practice. You'll be... ...approach reliability. Our infrastructure runs on AWS across... ...of experience in Site Reliability... ...Experience with AIOps—using AI/ML‑based tooling for...Flexible hours- CloudDevs: Senior Web site Reliability Engineer (SRE) CloudDevs works with fast-moving, venture-backed startups throughout the US. We’re constructing... ...Engineering roles. Sturdy expertise with cloud infrastructure (AWS most popular), Terraform, and Kubernetes. Deep data...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Site Reliability Engineer (SRE) - AI Infrastructure. Be the first to apply!
Related searches
- site reliability engineer remote San Francisco, CA
- site reliability engineer sre San Francisco, CA
- site reliability engineer San Francisco, CA
- infrastructure automation engineer San Francisco, CA
- senior infrastructure engineer San Francisco, CA
- security infrastructure engineer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
- infrastructure engineer San Francisco, CA
- infrastructure engineering manager San Francisco, CA
- lead infrastructure engineer San Francisco, CA