Senior AI Inference Reliability Engineer - GPU & Kubernetes
Fdetimes
Together AI in the United States is seeking a software engineer focused on reliability to own production for the Kubernetes-native control plane powering GPU inference fleets. You’ll manage SLOs, incident response, and automated remediation while improving efficiency and resilience at large scale.
You will collaborate with ML platforms and researchers to bring cutting-edge inference tech into production, building robust tooling and architecture to minimize outages and maximize throughput.
#J-18808-LjbffrVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Reliability Engineer - GPU & Kubernetes in San Francisco, CA vacancy
$160k - $280k
...Back to jobs New (Senior/Junior AI Inference Reliability Engineer, Compute Infra) San Francisco About This Role... ...own what happens in production to the Kubernetes-native control plane that provisions and runs our GPU inference fleet. The platform team builds...SeniorPermanent employmentFull timeTeli Labs
San Francisco, CA1 day ago- ...Together AI, the AI Native Cloud, is seeking a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You design a manifest-driven API where the inference team declares needs like clusters, model deployments, or...Senior
- Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San Francisco... ...routes training and inference jobs across global supply... ...operate, and debug large-scale GPU infrastructure used for... ...and hardware level. Kubernetes & Orchestration: Strong experience...SeniorFull timeRemote work
$250k
...Join a rapidly scaling AI cloud infrastructure provider... ...building a next-generation GPU platform designed for AI... ...training, experimentation, and inference at scale. The company is... ...company is looking for a Senior / Staff Site Reliability Engineer to support and scale large...SeniorPermanent employmentRemote work$175k - $250k
...0.00/yr Job Title: Senior Cloud Infrastructure Engineer Location: San Francisco... ...with generative AI. They are the team behind... ..., performance, and reliability across environments.... ...Manage and automate GPU compute clusters... ...tools such as Python, Kubernetes, Terraform, and...SeniorFull timeRemote workRelocationRelocation package$300k
...startup building out their AI and cloud platform,... ...scale model training, or inference. As a Platform Engineer/Senior Site Reliability Engineer, you’ll own the... ...and automation of this GPU-powered infrastructure,... ...environments managed by Slurm, Kubernetes, or direct SSH access....SeniorPermanent employment- ...Beam is seeking a role-focused engineer to own the health and reliability of our GPU compute fleet in a fast-growing AI inference platform. You will build and own metrics pipelines, alerts, and a unified health view across thousands of GPUs in production. You will automate...
BEAM inc.
San Francisco, CA3 days ago $160k - $220k
Secure Every Identity, from AI to HumanIdentity is the key to unlocking the... ...mission. If you are too, let's talk.Senior Database Reliability Engineer (DBRE) Experience Level: Mid-Senior... ...using tools such as Terraform, Ansible, Kubernetes Operators, or custom tooling.Build...SeniorPermanent employmentWork at officeLocal areaWorldwideFlexible hoursOkta
San Francisco, CA3 days ago$160k - $280k
...re looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest... ...automatically. Own reliability of the pipeline:... ...or Go. About Together AI Together AI, the AI Native...SeniorFull time$127k - $196.5k
...innovators. As consumers embrace new AI-driven experiences, the LiveRamp data... ...operational support. We are looking for a Senior Site Reliability Engineer who is excited about establishing and... ...cost of the systems and rightsize Kubernetes containers.Work in close...SeniorWorldwideLiveRamp
San Francisco, CA2 days ago- ...Lambda is seeking a Senior Site Reliability Engineer to join our AI cloud infrastructure in San Francisco. You will design and operate monitoring for cluster... ...code. You will troubleshoot complex networking, GPU, and fabric issues and participate in on-call rotations...SeniorRemote work
Applied Methods Inc
San Francisco, CA4 days ago - ...An AI infrastructure company is looking for a Senior ML Engineer to optimize performance for voice models such as speech-to-text and text-to-speech.... ...models on advanced serving engines, focusing on GPU utilization and inference optimization. With over 5 years of...Senior
Together AI
San Francisco, CA3 days ago $152.5k - $205k
....What you’ll be responsible for:As a Senior Site Reliability Engineer on Circle’s platform team, you’ll design... ...behind critical digital-assets, AI, and application workloads. You will... ...and automation, developing reliable Kubernetes platforms, and using Terraform to make...SeniorFlexible hoursCircle
San Francisco, CA4 days ago- ...Mistral AI is building a Compute Support team to ensure reliability and scalability of GPU clusters in Kubernetes. You will be the first point of contact for customers and internal teams, providing guidance, triage, and resolution for compute-related inquiries. The...Senior
Firstminute Capital
San Francisco, CA5 days ago $152.5k - $205k
...What you’ll be responsible forThe Site Reliability Engineer builds and maintains shared platform capabilities... ...help teams safely adopt and operate AI-enabled tooling and workflows by... ...secure, reliable cloud infrastructure and Kubernetes-based services.Improve CI/CD pipelines,...SeniorFlexible hoursCircle
San Francisco, CA3 days ago$160k - $250k
About AirwallexAirwallex is the AI-native financial operating system for a real... ...in full.How you'll make impactAs a Senior Site Reliability Engineer, you’ll work closely with product teams... ...cloud platforms such as AWS or GCP, Kubernetes, observability, and incident response...SeniorTemporary workWork at officeLocal areaFlexible hours3 days per weekAirwallex
San Francisco, CA3 days ago$165k - $226.6k
Secure Every Identity, from AI to HumanIdentity is the key to... ...Identity belongs to you. The Engineering OpportunityWe are looking for an experienced Senior Site Reliability Engineer to join Okta's Emerging... .../Orchestration: Kubernetes (EKS/GKE), Terraform, Helm, Git...SeniorLocal areaWorldwideFlexible hoursOkta
San Francisco, CA2 days ago- About the RoleAs a Senior Site Reliability Engineer (SRE) at Hinge Health, you will play a pivotal role in... ...and developer productivity, including AI-assisted tooling used safely. Be a go... ...) and container orchestration (e.g., Kubernetes).Hands-on experience with Infrastructure...SeniorWork at officeLocal areaRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA2 days ago - ...Databricks is seeking a Staff Software Engineer to contribute to the AI Runtime platform for large-scale GPU training. The role centers around driving the architecture... ...the managed training stack, ensuring fast and reliable operations. Candidates should have over 10...Senior
NEON Inc
San Francisco, CA3 days ago $167.7k - $245.2k
...Observability team within Cloud Network Platform Engineering’s Site Reliability Engineering organization. You will... ...services, with an initial focus on Kubernetes-based platform workloads such as... ...and protect organizations in the AI era - and beyond. We’ve been innovating...SeniorFull timeTemporary workLocal areaFlexible hoursCISCO Systems
San Francisco, CA2 days ago- ...Lambda is building the AI cloud infrastructure leader... ...the world. We are seeking a Senior Software Engineer to join our Managed Kubernetes (Mk8s) team, shaping the architecture, reliability, and automation of our Kubernetes... ...team you will work on GPU-aware scheduling, control...Senior
Lambda
San Francisco, CA2 days ago - ...E2B is seeking a Senior SRE/Infrastructure Engineer to build and operate infrastructure across AWS, GCP,... ...Terraform modules, Helm charts, and Kubernetes configurations for production deployments... ...EKS, GKE, and AKS, while enhancing reliability, monitoring, and automation. You...Senior
E2B
San Francisco, CA2 days ago - ...UsAlembic is the pioneering Causal AI platform. We help the world's... ...under real-world scale, reliability, and security demands — and we're looking for an engineer who wants to own the foundation... ...network peering.Familiarity with Kubernetes networking (CNI plugins, ingress...Senior
Alembic
San Francisco, CA5 days ago $127k - $249k
...The Team Platform Engineering is the department within SRE that is responsible... ...are our multi-cloud-provider Kubernetes infrastructure, networking,... ...that ensure cluster reliability and security (e.g., CoreDNS,... ...redefined the database for the AI era, enabling innovators to create...SeniorWork at officeLocal areaRemote workWorldwideFlexible hoursMongoDB
San Francisco, CA2 days ago$167.7k - $245.2k
...those beyond their ownership. Leveraging AI and an unparalleled set of cloud,... ...Observability portfolios.Your ImpactAs a Senior Site Reliability Engineer (SRE), you will lead the design and... ...leverage CNCF-standard tools—such as Kubernetes, Prometheus, and Service Mesh—to...SeniorFull timeTemporary workWork at officeLocal areaFlexible hoursCISCO Systems
San Francisco, CA4 days ago- ...experienced ML Infrastructure Engineer to help scale the... ...behind cutting-edge AI systems. You will... ...of training and inference pipelines that power... ...systems, optimizing GPU workloads, and ensuring reliability across cloud environments using Kubernetes and Docker with AWS/...Senior
Goliath Partners LP
San Francisco, CA5 days ago - ...mission is to create reliable, interpretable, and steerable AI systems. We want AI... ...researchers, engineers, policy experts, and... ...mandate is to make inference deployment boring and... ...production across GPU, TPU, and Trainium... ...Proficiency with Kubernetes-based deployments,...SeniorFull timeWork at officeVisa sponsorshipFlexible hoursShift work
Anthropic
San Francisco, CA5 days ago $170.1k - $258.3k
...accessible mobility. For the AI Kernels & Compilers... ...run efficiently and reliably on real vehicles at scale... ..., and performance engineering so that every cycle on... ...builds high‑performance GPU kernels and custom libraries... ...of our on‑vehicle ML inference for ADAS and autonomous...SeniorFull timeLocal areaRemote workWork from homeRelocation packageFlexible hoursGeneral Motors
San Francisco, CA4 days ago$250k - $300k
...vertically integrated AI infrastructure... ....About the Role:As a Senior Engineering Manager, you will lead... ...faster, cheaper, and more reliably in production. While... ...and hands-on with the inference stack end to end: profiling... ...with Docker and Kubernetes.Prior work building...SeniorTemporary workCrusoe
San Francisco, CA2 days ago- ...hybrid role spans across platform reliability and infrastructure engineering. You'll be instrumental in ensuring... ...internal research and external customers' GPU cluster environments.... ...tools. Hands-on experience with Kubernetes and cloud platforms (GCP preferred)...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Reliability Engineer - GPU & Kubernetes. Be the first to apply!
Related searches
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai research engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- reliability maintenance engineering technician San Francisco, CA
- sr reliability engineer San Francisco, CA