GPU Fleet Infra Engineer: Kubernetes & Scheduling
$230kOpenAI
OpenAI is seeking a Software Engineer to join our Fleet Infrastructure team in San Francisco. This team operates the world's largest GPU fleet supporting AI model training and deployment. Responsibilities include designing, deploying, and managing high-performance systems with a focus on automation and user requirements. This position offers a hybrid work model, a competitive salary range of $230K – $490K, and opportunities for equity. We provide relocation assistance and strive for a diverse and inclusive workplace. #J-18808-Ljbffr OpenAI
- ...in San Francisco is seeking an Infrastructure Ops Engineer to manage the operational health of their GPU fleet. This role involves working closely with customer... .... Candidates should possess strong skills in Kubernetes and a solid background in cloud infrastructure management...Fleet
$175k - $300k
Fluidstack is looking for a dedicated individual to take ownership of the health of our compute fleet in San Francisco. This role involves constructing metrics pipelines, managing GPU qualifications, and implementing automation processes to improve operational efficiency....Fleet$180k - $250k
A tech innovation company is looking for a hands-on engineer in San Francisco to manage a vast fleet of GPU servers. You will build systems for tracking server lifecycle, automate provisioning and health checks, and ensure OS-level security. The role requires 5+ years of...Fleet- ...company in San Francisco seeks infrastructure engineers to enhance the tooling and systems that... ...applications. Responsibilities include building GPU orchestration, scaling cloud batchjob systems, and designing efficient scheduling software. Candidates should have experience...SuggestedVisa sponsorship
- Generalist is seeking a candidate to manage GPU fleets for training large-scale AI models. You will optimize ML data loading, storage,... ...environments. Ideal candidates have deep experience with GPUs, Slurm or Kubernetes, and a strong understanding of the ML hardware stack. Your...Fleet
- ...infrastructure company in San Francisco is seeking an experienced engineer to manage and operate GPU clusters. The role requires over 5 years of hands-on... ...of hardware systems, and a passion for automating fleet operations. You will work as part of a small team, participate...Fleet
- ...build a high-performance macOS virtualization platform. This role involves managing the VM lifecycle and integrating with the fleet scheduler to optimize performance on Apple Silicon. The ideal candidate is curious and has hands-on experience in virtualization technologies...FleetFlexible hours
$167.2k - $209k
...world. DigitalOcean is seeking a Senior Engineer 2 to play a key technical role in our AI... ...roadmap for our high-performance inference fleet. What You’ll Do Performance... ...optimizations at the inference engine and GPU kernel layers, ensuring our infrastructure...FleetLocal areaRemote workWorldwideFlexible hours$320k - $405k
...committed researchers, engineers, policy experts,... ...Engineer, Node Infra About the role the... ...automation that keep every GPU, TPU and Trainium node in the fleet usable and ready to... ...platforms (e.g., Kubernetes, IaC, AWS/GCP/Azure... ...internals (scheduler, autoscaler, kubelet...FleetVisa sponsorship$260k - $290k
Together AI is searching for a Customer Support Engineer based in San Francisco, CA. In this role, you will be the technical owner for strategic customer relationships, ensuring flawless operation of GPU services. Your expertise will drive both customer success and company...- A high-growth AI startup in San Francisco is seeking a Software Engineer (Infrastructure) to design and scale Kubernetes systems for a rapidly expanding platform. You will be responsible for leading technical deployments for enterprise clients and developing secure execution...
- Together AI seeks a Customer Support Engineer to own technical relationships with strategic customers, focusing on infrastructure health and GPU deployments. You'll engage with client needs, manage incidents, and ensure operational excellence across compute, networking,...
$300k
GPU Optimisation Engineer — Real-Time Inference Want to push GPU performance to its limits — not in... ...kernel launch overhead, occupancy limits, scheduling inefficiencies, KV cache behaviour,... ...inference execution — not general infra, not model research. You’ll operate across...RelocationVisa sponsorshipFree visa$230k
OpenAI in San Francisco is hiring a Software Engineer for their Frontier Clusters Infrastructure team. This role involves scaling large Kubernetes clusters and automating infrastructure management to support cutting-edge AI research. Candidates should have experience in...- A leading AI research company in San Francisco is seeking engineers to operate next-gen compute clusters. The role requires scaling Kubernetes, automating infrastructure, and ensuring system reliability. Ideal candidates have strong Kubernetes and scripting skills with...
$220k - $300k
.... When people finance GPU clusters, the datacenters... ...culture, mentor junior engineers, and learn from our... ...The idea of automating fleet operations (provisioning... ...analysis Experience with schedulers and orchestration systems such as Slurm and Kubernetes Exposure to...FleetLong term contractContract workFixed term contractWork at officeLocal areaVisa sponsorshipShift work3 days per week$209k - $253k
A leading AI infrastructure company in San Francisco seeks a Staff Software Engineer to design and develop control systems for GPU node management. The candidate will be critical in building foundational cloud infrastructure and achieving business goals. This role requires...Fleet- Senior Site Reliability Engineer - AI Infrastructure... ...and debug large‑scale GPU infrastructure used for... .... Make topology‑aware scheduling, networking, and storage... ...heterogeneous GPU fleets optimized for training... ...syscall and hardware level. Kubernetes & Orchestration:...FleetFull timeRemote work
- Skipwithjoy in San Francisco is seeking an adaptable engineer to lead the infrastructure and security for their wearable robotic devices... ...secure boot and automated update pipelines for the MO/GO fleet. The role requires 6+ years in infrastructure engineering, with...Fleet
$175k - $300k
...observability platform and design APIs for infrastructure. This position involves building a production control plane and ensuring the fleet's legibility. Your experience with distributed systems and AI tooling will be key to success. The base salary ranges from $175,000...Fleet- United States Digital Space LLC seeks an experienced Engineer for the Hardware Health and Observability team, responsible for maintaining and optimizing the health of our global compute fleet. You will define health signals and build automated remediation systems across...Fleet
- ...etc. We are a small team of engineers wrangling problems from context... ...THE FRONTIER YOU'LL WORK ON fleet-managing agent runtimes... ...nothing is a must per-se core infra engineering you've run software... ...prem, VPC, air-gapped. deep kubernetes and helm: chart authoring, init...Fleet
- ...technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and... .... You will design distributed training systems and optimize GPU utilization while collaborating with cross-functional teams to adapt...
- A leading AI research company in San Francisco is seeking a software engineer for its Fleet High Performance Computing team. In this role, you'll ensure the reliability and uptime of the compute fleet, working with automation systems and monitoring tools. Ideal candidates...Fleet
- ...country, accelerating project schedules of billion-dollar infrastructure... ...veterans and world‑class engineers to solve physical‑world problems... ...us. We’re growing our sizable fleet of retrofitted autonomous construction... ...platforms with significant GPU resources Common autonomous...FleetTemporary workWork at officeFlexible hours
$300 per month
...scale. We are hiring a Senior Engineering Manager, SDN Management Plane... ...across our entire network fleet. This is a senior software engineering... ...traffic monitoring across GPU clusters. Design and... ...Generous paid time off and holiday schedule Cell phone reimbursement...FleetTemporary work$285k - $315k
...AMD. We are partnering with researchers, engineers, and organizations who share our belief... ...About the Role We're hiring a Founding GPU Compiler Engineer to build the core compilation... ...(fusion, tiling, memory planning, scheduling) Build search‑based compiler infrastructure...Full timeWork at officeRelocation package$100k - $120k
...Responsibilities Lead a team of kernel and system engineers focused on performance-critical code... ...compute kernels for CPU (AVX/ARM NEON), GPU (CUDA/ROCm), and hardware accelerators... ...bottlenecks in memory hierarchy, thread scheduling, and data movement Integrate kernel...$300k
Aionia Group in San Francisco is seeking a Systems Infrastructure Engineer to build scalable infrastructure for RL experiments. This role offers a unique opportunity to work on innovative projects with leading researchers in a well-funded AI company. The ideal candidate...- ...don’t believe culture can be engineered - but when it falls into place... ...to developer tooling and fleet-facing systems—working closely... ...Familiarity with real-time scheduling, inter-process communication,... ...integration Experience with GPU-accelerated compute or productionizing...FleetLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Fleet Infra Engineer: Kubernetes & Scheduling. Be the first to apply!
- fleet service San Francisco, CA
- fleet logistics San Francisco, CA
- commercial fleet sales San Francisco, CA
- fleet driver San Francisco, CA
- fleet San Francisco, CA
- fleet diesel mechanic San Francisco, CA
- fleet maintenance San Francisco, CA
- fleet engineer San Francisco, CA
- fleet mechanic San Francisco, CA
- fleet technician San Francisco, CA
