ML Infra Engineer — GPU Clusters & Distributed Systems
AI Breaking Wire
OpenAI in San Francisco is seeking an experienced engineer to architect, build, and scale high-performance distributed training and inference infrastructure for massive LLMs. You will optimize GPU cluster utilization and memory management for multi-node training, partnering with research teams to accelerate experiments. The role requires deep expertise in distributed systems, networking, and high-throughput computing, plus strong coding in C++, Python, and CUDA, with hands-on experience on large #J-18808-Ljbffr AI Breaking Wire
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Infra Engineer — GPU Clusters & Distributed Systems in San Francisco, CA vacancy
- Flexion seeks a senior ML engineer to own its GPU compute platforms on-site in San Francisco. You will design, bring up, operate and optimize distributed multi-node GPU clusters and collaborate with AI engineers to accelerate training and improve hardware utilization....Suggested
- ...world. We are a group of engineers, scientists, roboticists,... ...of the future. As an ML Infra Engineer (Data Systems), you’ll build and operate... ...role at the intersection of distributed systems, storage, and... ...petabytes efficiently across clusters and environments....Suggested
Physical Intelligence
San Francisco, CA1 day ago - Genesis AI in San Francisco is seeking a senior ML infrastructure engineer to design and optimize distributed training systems and performance-critical components. You... ...efficient hardware utilization across multi‑node GPU clusters. Join a team focused on scalable AI...Suggested
- Uber is seeking a Staff Software Engineer for ML Infra in San Francisco to architect and build scalable ML data and backend systems that power the trust and pricing platforms across... ...in MLOps, large language models, and distributed systems is required, focusing on...Suggested
- Flexion Robotics seeks a senior ML engineer to own GPU compute platforms and optimize training workflows on multi-node clusters. You will collaborate with AI and infrastructure... ...environments. The role requires deep knowledge of distributed training, PyTorch, and Python, with...Suggested
- ...As a Machine Learning Systems Administrator / DevOps Engineer, you will maintain... ...large-scale training clusters and the deployments and... ...Prior work supporting ML/AI infrastructure, including GPU management and... ...InfiniBand, RoCE) and distributed storage Experience...Work at officeRemote workRelocation package
Zyphra
San Francisco, CA21 hours ago - ...hands-on support from AMD engineers the team is scaling... ...We are looking for a GPU Cluster Engineer to own the entire... ..., containers, and ML frameworks. While our... ...production services. Distributed Performance: Tune NCCL... ...Haves: ~5+ years in systems/infrastructure...Flexible hours
Sciforium
San Francisco, CA1 day ago - Avala is seeking a senior ML infrastructure engineer in San Francisco to scale neural network training... ...data loading, pipelines, and distributed training across massive GPU clusters. Join a team building cutting-edge autonomous systems data infrastructure, with equity and...
- Hamilton Barnes is seeking a Senior Storage Engineer to own the high-performance storage layer for large-scale GPU clusters and AI workloads. You will design, deploy, and... ...performance. The role focuses on optimizing distributed storage, troubleshooting bottlenecks, and...Remote job
- Uber is seeking to build and launch AI/ML-powered products and scalable distributed systems to optimize consumer experiences. You will guide projects from scoping and experimentation to production deployment and maintenance. The role focuses on delivering high-impact AI...
- ...Francisco is seeking a Machine Learning Infrastructure Engineer to architect and scale compute, training, and... ...pipelines powering next-gen AI models. You will own distributed systems across large GPU clusters, collaborate with core platform teams, and drive low-...Full timeFlexible hours
$180k - $310k
...Software Engineer, Distributed Systems (Infra) We're building the creative layer for modern communication. Every month, over a billion people make presentations — but the tools they use to make them haven't evolved in decades. We're changing that, using AI to disrupt...Full timeWork at officeWork from homegamma.app
San Francisco, CA1 day ago$227.2k - $324.5k
...the Role:As a Staff Software Engineer on the ML Infrastructure team, you... ...low-latency ML model serving systems that support Deep Learning,... ...throughput, and low latency distributed systems using ScalaBuild reusable... ...cost, and efficiency of our infra. Lead large scale cross...Full timeTemporary workLocal areaFlexible hoursTubi TV
San Francisco, CA5 days ago- ...Principal Machine Learning Systems Engineer (P60) to lead technical... ...Doð Design and Build ML SystemsArchitect and... ...data.Develop tools and infra to support rapid experimentation... ...to HaveBackground in distributed systems, high-performance computing, or GPU optimization....Work at officeLocal area
Atlassian
San Francisco, CA3 days ago - Trajectory is seeking an ML Infrastructure Engineer to join our research-driven team in San Francisco. You... ...translate new algorithms into reliable systems. We value deep specialization in training infra, inference systems, or GPU kernels, strong Python and C++/CUDA/Triton...
$204k - $216k
...lives in silos, in legacy systems, in the heads of a few... ...research, and platform engineering, and you make the... ...to get right. The AI/ML Infrastructure and Systems... ...of inference, including GPU and hardware efficiency... ...programming and distributed systems fundamentals....- ...medium. Supercomputing / AI Infra at Krea We build and... ...s research and inference. Distributed training, 1000+ K8s GPU clusters, petabyte scale data pipelines... ...datastores, job orchestration systems, and streaming pipelines... ...RL infrastructure Applied ML pipelines Find clean...
$500 per month
...available to any downstream query engine and use case (from... ...analytics to real-time AI / ML). We are a team of self-... ...have created large-scale data systems and globally distributed platforms that sit at the... ...algorithms over a Kubernetes cluster. Leverage data from...Odd jobWork at officeRemote workLogoslabs
San Francisco, CA1 day ago- ...based real-time data streaming platform, seeks a founding engineer focused on distributed systems. You'll help shape the next-gen data platform, interact... ...across Go, Kafka, Kubernetes, Terraform/Helm, and cloud infra, with opportunities to influence product direction and...
$175k - $300k
...infrastructure. This position involves building a production control plane and ensuring the fleet's legibility. Your experience with distributed systems and AI tooling will be key to success. The base salary ranges from $175,000 to $300,000 annually, with additional benefits...$170.1k - $258.3k
...4-capable fully self-driving systems, to move us toward safer, more... ...development, and performance engineering so that every cycle on our accelerators... ...team builds high‑performance GPU kernels and custom libraries... ...the heart of our on‑vehicle ML inference for ADAS and...Full timeLocal areaRemote workWork from homeRelocation packageFlexible hoursGeneral Motors
San Francisco, CA1 day ago$200k - $300k
...Foundation Model. As a Senior ML Engineer, Foundation Models, you will work... ..., and world model literature into systems that handle real food, with real end... ...prediction Background in large‑scale distributed training (multi‑node GPU clusters, FSDP, DeepSpeed) Familiarity...Flexible hoursAlumni Ventures
San Francisco, CA1 day ago- ...legal entity. Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference... ...have the chance to own everything from distributed infrastructure (global KV cache, continuous... ...) to deep low-level optimizations (GPU kernels, quantization, speculative decoding...Work at officeLocal area
Atlassian
San Francisco, CA2 days ago - ...intelligence. We build the systems that make large-scale... ...leading investors. Engineers at Hedra work across... ...and operating distributed production systems.... ...serving infrastructure. GPU or accelerator infrastructure... ...Kubernetes or other cluster orchestration systems....Work at office
Hedra Inc.
San Francisco, CA3 days ago - ...a Machine Learning Infrastructure Engineer to help architect the compute, training... ...direct ownership over scaling distributed systems across massive hardware clusters while collaborating directly with... ...-scale workloads across extensive GPU clusters.Build developer abstractions...Full timeWork at officeFlexible hours
Objective Paradigm
San Francisco, CA1 day ago - ...about yours. About this role You’ll be among the first ML Systems Engineer, joining a team of machine learning researchers and... ...where per‑user state and low latency both matter. Work on distributed training – data and model parallelism, communication scheduling...Work at office
Engram
San Francisco, CA1 day ago - ...building massive amounts of GPU capacity. Meanwhile,... ...We believe the ideal cluster optimization solution... ..., it must sit at the systems layer. We are a... ...performance optimization, distributed systems debugging,... ...research and production engineering. We look for exceptional...Full timeLive inWork at officeRemote workVisa sponsorshipRelocation package
Thunder Compute
San Francisco, CA1 day ago $250k
...workloads. With expanding GPU infrastructure across Europe... ...limitations. As a Senior ML Infrastructure Engineer, the successful candidate... ...scale training and inference systems. The role focuses on... ...inference optimisation, and distributed systems reliability, working...Full timeSan Francisco, CAmore than 2 months ago$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference... ...’d have:Strong excitement about system optimizationExperience with... ...distributed ML systemsStrong software engineering skills, proficient in frameworks...Full timeScale AI
San Francisco, CA5 days ago$175k - $300k
...frontier forward. The Production Engineering Team Examples of key... ...actual state inspection, and distributed command execution. One... ...hundred scripts. Make the system's view of itself always match... ...platforms, so every new site and GPU generation lands cleanly from...Local areaFluidstack
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Infra Engineer — GPU Clusters & Distributed Systems. Be the first to apply!
Related searches
- senior ml engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- data systems engineer San Francisco, CA