Software Engineer: ML Infra
Generalist
About the Role Generalist trains very large robot foundation models. This requires utilizing very large numbers of the latest generation GPU hardware and infrastructure (currently Nvidia) to run distributed training jobs and researcher experiments. We have extreme requirements on storage and data loading infrastructure that requires maximizing cloud infrastructure and custom solutions. You will also own inference infrastructure. For our robots this is a fleet of on‑prem GPUs attached to robots that have extreme real‑time and latency budgets in compute constrained environments. You’ll be responsible for: Owning our GPU compute fleets Ensure our GPUs are easy for researchers to use and maximally utilized Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments. Orchestration of robot inference fleets You might thrive in this role if you: Have managed large fleets of GPUs doing large‑scale, long‑term, highly distributed training runs or inference Deep experience in Slurm or Kubernetes for ML workload orchestration Have built high‑scale ML data loaders and preparation systems Deeply understand every layer of the ML hardware, storage, and networking stacks Have experience in the NVidia GPU ecosystem About Generalist At Generalist, we are on a mission to make general‑purpose robots a reality. We believe the industries and homes of the future will depend on humans and machines working together in new ways. Robots can help us build more and get more done. We build embodied foundation models, starting with a focus on dexterity. This requires advancing the frontiers of data, models, and hardware, to enable robots to intelligently interact with the physical world. The company embraces both large‑scale AI and robotics as core to its DNA. Our team of researchers, roboticists, and company builders come from OpenAI, Boston Dynamics, Google DeepMind, and other frontier labs—with a track record of shipping AI breakthroughs. Before Generalist, we pioneered large embodied multimodal models and vision-language-action models (PaLM‑E, RT‑2, Gemini Robotics), launched and scaled ChatGPT and GPT‑4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next‑generation robots (Atlas, Spot, Stretch) and pushed the limits of what they can do (from parkour to manipulation, and testing robustness). We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. #J-18808-Ljbffr Generalist
- ...Catasta, etc. Responsibilities: Scale infra for post-training of multimodal LLMs (CPT... ...web‑agent Work closely with product engineers to translate cutting‑edge AI capabilities... ...we’re looking for: Experience with ML infrastructure (GPU clusters) and supporting...SuggestedWork at officeRelocationVisa sponsorship
- Staff Software Engineer, ML Infra & Distributed Systems About the Role: As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world-class machine learning inference platforms. These...Suggested
$150k - $250k
Foundry Robotics Inc. is looking for a Senior Software Engineer to join their team in San Francisco. This vital role focuses on building cloud-based backend systems, infrastructure, and ensuring data integrity in advanced robotics manufacturing. The successful candidate...Suggested$200k - $275k
...transforms through data pipelines, and powers ML models that clinicians rely on every... ...work alongside our data scientists and ML engineers to build and operate the infrastructure... ...at an early-stage startup where you owned infra end-to-end This role is NOT for you if Startup...SuggestedWork at officeHome officeDay shift- A leading AI technology firm in San Francisco is seeking an AI Infra Engineer to enhance their infrastructure. The successful candidate will... ...foundation in Python and C++. Join a dynamic team aiming at advancements in AI and ML infrastructure. #J-18808-Ljbffr PerplexitySuggested
$320k - $405k
...group of committed researchers, engineers, policy experts, and business... ...Infrastructure Engineer, Node Infra About the role the company's... ...Preferred qualifications 8+ years of software engineering experience,... ..., InfiniBand) for distributed ML workloads. Demonstrated ownership...Visa sponsorship- ...significantly outperforms individual engineers. We combine language models... ...to push the boundaries of software development efficiency and quality... ...alongside AI researchers, infra specialists, frontend engineers... ...systems Collaborate with ML engineers to integrate models...Remote work
- Tubi Tv is seeking a Software Engineer specializing in ML Infra & Distributed Systems to enhance their machine learning platforms. Collaborating closely with product and ML teams, you will design high-performance, low-latency systems that power essential services like...
- ...Join us and help build the platform engineers turn to to ship AI products. THE ROLE As a Software Engineer on the Internal Tooling... ...incidents Partner with SRE and Infra teams to ensure Capacity reflects... ...follow through Interest in AI/ML infrastructure; familiarity with...Flexible hours
$180k - $300k
Join to apply for the Software Engineer (Infra) role at Numeral . This range is provided by Numeral. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $180,000.00/yr - $300,000.00/yr About NumeralHQ...Full timeImmediate startRemote workFlexible hours$159k - $278.25k
...large language models to build software which helps our internal GTM... ...ll play the role of a backend engineer working across the stack (backend... ...to contribute to more ML specific tasks. Successful individuals... ...of the stack (foundational infra, backend, UX). You should be able...Work at office3 days per week- United States Digital Space LLC is seeking a Research Engineer / Scientist to design and build infrastructure for AI research. You'll contribute... ...beneficial for society. The ideal candidate is experienced in ML systems, enjoys experimentation, and has a passion for the...
$140k - $265k
...work across distributed systems, production observability, and ML infra integrations to deliver an experience that feels instant,... ...the most impactful roadmap investments. You Are 3+ years of software engineering experience building production distributed systems or cloud-...Full timeHome office3 days per week$180k - $220k
...and get work done in the AI era. We’re looking for a backend engineer to join our small team and help lead the effort to prepare the product... ...RESTful and GraphQL APIs, with emphasis on integrating AI/ML inference endpoints and ensuring predictable SLAs ~ Familiarity...Work at officeLocal areaImmediate startFlexible hours$150k
Tzafon is seeking a skilled engineer to enhance their machine intelligence systems in San Francisco. As part of the team, you'll be responsible... ...machine learning frameworks, a solid track record of shipping ML systems, and strong opinions on evaluation methodologies. The...- ...Google Workspace. What you’ll do As a Software Engineer, Infrastructure at Sierra, you will be responsible... ...databases, retrieval systems, and ML models. Develop and maintain core data... ...‑paced startup environment or platform/infra‑focused team. What we offer We want our...Full timeFlexible hours
- ...computing and make it accessible to software developers of all skill levels... ...data scientist can scale an ML application from their laptop... .... We're looking for engineers with systems software experience... .../ distributed libraries, test infra improvements, debugging, and longer...Work experience placement
- ...us and help build the platform engineers turn to to ship AI products. THE ROLE As a Senior Software Engineer - Model Training at Baseten... ..., collaborate with product and infra teams to surface customer needs,... ...5+ years of experience in ML infrastructure, distributed systems...Flexible hours
- ~ Senior Software Engineer (Rust) at Symbolica – San Francisco, US Senior Software Engineer (Rust) at Symbolica – San Francisco, US About... ...shipping them quickly. You’ll work closely with researchers, ML engineers, and leadership to turn ambitious ideas into real...Work at officeShift work
- ...Francisco is looking for a Senior or Staff AI Infrastructure Engineer dedicated to building and scaling AI/ML systems. You'll develop robust pipelines and... ...solutions. The ideal candidate has a strong background in software development, especially in Python and ML Ops...
$250k - $330k
...foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time... ...organize around five focus areas: Core Infra: The foundational cloud stack—networking,... ...Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate production...Work at office$240k
...mission is to fundamentally change how software is built on the Internet by empowering developers... ...Team: Convex has assembled a team of engineers who have built and designed some of the... ...designing and operating large-scale infra, we’d love to talk! This is a hands-on...Full timeWork at officeRemote workShift workNight shift- Hamilton Barnes Associates Limited is looking for a Senior Storage Engineer to support large-scale AI infrastructure in San Francisco. This... ...experience in storage engineering and a strong background in AI/ML workloads. The position offers competitive salary and benefits,...Remote job
- .... At Inductive Bio, our goal is to build software that can dramatically improve how molecules... .... We are seeking a full-stack software engineer to join our talented, ambitious, and kind... ...opportunity to work directly with chemists, ML Engineers, and our users. As an early...
- ...applied AI lab building a search engine unlike the world has ever seen. We build massive-scale infra to crawl the entire web, train... ...want to build massive-scale ML systems that will define the way... ...this is the place for you. As a Software Engineer on Knowledge Systems...
- Founding Robotics Software Engineer Location: San Francisco (preferred) / US Type: Full-time · Founding Team About Bracket Bot Bracket... ...engineers by building a full-stack platform—hardware, software, infra, and ML—designed from first principles for performance, usability,...Full time
$180k - $215k
...Position Summary As a full stack engineer on the product engineering team, you will... ...way from the frontend to backend API to ML models. You are someone who is passionate... ...~3+ years of experience in Full Stack Software Development. ~ Experienced with RESTful...Work experience placement- Founding Engineer, Backend & Infrastructure About Backbone Care should be paid for the moment... ...BS/MS in Math & CS from Stanford and led ML infrastructure at Sequoia-backed Kumo AI,... ...systems that navigate complex medical software and payer portals Design reliable systems...
- A dynamic digital product studio is seeking a Backend Software Engineer (ML Infrastructure) to design and build core systems for training and deploying ML models. This early-career role involves collaborating with ML engineers and focuses on distributed training pipelines...
- ...companies building enterprise-grade products. Their promise is simple: they make your AI system better. They are hiring a Backend Software Engineer (ML Infrastructure) to help design, build, and scale the core systems that power large-scale model training and deployment. The...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer: ML Infra. Be the first to apply!
- software engineer amazon San Francisco, CA
- experienced software developer San Francisco, CA
- federal - software developer San Francisco, CA
- software developer internship San Francisco, CA
- senior software engineer San Francisco, CA
- software developer fintech San Francisco, CA
- part time software developer remote San Francisco, CA
- software developer intern San Francisco, CA
- software data engineer San Francisco, CA
- fall software engineering internship San Francisco, CA


