Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer: ML Infra

Generalist

About the Role Generalist trains very large robot foundation models. This requires utilizing very large numbers of the latest generation GPU hardware and infrastructure (currently Nvidia) to run distributed training jobs and researcher experiments. We have extreme requirements on storage and data loading infrastructure that requires maximizing cloud infrastructure and custom solutions. You will also own inference infrastructure. For our robots this is a fleet of on‑prem GPUs attached to robots that have extreme real‑time and latency budgets in compute constrained environments. You’ll be responsible for: Owning our GPU compute fleets Ensure our GPUs are easy for researchers to use and maximally utilized Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments. Orchestration of robot inference fleets You might thrive in this role if you: Have managed large fleets of GPUs doing large‑scale, long‑term, highly distributed training runs or inference Deep experience in Slurm or Kubernetes for ML workload orchestration Have built high‑scale ML data loaders and preparation systems Deeply understand every layer of the ML hardware, storage, and networking stacks Have experience in the NVidia GPU ecosystem About Generalist At Generalist, we are on a mission to make general‑purpose robots a reality. We believe the industries and homes of the future will depend on humans and machines working together in new ways. Robots can help us build more and get more done. We build embodied foundation models, starting with a focus on dexterity. This requires advancing the frontiers of data, models, and hardware, to enable robots to intelligently interact with the physical world. The company embraces both large‑scale AI and robotics as core to its DNA. Our team of researchers, roboticists, and company builders come from OpenAI, Boston Dynamics, Google DeepMind, and other frontier labs—with a track record of shipping AI breakthroughs. Before Generalist, we pioneered large embodied multimodal models and vision-language-action models (PaLM‑E, RT‑2, Gemini Robotics), launched and scaled ChatGPT and GPT‑4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next‑generation robots (Atlas, Spot, Stretch) and pushed the limits of what they can do (from parkour to manipulation, and testing robustness). We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. #J-18808-Ljbffr Generalist

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer: ML Infra in San Francisco, CA vacancy
  •  ...Catasta, etc. Responsibilities: Scale infra for post-training of multimodal LLMs (CPT...  ...web‑agent Work closely with product engineers to translate cutting‑edge AI capabilities...  ...we’re looking for: Experience with ML infrastructure (GPU clusters) and supporting... 
    Suggested
    Work at office
    Relocation
    Visa sponsorship

    Yutori

    San Francisco, CA
    4 days ago
  • Staff Software Engineer, ML Infra & Distributed Systems About the Role: As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world-class machine learning inference platforms. These... 
    Suggested

    Tubi Tv

    San Francisco, CA
    12 days ago
  • $150k - $250k

    Foundry Robotics Inc. is looking for a Senior Software Engineer to join their team in San Francisco. This vital role focuses on building cloud-based backend systems, infrastructure, and ensuring data integrity in advanced robotics manufacturing. The successful candidate... 
    Suggested

    Foundry Robotics Inc.

    San Francisco, CA
    5 days ago
  • $200k - $275k

     ...transforms through data pipelines, and powers ML models that clinicians rely on every...  ...work alongside our data scientists and ML engineers to build and operate the infrastructure...  ...at an early-stage startup where you owned infra end-to-end This role is NOT for you if Startup... 
    Suggested
    Work at office
    Home office
    Day shift

    HealthLeap

    San Francisco, CA
    2 days ago
  • A leading AI technology firm in San Francisco is seeking an AI Infra Engineer to enhance their infrastructure. The successful candidate will...  ...foundation in Python and C++. Join a dynamic team aiming at advancements in AI and ML infrastructure. #J-18808-Ljbffr Perplexity
    Suggested

    Perplexity

    San Francisco, CA
    2 days ago
  • $320k - $405k

     ...group of committed researchers, engineers, policy experts, and business...  ...Infrastructure Engineer, Node Infra About the role the company's...  ...Preferred qualifications 8+ years of software engineering experience,...  ..., InfiniBand) for distributed ML workloads. Demonstrated ownership... 
    Visa sponsorship

    United States Digital Space LLC

    San Francisco, CA
    6 days ago
  •  ...significantly outperforms individual engineers. We combine language models...  ...to push the boundaries of software development efficiency and quality...  ...alongside AI researchers, infra specialists, frontend engineers...  ...systems Collaborate with ML engineers to integrate models... 
    Remote work

    CodeRabbit

    San Francisco, CA
    2 days ago
  • Tubi Tv is seeking a Software Engineer specializing in ML Infra & Distributed Systems to enhance their machine learning platforms. Collaborating closely with product and ML teams, you will design high-performance, low-latency systems that power essential services like... 

    Tubi Tv

    San Francisco, CA
    4 days ago
  •  ...Join us and help build the platform engineers turn to to ship AI products. THE ROLE As a Software Engineer on the Internal Tooling...  ...incidents Partner with SRE and Infra teams to ensure Capacity reflects...  ...follow through Interest in AI/ML infrastructure; familiarity with... 
    Flexible hours

    The Consensus

    San Francisco, CA
    6 days ago
  • $180k - $300k

    Join to apply for the Software Engineer (Infra) role at Numeral . This range is provided by Numeral. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $180,000.00/yr - $300,000.00/yr About NumeralHQ... 
    Full time
    Immediate start
    Remote work
    Flexible hours

    Numeral

    San Francisco, CA
    4 days ago
  • $159k - $278.25k

     ...large language models to build software which helps our internal GTM...  ...ll play the role of a backend engineer working across the stack (backend...  ...to contribute to more ML specific tasks. Successful individuals...  ...of the stack (foundational infra, backend, UX). You should be able... 
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    4 days ago
  • United States Digital Space LLC is seeking a Research Engineer / Scientist to design and build infrastructure for AI research. You'll contribute...  ...beneficial for society. The ideal candidate is experienced in ML systems, enjoys experimentation, and has a passion for the... 

    United States Digital Space LLC

    San Francisco, CA
    5 days ago
  • $140k - $265k

     ...work across distributed systems, production observability, and ML infra integrations to deliver an experience that feels instant,...  ...the most impactful roadmap investments. You Are 3+ years of software engineering experience building production distributed systems or cloud-... 
    Full time
    Home office
    3 days per week

    Glean

    San Francisco, CA
    2 days ago
  • $180k - $220k

     ...and get work done in the AI era. We’re looking for a backend engineer to join our small team and help lead the effort to prepare the product...  ...RESTful and GraphQL APIs, with emphasis on integrating AI/ML inference endpoints and ensuring predictable SLAs ~ Familiarity... 
    Work at office
    Local area
    Immediate start
    Flexible hours

    Glu Mobile Inc.

    San Francisco, CA
    4 days ago
  • $150k

    Tzafon is seeking a skilled engineer to enhance their machine intelligence systems in San Francisco. As part of the team, you'll be responsible...  ...machine learning frameworks, a solid track record of shipping ML systems, and strong opinions on evaluation methodologies. The... 

    Tzafon

    San Francisco, CA
    6 days ago
  •  ...Google Workspace. What you’ll do As a Software Engineer, Infrastructure at Sierra, you will be responsible...  ...databases, retrieval systems, and ML models. Develop and maintain core data...  ...‑paced startup environment or platform/infra‑focused team. What we offer We want our... 
    Full time
    Flexible hours

    Neura Market

    San Francisco, CA
    4 days ago
  •  ...computing and make it accessible to software developers of all skill levels...  ...data scientist can scale an ML application from their laptop...  .... We're looking for engineers with systems software experience...  .../ distributed libraries, test infra improvements, debugging, and longer... 
    Work experience placement

    Anyscale

    San Francisco, CA
    6 days ago
  •  ...us and help build the platform engineers turn to to ship AI products. THE ROLE As a Senior Software Engineer - Model Training at Baseten...  ..., collaborate with product and infra teams to surface customer needs,...  ...5+ years of experience in ML infrastructure, distributed systems... 
    Flexible hours

    BaseTen

    San Francisco, CA
    4 days ago
  • ~ Senior Software Engineer (Rust) at Symbolica – San Francisco, US Senior Software Engineer (Rust) at Symbolica – San Francisco, US About...  ...shipping them quickly. You’ll work closely with researchers, ML engineers, and leadership to turn ambitious ideas into real... 
    Work at office
    Shift work

    Victrays

    San Francisco, CA
    1 day ago
  •  ...Francisco is looking for a Senior or Staff AI Infrastructure Engineer dedicated to building and scaling AI/ML systems. You'll develop robust pipelines and...  ...solutions. The ideal candidate has a strong background in software development, especially in Python and ML Ops... 

    Dormont Manufacturing Company

    San Francisco, CA
    2 days ago
  • $250k - $330k

     ...foundations that power Decagon: networking, data, ML serving, developer platform, and real‑time...  ...organize around five focus areas: Core Infra: The foundational cloud stack—networking,...  ...Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate production... 
    Work at office

    Decagon

    San Francisco, CA
    2 days ago
  • $240k

     ...mission is to fundamentally change how software is built on the Internet by empowering developers...  ...Team: Convex has assembled a team of engineers who have built and designed some of the...  ...designing and operating large-scale infra, we’d love to talk! This is a hands-on... 
    Full time
    Work at office
    Remote work
    Shift work
    Night shift

    Convex

    San Francisco, CA
    6 days ago
  • Hamilton Barnes Associates Limited is looking for a Senior Storage Engineer to support large-scale AI infrastructure in San Francisco. This...  ...experience in storage engineering and a strong background in AI/ML workloads. The position offers competitive salary and benefits,... 
    Remote job

    Hamilton Barnes Associates Limited

    San Francisco, CA
    6 days ago
  •  .... At Inductive Bio, our goal is to build software that can dramatically improve how molecules...  .... We are seeking a full-stack software engineer to join our talented, ambitious, and kind...  ...opportunity to work directly with chemists, ML Engineers, and our users. As an early... 

    Inductive Bio, Inc.

    San Francisco, CA
    5 days ago
  •  ...applied AI lab building a search engine unlike the world has ever seen. We build massive-scale infra to crawl the entire web, train...  ...want to build massive-scale ML systems that will define the way...  ...this is the place for you. As a Software Engineer on Knowledge Systems... 

    AI Chopping Block, Inc.

    San Francisco, CA
    2 days ago
  • Founding Robotics Software Engineer Location: San Francisco (preferred) / US Type: Full-time · Founding Team About Bracket Bot Bracket...  ...engineers by building a full-stack platform—hardware, software, infra, and ML—designed from first principles for performance, usability,... 
    Full time

    Bracket Bot Inc.

    San Francisco, CA
    6 days ago
  • $180k - $215k

     ...Position Summary As a full stack engineer on the product engineering team, you will...  ...way from the frontend to backend API to ML models. You are someone who is passionate...  ...~3+ years of experience in Full Stack Software Development. ~ Experienced with RESTful... 
    Work experience placement

    HeyGen

    San Francisco, CA
    5 days ago
  • Founding Engineer, Backend & Infrastructure About Backbone Care should be paid for the moment...  ...BS/MS in Math & CS from Stanford and led ML infrastructure at Sequoia-backed Kumo AI,...  ...systems that navigate complex medical software and payer portals Design reliable systems... 

    Backbone Systems

    San Francisco, CA
    3 days ago
  • A dynamic digital product studio is seeking a Backend Software Engineer (ML Infrastructure) to design and build core systems for training and deploying ML models. This early-career role involves collaborating with ML engineers and focuses on distributed training pipelines... 

    Rockstar

    San Francisco, CA
    2 days ago
  •  ...companies building enterprise-grade products. Their promise is simple: they make your AI system better. They are hiring a Backend Software Engineer (ML Infrastructure) to help design, build, and scale the core systems that power large-scale model training and deployment. The... 
    Remote work

    Rockstar

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer: ML Infra. Be the first to apply!