Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Infra Engineer, Modeling

Full-time

Physical Intelligence

Physical Intelligence is bringing general-purpose AI into the physical world. We are a group of engineers, scientists, roboticists, and company builders developing foundation models and learning algorithms to power the robots of today and the physically-actuated devices of the future.

In this role you will help scale and optimize our training systems and core model code. You’ll own critical infrastructure for large-scale training, from managing GPU/TPU compute and job orchestration to building reusable and efficient JAX training pipelines. You’ll work closely with researchers and model engineers to translate ideas into experiments—and those experiments into production training runs.

This is a hands-on, high-leverage role at the intersection of ML, software engineering, and scalable infrastructure.

The Team

The ML Infrastructure team supports and accelerates PI’s core modeling efforts by building the systems that make large-scale training reliable, reproducible, and fast. The team works closely with research, data, and platform engineers to ensure models can scale from prototype to production-grade training runs.

In This Role You Will

  • Own training/inference infrastructure: Design, implement, and maintain systems for large-scale model training, including scheduling, job management, checkpointing, and metrics/logging.

  • Scale distributed training: Work with researchers to scale JAX-based training across TPU and GPU clusters with minimal friction.

  • Optimize performance: Profile and improve memory usage, device utilization, throughput, and distributed synchronization.

  • Enable rapid iteration: Build abstractions for launching, monitoring, debugging, and reproducing experiments.

  • Partner with researchers: Translate research needs into infra capabilities and guide best practices for training at scale.

  • Contribute to core training code: Evolve JAX model and training code to support new architectures, modalities, and evaluation metrics.

What We Hope You’ll Bring

  • Strong software engineering fundamentals and experience building ML training infrastructure or internal platforms.

  • Hands-on large-scale training experience in JAX (preferred), PyTorch.

  • Familiarity with distributed training, multi-host setups, data loaders, and evaluation pipelines.

  • Experience managing training workloads on cloud platforms (e.g., SLURM, Kubernetes, GCP TPU/GKE, AWS).

  • Ability to debug and optimize performance bottlenecks across the training stack.

  • Strong cross-functional communication and ownership mindset.

Bonus Points If You Have

  • Deep ML systems background (e.g., training compilers, runtime optimization, custom kernels).

  • Experience operating close to hardware (GPU/TPU performance tuning).

  • Background in robotics, multimodal models, or large-scale foundation models.

  • Experience designing abstractions that balance researcher flexibility with system reliability.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the ML Infra Engineer, Modeling in San Francisco, CA vacancy
  •  ...ML Engineer — Model Evaluation & Safety(モデルの評価と安全性) 募集概要 Highlanders は、ヒューマノイドロボットと、フィジカルAI(現実の世界で体を動かすAI)の基盤モデル、そしてその学習データを生み出すロボットの群れを、一つの流れとして開発しています。実機が現場で働くほどデータが集まり、モデルが賢くなり、ロボットがさらに働けるようになる。このデータの循環を、日本の工場の現場とサンフランシスコの両方から回しています。 ロボットを動かすモデルが、安全に、期待どおりに動く... 
    Suggested

    株式会社Highlanders

    San Francisco, CA
    4 days ago
  •  ...physical world. We are a team of engineers, scientists, roboticists, and...  ...developing foundation models and learning algorithms to power...  ...part of this work is reducing infra churn by standardizing patterns...  ...Experience with large-scale ML training, evaluation, or simulation... 
    Suggested
    Full time
    Local area
    Remote work

    Physical Intelligence

    San Francisco, CA
    3 days ago
  • $181k - $250k

     ...these products and other agentic products. You'll work on voice models, agent capability evals, benchmark design, LLM-as-judge...  ...Learning, Statistics, or related field ~3+ years of experience in ML Engineering or Applied ML with 8+ years of overall experience ~ Strong... 
    Suggested
    Contract work
    Worldwide

    Aircall.io, Inc.

    San Francisco, CA
    28 days ago
  •  ...Perplexity is seeking experienced ML engineers to design, build, and optimize the recommendation systems that power core experiences on...  ...drive impact on core user and business metrics. Build user modeling that captures intent, preference, and propensity, and powers more... 
    Suggested
    Full time

    Perplexity

    San Francisco, CA
    3 days ago
  • $228.96k - $315.36k

     ...stop fraud before it happens. The team owns the full ML lifecycle—from feature pipelines and model training to production serving and monitoring—building...  ...hundreds of customers.As a Senior Machine Learning Engineer, you will own the development of high-performance feature... 
    Suggested
    Work experience placement
    Work at office
    Local area

    Plaid Financial

    San Francisco, CA
    13 hours ago
  • $250k

     ...without traditional infrastructure limitations. As a Senior ML Infrastructure Engineer, the successful candidate will help build and scale...  ...Improve and maintain inference infrastructure, including model packaging, deployment, and serving optimisation Collaborate... 
    Full time
    San Francisco, CA
    more than 2 months ago
  • $192.5k - $357.5k

     ...data and novel computational models to drive impact. Seamless data...  ...a Principal Machine Learning Engineer to join our Foundation Models...  ...clinical data sources.Scalable ML Systems & Productionization: Design...  ...a technical authority on ML infra for Genentech leadership,... 
    Full time
    Local area
    Worldwide
    Relocation package

    Genentech

    South San Francisco, CA
    3 days ago
  •  ...the loop from raw robot experience to a model running on real hardware. Munari observes...  ...role sits deliberately between research engineering and production machine learning. You...  ...productive in PyTorch, JAX, or a comparable ML stack. You understand both model behavior... 

    a16z-speedrun

    San Francisco, CA
    13 hours ago
  • Title: ML Engineer Location: San Francisco, CA (Onsite) Direct HireCompany Mission Our client’s mission is to scale medical knowledge and...  ...medical knowledge to create transparent, clinically grounded models. Its early adopters include health systems and insurers using... 

    Spectraforce Technologies

    San Francisco, CA
    4 days ago
  • $250k - $295k

     ...protection. We use advanced physics and AI to model catastrophic risk at the asset level, then...  .... The real product is a scalable risk engine, our Stand World Model . We stay when...  ...outcomes Build on and extend scalable ML infrastructure Partner with Stand’s Platform... 
    Full time
    Temporary work
    H1b
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    Stand Insurance

    San Francisco, CA
    1 day ago
  • $190k - $222k

     ...About the Role Lead perception engineering for a defense technology team developing autonomous systems to detect and track aerial threats...  ...classification, and sensor fusion. Develop computer vision models and training pipelines, then deploy them on-device. Fuse EO... 

    Clera Labs, Inc.

    San Francisco, CA
    4 days ago
  • $230k - $290k

     ...Tanaka's AI group, builds the systems that decide whether a new model, prompt or Procedure change ships. It also produces the annual resolution...  ...resolution benchmark What you’ll bring ~5+ years in applied ML, with significant time on evaluation, measurement or data quality... 

    Pazau, Inc.

    San Francisco, CA
    13 hours ago
  • $180k - $220k

     ...About the Role: Crusoe is hiring an AI Engineer for our Developer Relations Engineering...  ...and Research workflows. Test features and models before launch, make sure samples and docs...  ...Experience: 5+ years as a software engineer, ML engineer, applied AI engineer, forward-... 
    Temporary work

    Crusoe

    San Francisco, CA
    10 days ago
  •  ..., and between sessions, it retains scraps at best. We train models to study your world and anticipate your questions in advance...  ...about yours. About this role You’ll be among the first ML Systems Engineer, joining a team of machine learning researchers and... 
    Work at office

    ENGRAM Lab

    San Francisco, CA
    1 day ago
  • $180k - $240k

     ...of its clients a Senior Machine Learning Engineer - this is a fully remote role for US/Canada...  ...experience to join our small but mighty ML team building production-grade AI voice...  ...exploration and application of Large Language Models and Generative AI, venturing into new... 
    Remote work
    Flexible hours

    Career Renew

    San Francisco, CA
    22 days ago
  • $500 per month

     ...laser weapons to shoot down drones. We're a small team of engineers, former US military operators, and subject matter experts scaling...  ...detection, tracking, classification, and sensor fusion ML model development, training pipelines, and on-device deployment Multi... 
    Permanent employment
    Work at office
    Monday to Friday
    Flexible hours
    Night shift
    Weekend work

    Aurelius Systems

    San Francisco, CA
    12 days ago
  • $175k - $250k

     ...Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing...  ...leader within our AI Research & Engineering team. Operating at the sweet spot between...  ...ultra-high-quality training datasets for model fine-tuning.Cross-Functional & Clinical Collaboration... 
    Flexible hours

    Ellipsis Health

    San Francisco, CA
    4 hours ago
  • $129k - $198.4k

    Job DescriptionRole: As an AI/ML Engineer on the Metrics Frameworks team, part of the Simulation...  ...with other frameworks and data infra teams to build and deploy tools to improve...  ...engineering to enable rapid development and model feedback. Maintain a high technical standard... 
    Full time
    Local area
    Work from home

    General Motors

    San Francisco, CA
    4 days ago
  • $210k - $260k

     ...their financial journey. Machine Learning Engineers at Rocket Money further our mission by...  ...teams, know how to support strategy with ML and AI powered user experiences, can...  ...frameworks that enable systematic assessment of model performance, supporting rapid iteration... 
    Work at office
    Local area

    Rocket Money

    San Francisco, CA
    1 day ago
  • $191.48k - $260.83k

     ...best chapter of your career. Senior MLOps Engineer, Forward DeployedForward Deployed Engineering...  ...engineering role. You will work across model training and refresh workflows, APIs, orchestration...  ...'ll Bring6+ years of experience in MLOps, ML platform engineering, backend engineering,... 
    Full time
    Shift work
    Night shift

    6sense

    San Francisco, CA
    3 days ago
  •  ...1000s of developers and enterprise users.ML performance, quality, and systems acumen-...  ...release gates to detect regressions across model, prompt, tool, and retrieval changes....  ...Qualifications 7+ years of software engineering experience building and operating enterprise... 
    Work at office

    Atlassian

    San Francisco, CA
    4 days ago
  • $170.1k - $258.3k

     ...real vehicles at scale. We pioneer new approaches to model export, kernel development, and performance engineering so that every cycle on our accelerators translates...  ...libraries that sit at the heart of our on‑vehicle ML inference for ADAS and autonomous driving. We own making... 
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    San Francisco, CA
    1 day ago
  • $60 - $90 per hour

     ...Summers , and Jack Dorsey . Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract Compensation...  ...Role Responsibilities Design tasks by transforming real ML research ideas into well-defined, multi-step tasks. Run... 
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    2 days ago
  • $184k - $272k

     ...levels of stability and efficiency. Comprehensively profile model runtime and memory to pinpoint performance bottlenecks....  ...compilation/deployment techniques. Work with researchers and ML engineers on best-practices for optimal resource usage. Create and improve... 
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    8 days ago
  • The Fountain Group is currently seeking an AI/ML Engineer / Data Scientist (Predictive Modeling Contractor) for a prominent client of ours. Open for 100% Remote Candidates. Prefer someone who can work Hybrid or go onsite occasionally at South San Francisco, CA office .... 
    Contract work
    For contractors
    Work at office
    Remote work

    The Fountain Group

    South San Francisco, CA
    3 days ago
  • $90 - $140 per hour

     ...development of the most advanced Large Language Models. 1\. Overview Join a leading AI lab'...  ...We're seeking talented Machine Learning Engineers and Scientific Computing experts with...  ..., correctness and reproducibility of ML and scientific work. Collaborate with... 
    Contract work
    Part time
    Weekday work

    Mercor

    San Francisco, CA
    2 days ago
  •  ...everything from early research experiments to frontier-scale model runs. With a dual mandate to accelerate researchers and...  ...experiments and products). About the Role As a Training: ML Framework Engineer, you will work on improving the training throughput for our... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    7 days ago
  •  ...distributed-first company. Responsibilities As a Senior ML System Engineer in the Rovo GenAI Platform team, you will build and maintain...  ..., train, evaluate, deploy, and operate Machine Learning models and pipelines, and power the GenAI products in Atlassian. You... 
    Work at office

    Atlassian

    San Francisco, CA
    4 days ago
  • $184k - $272k

     ...strategy, and the operators and workflow engines that keep long-running training reliable....  ...hygiene, dashboards researchers trust, a real model registry, and lineage from dataset to...  ...change is. Build observability across the ML stack — utilization, throughput, failure modes... 
    Full time
    Live in
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    19 days ago
  • $184.7k - $324.8k

     ...Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for...  ...safety of large language and multimodal models.As part of Apple’s Responsible AI group...  ...data analysis, visualization, and applied ML workflowsExcellent interpersonal skills... 
    Relocation

    Apple

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Infra Engineer, Modeling. Be the first to apply!