Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Infrastructure Engineer

HSF

ML Infrastructure Engineer We are looking for an ML Infrastructure Engineer with 3+ years of experience to own and scale the training and inference stack at a fast-growing AI document processing platform. You'll be a strong generalist who understands the mechanics of how ML models work – from serving and monitoring to building robust data pipelines – and can improve inference performance, reliability, and cost efficiency. This is a high-impact IC role where you'll work closely with ML researchers to ensure models are deployed quickly and reliably, and that infrastructure is never a bottleneck for the products being served. The ideal candidate is AI-native from the get-go, comfortable with 1-to-3 node training and single-to-double node serving, and thrives in a fast-paced startup environment. What you will be doing: Building and maintaining model serving infrastructure – improving inference speed, monitoring, and reliability to ensure it's never a bottleneck for customers Setting up and improving training infrastructure for models ranging from 300M to 30B parameters across 1-to-3 node environments Developing observability, logging, and monitoring systems across the ML stack Building internal data pipelines and tooling to help ML researchers move faster from experiment to production Architecting infrastructure to arbitrate inference between multiple cloud providers while optimizing for accuracy, latency, and cost HSF

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Infrastructure Engineer in San Francisco, CA vacancy
  •  ...oprecruiting.comPhone: (***) ***-****Job Title: Machine Learning Infrastructure EngineerLocation: San Francisco, CA Metro Area (100% On-Site)...  ...company is seeking a Machine Learning Infrastructure Engineer to help architect the compute, training, and execution frameworks... 
    Suggested
    Full time
    Work at office
    Flexible hours

    Objective Paradigm

    San Francisco, CA
    4 days ago
  • $250k - $350k

    Job Description Most AI roles build on top of models. This one builds what makes them actually work. We're hiring ML Infrastructure Engineers to tackle a hard, real-world problem, understanding what's happening on live job sites using wearable devices, large-scale video... 
    Suggested

    techire ai

    San Francisco, CA
    1 day ago
  •  ...previous experience on Anthropic’s data team building data infrastructure, and datasets behind Claude. About the Role...  ...learning as far as it can go. We are looking for Senior ML Infrastructure Engineers to build the infrastructure and systems that power the... 
    Suggested
    Full time
    Visa sponsorship
    Relocation package

    preference-model

    San Francisco, CA
    2 days ago
  •  ...into the physical world. We are a team of engineers, scientists, roboticists, and company...  ...devices of the future. The Team The Infrastructure team builds and operates the backbone of...  ...You Have Experience with large-scale ML training, evaluation, or simulation... 
    Suggested
    Full time
    Local area
    Remote work

    Physical Intelligence

    San Francisco, CA
    11 days ago
  •  ...into the physical world. We are a group of engineers, scientists, roboticists, and company...  ...role sits at the intersection of our AI, infrastructure, and external partners. You’ll work...  ...in production. You do not need to be an ML researcher. Strong Python skills and... 
    Suggested
    Full time
    Remote work

    Physical Intelligence

    San Francisco, CA
    11 days ago
  • $160k - $250k

     ...principles, enjoy facing adversity, and can do the impossible at record breaking speeds.About You and The Role As an ML Training & Inference Infrastructure Engineer on the Data Platform team you will be building and scaling the systems powering our data flywheel. This person... 
    Local area

    Zipline

    South San Francisco, CA
    1 day ago
  • $200k - $300k

     ...observability and operating cost. Work closely with customers and engineers to shape the direction of the work. What you'll do -...  ...owned end to end, or fast career progression. - Backend, infrastructure or systems experience at a leading technology company or an early... 
    Full time
    Internship
    Work at office
    Immediate start
    Flexible hours

    Raydar

    San Francisco, CA
    2 days ago
  • ML Platform Engineer San Francisco | 5 Days Onsite Location: Onsite in San Francisco Compensation: Competitive Salary + Equity Who We Are...  ...generation + simulation orchestration + training/fine-tuning infrastructure + benchmarking pipelines + production deployments in... 
    Work at office
    Immediate start
    Flexible hours
    1 day per week

    UniversalAGI

    San Francisco, CA
    1 day ago
  •  ...intelligent system that combines robotics and AI to build the infrastructure that pulls society forward. Gritt deploys via simple...  ...Ventures, and other leading firms. Role: Software - ML Infrastructure Engineer Location: SF Bay Area (in-person) About the role... 
    Full time

    gritt

    South San Francisco, CA
    7 days ago
  •  ..., we can do the best work of our lives. Here, you’ll do more than join something — you’ll add something! Description As an engineer on the ML Compute team, your work will include: Drive performance optimization for large-scale foundation model training on TPUs, focusing... 

    Apple

    San Francisco, CA
    1 day ago
  • $183.7k - $248.6k

     ...opportunity Unity is looking for a Senior Machine Learning Infrastructure Engineer to join our Vector Ads team, where we build the real-time systems...  .... You'll build and operate the infrastructure that brings ML models from training into production, ensuring our ranking,... 
    Work at office
    Remote work
    Worldwide
    Relocation package

    UNITY

    San Francisco, CA
    1 day ago
  •  ...behalf of our client. Build and tune the serving and training infrastructure behind specialized language models, from early experiments...  ...credit for performance or stability gains. Solid low-level engineering and troubleshooting ability, including familiarity with GPU... 
    Full time
    Work at office

    Software Company

    San Francisco, CA
    1 day ago
  •  ...Job Description Job Description We’re looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations on is probably the largest anime AI training cluster in the world . You’ll serve as the bridge between our researchers and... 
    Work at office
    Visa sponsorship

    Spellbrush

    San Francisco, CA
    9 days ago
  •  ...driving innovation through advanced hardware engineering and AI solutions. Our mission is to...  ...We are seeking a Senior Machine Learning Infrastructure Engineer to join our team. The person...  ...shaping a high-performance, production-grade ML ecosystem to support rapid... 
    Flexible hours

    Echo Neurotechnologies

    San Francisco, CA
    23 days ago
  • $350k

     ...Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to...  ...Policy commitments. We're looking for an engineer to own the infrastructure behind that research. This is the tooling our researchers rely... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    San Francisco, CA
    1 day ago
  •  ...capabilities of our autonomy stack, our customer base, and our team. The role We are looking for an experienced ML engineer to join Flexion’s experienced infrastructure team and take ownership of Flexion’s GPU compute platforms. This is a senior, on-site role with... 
    Temporary work
    Work at office
    Relocation

    Flexion Robotics

    San Francisco, CA
    1 day ago
  •  ...Large World Model that will be the most powerful intelligence engine for the physical world. This system doesn't just see what something...  ...sensing systems. About the Role Matter is hiring a Data Infrastructure Engineer to build the systems that transform drone, airborne,... 
    Permanent employment
    Full time
    Remote work

    matter-intelligence

    San Francisco, CA
    7 days ago
  •  ...Job Description Job Description ML Infrastructure Engineer – Distributed Training & Systems San Francisco, CA | Hybrid | Full-Time | Permanent Employment | Mid-Level | ASAP Start MaxIT Consulting – Max Corporate Group is looking for a Research Engineer to build... 
    Permanent employment
    Full time
    H1b
    Work at office
    Immediate start
    Visa sponsorship
    Flexible hours
    3 days per week

    MaxIT Consulting - Max Corporate Group

    San Francisco, CA
    6 days ago
  •  ...in the enterprise through purpose-built ML systems that learn from Rippling's proprietary...  ...Rippling.As a Senior Machine Learning Engineer, you will own the end-to-end ML...  ...such as PyTorch or JAX and production ML infrastructure.Experience building evaluation systems for... 
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    1 day ago
  •  ...in the enterprise through purpose-built ML systems that learn from Rippling's proprietary...  ...at Rippling.As a Staff Machine Learning Engineer, you will own the end-to-end ML...  ...Build robust evaluation and experimentation infrastructure: offline benchmarks, A/B testing, and... 
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    1 day ago
  •  ...-scale training running on top of that: infrastructure orchestration, distributed compute, and...  ...tolerant infrastructure for distributed ML. GPU clusters, NVIDIA runtime, S3 checkpointing...  ...For Infrastructure and platform engineering (required) : Production experience with... 
    Full time
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    Pluralis Research

    San Francisco, CA
    14 days ago
  •  ...The AI Infrastructure team at Zensors builds the engine that powers our visual sensing platform. We provide the tools to automate the lifecycle of our AI workflow...  ...video streams. As a Machine Learning Engineer in ML Runtime & Optimization , you will develop... 
    Full time

    zensors

    San Francisco, CA
    7 days ago
  • $276k - $414k

     ...in addition to Bitmoji, Saturn, and other digital services.Snap Engineering teams build fun and technically sophisticated products that...  ...in innovative waysCollaborate with leadership to up-level the ML tech stack and improve the performance of the organizationWork... 
    Full time
    Live in
    Work at office
    Local area

    Snap

    San Francisco, CA
    22 hours ago
  •  ...support their role and our mission. Reporting to the Senior Engineering Manager of the AI & ML Platform team, this Senior Machine Learning Engineer II...  ...responses across cloud (AWS, Azure) and Kubernetes infrastructure, communicating progress clearly to stakeholders. Set... 
    Work at office
    Worldwide
    Relocation
    2 days per week
    3 days per week

    SpringHealth Behavioral Health & Integrated Care

    San Francisco, CA
    1 day ago
  • Machine Learning Engineer, Platform So much of the work society depends on is still slower and harder than it should be. Permits take months...  ...a Machine Learning Engineer on Platform, you'll build the core ML capabilities every product we ship stands on — built once,... 

    BRAIN CORP

    San Francisco, CA
    1 day ago
  • $1,000 per month

     ...support their role and our mission. Reporting to the Senior Engineering Manager of the AI & ML Platform team, this Senior Machine Learning Engineer...  ...and debug cloud (AWS and Azure) and Kubernetes (K8s) infrastructure issues to ensure the reliability and availability of... 
    Work at office
    Worldwide
    Relocation
    Sleeping nights
    2 days per week
    3 days per week

    SpringHealth Behavioral Health & Integrated Care

    San Francisco, CA
    1 day ago
  •  ...are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies...  ...You will build and operate production ML systems that improve how Stripe...  ...iteration. Working with data scientists, engineers, and product partners, you will turn model... 
    Temporary work

    Stripe

    San Francisco, CA
    1 day ago
  • $213k - $263k

     ...The Platform team is part of the Marketplace engineering: we provide specialized business platforms supporting Marketplace ML and Optimization products. We own and host...  ...commercial services. Develop high-level infrastructure code for automatically training and deploying... 
    Full time
    Remote work

    CapitalG

    San Francisco, CA
    1 day ago
  • $245k - $345k

     ...out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their...  ...engineers eager to shape the future of AI and ML at Whatnot. You'll design and scale the core infrastructure that powers machine learning and self-hosted large... 
    Work experience placement
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    CapitalG

    San Francisco, CA
    1 day ago
  • $200k - $400k

     ...Job Description Job Description Machine Learning Engineer - Infrastructure Company: Confidential — venture-backed technology company Location...  ...performance for large models. If you have built large-scale ML infrastructure for language, vision, robotics or biology... 
    Full time
    Work at office
    Relocation
    Visa sponsorship

    Transparent Search Group

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Infrastructure Engineer. Be the first to apply!