ML Infrastructure Engineer
HSF
ML Infrastructure Engineer We are looking for an ML Infrastructure Engineer with 3+ years of experience to own and scale the training and inference stack at a fast-growing AI document processing platform. You'll be a strong generalist who understands the mechanics of how ML models work – from serving and monitoring to building robust data pipelines – and can improve inference performance, reliability, and cost efficiency. This is a high-impact IC role where you'll work closely with ML researchers to ensure models are deployed quickly and reliably, and that infrastructure is never a bottleneck for the products being served. The ideal candidate is AI-native from the get-go, comfortable with 1-to-3 node training and single-to-double node serving, and thrives in a fast-paced startup environment. What you will be doing: Building and maintaining model serving infrastructure – improving inference speed, monitoring, and reliability to ensure it's never a bottleneck for customers Setting up and improving training infrastructure for models ranging from 300M to 30B parameters across 1-to-3 node environments Developing observability, logging, and monitoring systems across the ML stack Building internal data pipelines and tooling to help ML researchers move faster from experiment to production Architecting infrastructure to arbitrate inference between multiple cloud providers while optimizing for accuracy, latency, and cost HSF
- ...oprecruiting.comPhone: (***) ***-****Job Title: Machine Learning Infrastructure EngineerLocation: San Francisco, CA Metro Area (100% On-Site)... ...company is seeking a Machine Learning Infrastructure Engineer to help architect the compute, training, and execution frameworks...SuggestedFull timeWork at officeFlexible hours
$250k - $350k
Job Description Most AI roles build on top of models. This one builds what makes them actually work. We're hiring ML Infrastructure Engineers to tackle a hard, real-world problem, understanding what's happening on live job sites using wearable devices, large-scale video...Suggested- ...previous experience on Anthropic’s data team building data infrastructure, and datasets behind Claude. About the Role... ...learning as far as it can go. We are looking for Senior ML Infrastructure Engineers to build the infrastructure and systems that power the...SuggestedFull timeVisa sponsorshipRelocation package
- ...into the physical world. We are a team of engineers, scientists, roboticists, and company... ...devices of the future. The Team The Infrastructure team builds and operates the backbone of... ...You Have Experience with large-scale ML training, evaluation, or simulation...SuggestedFull timeLocal areaRemote work
- ...into the physical world. We are a group of engineers, scientists, roboticists, and company... ...role sits at the intersection of our AI, infrastructure, and external partners. You’ll work... ...in production. You do not need to be an ML researcher. Strong Python skills and...SuggestedFull timeRemote work
$160k - $250k
...principles, enjoy facing adversity, and can do the impossible at record breaking speeds.About You and The Role As an ML Training & Inference Infrastructure Engineer on the Data Platform team you will be building and scaling the systems powering our data flywheel. This person...Local area$200k - $300k
...observability and operating cost. Work closely with customers and engineers to shape the direction of the work. What you'll do -... ...owned end to end, or fast career progression. - Backend, infrastructure or systems experience at a leading technology company or an early...Full timeInternshipWork at officeImmediate startFlexible hours- ML Platform Engineer San Francisco | 5 Days Onsite Location: Onsite in San Francisco Compensation: Competitive Salary + Equity Who We Are... ...generation + simulation orchestration + training/fine-tuning infrastructure + benchmarking pipelines + production deployments in...Work at officeImmediate startFlexible hours1 day per week
- ...intelligent system that combines robotics and AI to build the infrastructure that pulls society forward. Gritt deploys via simple... ...Ventures, and other leading firms. Role: Software - ML Infrastructure Engineer Location: SF Bay Area (in-person) About the role...Full time
- ..., we can do the best work of our lives. Here, you’ll do more than join something — you’ll add something! Description As an engineer on the ML Compute team, your work will include: Drive performance optimization for large-scale foundation model training on TPUs, focusing...
$183.7k - $248.6k
...opportunity Unity is looking for a Senior Machine Learning Infrastructure Engineer to join our Vector Ads team, where we build the real-time systems... .... You'll build and operate the infrastructure that brings ML models from training into production, ensuring our ranking,...Work at officeRemote workWorldwideRelocation package- ...behalf of our client. Build and tune the serving and training infrastructure behind specialized language models, from early experiments... ...credit for performance or stability gains. Solid low-level engineering and troubleshooting ability, including familiarity with GPU...Full timeWork at office
- ...Job Description Job Description We’re looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations on is probably the largest anime AI training cluster in the world . You’ll serve as the bridge between our researchers and...Work at officeVisa sponsorship
- ...driving innovation through advanced hardware engineering and AI solutions. Our mission is to... ...We are seeking a Senior Machine Learning Infrastructure Engineer to join our team. The person... ...shaping a high-performance, production-grade ML ecosystem to support rapid...Flexible hours
$350k
...Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to... ...Policy commitments. We're looking for an engineer to own the infrastructure behind that research. This is the tooling our researchers rely...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work- ...capabilities of our autonomy stack, our customer base, and our team. The role We are looking for an experienced ML engineer to join Flexion’s experienced infrastructure team and take ownership of Flexion’s GPU compute platforms. This is a senior, on-site role with...Temporary workWork at officeRelocation
- ...Large World Model that will be the most powerful intelligence engine for the physical world. This system doesn't just see what something... ...sensing systems. About the Role Matter is hiring a Data Infrastructure Engineer to build the systems that transform drone, airborne,...Permanent employmentFull timeRemote work
- ...Job Description Job Description ML Infrastructure Engineer – Distributed Training & Systems San Francisco, CA | Hybrid | Full-Time | Permanent Employment | Mid-Level | ASAP Start MaxIT Consulting – Max Corporate Group is looking for a Research Engineer to build...Permanent employmentFull timeH1bWork at officeImmediate startVisa sponsorshipFlexible hours3 days per week
- ...in the enterprise through purpose-built ML systems that learn from Rippling's proprietary... ...Rippling.As a Senior Machine Learning Engineer, you will own the end-to-end ML... ...such as PyTorch or JAX and production ML infrastructure.Experience building evaluation systems for...Work at office3 days per week
- ...in the enterprise through purpose-built ML systems that learn from Rippling's proprietary... ...at Rippling.As a Staff Machine Learning Engineer, you will own the end-to-end ML... ...Build robust evaluation and experimentation infrastructure: offline benchmarks, A/B testing, and...Work at office3 days per week
- ...-scale training running on top of that: infrastructure orchestration, distributed compute, and... ...tolerant infrastructure for distributed ML. GPU clusters, NVIDIA runtime, S3 checkpointing... ...For Infrastructure and platform engineering (required) : Production experience with...Full timeRemote workVisa sponsorshipRelocation packageFlexible hours
- ...The AI Infrastructure team at Zensors builds the engine that powers our visual sensing platform. We provide the tools to automate the lifecycle of our AI workflow... ...video streams. As a Machine Learning Engineer in ML Runtime & Optimization , you will develop...Full time
$276k - $414k
...in addition to Bitmoji, Saturn, and other digital services.Snap Engineering teams build fun and technically sophisticated products that... ...in innovative waysCollaborate with leadership to up-level the ML tech stack and improve the performance of the organizationWork...Full timeLive inWork at officeLocal area- ...support their role and our mission. Reporting to the Senior Engineering Manager of the AI & ML Platform team, this Senior Machine Learning Engineer II... ...responses across cloud (AWS, Azure) and Kubernetes infrastructure, communicating progress clearly to stakeholders. Set...Work at officeWorldwideRelocation2 days per week3 days per week
- Machine Learning Engineer, Platform So much of the work society depends on is still slower and harder than it should be. Permits take months... ...a Machine Learning Engineer on Platform, you'll build the core ML capabilities every product we ship stands on — built once,...
$1,000 per month
...support their role and our mission. Reporting to the Senior Engineering Manager of the AI & ML Platform team, this Senior Machine Learning Engineer... ...and debug cloud (AWS and Azure) and Kubernetes (K8s) infrastructure issues to ensure the reliability and availability of...Work at officeWorldwideRelocationSleeping nights2 days per week3 days per week- ...are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies... ...You will build and operate production ML systems that improve how Stripe... ...iteration. Working with data scientists, engineers, and product partners, you will turn model...Temporary work
$213k - $263k
...The Platform team is part of the Marketplace engineering: we provide specialized business platforms supporting Marketplace ML and Optimization products. We own and host... ...commercial services. Develop high-level infrastructure code for automatically training and deploying...Full timeRemote work$245k - $345k
...out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their... ...engineers eager to shape the future of AI and ML at Whatnot. You'll design and scale the core infrastructure that powers machine learning and self-hosted large...Work experience placementWork at officeLocal areaRemote workWork from homeHome officeFlexible hours$200k - $400k
...Job Description Job Description Machine Learning Engineer - Infrastructure Company: Confidential — venture-backed technology company Location... ...performance for large models. If you have built large-scale ML infrastructure for language, vision, robotics or biology...Full timeWork at officeRelocationVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Infrastructure Engineer. Be the first to apply!
- junior machine learning research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- entry level infrastructure engineer San Francisco, CA


