ML Infra Engineer: Scalable Training & Inference
Mixpeek
Trajectory is seeking an ML Infrastructure Engineer to join our research-driven team in San Francisco. You will own the innermost loop of our continual learning platform, spanning training, inference and kernels, and collaborate with researchers to translate new algorithms into reliable systems. We value deep specialization in training infra, inference systems, or GPU kernels, strong Python and C++/CUDA/Triton skills, and the ability to deliver measurable performance gains while preserving #J-18808-Ljbffr
- ...Reducto, a fast-growing AI company in San Francisco, is hiring a Machine Learning Infra Engineer. This role involves building and maintaining the training and inference frameworks necessary for optimal performance. Ideal candidates should possess strong Python skills,...Training
- ...Zyphra is seeking a Machine Learning Systems Administrator / DevOps Engineer to maintain and build the core infrastructure behind model training and inference clouds. You will split time between large-scale training clusters and production deployments across heterogeneous...Training
$200k - $275k
...Description General Legal is seeking a Senior ML Infra Engineer to build the systems that allow us to rapidly experiment with, evaluate, train, and deploy increasingly capable AI... ...for model experimentation, evaluation, inference, data generation, training, and observability...TrainingContract workWork at office3 days per week- ...Epsilon Health in San Francisco is seeking an ML infrastructure engineer to design core systems for scalable training of large models in medical imaging. You will enable... ...you own distributed training, data loading, inference and deployment pipelines, and the RL training stack...Training
- ...Epsilon Health is seeking an ML infrastructure engineer in San Francisco to design and build core systems enabling scalable training of large models for medical imaging and research... ...distributed training, RL infrastructure, and inference pipelines from experimentation to...Training
- A leading technology company is looking for an ML Infrastructure Engineer in San Francisco. The successful candidate will build and maintain ML training pipelines and ensure low-latency model serving. Candidates should have over 4 years of experience in ML engineering,...TrainingWork at office
- ...physical world. We are a group of engineers, scientists, roboticists,... ...of the future. As an ML Infra Engineer (Data Systems), you... ...between raw data sources and training/evaluation, enabling us to move... ...with performance and scalability in mind. Data Lifecycle Management...Training
$228.96k - $315.36k
...The team owns the full ML lifecycle—from feature pipelines and model training to production serving and... ...—building reliable, scalable systems that deliver high... ...Machine Learning Engineer, you will own the development... ...computation and online inference pipelines that power...TrainingWork experience placementWork at officeLocal area- ...is seeking a Senior Software Engineer for the Machine Learning Platform... .... You will design and build scalable ML infrastructure, enabling data... ...and ML engineers to develop, train, deploy, and monitor models... ...computation, real-time inference, and agentic orchestration, using...Training
$250k
...compute platforms for large-scale AI training and inference workloads. With expanding GPU... ...organisation enables AI teams to access scalable compute environments without... ...infrastructure limitations. As a Senior ML Infrastructure Engineer, the successful candidate will help...TrainingFull time- ...About the Role ML Ops Engineer — Agentic AI Lab (Founding... ...automating the model training, deployment, versioning... ...and maintain secure, scalable, and automated pipelines... ..., quantization, and inference rollout Manage hybrid... ...engineering, or infra-focused ML roles ~ Deep...TrainingFull time
$160k - $280k
...the dating industry. Our Machine Learning Engineer is responsible for building high quality ML datasets at scale, used to train ML models that power AI-centric features. In... ...production code, ensuring systems are maintainable, scalable and performant. Ability to produce well-...TrainingWork experience placementImmediate startFlexible hours- Title: ML Engineer Location: San Francisco, CA (Onsite) Direct HireCompany... ..., interpretability, and scalability. This is an opportunity to... ..., scalable ML pipelines for training, validation, and deployment... ...survival analysis, or Bayesian inference is preferred.Healthcare...Training
- ...Reducto in San Francisco is seeking an ML Infrastructure Tech Lead to own and scale high-performance model training and inference systems. This hands-on role emphasizes building, debugging, and optimizing the production stack while guiding architectural decisions. You...Training
$147.6k - $274k
...that enable researchers and engineers to move models from experimentation... ...real-time and batch inference workloads, GPU-backed services... ...implement, ship, and operate scalable model‑serving infrastructure... ...performance computing, distributed training, or large‑scale data...TrainingLocal areaImmediate startWorldwideRelocation package$222.72k - $389.75k
...Content Foundation ML team is responsible... ...for an experienced Engineering Manager who can drive... ...the team in building scalable content understanding... ...efficiently and at low infra cost?How to improve inference throughput,... ...Large scale distributed training and inference of LLM...TrainingWork at officeLocal areaRelocationRelocation package- ...Flexion seeks a senior ML engineer to own its GPU compute platforms on-site in San Francisco. You will design, bring up, operate and optimize... ...GPU clusters and collaborate with AI engineers to accelerate training and improve hardware utilization. You will influence long-term...Training
- ...RL environments for training capable, better-aligned... ...for Senior ML Infrastructure Engineers to build the infrastructure... ...involves building scalable infrastructure to... ...-grade LLM inference and training infrastructure... ...researchers who aren't infra specialists...TrainingVisa sponsorshipRelocation package
- ...Preference Model is a pioneering AI research company building RL environments for training capable and well-aligned superintelligences. We are seeking Senior ML Infrastructure Engineers to design and scale the infrastructure powering post-training research on large language...Training
$204k
...an experienced full stack ML engineer with demonstrated industry... ...assistant. Developing distributed training & experiment... ...lifecycle. Be developing a highly scalable, high-QPS inference service providing low... ...including their modeling and ML infra roadmap. About you You are...TrainingLive inLocal areaRemote work$204k - $216k
...intelligence at scale. You build and run the inference infrastructure that turns the models and... ...to applied AI, research, and platform engineering, and you make the difference between a... ...engineering to get right. The AI/ML Infrastructure and Systems Engineer owns...$227.33k - $312.58k
We’re looking for a Staff ML Data Engineer to join Procore’s AI & Frontier Models organization... ...ambiguous research needs into scalable, production‑ready data pipelines.... ...that support machine learning training, evaluation, or inference workflows.Solid understanding of data...TrainingFull timeWork at officeLocal areaImmediate start3 days per week- ...Epsilon Health in San Francisco is seeking an ML infrastructure engineer to design and build the core systems for scalable training of large models in medical imaging research... ...training, RL infrastructure, and inference pipelines, ensuring models move smoothly from...Training
- ...OpenAI in San Francisco seeks an experienced Software Engineer to help bring inference workloads to AWS Trainium and build the software stack to run... ...kernels, improve compiler support, and ensure scalable execution of the model forward pass on Trainium. #J-18808...
$200k - $300k
...ML Infrastructure EngineerThe company is building one of the leading... ...applications.As an ML Infrastructure Engineer, you'll own critical training and inference infrastructure powering... ...improving latency, reliability, scalability, and cost across production AI workloads...Training- ...Machine Learning Systems Engineer (P60) to lead... ...Doð Design and Build ML SystemsArchitect and implement scalable systems for training, fine-tuning, and serving... ...data.Develop tools and infra to support rapid experimentation... ...scale model training, inference pipelines, or search/...TrainingWork at officeLocal area
- Job title: ML Engineer / Researcher, Large Language Models WORK AUTHORIZATION... ..., and fine-tune and post-train models. You will also work... ...Research ways to reduce inference cost and latency while... ...inference cost, reliability, and scalability Collaborate closely with clinicians...TrainingWork at officeVisa sponsorship
- ...Physical Intelligence seeks an ML Infra Engineer (Data Systems) to build and operate data infrastructure enabling large-scale... ...ingestion, batch and streaming pipelines, and scalable storage to support training and evaluation. You will optimize dataloaders, caching...Training
- ...be the most powerful intelligence engine for the physical world. This system... ...processing, storage, lineage, indexing, and scalable access while partnering closely... ...supporting machine-learning training, evaluation, feature, or inference workloads. What Success Looks...TrainingPermanent employmentRemote work
- ...business problems.We're training and deploying frontier... ...a team of researchers, engineers, designers, and more, who... ...fast, reliable, and scalable model training — and build... ...the full stack of ML systems, this role gives... ...Collaborate closely with infra teams to ensure our cluster...TrainingFull timeWork at officeLocal areaRemote workHome office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Infra Engineer: Scalable Training & Inference. Be the first to apply!
- senior ml engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- machine learning researcher San Francisco, CA
- intern - quantum machine learning for quantum computing San Francisco, CA




