ML Infrastructure Engineer - Distributed Training & Systems
MaxIT Consulting - Max Corporate Group
ML Infrastructure Engineer Distributed Training & Systems
San Francisco CA Hybrid Full-Time Permanent Employment Mid-Level ASAP Start
MaxIT Consulting Max Corporate Group is looking for a Research Engineer to build the training and environment infrastructure of a fast-growing AI company in San Francisco. The company builds evaluation environments and post-training infrastructure for long-horizon enterprise agents and uses that stack to train and deploy custom models for very large technology companies.
It is a small founding-stage team out of top AI labs and technology companies already profitable and with real enterprise revenue. This role sits under the whole company: the research and deployed teams build directly on what you own.
THE CHALLENGE
As agent workflows get longer evaluation and training infrastructure become the bottleneck. You will own the systems that let long runs be paused rewound and continued and that start watch and shut down thousands of heterogeneous environments cheaply and reliably.
Within your first 90 days you will own one of the core systems end to end: checkpoint and restore the environment orchestrator or the simulated companies used for training and evaluation.
KEY RESPONSIBILITIES
- Build checkpoint and restore of full machine state including memory and GPU state across many machines.
- Build the orchestrator that starts monitors and shuts down thousands of environments from a single container to a multi-GPU cluster .
- Provision real cloud accounts for agents with hundreds created and deleted on demand.
- Build realistic simulated companies with code people tickets threads and documentation for agent training and evaluation.
- Be the infrastructure foundation that the research and deployed teams depend on.
WHAT WE ARE LOOKING FOR
- One to five years of full-time experience (at least one year full time).
- Deep experience in at least one of: distributed systems containers and operating-system internals ML infrastructure or model training .
- Has trained or served models at real scale ( distributed training inference or serving ) or built the environment or benchmark behind a published result.
- A publication at a top venue (such as ICLR or NeurIPS ).
- Has built and owned infrastructure that other people depended on beyond a single research script.
- Comfortable choosing the right tools: no specific language or framework is required.
- Professional English as the role works daily with technical teams and enterprise customers.
NICE TO HAVE
- Experience with checkpointing cluster orchestration or scheduling of many heterogeneous jobs.
- Compiler inference or serving work on large models.
- Simulation or benchmark environments (robotics sim agent gyms browser or operating-system environments multi-agent benchmarks).
- Masters degree from a strong computer science program.
- Interest in joining an early-stage company for the long-term upside.
POSITION DETAILS
Work arrangement: Hybrid three to four days a week in the San Francisco office
Schedule: Full-Time six-day work week
Employment type: Permanent employment
Seniority: Mid-Level (1 to 5 years)
Start date: ASAP
Location: San Francisco California United States
Competitive base salary founding-level equity a performance bonus tied to customer deployments and health dental and vision coverage. Flexible arrangements for candidates outside the Bay Area are reviewed case by case.
WORK AUTHORIZATION
Candidates must be legally authorized to work in the United States. Visa sponsorship for new petitions is not available; H-1B transfers and OPT with sufficient time remaining are considered.
HOW TO APPLY
If you want to own the infrastructure that frontier-level agent training runs on we would like to hear from you. Apply through this platform including your expected gross annual salary in USD and your availability to start.
$117.2k - $313.7k
...you are the future of Salesforce.Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal... ...-ready.Your Impact:Deliver cloud infrastructure automation tools, frameworks,... ...compensation, promotion, benefits, training, assessment of job performance, discipline...TrainingFull time$200k - $280k
...Engineering San Francisco Full-time $200,000 - $280,000 About the Role Join our ML Infrastructure team to build the systems that train, deploy, and serve our AI models at scale. You'll work at... ...with ML training frameworks and distributed training ~ Familiarity with...TrainingFull timeWork at office- ...Job Title: Machine Learning Infrastructure Engineer Location: San Francisco, CA Metro Area... ...Engineer to help architect the compute, training, and execution frameworks powering... ...hold direct ownership over scaling distributed systems across massive hardware clusters while...TrainingFull timeWork at officeFlexible hours
$160k - $250k
...world's largest autonomous logistics system, delivering critical supplies... ...speeds.About You and The RoleAs an ML Training & Inference Infrastructure Engineer on the Data Platform team you... ...processing pipelines, dataset management, distributed training, continuous model...TrainingLocal area$148.5k - $223.9k
...frameworks in developing distributed filesystems in an... ...mentoring junior engineers, and providing... ...public cloud infrastructure - AWS/Azure/GCP.-... ...distributed systems at scale. - Proficiency... ...with Big-Data/ML and S3 Hands-on experience... ..., benefits, training, assessment of...TrainingFull timeImmediate start- ...virtually, a part of being a distributed-first company. Responsibilities As a Senior ML System Engineer in the Rovo GenAI Platform... ...and maintain the core infrastructure to allow machine learning engineers... ...scientists to develop, train, evaluate, deploy, and operate...TrainingWork at office
- ...Gritt is an intelligent system that combines... ...and AI to build the infrastructure that pulls society forward... ...Role: Software - ML Infrastructure Engineer Location: SF Bay... ...deploy scalable AI training and validation pipelines... .... Spin up distributed pipelines for data ingestion...Training
- ...We are a team of engineers, scientists, roboticists... ...The Team The Infrastructure team builds and... ...PI does: from training state-of-the-art... ...platform for internal systems such as... ...platforms (GCP, AWS) and distributed systems: compute... ...with large-scale ML training,...TrainingFull timeLocal areaRemote work
- ...We are a group of engineers, scientists,... ...at Pi builds the systems that scale research... ...intersection of our AI, infrastructure, and external... ..., caching, distributed systems, and infrastructure... ...need to be an ML researcher.... ...responsible for training policies for individual...TrainingFull timeRemote work
$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering... ...:Strong excitement about system optimizationExperience... ...ML systemsStrong software engineering skills, proficient in...TrainingFull time$166k - $343k
Presales Systems Engineer - HPE Networking (Northern California)This role... ...experience with networking infrastructure technologies in all arenas.... ...on datacenter, campus and distributed branch networks. The... ...work experience, education/training, and/or skill level. - United...TrainingFull timeWork experience placementLocal areaImmediate startRemote workWork from home- ...As a Machine Learning Systems Administrator / DevOps Engineer, you will maintain and build the core infrastructure behind both our model training and our inference... ...Prior work supporting ML/AI infrastructure, including... ..., RoCE) and distributed storage Experience...TrainingWork at officeRemote workRelocation package
$215k - $260k
...vertically integrated AI infrastructure company built from the... ...looking for a Staff Engineer to be the technical lead and systems architect for Crusoe's... ...MDT moves petabyte-scale training data between hyperscaler... ...You'll Bring to the Team:Distributed Systems Depth: Hands-on...TrainingTemporary work$170k - $225k
...company with employees distributed across the US and... ...Machine Learning Engineer to take technical... ...our core ranking system. Every job... ...most consequential ML systems we run.... ...produce cleaner training data and unlock downstream... ...stores, training infrastructure, serving,...TrainingWork at officeImmediate startFlexible hours- ...Protocol Learning: training and serving large models... ...on top of that: infrastructure orchestration, distributed compute, and the... ...resource management systems that provision and... ...infrastructure for distributed ML. GPU clusters,... ...and platform engineering (required) : Production...TrainingFull timeRemote workVisa sponsorshipRelocation packageFlexible hours
- ...enterprise grade search infrastructure. Powering search and... ...to determine where new ML capabilities can... ...quality agentic search systems, addressing tail latency... ...systems, mentor senior engineers, and align technical and... ...and operations.Strong distributed-systems expertise...Work at officeLocal area
$215k - $260k
...and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate... ...Crusoe.About the Role:We are seeking a Staff Software Engineer to lead distributed systems design and development within Crusoe Cloud's Cloud Monitoring...Full timeTemporary work$166k - $225k
...world's best data and AI infrastructure platform so our... ...their business. Founded by engineers — and customer obsessed... ...building the next generation distributed data storage and processing systems that can outperform... ...relevant certifications and training, and specific work...TrainingLocal areaWorldwide- Title: ML Engineer Location: San Francisco, CA (Onsite)... ...class of neurosymbolic AI systems, combining statistical... ...ML pipelines for training, validation, and deployment within distributed computing environments... ...generation predictive infrastructure for healthcare.Opportunities...Training
$191.48k - $260.83k
...career. Senior MLOps Engineer, Forward... ...work across model training and refresh workflows... ...reliable backend systems, validate the outcome... ...quality, score distributions, threshold... ...experience in MLOps, ML platform engineering... ..., and production infrastructure.Experience...TrainingFull timeShift workNight shift$175k - $250k
...cutting-edge AI/ML products that solve... ...AI Research & Engineering team. Operating at... ...production-grade systems, you will drive the... ...with core infrastructure and platform teams... ...techniques in post-training fine-tuning, preference... ...expertise with distributed machine learning...TrainingFlexible hours- ...Description Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying to the Public Cloud - Distributed... ...core back-end systems. Your Impact: Deliver cloud infrastructure automation tools, frameworks, workflows, and...Full time
- ...world. We are a group of engineers, scientists,... ...scale and optimize our training systems and core model code. You’ll own critical infrastructure for large-scale training... ...the intersection of ML, software engineering... ...metrics/logging. Scale distributed training: Work with...TrainingFull time
- ...About the Team Training Runtime designs the core distributed machine-learning training runtime that powers everything... ...About the Role As a Training: ML Framework Engineer, you will work on improving the... ..., understanding distributed systems, and who cannot stand having...TrainingFull timeWork at officeRelocation package
$184k - $272k
...Build and evolve our training infrastructure on Kubernetes with Infrastructure... ..., multi-node distributed jobs, capacity... ...operators and workflow engines that keep long-running... ...observability across the ML stack — utilization,... ...intensive production systems. ~ Excellent Python...TrainingFull timeLive inWork at officeLocal areaRemote workWork from homeFlexible hours$267k
...problems. We work closely with engineering, product and data science... ...Generative AI, Computer Vision, ML Optimization, Geospatial AI.... ..., automation, and decision systems across Mobility, Delivery,... ...experience with PyTorch and distributed training.Proven ability to set the...TrainingFull timeWork at officeRemote work$166k - $210.25k
...SummaryAs a Senior Applied ML Engineer on the Applied AI... ...performance of our infrastructure. Your work will span... ...optimization techniques.Build Systems: Design end-to-end ML... ...: Architect, train, and deploy state-of-... ...computer systems and distributed environments.Minimum...TrainingLocal areaWorldwide$70 per hour
....S. states. Software Engineering builds the brains of Waymo... ...with hardware and systems engineers. If you’re a... ...You will: Train and fine-tune a large... ...a solid grounding in ML fundamentals: precision... ...Experience with JAX/Flax, distributed training on TPUs or GPUs...TrainingHourly payFull timeInternshipSummer internshipRelocation package$400k
...and judgment. We are training frontier models with... ...training depends on systems that can keep large accelerator... .... We’re looking for engineers to build and improve... ...researchers on the infrastructure behind large-scale... ..., coordinating distributed workloads, and recovering...TrainingFull timeImmediate startVisa sponsorshipWork visaRelocation package- # Infrastructure Engineer (Storage)Lightning AIUnited StatesFull timeRemoteUSD... ...for developing, training, and deploying AI systems—designed to take ideas from... ...power large-scale AI/ML training, inference, and... ...reliability, and scaling distributed storage systems across our...TrainingWork at officeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Infrastructure Engineer - Distributed Training & Systems. Be the first to apply!
- computer vision machine learning engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA





