ML Infra Engineer
Zeromatter
Zeromatter Mission We're Zeromatter. Our mission is to accelerate how robotics and autonomy is built, tested, and trained by leveraging simulation to the fullest extent possible. Part of what we're building to accomplish this is a cloud-based sensor simulation platform that is beyond the state of the art. We are looking for an individual who can support us in accomplishing this mission. You should apply if you're interested in working at a fast-moving startup where you can live up to your potential, unencumbered by office politics or team boundaries. Working at Zeromatter gives you an opportunity to work on technology that will soon be used by various well-known companies who have strong simulation needs. At Zeromatter, we believe in evaluating candidates based on their skills, experience, and potential. We are committed to providing equal opportunities to all applicants and believe that having a diverse team spanning a wide variety of backgrounds, academically as well as in general, is a key asset. If you're passionate about Physical AI, robotics and simulation and eager to make a difference in the field, we'd love to hear from you! Role Description Design, deploy, and run our GPU compute across cloud providers and on-prem: provisioning, job scheduling (Kubernetes, Slurm, or Ray), autoscaling, quotas, and cost controls Build distributed training infrastructure for perception, world models, and RL policies, including multi-node PyTorch DDP/FSDP training, checkpointing, and fault recovery Make simulation and training run together without bottlenecks: high-throughput synthetic sensor data generation, plus RL and closed-loop training with the simulator in the loop Build the data platform for petabyte-scale simulated and real multimodal data: shard formats, caching tiers, dataset versioning, and lineage, so jobs are never input-bound Ship evaluation infrastructure that runs models in closed loop across thousands of simulated scenarios and reports metrics engineers trust Stand up inference and serving for models inside the platform, optimized for real-time simulation and, for some customers, edge hardware Own observability: per-job GPU utilization, step time, input wait, and failure classification, so every GPU-hour is accounted for Help customers run Zeromatter-based training in their own cloud or on-prem environments, and set engineering standards as an early member of the ML infra team Responsibilities Ideally, you have an engineering degree in a related field (e.g. computer science, mechanical engineering, physics, math, robotics, etc.) 5+ years of software engineering, with substantial production work on distributed systems or ML infrastructure Hands-on experience building and operating GPU clusters for training at meaningful scale (roughly 100+ GPUs), including failures that only appear at scale: hung collectives, stragglers, input-bound jobs, stranded capacity Strong Python, plus one systems language such as C++, Rust, or Go Working knowledge of PyTorch and distributed training concepts (DDP, FSDP, NCCL, sharding, checkpointing) Experience with Kubernetes and at least one major cloud (AWS, GCP, or Azure) or large on-prem GPU infrastructure Comfort with infrastructure as code (Terraform or equivalent), containers, and CI/CD Sound judgment on trade-offs such as cloud versus on-prem, build versus buy, and speed versus cost, and clear communication with the engineers who use your platform Qualifications Ideally, you have an engineering degree in a related field (e.g. computer science, mechanical engineering, physics, math, robotics, etc.) ML infra experience in autonomy, robotics, aerospace, or another simulation-heavy domain RL or closed-loop training infrastructure, where a simulator or environment runs inside the training loop Familiarity with GPU rendering and graphics APIs (Vulkan, CUDA interop), or feeding rendered sensor data into training Large-model training: tensor and pipeline parallelism, NCCL tuning, mixed precision GPU profiling and telemetry tools such as Nsight Systems, the PyTorch profiler, and DCGM Training-native data formats (WebDataset, Parquet, Lance) and GPU-side video or image decode Ray or KubeRay, Kueue or Volcano, and experiment tracking (Weights & Biases, MLflow) HPC background: schedulers, parallel file systems, and high-speed interconnects (InfiniBand, RoCE) Deploying and optimizing models for edge hardware (TensorRT, ONNX), including in customer, air-gapped, or regulated environments Zeromatter
$200k - $275k
...who've been doing deep learning in the legal space since long before ChatGPT. Description General Legal is seeking a Senior ML Infra Engineer to build the systems that allow us to rapidly experiment with, evaluate, train, and deploy increasingly capable AI systems. You...SuggestedContract workWork at office3 days per week- ...veterans and innovative thinkers. We don't believe culture can be engineered - but when it falls into place, it's a once-in-a-lifetime... ...never felt so present. Position Overview We're looking for an ML infrastructure engineer to help design, build, and scale the foundational...SuggestedLocal area
$350k
...Founding AI/ML Engineer (Production) | NYC | $350k + Founding Equity We're hiring for one of NYC's top 10 robotics startups. If you'... ...models that handle mission-critical operational logic. Systems & Infra: Building the RAG pipelines and data flywheels that power our...Suggested- ...identify and stop fraud before it happens. The team owns the full ML lifecycle—from feature pipelines and model training to... ...to support hundreds of customers. As a Senior Machine Learning Engineer, you will own the development of high-performance feature computation...SuggestedWork experience placementLocal area
- ...Be the first dedicated owner of Confido's ML platform. Our AI/ML team already ships... ...new models and agents without fighting the infra Stand up the cloud foundation as Infrastructure... ...one) Own the data interface with data engineering: serve the right data to models and...SuggestedLocal areaRelocation packageWeekend work
- Job Description Job Description Job Description: AI Image Evaluation Specialist Role Type: Contractor, Part-time, Project-based Location: Remote, United States only About the Role We are seeking detail-oriented individuals to support an AI image evaluation...Remote jobPart timeFor contractors
$110 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: MLOps Engineer (JAX, PyTorch, Pallas/Triton) Type: Contract... ...AI model performance in MLOps , training infrastructure, and ML framework-level topics . Design challenging, domain-relevant...Remote jobContract workSummer workWeekday work- ...is a full-time role for a Founding Machine Learning Engineer, located in Manhattan, NYC. The Founding ML Engineer will develop the core of Photonium’s agentic... ...experience in building and deploying ML pipelines/infra • Interest in optics and physics-based optimization...Full time
$200k - $295k
...most closely guarded these businesses hold.The jobYou'll be the engineer responsible for how the product uses machine learning. You decide... ...the product safelyWhat you'll bringAt least four years building ML or LLM systems that run in productionHands-on fine-tuning of...Work at officeRemote workRelocation- ...was founded by Rachit Kataria, a founding engineer on Facebook Shops who helped scale it to 2... .... The role We’re hiring our first ML engineer to lead ML and applied AI across... ...approach the problems we tackle every day. # Infra Conversation: A conversation with Perry,...Full timeRemote workFlexible hoursShift work
- ML Engineer URGENT REQUIREMENT - Looking for candidates regarding the following: Location: Remote Duration: 6 Months Interview Type: Video Required Skills: Experience in Python, API (flask, FastAPI), microservices, Kubernetes, Docker. Knowledge of data science, and model...Local areaRemote work
$130k - $135k
Machine Learning Engineer Location: Across USA any Location The pay range for this role is $130k - $135k per annum including any bonuses or variable pay Job Summary: We are seeking a highly skilled Machine Learning Engineer with a strong background in Natural Language...- ML Engineer New York, New York, United States About the Job Our client is a rapidly growing Tier 1 VC backed startup based in New York with $60 million in funding revolutionizing how outside sales and service teams work. Their AI technology captures and analyzes real-world...Full time
$98.61k - $167.64k
...based platform provides data storage, analytics, governance, and AI/ML capabilities that enable thousands of users to transform data... ...adopt modern data and AI solutions at scale. The ML Ops Engineer will develop and maintain machine learning pipelines, model registries...Full timeContract workWork experience placementLive inWork at officeImmediate startRemote work$153.2k - $183.8k
...across all our Autonomy users. We are hiring a Machine Learning Engineer to sit at the center of that growth: reporting to Dataloop +... ...replay, or model validation Familiarity with autonomy or robotics ML models (perception, tracking, prediction, or planning) and the data...Full timeWork at officeImmediate startRemote workRelocation$120k - $160k
Requirements: Architect, build, and operate end-to-end ML pipelines for training, validation and deployment on Google Cloud and AWS... .... Collaborate with cross-functional teams, including frontend engineers, backend engineers, research engineers, and infrastructure engineers...- Expression Of Interest: Machine Learning Engineer Menlo Park, California, United States; New... ...architect the next generation of planet-scale ML systems. At Moloco, our mission is to... ...Optimize for performance, partnering with Infra teams to reduce latency and improve throughput...Temporary workImmediate startShift work
$140k - $294k
Machine Learning Engineer At R1, we're transforming how healthcare works by combining nearly two decades of revenue cycle expertise with... ...scale unstructured healthcare data Design, build, and operate AI/ML Systems end-to-end: from problem framing and model selection to...Work at officeLocal areaImmediate startFlexible hours$160k - $180k
...scalable machine learning models and pipelines that support enterprise mission objectives and operational baselines. Apply advanced ML frameworks and lifecycle management practices to improve predictive capability, automation, and analytical insight, aligned with business...Contract workWork experience placementWork at officeLocal area2 days per week- ...infrastructure that Kepler requires. Our founding engineers led Foundry's core systems - Ontology,... ...scales with experience. You've shipped ML systems to production (fine-tuning,... ...whatever your path into ML (research, ML infra, product). Our backend is Rust, but we don...Permanent employmentWork at office
$75 - $85 per hour
job summary: Work with other senior and staff engineers on machine learning initiatives from ideation and prototyping through experimentation, deployment, and large-scale productionization. Design, develop, and deploy machine learning systems that operate across hundreds...Hourly payContract workTemporary workWork experience placement- Founding Machine Learning Engineer This is a full-time on-site role for a Founding Machine Learning Engineer, located in NYC. The Founding ML Engineer will be responsible for the design and implementation of our optical design agent. You'll develop ML models that generate...Full time
- Senior ML Engineer At Apheris, we power federated data network in life sciences to address the data bottleneck in training highly performant ML models. Publicly available, molecular datasets are insufficient to train high-quality ML models that meet industry requirements...Remote workWork from home
$160k - $300k
...the best people in the right roles to drive long-term success for both clients and candidates. Title of Role: Senior/Staff ML Engineer Location: New York City, NY Company Stage of Funding: Early-Stage, Venture-Backed Office Type: Hybrid / Onsite...Permanent employmentWork at officeImmediate startRemote workRelocationRelocation package$200k - $275k
...end and make them better in ways users can feel as well as the engineering foundation under them. What you'll work on: - Teaching... ...- Customer obsession. Everyone talks to users, including the ML team. Responsibilities: - Own production models end to end...Full time$180k - $230k
...Role Arlo's underwriting is the core of the business, and it runs on machine learning at serious scale. We're hiring a Senior ML Engineer to build and own the infrastructure that powers it — from training models on tens of millions of patients and hundreds of...Full time$184.7k - $324.8k
...ServicesLocation: New York CityPosted: 2026-10-06SummaryApple Services GenAI & ML Frameworks team aims at bridging foundation model capabilities... ...reasoning, and system integration—working closely with product, infra, and foundation model teams to bring cutting-edge models into...Relocation$140 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Scientific / ML Engineer Type: Contract Compensation: $90–$140/hour Location: Remote Role Responsibilities Guide research and...Remote jobContract workPart timeSummer workWeekday work$184.7k - $324.8k
...globally representative?Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for the next generation of... ...with strong skills in data analysis, visualization, and applied ML workflowsExcellent interpersonal skills and proven ability to...Relocation- AI/ML Ops EngineerLocation: Remote / Hybrid (Client-Facing Consulting Engagement)Employment Type: Full-Time ConsultantDuration: Project... ...at Slalom.com.About the RoleWe are seeking an experienced AI/ML Engineer to design, deploy, and operate production-grade machine learning...Full timeContract workLocal areaRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Infra Engineer. Be the first to apply!
- junior machine learning research engineer New York, NY
- machine learning ai engineer New York, NY
- graduate machine learning engineer New York, NY
- senior ml engineer New York, NY
- machine learning software engineer New York, NY
- computer vision machine learning engineer New York, NY
- ai ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- machine learning New York, NY





