Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Infra Engineer

Zeromatter

Zeromatter Mission We're Zeromatter. Our mission is to accelerate how robotics and autonomy is built, tested, and trained by leveraging simulation to the fullest extent possible. Part of what we're building to accomplish this is a cloud-based sensor simulation platform that is beyond the state of the art. We are looking for an individual who can support us in accomplishing this mission. You should apply if you're interested in working at a fast-moving startup where you can live up to your potential, unencumbered by office politics or team boundaries. Working at Zeromatter gives you an opportunity to work on technology that will soon be used by various well-known companies who have strong simulation needs. At Zeromatter, we believe in evaluating candidates based on their skills, experience, and potential. We are committed to providing equal opportunities to all applicants and believe that having a diverse team spanning a wide variety of backgrounds, academically as well as in general, is a key asset. If you're passionate about Physical AI, robotics and simulation and eager to make a difference in the field, we'd love to hear from you! Role Description Design, deploy, and run our GPU compute across cloud providers and on-prem: provisioning, job scheduling (Kubernetes, Slurm, or Ray), autoscaling, quotas, and cost controls Build distributed training infrastructure for perception, world models, and RL policies, including multi-node PyTorch DDP/FSDP training, checkpointing, and fault recovery Make simulation and training run together without bottlenecks: high-throughput synthetic sensor data generation, plus RL and closed-loop training with the simulator in the loop Build the data platform for petabyte-scale simulated and real multimodal data: shard formats, caching tiers, dataset versioning, and lineage, so jobs are never input-bound Ship evaluation infrastructure that runs models in closed loop across thousands of simulated scenarios and reports metrics engineers trust Stand up inference and serving for models inside the platform, optimized for real-time simulation and, for some customers, edge hardware Own observability: per-job GPU utilization, step time, input wait, and failure classification, so every GPU-hour is accounted for Help customers run Zeromatter-based training in their own cloud or on-prem environments, and set engineering standards as an early member of the ML infra team Responsibilities Ideally, you have an engineering degree in a related field (e.g. computer science, mechanical engineering, physics, math, robotics, etc.) 5+ years of software engineering, with substantial production work on distributed systems or ML infrastructure Hands-on experience building and operating GPU clusters for training at meaningful scale (roughly 100+ GPUs), including failures that only appear at scale: hung collectives, stragglers, input-bound jobs, stranded capacity Strong Python, plus one systems language such as C++, Rust, or Go Working knowledge of PyTorch and distributed training concepts (DDP, FSDP, NCCL, sharding, checkpointing) Experience with Kubernetes and at least one major cloud (AWS, GCP, or Azure) or large on-prem GPU infrastructure Comfort with infrastructure as code (Terraform or equivalent), containers, and CI/CD Sound judgment on trade-offs such as cloud versus on-prem, build versus buy, and speed versus cost, and clear communication with the engineers who use your platform Qualifications Ideally, you have an engineering degree in a related field (e.g. computer science, mechanical engineering, physics, math, robotics, etc.) ML infra experience in autonomy, robotics, aerospace, or another simulation-heavy domain RL or closed-loop training infrastructure, where a simulator or environment runs inside the training loop Familiarity with GPU rendering and graphics APIs (Vulkan, CUDA interop), or feeding rendered sensor data into training Large-model training: tensor and pipeline parallelism, NCCL tuning, mixed precision GPU profiling and telemetry tools such as Nsight Systems, the PyTorch profiler, and DCGM Training-native data formats (WebDataset, Parquet, Lance) and GPU-side video or image decode Ray or KubeRay, Kueue or Volcano, and experiment tracking (Weights & Biases, MLflow) HPC background: schedulers, parallel file systems, and high-speed interconnects (InfiniBand, RoCE) Deploying and optimizing models for edge hardware (TensorRT, ONNX), including in customer, air-gapped, or regulated environments Zeromatter

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the ML Infra Engineer in New York, NY vacancy
  • $200k - $275k

     ...who've been doing deep learning in the legal space since long before ChatGPT. Description General Legal is seeking a Senior ML Infra Engineer to build the systems that allow us to rapidly experiment with, evaluate, train, and deploy increasingly capable AI systems. You... 
    Suggested
    Contract work
    Work at office
    3 days per week

    General Legal

    New York, NY
    3 days ago
  •  ...veterans and innovative thinkers. We don't believe culture can be engineered - but when it falls into place, it's a once-in-a-lifetime...  ...never felt so present. Position Overview We're looking for an ML infrastructure engineer to help design, build, and scale the foundational... 
    Suggested
    Local area

    Humble Robotics

    New York, NY
    3 days ago
  • $350k

     ...Founding AI/ML Engineer (Production) | NYC | $350k + Founding Equity We're hiring for one of NYC's top 10 robotics startups. If you'...  ...models that handle mission-critical operational logic. Systems & Infra: Building the RAG pipelines and data flywheels that power our... 
    Suggested

    Open Talent

    New York, NY
    3 days ago
  •  ...identify and stop fraud before it happens. The team owns the full ML lifecycle—from feature pipelines and model training to...  ...to support hundreds of customers. As a Senior Machine Learning Engineer, you will own the development of high-performance feature computation... 
    Suggested
    Work experience placement
    Local area

    Plaid

    New York, NY
    3 days ago
  •  ...Be the first dedicated owner of Confido's ML platform. Our AI/ML team already ships...  ...new models and agents without fighting the infra Stand up the cloud foundation as Infrastructure...  ...one) Own the data interface with data engineering: serve the right data to models and... 
    Suggested
    Local area
    Relocation package
    Weekend work

    Confido

    New York, NY
    3 days ago
  • Job Description Job Description Job Description: AI Image Evaluation Specialist Role Type: Contractor, Part-time, Project-based Location: Remote, United States only About the Role We are seeking detail-oriented individuals to support an AI image evaluation...
    Remote job
    Part time
    For contractors

    YO AI Labs

    New York, NY
    4 days ago
  • $110 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: MLOps Engineer (JAX, PyTorch, Pallas/Triton) Type: Contract...  ...AI model performance in MLOps , training infrastructure, and ML framework-level topics . Design challenging, domain-relevant... 
    Remote job
    Contract work
    Summer work
    Weekday work

    Mercor

    New York, NY
    6 days ago
  •  ...is a full-time role for a Founding Machine Learning Engineer, located in Manhattan, NYC. The Founding ML Engineer will develop the core of Photonium’s agentic...  ...experience in building and deploying ML pipelines/infra •⁠ ⁠Interest in optics and physics-based optimization... 
    Full time

    Photonium

    New York, NY
    2 days ago
  • $200k - $295k

     ...most closely guarded these businesses hold.The jobYou'll be the engineer responsible for how the product uses machine learning. You decide...  ...the product safelyWhat you'll bringAt least four years building ML or LLM systems that run in productionHands-on fine-tuning of... 
    Work at office
    Remote work
    Relocation

    Trust In Soda

    New York, NY
    3 days ago
  •  ...was founded by Rachit Kataria, a founding engineer on Facebook Shops who helped scale it to 2...  .... The role We’re hiring our first ML engineer to lead ML and applied AI across...  ...approach the problems we tackle every day. # Infra Conversation: A conversation with Perry,... 
    Full time
    Remote work
    Flexible hours
    Shift work

    centralize

    New York, NY
    9 days ago
  • ML Engineer URGENT REQUIREMENT - Looking for candidates regarding the following: Location: Remote Duration: 6 Months Interview Type: Video Required Skills: Experience in Python, API (flask, FastAPI), microservices, Kubernetes, Docker. Knowledge of data science, and model... 
    Local area
    Remote work

    E-Solutions

    New York, NY
    3 days ago
  • $130k - $135k

    Machine Learning Engineer Location: Across USA any Location The pay range for this role is $130k - $135k per annum including any bonuses or variable pay Job Summary: We are seeking a highly skilled Machine Learning Engineer with a strong background in Natural Language... 

    Yochana

    New York, NY
    3 days ago
  • ML Engineer New York, New York, United States About the Job Our client is a rapidly growing Tier 1 VC backed startup based in New York with $60 million in funding revolutionizing how outside sales and service teams work. Their AI technology captures and analyzes real-world... 
    Full time

    Catalyst Labs, LLC

    New York, NY
    3 days ago
  • $98.61k - $167.64k

     ...based platform provides data storage, analytics, governance, and AI/ML capabilities that enable thousands of users to transform data...  ...adopt modern data and AI solutions at scale. The ML Ops Engineer will develop and maintain machine learning pipelines, model registries... 
    Full time
    Contract work
    Work experience placement
    Live in
    Work at office
    Immediate start
    Remote work

    ICF International Inc

    New York, NY
    3 days ago
  • $153.2k - $183.8k

     ...across all our Autonomy users. We are hiring a Machine Learning Engineer to sit at the center of that growth: reporting to Dataloop +...  ...replay, or model validation Familiarity with autonomy or robotics ML models (perception, tracking, prediction, or planning) and the data... 
    Full time
    Work at office
    Immediate start
    Remote work
    Relocation

    TORC Robotics

    New York, NY
    3 days ago
  • $120k - $160k

    Requirements: Architect, build, and operate end-to-end ML pipelines for training, validation and deployment on Google Cloud and AWS...  .... Collaborate with cross-functional teams, including frontend engineers, backend engineers, research engineers, and infrastructure engineers... 

    Foundation EGI

    New York, NY
    3 days ago
  • Expression Of Interest: Machine Learning Engineer Menlo Park, California, United States; New...  ...architect the next generation of planet-scale ML systems. At Moloco, our mission is to...  ...Optimize for performance, partnering with Infra teams to reduce latency and improve throughput... 
    Temporary work
    Immediate start
    Shift work

    Moloco

    New York, NY
    3 days ago
  • $140k - $294k

    Machine Learning Engineer At R1, we're transforming how healthcare works by combining nearly two decades of revenue cycle expertise with...  ...scale unstructured healthcare data Design, build, and operate AI/ML Systems end-to-end: from problem framing and model selection to... 
    Work at office
    Local area
    Immediate start
    Flexible hours

    R1 RCM

    New York, NY
    3 days ago
  • $160k - $180k

     ...scalable machine learning models and pipelines that support enterprise mission objectives and operational baselines. Apply advanced ML frameworks and lifecycle management practices to improve predictive capability, automation, and analytical insight, aligned with business... 
    Contract work
    Work experience placement
    Work at office
    Local area
    2 days per week

    Karsun Solutions

    New York, NY
    3 days ago
  •  ...infrastructure that Kepler requires. Our founding engineers led Foundry's core systems - Ontology,...  ...scales with experience. You've shipped ML systems to production (fine-tuning,...  ...whatever your path into ML (research, ML infra, product). Our backend is Rust, but we don... 
    Permanent employment
    Work at office

    Kepler

    New York, NY
    3 days ago
  • $75 - $85 per hour

    job summary: Work with other senior and staff engineers on machine learning initiatives from ideation and prototyping through experimentation, deployment, and large-scale productionization. Design, develop, and deploy machine learning systems that operate across hundreds... 
    Hourly pay
    Contract work
    Temporary work
    Work experience placement

    Randstad

    New York, NY
    3 days ago
  • Founding Machine Learning Engineer This is a full-time on-site role for a Founding Machine Learning Engineer, located in NYC. The Founding ML Engineer will be responsible for the design and implementation of our optical design agent. You'll develop ML models that generate... 
    Full time

    Photonium

    New York, NY
    3 days ago
  • Senior ML Engineer At Apheris, we power federated data network in life sciences to address the data bottleneck in training highly performant ML models. Publicly available, molecular datasets are insufficient to train high-quality ML models that meet industry requirements... 
    Remote work
    Work from home

    Apheris

    New York, NY
    3 days ago
  • $160k - $300k

     ...the best people in the right roles to drive long-term success for both clients and candidates. Title of Role: Senior/Staff ML Engineer Location: New York City, NY Company Stage of Funding: Early-Stage, Venture-Backed Office Type: Hybrid / Onsite... 
    Permanent employment
    Work at office
    Immediate start
    Remote work
    Relocation
    Relocation package

    Recruiting from Scratch

    New York, NY
    3 days ago
  • $200k - $275k

     ...end and make them better in ways users can feel as well as the engineering foundation under them. What you'll work on: - Teaching...  ...- Customer obsession. Everyone talks to users, including the ML team. Responsibilities: - Own production models end to end... 
    Full time

    Alta

    New York, NY
    3 days ago
  • $180k - $230k

     ...Role Arlo's underwriting is the core of the business, and it runs on machine learning at serious scale. We're hiring a Senior ML Engineer to build and own the infrastructure that powers it — from training models on tens of millions of patients and hundreds of... 
    Full time

    Arlo

    New York, NY
    9 days ago
  • $184.7k - $324.8k

     ...ServicesLocation: New York CityPosted: 2026-10-06SummaryApple Services GenAI & ML Frameworks team aims at bridging foundation model capabilities...  ...reasoning, and system integration—working closely with product, infra, and foundation model teams to bring cutting-edge models into... 
    Relocation

    Apple

    New York, NY
    3 days ago
  • $140 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Scientific / ML Engineer Type: Contract Compensation: $90–$140/hour Location: Remote Role Responsibilities Guide research and... 
    Remote job
    Contract work
    Part time
    Summer work
    Weekday work

    Mercor

    New York, NY
    13 days ago
  • $184.7k - $324.8k

     ...globally representative?Apple is seeking an expert Machine Learning Engineer to shape the future of responsible AI for the next generation of...  ...with strong skills in data analysis, visualization, and applied ML workflowsExcellent interpersonal skills and proven ability to... 
    Relocation

    Apple

    New York, NY
    3 days ago
  • AI/ML Ops EngineerLocation: Remote / Hybrid (Client-Facing Consulting Engagement)Employment Type: Full-Time ConsultantDuration: Project...  ...at Slalom.com.About the RoleWe are seeking an experienced AI/ML Engineer to design, deploy, and operate production-grade machine learning... 
    Full time
    Contract work
    Local area
    Remote work
    Flexible hours

    Slalom

    New York, NY
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Infra Engineer. Be the first to apply!