Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Research Engineer - Experimental Systems & Evaluation

Jobleads-US

Nodi is seeking an engineering-focused ML scientist to design, run, and ship evaluations that improve agent decision-making and production systems. You will collaborate with a Principal Scientist to create reproducible experiments, build evaluation datasets, and push improvements from prototype to production in a data-driven Workcell environment.

Your role emphasizes end-to-end ML workflows, from hypothesis to deployment, with an emphasis on reproducibility, instrumentation, and scalable

#J-18808-Ljbffr Jobleads-US
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the ML Research Engineer - Experimental Systems & Evaluation in New York, NY vacancy
  • $216k - $270k

     ...develop reliable AI systems for the world’s most...  ..., combining rigorous evaluation with full-stack deployment...  ...paired with applied ML research, design, and...  ...Machine Learning Research Engineer, you will operate across...  ...evaluation, data, or experimentation work so teams can... 
    Suggested
    Full time

    Scale AI

    New York, NY
    3 days ago
  •  ...About the Role As an ML Research Engineer at Maple, you'll be a part...  ...deploying advanced models and systems that directly impact small...  ...latency. Manage rapid experimentation, training, and highly...  ...production inference. Lead evaluations, error analysis, and... 
    Suggested
    Work at office
    Local area

    Maple Services

    New York, NY
    4 days ago
  • $235k - $295k

     ...machinery that lets us understand, evaluate, and continuously improve...  ...own the evaluation and experimentation systems, contribute research ideas, and carry promising...  ...partnership with platform engineers. The profile is engineering-first, ML-strong, and research-capable... 
    Suggested

    Jobleads-US

    New York, NY
    2 days ago
  • $60 - $90 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  .... Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract Compensation...  ...Responsibilities Design tasks by turning real ML research ideas into well-defined,... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    4 days ago
  • $175k - $300k

     ...edits, rendering engines that composite multiple...  ...for AI agents Research — The foundation...  ...is seeking an ML Engineer to push the...  ...extending agentic systems that understand and...  ...systematic experiments to evaluate and improve agent...  ...systems Strong experimental rigor and good... 
    Suggested
    Full time
    Local area
    Night shift

    Mirage

    New York, NY
    6 days ago
  • $160k - $200k

     ...by leading machine learning researchers from MIT and Harvard...  ...across use cases. For health systems, our first product dramatically...  ...We’re hiring an exceptional ML Engineer to join our team (Boston or...  ...pipelines, CI/CD, testing/experimentation. Ensure robust monitoring... 
    Work at office

    Verana Health

    New York, NY
    4 days ago
  •  ...looking for a Machine Learning Research Engineer to join their team. As a...  ...problem and choosing an evaluation that a physician would actually...  ...problems as well-posed ML tasks, with labels and metrics...  ...increasingly LLMs and agentic systems for clinical workflows. Design... 
    Shift work

    advisorey.

    New York, NY
    1 day ago
  • $200k - $300k

     ...will focus on expanding our ML research platform to benchmark, rapidly...  ..., you will push our systems to their limits, identify bottlenecks...  ...insights to assist engineering teams with platform improvements...  ...understanding of how to train, evaluate, and deploy models at scale.... 

    Career Techniques Inc

    New York, NY
    3 days ago
  • $147.6k - $274k

     ...discovery and development. Roche’s Research and Early Development...  ...Drug Discovery, the Software Engineering team builds and operates...  ...that support the design and evaluation of therapeutic molecules. In...  ...testing, data modeling, and system design.You have experience independently... 
    Full time
    Local area
    Worldwide
    Relocation package
    3 days per week

    Genentech

    New York, NY
    3 days ago
  •  ...We’re looking for a Research Engineer to build the intelligent systems that power Antimetal. You...  ...capabilities and contribute to evaluation methodology....  ...best-in-class AI Agents, ML, and SRE research to our...  ...production, using data and experimentation to drive product and... 
    Work at office
    Night shift

    Antimetal Inc

    New York, NY
    4 days ago
  • $275k - $325k

     ...extracting decades of engineering records, Datalab...  ...'re looking for a Research Engineer to own...  ...results, and balance experimental rigor with...  ...Concretely: Train and evaluate models: Train task...  ...production‑grade model or system used in real‑world...  ..., especially in ML, vision, or NLP... 
    Local area

    datalab.mn d.o.o.

    New York, NY
    1 day ago
  •  ...data processing and experimentation to feature pipelines,...  ...monitoring. In this research role, you’ll partner...  ...with Machine Learning Engineers and Data Scientists to...  ...signals, explore and evaluate innovative modeling approaches...  ...into production systems. Nice-to-Have:... 
    Full time
    Work experience placement
    Local area

    Plaid

    New York, NY
    6 days ago
  • $183k - $246k

     ...with 100+ employees (50+ engineers), we’re scaling fast...  ...out of a multi-agent system , including defining...  ...problem definition through experimentation and productionization....  ...and improve evaluation and experimentation frameworks...  ...shipping production ML/AI systems. ~ Proven... 
    Work at office
    Remote work
    Flexible hours

    Trunk Tools, Inc.

    New York, NY
    a month ago
  •  ...Senior ML Eng Location: NYC (onsite only...  ...Machine Learning Engineer to join our in-house...  ..., and a production system without relying on...  ...extraction, scoring, evaluation, and AI-assisted research. Develop models...  ...from raw data and experimentation through deployment,... 
    Full time
    Relocation

    Alliance

    New York, NY
    more than 2 months ago
  •  ...Hume AI is looking for a Research Engineer to advance speech-language and...  ...training, and rigorous evaluation. Contribute to our endeavor...  ...with the data and evaluation systems needed to test ideas at scale...  ...development. Document experimental designs, results, limitations... 

    Hume AI

    New York, NY
    4 days ago
  • $110 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  .... Position: MLOps Engineer (JAX, PyTorch, Pallas/Triton...  ...infrastructure, and ML framework-level topics ....  ...solutions to MLOps and ML systems problems . Evaluate MLOps tasks and solutions... 
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    New York, NY
    4 days ago
  • $315k

    We are looking for Research Engineers to build “gold standard” evaluations for catastrophic risks, in order to understand...  ...in order to measure how risky AI systems are. Done well, this will inform...  ...may be a good fit if you: Have an ML-focused background and engineering... 
    Currently hiring
    Work at office
    Immediate start
    Home office
    Visa sponsorship
    Relocation package

    Anthropic

    New York, NY
    5 days ago
  •  ...Optimum seeks an experienced Machine Learning Engineer to deploy end-to-end AI solutions leveraging ML principles. You will work with stakeholders to define project...  .... Responsibilities include designing agentic AI systems on Google Cloud, integrating tools and APIs, and... 

    Jobleads-US

    New York, NY
    1 day ago
  • $270k - $310k

     ...looking for a Senior Research Engineer to join our Research...  ...and improving the systems behind large-scale distributed...  ...ll train models, run evaluations, and analyze data...  ...Raise the team's experimental velocity — make it faster...  ...systems, and ML infrastructure best practices... 

    AssemblyAI

    New York, NY
    16 days ago
  • $218k - $273k

     ...reliable, production-grade systems that drive real...  ...Staff Machine Learning Engineer (MLE) on the General Agents...  ...model and system design to evaluation, deployment, and...  ...problem spaces, balancing research-driven approaches with...  ...Experience deploying ML systems in cloud environments... 
    Full time

    Scale AI

    New York, NY
    3 days ago
  • $120 per hour

     ...technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: MLOps Engineer, LLM Systems (Serving, GPU Kernels, Profiling...  ...AI model performance on ML systems and training infrastructure . Evaluate MLOps and ML systems tasks... 
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    19 days ago
  •  ...Senior Machine Learning Engineer — Agentic Search &...  ...build intelligent systems that help people...  ...infrastructure, modeling, and evaluation teams. We combine applied research with production engineering, using experimentation and customer...  ...’s engineering and ML practices.Your... 
    Work at office
    Local area

    Atlassian

    New York, NY
    2 days ago
  • $174k - $252k

     ...datasets, benchmarks, and evaluation platforms for...  ...recipes.Integrate novel ML and agentic techniques into research prototypes.Build evaluation...  ...agent performance.Optimize system performance, latency, and...  ...research-focused Software Engineers are embedded throughout the... 

    Google

    New York, NY
    1 day ago
  • $207k - $300k

    Design, prototype, scale engineering solutions, and run...  ...experiments to address emerging research priorities within the...  ..., scalability, and system design.Present complex...  ...of experience with ML frameworks such as JAX...  ..., or AI safety evaluation and mitigation.Experience... 
    Shift work

    Google

    New York, NY
    16 hours ago
  •  ...Product to determine where new ML capabilities can...  ...high quality agentic search systems, addressing tail latency, throughput...  ...systems through rigorous evaluation, experimentation, and incremental adoption....  ...fragmented systems, mentor senior engineers, and align technical and... 
    Work at office
    Local area

    Atlassian

    New York, NY
    4 days ago
  • $180k - $300k

     ...the AI Site Reliability Engineer (SRE) for the...  ...deeply embedded in AI research, and we’re channeling...  ...Traversal, you'll build the systems our research team runs...  ...improving them is an experimental problem: form a hypothesis...  ...that let researchers evaluate agents against real customer... 
    Full time
    Work at office
    Flexible hours
    Shift work

    Traversal

    New York, NY
    2 days ago
  •  ...role As an AI Engineer on our research team, you'll work on...  ...prompt optimizations, evaluation framework, and AI...  ...Mainly a mix of ML, data science, and applied...  ...complex distributed systems with many async operations...  ...Can balance quick experimentation with systematic... 
    Work at office
    Flexible hours

    Amperos Health, Inc

    New York, NY
    3 days ago
  •  ...building intelligent systems that automate complex...  ...a Senior Applied AI/ML Engineer, you will design, build...  ...engineering role-not research in isolation. You...  ...systems end-to-end, from experimentation and model development through deployment, evaluation, monitoring, and... 
    Permanent employment
    Remote work
    Visa sponsorship
    Flexible hours

    Pivotal Health

    New York, NY
    4 days ago
  • $200k - $250k

     ...Research Engineer - $200,000 - $250,000 ($450,000 TC) – Hybrid (Chicago, NYC, Greenwich, Houston...  ...implement, refine and deploy alpha signals, evaluate and maintain trading tools, improve our...  ...high-throughput, low-latency software systems A track record of working directly... 

    Intec Select

    New York, NY
    1 day ago
  • $175k - $225k

     ...with traders and quantitative researchers to implement, refine and deploy alpha signals, evaluate and maintain trading tools, improve...  ...the Role As a Research Engineer, you will be an integral...  ...throughput, low-latency software systems A track record of working directly... 
    Temporary work
    Flexible hours

    P2P

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Research Engineer - Experimental Systems & Evaluation. Be the first to apply!