Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Applied ML Research Engineer: Build Real-World Evaluations

Verona

Verona is seeking an accomplished applied ML researcher/engineer to bridge research and production engineering. You will study live deployment failures, form precise hypotheses about model behavior, build evaluation infrastructure, and deliver systems that improve field performance. You will develop robust evaluations, high-signal datasets, and validation protocols, collaborating with engineers to deploy measurable improvements in customer workflows. #J-18808-Ljbffr Verona

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Applied ML Research Engineer: Build Real-World Evaluations in New York, NY vacancy
  •  ...in New York is seeking an Applied Machine Learning Engineer to bridge cutting-edge AI research with practical, real-world applications. You will develop...  ...-tune, and operationalize ML models that drive business...  ...architects, and clients to build end-to-end AI-powered applications... 
    Suggested

    Fireworks AI

    New York, NY
    4 days ago
  • TensorOps is seeking a Junior Machine Learning Engineer to deliver real-world ML projects. You’ll be mentored by a senior engineer and work hands-on from day one on production-grade ML systems, with a focus on fast delivery and tangible impact. Ideal candidates hold a BSc... 
    Suggested
    Remote job

    TensorOps

    New York, NY
    2 days ago
  • $197.3k - $313.7k

     ...please consider applying for a maximum...  ...of life. The world of work as we...  ...and platform engineers to embed in...  ...you want to build and deploy the...  ...world-class research and products...  ...and massive, real-world scale....  ...pipelines to support ML and AI...  ...UIs, agentic evaluators, and more.Roll... 
    Suggested
    Full time

    Salesforce

    New York, NY
    2 days ago
  • Applied research at Verona begins with a demanding real-world question: how do we know an AI system is useful...  ...You will develop the evaluation methods, datasets,...  ...research and production engineering. You will study failures...  ...and system behavior, build the infrastructure... 
    Suggested

    Verona

    New York, NY
    2 days ago
  • $115k - $130k

    Senior Manager, Applied Research & Evaluation New York, NY About Understood Understood...  ...focused on shaping the world for difference. We raise awareness...  .... Together, we can build a world where everyone can...  ...adapting rigorous methods to real‑world and digital settings.... 
    Suggested
    Permanent employment
    Work at office
    Local area
    Visa sponsorship
    Work visa
    3 days per week

    Understood For All, Inc.

    New York, NY
    4 days ago
  •  ...enterprise AI company. We build cutting‑edge...  ...are designed to solve real-world business problems. We...  ...Cohere is a team of researchers, engineers, designers, and more,...  ...us! Why this role? Evaluation is critical to making...  ...still encourage you to apply. We strive to create... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    cohere

    New York, NY
    2 days ago
  • $264.8k - $331k

     ...are doubling down on building out state of the art...  ...around the world. The Enterprise ML Research Lab works on the front...  ...will be working on applying our Agent RL Training...  ...Building algorithms to real life enterprise datasets...  ...a fair and thorough evaluation of all applicants.... 
    Full time

    Scale AI

    New York, NY
    3 days ago
  • $227.2k - $284k

     ...systems for the world’s most important...  ...combining rigorous evaluation with full-stack deployment...  ...customers can build AI they can trust...  ..., paired with applied ML research, design, and...  ...Learning Research Engineer, you will operate...  ...applications that deliver real impact. We work... 
    Full time

    Scale AI

    New York, NY
    3 days ago
  • $160k - $200k

     ...ML Research Engineer Boston or NYC Layer Health was founded in 2023...  ...Harvard Medical School. We are building an AI layer that can...  ...with complex, large-scale, real-world clinical data (both structured...  ...ranges, please still consider applying to our role. We will make a... 
    Work at office

    Layer Health

    New York, NY
    2 days ago
  • $200k - $300k

     ...on expanding our ML research platform to benchmark...  ...for ML Research: Build high-level...  ...rapid iteration on real-world data and seamless...  ...insights to assist engineering teams with...  ...enthusiastic about using. Applied Machine Learning:...  ...of how to train, evaluate, and deploy... 

    Career Techniques Inc

    New York, NY
    5 days ago
  •  ...MapleAt Maple, we're building AI agents that work for...  ..., and handle real customer interactions...  ...runway, and backing from world-class investors. I'll...  ....About the RoleAs an ML Research Engineer at Maple, you'll be a...  ...production inference.Lead evaluations, error analysis, and... 
    Work at office
    Local area

    Maple AI, Inc

    New York, NY
    4 days ago
  •  ...ACL—and see that research deployed to a...  ...As an AI Agents Applied Research/Engineering Executive Director...  ...use, and safety; building production...  ...that perform under real-world latency, accuracy...  ...governance, and evaluation frameworks.Implement...  ...foundation in ML, deep learning,... 

    JP Morgan Chase

    New York, NY
    2 days ago
  • $189.6k - $237k

    Scale’s ML platform (RLXF) team builds our internal distributed...  ...powering MLEs, researchers, data scientists...  ...automatic training and evaluation of LLM's, as...  ...software engineering skills, proficient...  ...systems for the world's most important...  ...applications that deliver real impact. We work... 
    Full time

    Scale AI

    New York, NY
    3 days ago
  • $264.8k - $331k

     ...Learning Systems Research Engineer, Agent Post-...  ...doubling down on building out state of the...  ...enterprises around the world. The Enterprise ML Research Lab...  ...algorithms and applying them to client use...  ...and thorough evaluation of all applicants...  ...applications that deliver real impact. We work... 
    Full time
    Contract work
    For contractors
    For subcontractor
    Work at office

    SCALE INC

    New York, NY
    4 days ago
  • $174k - $252k

     ...organizations to build high-quality...  ..., and evaluation platforms for...  ...Integrate novel ML and agentic techniques...  ...into research prototypes.Build...  ...or leading applied research...  ...focused Software Engineers are embedded...  ...all over the world.From creating...  ...engineers work on real-world... 

    Google

    New York, NY
    2 days ago
  • $150k - $350k

     ...one roof. We're building a general-...  ...scientists around the world, translating AI...  ...accelerate research everywhere. Biohub...  ...As a Research Engineer, you'll build...  ...tasks. Design evaluation frameworks and...  ..., grounded in real biological...  ...Please note that applying to this opportunity... 
    Full time
    Worldwide
    Relocation package

    Biohub

    New York, NY
    4 days ago
  • $110.7k - $379.2k

    Position Summary Research Engineer — Post-Training &...  ...investment, building the reasoning...  .... This is not AI applied at the margins. It...  ...resourced to do real post-training at...  ...will design, train, evaluate, and align the models...  ...in the world. The work spans the... 
    Local area
    Visa sponsorship

    Deloitte

    New York, NY
    2 days ago
  • $200k - $300k

     ...innovation. We build and deploy...  ...within one of the world’s most...  ...empowers talented engineers to make...  ...and skilled Research Engineers who...  ...profitable trades.Evaluating sim vs. live...  ...degree, please apply to our Campus...  ...if you have real hands-on experience...  ...and/or ML/Deep Learning... 
    Temporary work
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    3 days ago
  • $264.8k - $331k

     ...helping organizations build and deploy...  ...agent development and real-world deployment, translating...  ...Machine Learning Engineer (MLE) on the...  ...system design to evaluation, deployment, and iteration...  ...spaces, balancing research-driven approaches...  ...deploying ML systems in cloud environments... 
    Full time

    Scale AI

    New York, NY
    3 days ago
  •  ...sciemo Sciemo builds AI for consumer...  ...decision-makers in real-time, turning...  ...of complex ML systems reporting...  ...Machine Learning Engineer, you will play...  ...full spectrum of applied AI—spanning...  ...value in real‑world environments. As...  ...engineering, modeling, evaluation, and deployment... 
    Work at office
    Remote work

    Sciemo

    New York, NY
    1 day ago
  • $198.2k - $368k

    Director, Applied Research Are you excited about...  ...experiment, we build, we deliver. We...  ...closely with product engineering teams to deliver real value in high-...  ...experience building AI/ML systems for...  ...with AI agent evaluation, language model...  ...and deliver real-world solutions. Our Grow... 
    Full time
    Local area
    Flexible hours

    Thomson Reuters

    New York, NY
    5 days ago
  •  ..., enabling companies to build, train, and serve AI models...  ...AI. The Role As an Applied Machine Learning Engineer, you will serve as a vital...  ...between cutting-edge AI research and practical, real-world applications. Your work...  ...successful deployment of ML solutions. Demo / Proof... 

    Fireworks AI

    New York, NY
    2 days ago
  • Tower Research Capital in New York is seeking an AI/ML Applied Research Engineer to sit at the cutting edge of our ML infrastructure and research teams. You will act as Customer Zero for our internal ML Research platform and push the system to its limits across hardware... 

    Trading Interview

    New York, NY
    1 day ago
  •  ...Research Engineer As a Research Engineer on...  ...will work on real production use...  ...LLMs and other ML techniques to...  ...adopt––including evaluating when to use...  ...interpretability, and real-world impact...  ...Building a state machine...  ...still consider applying! We're excited... 
    Full time
    Work at office

    Forus

    New York, NY
    2 days ago
  • $184.9k - $250.2k

     ...Machine Learning Engineer to work directly alongside our research scientists to train, evaluate, and deploy the models...  ..., and act in the real world. This is a hands-on ML role: you will...  ...— not just build the pipes around...  ...supervised learning applied to robotics and embodied... 
    Internship
    Flexible hours

    Amazon

    New York, NY
    2 days ago
  •  ...changes how the world's largest...  ...transformation engine: a governed,...  ...the reason the research is...  ...environments, and evaluation is a research...  ...at scale.You build the training,...  ...'t. That's a real reward signal...  ...change can be applied, checked, and...  ...open-source ML systems (vLLM... 

    Tessera Labs

    New York, NY
    3 days ago
  •  ...Research EngineerWe're looking for a Research Engineer to build the intelligent systems that power...  ...and contribute to evaluation methodology....  ...Research Directions: Apply and develop techniques...  ...class AI Agents, ML, and SRE research...  ...methodology.Real world expertise in one... 
    Work at office
    Night shift

    Antimetal

    New York, NY
    4 days ago
  •  ...captures and analyzes real-world conversations,...  ...specialized vertical in Applied AI, Machine...  ...Responsibilities Design, build, and deploy production‑grade ML systems with end‑to...  ...experience in ML engineering. Strong programming...  ...model training and evaluation. Familiarity with FastAPI... 
    Full time

    Catalyst Labs, LLC

    New York, NY
    3 days ago
  •  ...US) Do you dream of building safe and ethical AI for the real world? Join Dynamo AI!...  ...team of Ph.D.s and engineers pushes the boundaries of AI research, with real-world impact...  ...You’ll be an LLM Evaluation Engineer, developing...  ...a positive impact? Apply today! Dynamo AI is... 

    Stackruit Ltd.

    New York, NY
    4 days ago
  • $270k - $380k

     ...enterprise AI company. We build cutting-edge...  ...to solve real-world business problems...  ...Cohere is a team of researchers, engineers, designers, and more...  ...training and evaluation. You will own the...  ...encourage you to apply.You will be working...  ...evaluationCollaborate with the ML modeling team to... 
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Applied ML Research Engineer: Build Real-World Evaluations. Be the first to apply!