Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Applied AI Researcher, Agent Systems and Evaluation

The Robot Age

What the role actually is Nuro is hiring an applied AI researcher focused on agent systems and evaluation. The work sits around the research and measurement loop for autonomous driving systems, with emphasis on how agent behavior is tested, compared, and improved. For The Robot Age, the interesting part is the evaluation angle. Better robotics products depend on knowing whether an autonomous system behaves well enough in the situations people actually encounter. What you would work on Develop evaluation approaches for autonomous driving agent behavior Work with model, autonomy, and product teams to turn research findings into system improvements Analyze agent performance across simulation, logged data, and real-world autonomy cases Help define the metrics and experiments that guide Nuro's applied AI roadmap What they are asking for Applied AI, robotics, machine learning, or autonomy research background Experience evaluating agentic or autonomous systems Ability to turn ambiguous behavior questions into measurable experiments Strong collaboration with engineering and research teams Why this one is worth a look Evaluation is becoming one of the central product problems in robotics. This role is not about publishing a standalone model; it is about helping an autonomy company understand whether its agents are ready for the real world. #J-18808-Ljbffr The Robot Age

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Applied AI Researcher, Agent Systems and Evaluation in Brooklyn, NY vacancy
  • $104.9k - $182.13k

     ...forward-thinking organization, apply now. We are currently seeking a Applied AI Researcher to join our team in Jersey City...  ...understand how model, retrieval, data, evaluation, latency, cost, and safety...  ..., or enterprise knowledge systems. Experience with AWS Bedrock... 
    Suggested
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Jersey City, NJ
    13 days ago
  • Adaption Labs is hiring a senior engineer to build agent systems that convert customer goals into reliable, multi-step executions across...  ...balancing quality, latency, cost, and complexity while shaping evaluation systems to prevent gaming and ensure reproducibility. #J-188... 
    Suggested

    Adaption Labs

    Brooklyn, NY
    2 days ago
  •  ...autonomously. As a Principal Applied Scientist, youll help...  .... You will lead the research and development of frontier AI systems that combine foundation...  ...algorithms, training and evaluating large models, developing...  ...systems Enterprise AI agents Our mission is to advance... 
    Suggested
    Work at office
    Immediate start
    Remote work

    UiPath, Inc.

    Brooklyn, NY
    11 hours ago
  • $191.3k - $305.7k

    ## Principal Applied Scientist, Agentic AIApplyremote...  ...teamThe Agentic AI team at Zillow is...  ...foundation for agents that perform...  ...experimentation, evaluation, and production innovation##...  ...-running agent systems within the Agentic...  ...the forefront of research in agentic AI and... 
    Suggested
    Permanent employment
    Live in
    Work at office
    Local area
    Remote work

    Zillow Group Inc.

    Brooklyn, NY
    11 hours ago
  •  ...OpenTrain OpenTrain AI is hiring an AI Browsing Benchmark Researcher to help advance the systems shaping the future of...  ...discover projects, and apply in minutes. Creating...  ...About AI Training and Evaluation AI training is the...  ...research for browsing agents. Your work will help... 
    Suggested
    Part time
    For contractors
    Work at office

    OpenTrain AI

    Brooklyn, NY
    4 days ago
  • Reflection Research Lab in San Francisco is seeking a candidate to conduct critical comparative...  .... You will build and refine evaluation systems that create tight feedback loops between...  ...collaborate with pre-training, post-training, and applied teams, and #J-18808-Ljbffr Visa Hunt

    Visa Hunt

    Brooklyn, NY
    2 days ago
  •  ...inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AI Researcher - Support & Innovation to join our team in Jersey...  ...’s AI capabilities through rigorous prototyping, evaluation, and collaboration with engineering teams.This role... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Jersey City, NJ
    1 day ago
  •  ...highly motivated Postdoctoral Researcher to conduct research at the...  ...position will focus on developing AI-enabled methods to automate...  ...workflows that can be applied across datasets, programs, and...  ...with real research workflows Evaluate and validate curation approaches... 
    Local area

    Upenn

    Brooklyn, NY
    2 days ago
  •  ...is seeking talented students for the Applied Machine Learning Ark team, working on...  ...end MaaS solutions, data pipelines, and evaluation systems across US and international markets. The...  ...system engineering with cutting-edge AI research, offering hands-on experience,... 
    Internship

    Pangle

    Brooklyn, NY
    4 days ago
  • Serverless Ventures ( is hiring an AI Researcher Intern to explore the cutting...  ...ideas land in production systems, keep reading. About the...  ...synthesize research across LLMs, agents, multimodal systems, and edge...  ...novel AI approaches Evaluate model performance, benchmark... 
    Internship
    Local area
    Remote work

    Serverlessvc

    Brooklyn, NY
    5 days ago
  • A forward-thinking technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will... 
    Remote job
    Part time

    Mindrift

    Brooklyn, NY
    11 hours ago
  • $137.1k - $254.7k

    Senior Applied Scientist, Search & Information Retrieval...  ...-grade search systems that power Westlaw, PracticalLaw...  ...s in Computer Science, AI, NLP, or a related...  ...quality optimization Build evaluation frameworks — component-...  ...to published research at venues such as SIGIR... 
    Local area
    Flexible hours

    Relha LLC

    Brooklyn, NY
    4 days ago
  • $98k - $176k

     ...is a group of design, research, and accessibility practitioners...  ...programs, including System Usability Scale...  ...Quantitative UX Research and AI Enablement and...  ..., validate hypotheses, evaluate concepts and experiences...  ...quantitative research, applied research, consumer insights... 
    Temporary work
    Work experience placement
    Flexible hours

    Relha LLC

    Brooklyn, NY
    3 days ago
  •  ...team. This Data Scientist / Researcher will collaborate closely with...  ...models that enable the scalable evaluation & monitoring of millions of...  ...real impact on the world by applying data science to VC and tech startups...  ...'s areas of interest (e.g., AI, enterprise software, deep... 
    Full time
    Work experience placement
    Remote work
    Work from home
    Flexible hours

    HOF Capital

    Brooklyn, NY
    4 days ago
  • As an X-Day Offensive Research (XOR) Vulnerability Researcher - Assessments...  ...with regulatory requirements.Evaluate controls for effectiveness...  ..., including operating systems, mobile devices, web applications...  ...practices, and regulations, applying this knowledge to enhance the... 
    Worldwide

    JP Morgan Chase

    Jersey City, NJ
    4 days ago
  • $170k - $220k

     ...TetraScience is the Scientific Data and AI Company building Tetra OS, the operating system for scientific intelligence. We...  ...-shelf solutions. AI-first: we apply AI across every layer of the...  ...compensation is determined by a thorough evaluation of factors including the... 
    Contract work
    Immediate start
    Remote work
    Visa sponsorship
    Flexible hours

    TetraScience, Inc.

    Brooklyn, NY
    11 hours ago
  •  ...Learning Engineer, Agent Memory & Reasoning...  ...Wand turns AI into labor. It enables...  ...that combines deep research expertise and real...  ...Build agent memory systems: not just picking...  ...retraining them. An applied, builder's mindset...  ...with agent evaluation and benchmarking tooling... 
    Full time
    Remote work
    Shift work

    Wand Inc.

    Brooklyn, NY
    1 day ago
  • $220k - $292k

     ...changing how military systems are designed,...  ...by Lattice OS, an AI-powered operating...  ...are seeking an AI Research Scientist to serve...  ...role (splitroughly60%applied research/...  ...influence how multi-agent autonomy is deployed...  ...orders. Shape Data & Evaluation Strategies: Define... 
    Full time
    Work experience placement

    Anduril Industries, Inc.

    Brooklyn, NY
    2 days ago
  •  ...Engineer - ML Engineer for Agent Platform at JPMorgan...  ..., remember, and get evaluated in a secure, stable, and...  ...enterprise-authorized AI-assisted engineering practices...  ...use within existing systems and information...  ...concepts and 5+ years applied experienceHands-on practical... 

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  • ## AI Agent DeveloperApplylocations: USA-Remotetime type: Full timeposted on: Posted Todayjob...  ...flows, integrating with Hagerty's systems, evaluating quality, and iterating relentlessly in...  ...established release and engineering standards.* Apply engineering discipline in a no-code/low... 
    Work at office
    Remote work
    3 days per week

    Hagerty Insurance Agency

    Brooklyn, NY
    3 days ago
  •  ...Engineer - ML Engineer for Agent Platform at JPMorgan...  ...memory, retrieval, and evaluation — in a secure, stable,...  ...enterprise-authorized AI-assisted engineering practices...  ...applicaitons and systems Implements permission-aware...  ...concepts and 5+ years applied experienceHands-on... 

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  •  ...engineer to architect and ship advanced agentic systems across Python, Java, and frontend stacks. You will own multi-agent orchestration, prompt design, and streaming runtimes...  ..., and guide architectural direction for AI-enabled workflows and MCP interactions across the... 

    ServiceNow

    Brooklyn, NY
    3 days ago
  •  ...Advanced Data Analytics Research Analyst serves as a...  ...Artificial Intelligence (AI) and machine learning approaches...  ...data to train and evaluate machine learning models...  ...next steps (25%). Apply advanced statistical and...  ...to computational and/or systems biology including... 
    Shift work

    https:/www.scheurer.org/careers/

    Brooklyn, NY
    1 day ago
  • AI Research Post Doctoral Fellow Posting Number: req3741...  ...execution, and multi-agent orchestration—and will...  ...design, development, and evaluation of the project’s...  ...high-performance GPU systems (e.g., H100 / A100 / L...  ...in machine learning, applied artificial intelligence... 
    Full time
    Local area
    Work visa

    The University of New Mexico

    Brooklyn, NY
    3 days ago
  •  ...Job Title: Research Scientist – Quantum & AI Photonic Chip Simulation Location:...  ...simulation-validated device and system designs suitable for...  ...multiphysics simulations to evaluate optical, nonlinear, and quantum...  ...:  ~ Ph.D. in Physics, Applied Physics, Electrical... 
    Remote work

    QUANTUM COMPUTING, INC.

    Hoboken, NJ
    a month ago
  • OpenTrain AI is hiring an AI Browsing Benchmark Researcher to design evaluation problems for frontier AI browsing agents. The role emphasizes rigorous research, auditable documentation, and objective verification, with questions that have stable, verifiable answers even... 

    OpenTrain AI

    Brooklyn, NY
    4 days ago
  • $12.12k - $16.16k

    Black Lotus Labs Threat Researcher -APT Research (WORKS...  ...you to log into their system via iCloud or Google, send...  ...trusted network for the AI‑powered world,...  ...Background results will be evaluated on a case‑by‑case basis...  ...know which ones are worth applying to. Sign up and create... 
    Temporary work
    Remote work
    Work from home

    Talanto

    Brooklyn, NY
    3 days ago
  • Amadeus Search, an early-stage AI startup in San Francisco, is hiring an Applied AI Researcher to lead training of state-of-the-art video diffusion models from scratch on massive visual data and GPU clusters. You’ll design and train diffusion/transformer models, curate... 

    Amadeus Search

    Brooklyn, NY
    3 days ago
  •  ...the Role We are looking for a Principal AI Researcher to join our growing AI team and help build intelligent, production-grade AI systems that solve complex problems at scale. In...  ...applications, including LLM-based solutions, AI agents, retrieval-augmented generation (RAG),... 
    Temporary work
    Internship

    Uncover

    Brooklyn, NY
    2 days ago
  • $10k

     ...interest you? You should apply - even if you don't...  ...foundational and strategic research that informs product...  ...standards and lightweight systems that make high-quality...  ...what they learn. Use AI and emerging research methods...  ...and design teams to evaluate AI-enabled experiences... 
    Weekly pay
    Work experience placement
    Local area

    City Auto Glass, inc.

    Brooklyn, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Applied AI Researcher, Agent Systems and Evaluation. Be the first to apply!