Applied AI Researcher, Agent Systems and Evaluation
The Robot Age
What the role actually is Nuro is hiring an applied AI researcher focused on agent systems and evaluation. The work sits around the research and measurement loop for autonomous driving systems, with emphasis on how agent behavior is tested, compared, and improved. For The Robot Age, the interesting part is the evaluation angle. Better robotics products depend on knowing whether an autonomous system behaves well enough in the situations people actually encounter. What you would work on Develop evaluation approaches for autonomous driving agent behavior Work with model, autonomy, and product teams to turn research findings into system improvements Analyze agent performance across simulation, logged data, and real-world autonomy cases Help define the metrics and experiments that guide Nuro's applied AI roadmap What they are asking for Applied AI, robotics, machine learning, or autonomy research background Experience evaluating agentic or autonomous systems Ability to turn ambiguous behavior questions into measurable experiments Strong collaboration with engineering and research teams Why this one is worth a look Evaluation is becoming one of the central product problems in robotics. This role is not about publishing a standalone model; it is about helping an autonomy company understand whether its agents are ready for the real world. #J-18808-Ljbffr The Robot Age
$104.9k - $182.13k
...forward-thinking organization, apply now. We are currently seeking a Applied AI Researcher to join our team in Jersey City... ...understand how model, retrieval, data, evaluation, latency, cost, and safety... ..., or enterprise knowledge systems. Experience with AWS Bedrock...SuggestedTemporary workWork at officeRemote workFlexible hours- Adaption Labs is hiring a senior engineer to build agent systems that convert customer goals into reliable, multi-step executions across... ...balancing quality, latency, cost, and complexity while shaping evaluation systems to prevent gaming and ensure reproducibility. #J-188...Suggested
- ...autonomously. As a Principal Applied Scientist, youll help... .... You will lead the research and development of frontier AI systems that combine foundation... ...algorithms, training and evaluating large models, developing... ...systems Enterprise AI agents Our mission is to advance...SuggestedWork at officeImmediate startRemote work
$191.3k - $305.7k
## Principal Applied Scientist, Agentic AIApplyremote... ...teamThe Agentic AI team at Zillow is... ...foundation for agents that perform... ...experimentation, evaluation, and production innovation##... ...-running agent systems within the Agentic... ...the forefront of research in agentic AI and...SuggestedPermanent employmentLive inWork at officeLocal areaRemote work- ...OpenTrain OpenTrain AI is hiring an AI Browsing Benchmark Researcher to help advance the systems shaping the future of... ...discover projects, and apply in minutes. Creating... ...About AI Training and Evaluation AI training is the... ...research for browsing agents. Your work will help...SuggestedPart timeFor contractorsWork at office
- Reflection Research Lab in San Francisco is seeking a candidate to conduct critical comparative... .... You will build and refine evaluation systems that create tight feedback loops between... ...collaborate with pre-training, post-training, and applied teams, and #J-18808-Ljbffr Visa Hunt
- ...inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AI Researcher - Support & Innovation to join our team in Jersey... ...’s AI capabilities through rigorous prototyping, evaluation, and collaboration with engineering teams.This role...Temporary workWork at officeRemote workFlexible hours
- ...highly motivated Postdoctoral Researcher to conduct research at the... ...position will focus on developing AI-enabled methods to automate... ...workflows that can be applied across datasets, programs, and... ...with real research workflows Evaluate and validate curation approaches...Local area
- ...is seeking talented students for the Applied Machine Learning Ark team, working on... ...end MaaS solutions, data pipelines, and evaluation systems across US and international markets. The... ...system engineering with cutting-edge AI research, offering hands-on experience,...Internship
- Serverless Ventures ( is hiring an AI Researcher Intern to explore the cutting... ...ideas land in production systems, keep reading. About the... ...synthesize research across LLMs, agents, multimodal systems, and edge... ...novel AI approaches Evaluate model performance, benchmark...InternshipLocal areaRemote work
- A forward-thinking technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will...Remote jobPart time
$137.1k - $254.7k
Senior Applied Scientist, Search & Information Retrieval... ...-grade search systems that power Westlaw, PracticalLaw... ...s in Computer Science, AI, NLP, or a related... ...quality optimization Build evaluation frameworks — component-... ...to published research at venues such as SIGIR...Local areaFlexible hours$98k - $176k
...is a group of design, research, and accessibility practitioners... ...programs, including System Usability Scale... ...Quantitative UX Research and AI Enablement and... ..., validate hypotheses, evaluate concepts and experiences... ...quantitative research, applied research, consumer insights...Temporary workWork experience placementFlexible hours- ...team. This Data Scientist / Researcher will collaborate closely with... ...models that enable the scalable evaluation & monitoring of millions of... ...real impact on the world by applying data science to VC and tech startups... ...'s areas of interest (e.g., AI, enterprise software, deep...Full timeWork experience placementRemote workWork from homeFlexible hours
- As an X-Day Offensive Research (XOR) Vulnerability Researcher - Assessments... ...with regulatory requirements.Evaluate controls for effectiveness... ..., including operating systems, mobile devices, web applications... ...practices, and regulations, applying this knowledge to enhance the...Worldwide
$170k - $220k
...TetraScience is the Scientific Data and AI Company building Tetra OS, the operating system for scientific intelligence. We... ...-shelf solutions. AI-first: we apply AI across every layer of the... ...compensation is determined by a thorough evaluation of factors including the...Contract workImmediate startRemote workVisa sponsorshipFlexible hours- ...Learning Engineer, Agent Memory & Reasoning... ...Wand turns AI into labor. It enables... ...that combines deep research expertise and real... ...Build agent memory systems: not just picking... ...retraining them. An applied, builder's mindset... ...with agent evaluation and benchmarking tooling...Full timeRemote workShift work
$220k - $292k
...changing how military systems are designed,... ...by Lattice OS, an AI-powered operating... ...are seeking an AI Research Scientist to serve... ...role (splitroughly60%applied research/... ...influence how multi-agent autonomy is deployed... ...orders. Shape Data & Evaluation Strategies: Define...Full timeWork experience placement- ...Engineer - ML Engineer for Agent Platform at JPMorgan... ..., remember, and get evaluated in a secure, stable, and... ...enterprise-authorized AI-assisted engineering practices... ...use within existing systems and information... ...concepts and 5+ years applied experienceHands-on practical...
- ## AI Agent DeveloperApplylocations: USA-Remotetime type: Full timeposted on: Posted Todayjob... ...flows, integrating with Hagerty's systems, evaluating quality, and iterating relentlessly in... ...established release and engineering standards.* Apply engineering discipline in a no-code/low...Work at officeRemote work3 days per week
- ...Engineer - ML Engineer for Agent Platform at JPMorgan... ...memory, retrieval, and evaluation — in a secure, stable,... ...enterprise-authorized AI-assisted engineering practices... ...applicaitons and systems Implements permission-aware... ...concepts and 5+ years applied experienceHands-on...
- ...engineer to architect and ship advanced agentic systems across Python, Java, and frontend stacks. You will own multi-agent orchestration, prompt design, and streaming runtimes... ..., and guide architectural direction for AI-enabled workflows and MCP interactions across the...
- ...Advanced Data Analytics Research Analyst serves as a... ...Artificial Intelligence (AI) and machine learning approaches... ...data to train and evaluate machine learning models... ...next steps (25%). Apply advanced statistical and... ...to computational and/or systems biology including...Shift work
- AI Research Post Doctoral Fellow Posting Number: req3741... ...execution, and multi-agent orchestration—and will... ...design, development, and evaluation of the project’s... ...high-performance GPU systems (e.g., H100 / A100 / L... ...in machine learning, applied artificial intelligence...Full timeLocal areaWork visa
- ...Job Title: Research Scientist – Quantum & AI Photonic Chip Simulation Location:... ...simulation-validated device and system designs suitable for... ...multiphysics simulations to evaluate optical, nonlinear, and quantum... ...: ~ Ph.D. in Physics, Applied Physics, Electrical...Remote work
- OpenTrain AI is hiring an AI Browsing Benchmark Researcher to design evaluation problems for frontier AI browsing agents. The role emphasizes rigorous research, auditable documentation, and objective verification, with questions that have stable, verifiable answers even...
$12.12k - $16.16k
Black Lotus Labs Threat Researcher -APT Research (WORKS... ...you to log into their system via iCloud or Google, send... ...trusted network for the AI‑powered world,... ...Background results will be evaluated on a case‑by‑case basis... ...know which ones are worth applying to. Sign up and create...Temporary workRemote workWork from home- Amadeus Search, an early-stage AI startup in San Francisco, is hiring an Applied AI Researcher to lead training of state-of-the-art video diffusion models from scratch on massive visual data and GPU clusters. You’ll design and train diffusion/transformer models, curate...
- ...the Role We are looking for a Principal AI Researcher to join our growing AI team and help build intelligent, production-grade AI systems that solve complex problems at scale. In... ...applications, including LLM-based solutions, AI agents, retrieval-augmented generation (RAG),...Temporary workInternship
$10k
...interest you? You should apply - even if you don't... ...foundational and strategic research that informs product... ...standards and lightweight systems that make high-quality... ...what they learn. Use AI and emerging research methods... ...and design teams to evaluate AI-enabled experiences...Weekly payWork experience placementLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Applied AI Researcher, Agent Systems and Evaluation. Be the first to apply!
- field researcher Brooklyn, NY
- product researcher Brooklyn, NY
- security researcher Brooklyn, NY
- data collection researcher Brooklyn, NY
- machine learning researcher Brooklyn, NY
- court researcher Brooklyn, NY
- researcher Brooklyn, NY
- postdoctoral researcher cosmetic science Brooklyn, NY
- senior researcher Brooklyn, NY
- independent researcher Brooklyn, NY


