Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist, Agentic Data & Benchmarking

Full-time

ifm-us

About the Institute of Foundation Models 

The Institute of Foundation Models (IFM) is a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy. 

As part of our team, you'll work at the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You'll help build groundbreaking AI systems with the potential to reshape entire industries, and contribute to establishing MBZUAI as a global hub for high-performance computing and deep learning. 

About the role 

The Agents team trains advanced agentic language models that use reasoning and tool use to complete real tasks on a computer. This is a specialist role at the center of the loop that drives those models: the data we train on and the benchmarks we measure against. 

You'll own the agentic data pipeline end-to-end — sourcing and generating high-quality trajectories, tool-use data, and RL environments — and the evaluation suite that tells us, rigorously and reproducibly, what our agents can actually do. These two halves are inseparable: benchmarks expose where models fail, and targeted data closes the gap. The agents are only as good as the data they learn from and the evals that keep us honest, and this role owns both. 

This is a research scientist position for someone who wants depth in data and measurement rather than breadth across the whole stack. You should be the kind of person who reads through datasets line by line, distrusts a metric until it's been validated, and gets satisfaction from making an eval suite that nobody questions. 

Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Research Scientist, Agentic Data & Benchmarking in Sunnyvale, CA vacancy
  • $150k

     ...Models (IFM) is a dedicated research lab for building, understanding...  ...world-class researchers, data scientists, and engineers, tackling the...  ...Agents team trains advanced agentic language models that use reasoning...  ...data we train on and the benchmarks we measure against.  You'... 
    Data
    Full time

    IFM

    Sunnyvale, CA
    4 days ago
  • $20 - $94 per hour

     ...multimodal foundation models, and agentic AI systems. Intelligent...  ...: As a Deep Learning Scientist Intern, you will work on research, design, and development...  ...datasets and evaluation benchmarks for model training, post-...  ...familiarity with data processing, dataset development... 
    Data
    Hourly pay
    Summer work
    Internship

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $174k - $252k

    Help in growing research business by sharing research trends and best...  ...project work by defining the data structure, framework, design,...  ...-facing conversational and agentic systems, user modeling and multi...  ...types of work. As a Research Scientist, you'll setup large-scale... 
    Data

    Google

    Mountain View, CA
    1 day ago
  • $184.7k - $324.8k

     ...billions of people globally. We are looking for Applied Research Scientists with a background and interest in Agentic Systems. You will be leveraging state-of-the-art...  ...Models (LLMs). Working knowledge of large-scale data processing especially with structured data,... 
    Data
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $207k - $300k

    Drive an ambitious research agenda in post-training, reinforcement learning, and agentic modeling to improve Gemini's reasoning, tool...  ...transfer, synthetic data generation, reward modeling, and...  ...reinforcement learning, multilingual benchmarking, reasoning and agentic systems... 
    Data
    Local area

    Google

    Mountain View, CA
    21 hours ago
  • $160k - $350k

     ...Collinear is a research-focused AI company building...  ...with founders, research scientists, and engineering leads...  ...generate high-quality data to close them. We believe...  ...Build Agentic Environments: Design...  ...safety beyond simple benchmarks. Close the Loop: Design... 
    Data
    Full time
    Work at office
    Local area
    Immediate start
    Relocation package
    Flexible hours

    Collinear AI, Inc.

    Sunnyvale, CA
    2 days ago
  • $85 per hour

     ...initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas...  ...Foundation Models using AV sensor data Design and implement post-training...  ...ablation studies on autonomous driving benchmarks, with the opportunity to publish findings... 
    Data
    Hourly pay
    Full time
    Internship
    Summer internship

    Waymo

    Mountain View, CA
    4 days ago
  • $202.5k - $354.4k

     ...brings together any AI, any data, and any workflow- helping 85...  ...Description As a Staff Researcher, you will work on research questions...  ...the future of enterprise agentic AI, from a rare vantage point...  ...rather than against benchmarks. Qualifications... 
    Data
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    3 days ago
  •  ...career. THE ROLE: We are seeking an AI Research Scientist to advance language models and...  ...curated corpora, demonstrations, synthetic data, agent trajectories, and execution feedback...  ...verification, and performance analysis. Create benchmarks that measure correctness,... 
    Data
    Full time

    AMD

    Santa Clara, CA
    3 hours ago
  • $201.3k - $352.3k

     ...platform brings together any AI, any data, and any workflow— helping 85% of...  ...for customers. We are a group of researchers, applied scientists, engineers, and product managers...  ...driven Senior Engineering Manager, Agentic & GenAI Benchmarking and Evaluations to establish and lead... 
    Data
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Shift work

    ServiceNow

    Santa Clara, CA
    2 days ago
  •  ...Research Scientist As a Research Scientist at Simular, you will: Shape the future of agentic AI by pioneering new research directions in planning, reinforcement...  ...experiments end-to-end: from data collection and benchmarking, to model training and evaluation... 
    Data

    Simular

    Palo Alto, CA
    5 days ago
  •  ...Pramaana brings together researchers and formal methods...  ...models. As a Research Scientist focused on AI, you’ll...  ...spans model training, data quality, representations...  ...generation, reasoning, and agentic AI, exploring new...  .... Develop rigorous benchmarks and evaluation methodologies... 
    Data

    Pramaana Labs

    Palo Alto, CA
    1 day ago
  •  ...Research ScientistWe're looking for a Research Scientist to set and pursue a research agenda for reliable...  ..., and the public agent benchmarks are mostly sandboxes....  ...reliable long-horizon agentic behavior in real enterprise...  ...use; curriculum and data strategy. Post-training... 
    Data

    Tessera Labs

    San Jose, CA
    4 days ago
  • $143k - $275k

     ...Quantum Topological Research Scientist – Technology ArchitectureGlobalFoundries is a leading full...  ...systemsContribute to experimental design, data analysis, and failure learning cycles...  ...integration)Establish technical benchmarks, requirements, and success metrics aligned... 
    Data
    Local area

    GLOBALFOUNDRIES

    Santa Clara, CA
    1 day ago
  • $207k - $300k

     ...lead strategic, high-impact research programs advancing state-of-the...  ...early-to-mid-career research scientists and engineers, fostering a...  ...reinforcement learning, reasoning, agentic systems, or scientific AI...  ...machine (and deep) learning, data mining, natural language processing... 
    Data

    Google

    Mountain View, CA
    3 days ago
  • $147k - $210k

    Develop data quality, filtering, and labeling methodologies, and optimize multimodal...  ...and action performance against benchmarks.Build and maintain the research software, evaluation tools, and...  ...types of work. As a Research Scientist, you'll setup large-scale tests and... 
    Data

    Google

    Mountain View, CA
    4 days ago
  • $174k - $252k

     ...approaches and generation of novel data sets.Collaborate within the...  ...Gemma).Experience conducting research and development, including...  ..., techniques, and agentic AI solutions.Experience with...  ...types of work. As a Research Scientist, you'll setup large-scale tests... 
    Data

    Google

    Mountain View, CA
    3 days ago
  • $174k - $252k

    Bring a combination of engineering and research expertise to advance Gemini's...  ...training.Build robust, scalable infra and data pipelines to support high-quality multimodal training and eval benchmarks.Partner closely with Research Scientists and Software engineers (SWEs) to... 
    Data

    Google

    Mountain View, CA
    3 days ago
  • $224k - $356.5k

    We are looking for a Senior Scientist to lead research on advancing AI models and agents for cybersecurity...  ...models, agent architectures, data, training and post-training methods, and...  ...in one or more relevant areas such as agentic AI, model training, reasoning and tool... 
    Data
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...NVIDIA AI Research Scientist At NVIDIA, we're solving the world's most exciting problems with...  ...models, curated datasets, and rigorous benchmarks that advance the state of the art and empower...  ...and hardware-derived syndrome data, enabling the community to train and evaluate... 
    Data

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $207k - $300k

     ...and ML efficiency. Drive new research ideas from conception, experimentation...  ...project work by defining the data structure, framework, design,...  ...types of work. As a Research Scientist, you'll setup large-scale...  ...and RecSys. We focus on: 1. benchmarking and improving Gemini models... 
    Data
    Shift work

    Google

    Mountain View, CA
    3 days ago
  • $184.7k - $324.8k

     ...are seeking an Applied Machine Learning Research Scientist to join our Accessibility efforts on...  ...accessibility challenges: multimodal reasoning, agentic systems and multi-turn interaction,...  ..., privacy-preserving ML, and synthetic data and evaluation methodologies.Minimum... 
    Data
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $192k - $304.75k

     ...'re looking for a passionate scientist at the intersection of quantum...  .... As a Sr. Quantum Applied Research Scientist, you will help design...  ...develop physics-informed data synthesis pipelines, post-trainable...  ...architectures, and practical benchmarks that the quantum community... 
    Data
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...you can make a lasting impact on the world.The Data and Agent Loop Lab is looking for a Senior Applied Research Scientist to help us build the next generation of...  ...relevance evaluation frameworks.Developing datasets, benchmarks, and experimental frameworks that establish... 
    Data
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $171.6k - $222.2k

     ...Services (AWS) is assembling an elite team of scientists and engineers to change both at once,...  ...with customers to rapidly transition research breakthroughs into production systemsAbout...  ...of the following areas: algorithms and data structures, parsing, numerical... 
    Data
    Work at office
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    Santa Clara, CA
    3 days ago
  •  ...About the Role As an AI Researcher for Computer Vision & Autonomous Robots...  ...interdisciplinary teams of researchers, data scientists, and roboticists to explore,...  ...Transformers, Diffusion Models, Agentic AI frameworks). Test and benchmark algorithms on physical robot... 
    Data
    Full time

    Tata Consultancy Services

    Santa Clara, CA
    5 days ago
  • $202.5k - $354.4k

     ...together any AI, any data, and any workflow— helping...  ...Our Core AI Research team develops novel methods...  ...role As a Staff Research Scientist, you will...  ...training environments and benchmarks for enterprise workflows...  ...~ Practical depth in agentic AI: tool use, environments... 
    Data
    Full time
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Shift work

    ServiceNow

    Santa Clara, CA
    8 days ago
  •  ...generation computing experiences—from AI and data centers, to PCs, gaming and embedded...  ...career. THE ROLE:We are hiring a AI Research Scientist, Hardware AI Systems, to develop AI systems...  ...one-off wins into reusable models, benchmarks, and transfer protocols that compound across... 
    Data
    Shift work

    AMD

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

     ...is hiring Senior Deep Learning Scientists to advance our efforts in streaming and agentic multimodal AI. You will demonstrate...  ...:Apply fundamental and applied research to develop, train, fine-tune,...  ...collection, development, and benchmarking of multimodal datasets, ensuring... 
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    1 day ago
  • $180k - $243.5k

     ...Job OverviewIntuit is hiring a Senior AI Research Scientist to join the Intuit Foresight team.In...  ...inference, simulation-based planning, agentic and multi-agent systems, neuro-symbolic...  ...a high-caliber team of domain experts, data scientists, and machine learning engineers... 
    Data
    Worldwide

    Intuit

    Mountain View, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist, Agentic Data & Benchmarking. Be the first to apply!