Research Scientist, Agentic Data & Benchmarking
ifm-us
About the Institute of Foundation Models
The Institute of Foundation Models (IFM) is a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.
As part of our team, you'll work at the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You'll help build groundbreaking AI systems with the potential to reshape entire industries, and contribute to establishing MBZUAI as a global hub for high-performance computing and deep learning.
About the role
The Agents team trains advanced agentic language models that use reasoning and tool use to complete real tasks on a computer. This is a specialist role at the center of the loop that drives those models: the data we train on and the benchmarks we measure against.
You'll own the agentic data pipeline end-to-end — sourcing and generating high-quality trajectories, tool-use data, and RL environments — and the evaluation suite that tells us, rigorously and reproducibly, what our agents can actually do. These two halves are inseparable: benchmarks expose where models fail, and targeted data closes the gap. The agents are only as good as the data they learn from and the evals that keep us honest, and this role owns both.
This is a research scientist position for someone who wants depth in data and measurement rather than breadth across the whole stack. You should be the kind of person who reads through datasets line by line, distrusts a metric until it's been validated, and gets satisfaction from making an eval suite that nobody questions.
$150k
...Models (IFM) is a dedicated research lab for building, understanding... ...world-class researchers, data scientists, and engineers, tackling the... ...Agents team trains advanced agentic language models that use reasoning... ...data we train on and the benchmarks we measure against. You'...DataFull time$20 - $94 per hour
...multimodal foundation models, and agentic AI systems. Intelligent... ...: As a Deep Learning Scientist Intern, you will work on research, design, and development... ...datasets and evaluation benchmarks for model training, post-... ...familiarity with data processing, dataset development...DataHourly paySummer workInternship$174k - $252k
Help in growing research business by sharing research trends and best... ...project work by defining the data structure, framework, design,... ...-facing conversational and agentic systems, user modeling and multi... ...types of work. As a Research Scientist, you'll setup large-scale...Data$184.7k - $324.8k
...billions of people globally. We are looking for Applied Research Scientists with a background and interest in Agentic Systems. You will be leveraging state-of-the-art... ...Models (LLMs). Working knowledge of large-scale data processing especially with structured data,...DataRelocation$207k - $300k
Drive an ambitious research agenda in post-training, reinforcement learning, and agentic modeling to improve Gemini's reasoning, tool... ...transfer, synthetic data generation, reward modeling, and... ...reinforcement learning, multilingual benchmarking, reasoning and agentic systems...DataLocal area$160k - $350k
...Collinear is a research-focused AI company building... ...with founders, research scientists, and engineering leads... ...generate high-quality data to close them. We believe... ...Build Agentic Environments: Design... ...safety beyond simple benchmarks. Close the Loop: Design...DataFull timeWork at officeLocal areaImmediate startRelocation packageFlexible hours$85 per hour
...initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas... ...Foundation Models using AV sensor data Design and implement post-training... ...ablation studies on autonomous driving benchmarks, with the opportunity to publish findings...DataHourly payFull timeInternshipSummer internship$202.5k - $354.4k
...brings together any AI, any data, and any workflow- helping 85... ...Description As a Staff Researcher, you will work on research questions... ...the future of enterprise agentic AI, from a rare vantage point... ...rather than against benchmarks. Qualifications...DataWork at officeImmediate startRemote workFlexible hours- ...career. THE ROLE: We are seeking an AI Research Scientist to advance language models and... ...curated corpora, demonstrations, synthetic data, agent trajectories, and execution feedback... ...verification, and performance analysis. Create benchmarks that measure correctness,...DataFull time
$201.3k - $352.3k
...platform brings together any AI, any data, and any workflow— helping 85% of... ...for customers. We are a group of researchers, applied scientists, engineers, and product managers... ...driven Senior Engineering Manager, Agentic & GenAI Benchmarking and Evaluations to establish and lead...DataWork experience placementWork at officeImmediate startRemote workFlexible hoursShift work- ...Research Scientist As a Research Scientist at Simular, you will: Shape the future of agentic AI by pioneering new research directions in planning, reinforcement... ...experiments end-to-end: from data collection and benchmarking, to model training and evaluation...Data
- ...Pramaana brings together researchers and formal methods... ...models. As a Research Scientist focused on AI, you’ll... ...spans model training, data quality, representations... ...generation, reasoning, and agentic AI, exploring new... .... Develop rigorous benchmarks and evaluation methodologies...Data
- ...Research ScientistWe're looking for a Research Scientist to set and pursue a research agenda for reliable... ..., and the public agent benchmarks are mostly sandboxes.... ...reliable long-horizon agentic behavior in real enterprise... ...use; curriculum and data strategy. Post-training...Data
$143k - $275k
...Quantum Topological Research Scientist – Technology ArchitectureGlobalFoundries is a leading full... ...systemsContribute to experimental design, data analysis, and failure learning cycles... ...integration)Establish technical benchmarks, requirements, and success metrics aligned...DataLocal area$207k - $300k
...lead strategic, high-impact research programs advancing state-of-the... ...early-to-mid-career research scientists and engineers, fostering a... ...reinforcement learning, reasoning, agentic systems, or scientific AI... ...machine (and deep) learning, data mining, natural language processing...Data$147k - $210k
Develop data quality, filtering, and labeling methodologies, and optimize multimodal... ...and action performance against benchmarks.Build and maintain the research software, evaluation tools, and... ...types of work. As a Research Scientist, you'll setup large-scale tests and...Data$174k - $252k
...approaches and generation of novel data sets.Collaborate within the... ...Gemma).Experience conducting research and development, including... ..., techniques, and agentic AI solutions.Experience with... ...types of work. As a Research Scientist, you'll setup large-scale tests...Data$174k - $252k
Bring a combination of engineering and research expertise to advance Gemini's... ...training.Build robust, scalable infra and data pipelines to support high-quality multimodal training and eval benchmarks.Partner closely with Research Scientists and Software engineers (SWEs) to...Data$224k - $356.5k
We are looking for a Senior Scientist to lead research on advancing AI models and agents for cybersecurity... ...models, agent architectures, data, training and post-training methods, and... ...in one or more relevant areas such as agentic AI, model training, reasoning and tool...DataFull timeShift work- ...NVIDIA AI Research Scientist At NVIDIA, we're solving the world's most exciting problems with... ...models, curated datasets, and rigorous benchmarks that advance the state of the art and empower... ...and hardware-derived syndrome data, enabling the community to train and evaluate...Data
$207k - $300k
...and ML efficiency. Drive new research ideas from conception, experimentation... ...project work by defining the data structure, framework, design,... ...types of work. As a Research Scientist, you'll setup large-scale... ...and RecSys. We focus on: 1. benchmarking and improving Gemini models...DataShift work$184.7k - $324.8k
...are seeking an Applied Machine Learning Research Scientist to join our Accessibility efforts on... ...accessibility challenges: multimodal reasoning, agentic systems and multi-turn interaction,... ..., privacy-preserving ML, and synthetic data and evaluation methodologies.Minimum...DataRelocation$192k - $304.75k
...'re looking for a passionate scientist at the intersection of quantum... .... As a Sr. Quantum Applied Research Scientist, you will help design... ...develop physics-informed data synthesis pipelines, post-trainable... ...architectures, and practical benchmarks that the quantum community...DataFull timeRemote work- ...you can make a lasting impact on the world.The Data and Agent Loop Lab is looking for a Senior Applied Research Scientist to help us build the next generation of... ...relevance evaluation frameworks.Developing datasets, benchmarks, and experimental frameworks that establish...DataFull time
$171.6k - $222.2k
...Services (AWS) is assembling an elite team of scientists and engineers to change both at once,... ...with customers to rapidly transition research breakthroughs into production systemsAbout... ...of the following areas: algorithms and data structures, parsing, numerical...DataWork at officeLocal areaWorldwideFlexible hours- ...About the Role As an AI Researcher for Computer Vision & Autonomous Robots... ...interdisciplinary teams of researchers, data scientists, and roboticists to explore,... ...Transformers, Diffusion Models, Agentic AI frameworks). Test and benchmark algorithms on physical robot...DataFull time
$202.5k - $354.4k
...together any AI, any data, and any workflow— helping... ...Our Core AI Research team develops novel methods... ...role As a Staff Research Scientist, you will... ...training environments and benchmarks for enterprise workflows... ...~ Practical depth in agentic AI: tool use, environments...DataFull timeWork at officeImmediate startRemote workFlexible hoursShift work- ...generation computing experiences—from AI and data centers, to PCs, gaming and embedded... ...career. THE ROLE:We are hiring a AI Research Scientist, Hardware AI Systems, to develop AI systems... ...one-off wins into reusable models, benchmarks, and transfer protocols that compound across...DataShift work
$152k - $241.5k
...is hiring Senior Deep Learning Scientists to advance our efforts in streaming and agentic multimodal AI. You will demonstrate... ...:Apply fundamental and applied research to develop, train, fine-tune,... ...collection, development, and benchmarking of multimodal datasets, ensuring...Full timeWork experience placement$180k - $243.5k
...Job OverviewIntuit is hiring a Senior AI Research Scientist to join the Intuit Foresight team.In... ...inference, simulation-based planning, agentic and multi-agent systems, neuro-symbolic... ...a high-caliber team of domain experts, data scientists, and machine learning engineers...DataWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist, Agentic Data & Benchmarking. Be the first to apply!
- scientist 1 Sunnyvale, CA
- machine learning scientist Sunnyvale, CA
- health scientist Sunnyvale, CA
- application scientist Sunnyvale, CA
- water quality scientist Sunnyvale, CA
- senior research scientist Sunnyvale, CA
- quality control scientist Sunnyvale, CA
- scientist Sunnyvale, CA
- applied scientist Sunnyvale, CA
- senior scientist Sunnyvale, CA





