Research Scientist: Agentic Data & Benchmarking
Institute of Foundation Models
Institute of Foundation Models in Sunnyvale, CA, seeks a research scientist to own the agentic data pipeline end-to-end—sourcing and generating high-quality trajectories, tool-use data, and RL environments—and to design the evaluation suite that measures model capabilities with rigor. You will lead benchmarking, data curation, and evaluation infrastructure, driving reliable, scalable experiments and providing clear, actionable insights to researchers and engineers. #J-18808-Ljbffr Institute of Foundation Models
$150k
...Models (IFM) is a dedicated research lab for building, understanding... ...world-class researchers, data scientists, and engineers, tackling the... ...Agents team trains advanced agentic language models that use reasoning... ...data we train on and the benchmarks we measure against. You'...DataFull time$20 - $94 per hour
...multimodal foundation models, and agentic AI systems. Intelligent... ...: As a Deep Learning Scientist Intern, you will work on research, design, and development... ...datasets and evaluation benchmarks for model training, post-... ...familiarity with data processing, dataset development...DataHourly paySummer workInternship$34 - $59 per hour
...digital biology. Join our applied research team to study agent swarms:... ...biologists, computational scientists, and engineers to connect experiments... ...; share reproducible code, benchmarks, and findings through open-... ...foundations in algorithms, data structures, numerical methods...DataHourly paySummer workInternship$174k - $252k
Help in growing research business by sharing research trends and best... ...project work by defining the data structure, framework, design,... ...-facing conversational and agentic systems, user modeling and multi... ...types of work. As a Research Scientist, you'll setup large-scale...Data$184.7k - $324.8k
...billions of people globally. We are looking for Applied Research Scientists with a background and interest in Agentic Systems. You will be leveraging state-of-the-art... ...Models (LLMs). Working knowledge of large-scale data processing especially with structured data,...DataRelocation- ...career.THE ROLE: We are seeking an AI Research Scientist to advance language models and intelligent... ...corpora, demonstrations, synthetic data, agent trajectories, and execution feedback... ..., and performance analysis.Create benchmarks that measure correctness, generalization...Data
$150k
...Research Scientist For Data-Centric Large Language Model Development We are a dedicated research lab... ...approaches in information retrieval, agentic search, and RAG (retrieval-augmented... ...deploying agentic LLM systems, reasoning benchmarks, or RAG pipelines. Background in...DataVisa sponsorship$207k - $300k
Drive an ambitious research agenda in post-training, reinforcement learning, and agentic modeling to improve Gemini's reasoning, tool... ...transfer, synthetic data generation, reward modeling, and... ...reinforcement learning, multilingual benchmarking, reasoning and agentic systems...DataLocal area$207k - $300k
...training.Build robust, scalable infra and data pipelines to support high-quality multimodal training and eval benchmarks.Partner closely with Research Scientists and SWEs to transition cutting-edge... ...agents, multi-agent workflows, or agentic frameworks (e.g., AutoGen, CrewAI,...DataWork experience placement$231k
...technology platform powered by data and machine learning... ...in AI-driven agentic systems. We're dedicated... ...safety across diverse benchmarks and production scenariosLead... ..., engineering, and research teams to translate... ...senior ML engineers and scientists, providing technical...DataFull timeWorldwide$85 per hour
...initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas... ...Foundation Models using AV sensor data Design and implement post-training... ...ablation studies on autonomous driving benchmarks, with the opportunity to publish findings...DataHourly payFull timeInternshipSummer internship$202.5k - $354.4k
...brings together any AI, any data, and any workflow— helping 85... ...Description As a Staff Researcher, you will work on research questions... ...the future of enterprise agentic AI, from a rare vantage point... ...rather than against benchmarks. Qualifications ~...DataInternshipWork at officeImmediate startRemote workFlexible hours$150k
...Models We are a dedicated research lab for building,... ...alongside world-class researchers, data scientists, and engineers, tackling the... ...understanding, reasoning, and agentic capabilities. You will work... ...post-training, and evaluation benchmarks. The role combines cutting-edge...Data- ...Research Scientist As a Research Scientist at Simular, you will: Shape the future of agentic AI by pioneering new research directions in planning, reinforcement... ...experiments end-to-end: from data collection and benchmarking, to model training and evaluation...Data
$201.3k - $352.3k
...platform brings together any AI, any data, and any workflow— helping 85% of... ...for customers. We are a group of researchers, applied scientists, engineers, and product managers... ...driven Senior Engineering Manager, Agentic & GenAI Benchmarking and Evaluations to establish and...DataFull timeWork experience placementWork at officeImmediate startRemote workFlexible hoursShift work- Deccan AI is a GenAI data company that runs the post-training and production layer for... .... Job Description: 1. Background The ML Researcher plays a critical role in keeping the... ...research directions, designing novel AI benchmarks, and creating high-quality evaluation datasets...Data
- ...Applied Scientist Frontier Tuning is Microsoft's AI... ...workflows, domains, and data—while preserving security... .... Partner with research and engineering teams to... ...systems ~ Evaluation or benchmarking of AI systems ~ Tool use, planning, or agentic model behaviors ~ Deployment...Data
- ...Pramaana brings together researchers and formal methods... ...models. As a Research Scientist focused on AI, you’ll... ...spans model training, data quality, representations... ...generation, reasoning, and agentic AI, exploring new... .... Develop rigorous benchmarks and evaluation methodologies...Data
$143k - $275k
...Introduction The Quantum Topological Research Scientist – Technology Architecture is a senior... ...Contribute to experimental design, data analysis, and failure learning cycles for... ...heterogeneous integration) Establish technical benchmarks, requirements, and success metrics...DataLocal area- ...Video Computer Vision (VCV) organization is an applied research and engineering team developing next-generation... ...supervised fine-tuning and reinforcement learning methods for agentic models, alongside the training data, interactive environments, reward signals, and...Data
- ...accumulated process, data, and code that no longer... ...'re the reason the research is interesting. Governance... ...for a Research Scientist to set and pursue a research... ...and the public agent benchmarks are mostly sandboxes.... ...reliable long-horizon agentic behavior in real enterprise...Data
- ...NVIDIA AI Research Scientist At NVIDIA, we're solving the world's most exciting problems with... ...models, curated datasets, and rigorous benchmarks that advance the state of the art and empower... ...and hardware-derived syndrome data, enabling the community to train and evaluate...Data
$202.5k - $354.4k
...together any AI, any data, and any workflow— helping... ...Core AI Research team develops novel methods... ...role As a Staff Research Scientist, you will independently... ...training environments and benchmarks for enterprise... ...infrastructure. Practical depth in agentic AI: tool use,...DataWork at officeImmediate startRemote workFlexible hoursShift work$147k - $210k
Develop data quality, filtering, and labeling methodologies, and optimize multimodal... ...and action performance against benchmarks.Build and maintain the research software, evaluation tools, and... ...types of work. As a Research Scientist, you'll setup large-scale tests and...Data$207k - $300k
...lead strategic, high-impact research programs advancing state-of-the... ...early-to-mid-career research scientists and engineers, fostering a... ...reinforcement learning, reasoning, agentic systems, or scientific AI... ...machine (and deep) learning, data mining, natural language processing...Data$147k - $210k
...analytically the Transformer, and Agentic LLM architecture and... ...structure and creating similar new data sets to improve the ability... ...experience owning and initiating research agendas.As an organization,... ...types of work. As a Research Scientist, you'll setup large-scale...Data$224k - $356.5k
We are looking for a Senior Scientist to lead research on advancing AI models and agents for cybersecurity... ...models, agent architectures, data, training and post-training methods, and... ...in one or more relevant areas such as agentic AI, model training, reasoning and tool...DataFull timeShift work$174k - $252k
...approaches and generation of novel data sets.Collaborate within the... ...Gemma).Experience conducting research and development, including... ..., techniques, and agentic AI solutions.Experience with... ...types of work. As a Research Scientist, you'll setup large-scale tests...Data$184.7k - $324.8k
...are seeking an Applied Machine Learning Research Scientist to join our Accessibility efforts on... ...accessibility challenges: multimodal reasoning, agentic systems and multi-turn interaction,... ..., privacy-preserving ML, and synthetic data and evaluation methodologies.Minimum...DataRelocation- ...increasing intelligence via additional agentic computation.Cerebras works with the leading... ...The RoleAs an Applied Machine Learning Research Scientist at Cerebras, you will play a key role... ...model quality, and iterating on data and evaluation strategies. Your contributions...DataInternship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist: Agentic Data & Benchmarking. Be the first to apply!
- scientist 1 Sunnyvale, CA
- research scientist machine learning deep learning Sunnyvale, CA
- scientist Sunnyvale, CA
- quality control scientist Sunnyvale, CA
- molecular biology scientist Sunnyvale, CA
- research scientist - biology Sunnyvale, CA
- machine learning research scientist Sunnyvale, CA
- safety scientist Sunnyvale, CA
- lab scientist Sunnyvale, CA
- remote scientist Sunnyvale, CA





