Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist: Agentic Data & Benchmarking

Institute of Foundation Models

Institute of Foundation Models in Sunnyvale, CA, seeks a research scientist to own the agentic data pipeline end-to-end—sourcing and generating high-quality trajectories, tool-use data, and RL environments—and to design the evaluation suite that measures model capabilities with rigor. You will lead benchmarking, data curation, and evaluation infrastructure, driving reliable, scalable experiments and providing clear, actionable insights to researchers and engineers. #J-18808-Ljbffr Institute of Foundation Models

Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Research Scientist: Agentic Data & Benchmarking in Sunnyvale, CA vacancy
  • $150k

     ...Models (IFM) is a dedicated research lab for building, understanding...  ...world-class researchers, data scientists, and engineers, tackling the...  ...Agents team trains advanced agentic language models that use reasoning...  ...data we train on and the benchmarks we measure against.  You'... 
    Data
    Full time

    IFM

    Sunnyvale, CA
    13 days ago
  • $20 - $94 per hour

     ...multimodal foundation models, and agentic AI systems. Intelligent...  ...: As a Deep Learning Scientist Intern, you will work on research, design, and development...  ...datasets and evaluation benchmarks for model training, post-...  ...familiarity with data processing, dataset development... 
    Data
    Hourly pay
    Summer work
    Internship

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $34 - $59 per hour

     ...digital biology. Join our applied research team to study agent swarms:...  ...biologists, computational scientists, and engineers to connect experiments...  ...; share reproducible code, benchmarks, and findings through open-...  ...foundations in algorithms, data structures, numerical methods... 
    Data
    Hourly pay
    Summer work
    Internship

    NVIDIA

    Santa Clara, CA
    17 hours ago
  • $174k - $252k

    Help in growing research business by sharing research trends and best...  ...project work by defining the data structure, framework, design,...  ...-facing conversational and agentic systems, user modeling and multi...  ...types of work. As a Research Scientist, you'll setup large-scale... 
    Data

    Google

    Mountain View, CA
    1 day ago
  • $184.7k - $324.8k

     ...billions of people globally. We are looking for Applied Research Scientists with a background and interest in Agentic Systems. You will be leveraging state-of-the-art...  ...Models (LLMs). Working knowledge of large-scale data processing especially with structured data,... 
    Data
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  •  ...career.THE ROLE: We are seeking an AI Research Scientist to advance language models and intelligent...  ...corpora, demonstrations, synthetic data, agent trajectories, and execution feedback...  ..., and performance analysis.Create benchmarks that measure correctness, generalization... 
    Data

    AMD

    Santa Clara, CA
    4 days ago
  • $150k

     ...Research Scientist For Data-Centric Large Language Model Development We are a dedicated research lab...  ...approaches in information retrieval, agentic search, and RAG (retrieval-augmented...  ...deploying agentic LLM systems, reasoning benchmarks, or RAG pipelines. Background in... 
    Data
    Visa sponsorship

    Institute of Foundation Models

    Sunnyvale, CA
    3 days ago
  • $207k - $300k

    Drive an ambitious research agenda in post-training, reinforcement learning, and agentic modeling to improve Gemini's reasoning, tool...  ...transfer, synthetic data generation, reward modeling, and...  ...reinforcement learning, multilingual benchmarking, reasoning and agentic systems... 
    Data
    Local area

    Google

    Mountain View, CA
    17 hours ago
  • $207k - $300k

     ...training.Build robust, scalable infra and data pipelines to support high-quality multimodal training and eval benchmarks.Partner closely with Research Scientists and SWEs to transition cutting-edge...  ...agents, multi-agent workflows, or agentic frameworks (e.g., AutoGen, CrewAI,... 
    Data
    Work experience placement

    Google

    Mountain View, CA
    3 days ago
  • $231k

     ...technology platform powered by data and machine learning...  ...in AI-driven agentic systems. We're dedicated...  ...safety across diverse benchmarks and production scenariosLead...  ..., engineering, and research teams to translate...  ...senior ML engineers and scientists, providing technical... 
    Data
    Full time
    Worldwide

    Expedia

    San Jose, CA
    2 days ago
  • $85 per hour

     ...initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas...  ...Foundation Models using AV sensor data Design and implement post-training...  ...ablation studies on autonomous driving benchmarks, with the opportunity to publish findings... 
    Data
    Hourly pay
    Full time
    Internship
    Summer internship

    Waymo

    Mountain View, CA
    3 days ago
  • $202.5k - $354.4k

     ...brings together any AI, any data, and any workflow— helping 85...  ...Description As a Staff Researcher, you will work on research questions...  ...the future of enterprise agentic AI, from a rare vantage point...  ...rather than against benchmarks. Qualifications ~... 
    Data
    Internship
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    3 days ago
  • $150k

     ...Models We are a dedicated research lab for building,...  ...alongside world-class researchers, data scientists, and engineers, tackling the...  ...understanding, reasoning, and agentic capabilities. You will work...  ...post-training, and evaluation benchmarks. The role combines cutting-edge... 
    Data

    Institute of Foundation Models

    Sunnyvale, CA
    27 days ago
  •  ...Research Scientist As a Research Scientist at Simular, you will: Shape the future of agentic AI by pioneering new research directions in planning, reinforcement...  ...experiments end-to-end: from data collection and benchmarking, to model training and evaluation... 
    Data

    Simular

    Palo Alto, CA
    3 days ago
  • $201.3k - $352.3k

     ...platform brings together any AI, any data, and any workflow— helping 85% of...  ...for customers. We are a group of researchers, applied scientists, engineers, and product managers...  ...driven Senior Engineering Manager, Agentic & GenAI Benchmarking and Evaluations to establish and... 
    Data
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Shift work

    ServiceNow

    Santa Clara, CA
    17 days ago
  • Deccan AI is a GenAI data company that runs the post-training and production layer for...  .... Job Description: 1. Background The ML Researcher plays a critical role in keeping the...  ...research directions, designing novel AI benchmarks, and creating high-quality evaluation datasets... 
    Data

    Deccan AI Automation Private Limited

    Mountain View, CA
    4 days ago
  •  ...Applied Scientist Frontier Tuning is Microsoft's AI...  ...workflows, domains, and data—while preserving security...  .... Partner with research and engineering teams to...  ...systems ~ Evaluation or benchmarking of AI systems ~ Tool use, planning, or agentic model behaviors ~ Deployment... 
    Data

    Microsoft Corporation

    Mountain View, CA
    3 days ago
  •  ...Pramaana brings together researchers and formal methods...  ...models. As a Research Scientist focused on AI, you’ll...  ...spans model training, data quality, representations...  ...generation, reasoning, and agentic AI, exploring new...  .... Develop rigorous benchmarks and evaluation methodologies... 
    Data

    Pramaana Labs

    Palo Alto, CA
    17 hours ago
  • $143k - $275k

     ...Introduction The Quantum Topological Research Scientist – Technology Architecture is a senior...  ...Contribute to experimental design, data analysis, and failure learning cycles for...  ...heterogeneous integration) Establish technical benchmarks, requirements, and success metrics... 
    Data
    Local area

    GLOBALFOUNDRIES

    Santa Clara, CA
    1 day ago
  •  ...Video Computer Vision (VCV) organization is an applied research and engineering team developing next-generation...  ...supervised fine-tuning and reinforcement learning methods for agentic models, alongside the training data, interactive environments, reward signals, and... 
    Data

    Apple

    Sunnyvale, CA
    3 days ago
  •  ...accumulated process, data, and code that no longer...  ...'re the reason the research is interesting. Governance...  ...for a Research Scientist to set and pursue a research...  ...and the public agent benchmarks are mostly sandboxes....  ...reliable long-horizon agentic behavior in real enterprise... 
    Data

    Tessera Labs

    San Jose, CA
    2 days ago
  •  ...NVIDIA AI Research Scientist At NVIDIA, we're solving the world's most exciting problems with...  ...models, curated datasets, and rigorous benchmarks that advance the state of the art and empower...  ...and hardware-derived syndrome data, enabling the community to train and evaluate... 
    Data

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $202.5k - $354.4k

     ...together any AI, any data, and any workflow— helping...  ...Core AI Research team develops novel methods...  ...role As a Staff Research Scientist, you will independently...  ...training environments and benchmarks for enterprise...  ...infrastructure. Practical depth in agentic AI: tool use,... 
    Data
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Shift work

    ServiceNow

    Santa Clara, CA
    2 days ago
  • $147k - $210k

    Develop data quality, filtering, and labeling methodologies, and optimize multimodal...  ...and action performance against benchmarks.Build and maintain the research software, evaluation tools, and...  ...types of work. As a Research Scientist, you'll setup large-scale tests and... 
    Data

    Google

    Mountain View, CA
    4 days ago
  • $207k - $300k

     ...lead strategic, high-impact research programs advancing state-of-the...  ...early-to-mid-career research scientists and engineers, fostering a...  ...reinforcement learning, reasoning, agentic systems, or scientific AI...  ...machine (and deep) learning, data mining, natural language processing... 
    Data

    Google

    Mountain View, CA
    3 days ago
  • $147k - $210k

     ...analytically the Transformer, and Agentic LLM architecture and...  ...structure and creating similar new data sets to improve the ability...  ...experience owning and initiating research agendas.As an organization,...  ...types of work. As a Research Scientist, you'll setup large-scale... 
    Data

    Google

    Mountain View, CA
    1 day ago
  • $224k - $356.5k

    We are looking for a Senior Scientist to lead research on advancing AI models and agents for cybersecurity...  ...models, agent architectures, data, training and post-training methods, and...  ...in one or more relevant areas such as agentic AI, model training, reasoning and tool... 
    Data
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    17 hours ago
  • $174k - $252k

     ...approaches and generation of novel data sets.Collaborate within the...  ...Gemma).Experience conducting research and development, including...  ..., techniques, and agentic AI solutions.Experience with...  ...types of work. As a Research Scientist, you'll setup large-scale tests... 
    Data

    Google

    Mountain View, CA
    3 days ago
  • $184.7k - $324.8k

     ...are seeking an Applied Machine Learning Research Scientist to join our Accessibility efforts on...  ...accessibility challenges: multimodal reasoning, agentic systems and multi-turn interaction,...  ..., privacy-preserving ML, and synthetic data and evaluation methodologies.Minimum... 
    Data
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  •  ...increasing intelligence via additional agentic computation.Cerebras works with the leading...  ...The RoleAs an Applied Machine Learning Research Scientist at Cerebras, you will play a key role...  ...model quality, and iterating on data and evaluation strategies. Your contributions... 
    Data
    Internship

    Cerebras Systems

    Sunnyvale, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist: Agentic Data & Benchmarking. Be the first to apply!