Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist - Frontier Benchmarks

JRNLClub

Save “ Research Scientist - Frontier Benchmarks ” at Snorkel AI , track your applications, and ask the Job Agent to rank similar roles for you.

At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data.

We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes since 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!

ABOUT THE ROLE

We're looking for a Research Scientist to collaborate with partners and lead the development of the next frontier benchmarks and datasets. This is a highly visible, customer-facing role at the intersection of research, company strategy, and go-to-market. You'll design datasets taking into account frontier model performance and work with our academic partners, and then partner with delivery, product and go-to-market to scale out production. You will also serve as a credible technical partner for our customers, prospects, and drive results that impact the broader research community.

This role reports directly to the Head of Research and is ideal for someone who is energized by cross-functional work and wants to understand how startups operate across research, data operations, and commercial teams.

MAIN RESPONSIBILITIES

  • Design state of the art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships
  • Translate benchmark insights into clear, compelling narratives that articulate the ROI of expert-curated data for customer-facing presentations, technical reports, and go-to-market materials.
  • Work cross-functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap.
  • Stay at the frontier of LLM evaluation research and bring best practices into Snorkel's workflows
  • Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI

PREFERRED QUALIFICATIONS

  • Strong research background in AI/ML evaluation, NLP, or related fields, with a track record of rigorous experimental design — especially around measuring the impact of training and evaluation data on model behavior.
  • Exceptional communication skills — able to present complex technical findings clearly to both technical and non-technical audiences
  • Comfort operating in a fast-moving, cross-functional environment with ambiguous problem spaces
  • Genuine interest in GTM strategy, startup dynamics, and the commercial side of AI data services.
  • Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered.

Joining Snorkel AI means becoming part of a company that has market proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success.

Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

#J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Research Scientist - Frontier Benchmarks in San Francisco, CA vacancy
  •  ...Roboflow is seeking a Research Scientist for Roboflow Labs in San Francisco to work at the intersection of benchmarks, models, and frontier labs, running failure analyses and turning those findings into data and evaluation specs. You will publish, extend RF100-VL, contribute... 
    Suggested

    Roboflow, Inc.

    San Francisco, CA
    3 days ago
  • $216k - $270k

    Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral...  ...team.Nice to have:Experience in crafting evaluations and benchmarks, or a background in data science roles related to LLM... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    4 days ago
  • $150k - $250k

     ...rearchitect critical operations for the frontier of AI. Our customers include the largest...  ...goods, and global social organizations.We research and deploy technologies that power AI-...  ...want to drive incremental improvements on benchmarks or optimize an existing process but... 
    Suggested
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    8 days ago
  •  ...Mercor is hiring PhD and Master's scientists to author AI evaluation tasks for a new benchmark in scientific computing. You will author original, executable research problems that today's frontier models cannot solve. Domains require depth in biology with focus on... 
    Suggested
    Part time
    Immediate start

    Mercor Inc

    San Francisco, CA
    2 days ago
  •  ...OpenAI in San Francisco is seeking an Agent Post-Training researcher for Frontier Evals & Environments. You will help build north star model environments to drive progress toward safe AGI/ASI and guide the research programs behind our largest training runs. You will... 
    Suggested

    Openai

    San Francisco, CA
    4 days ago
  • Plato, an applied AI research lab in the San Francisco Bay Area, is hiring an individual contributor researcher to design safety environments and benchmarks. You will establish a new research direction, measure AI R&D capabilities, and work with engineers to turn designs... 
    Relocation

    Plato

    San Francisco, CA
    2 days ago
  •  ...Cookiy Labs is hiring a researcher to own the science of the company from day one, potentially achieving a co-founder title and equity...  ...environments grounded in verified human judgment, and publish benchmarks and post-training results that reflect honest performance, including... 

    Cookiy Labs

    San Francisco, CA
    10 hours ago
  •  ...Movendi Inc. seeks a Director of Reality Research to lead independent, frontier AI work and attract top researchers, while avoiding people management duties. The role emphasizes scientific credibility and ambitious breakthroughs. You will define a multi-year research... 

    Movendi Inc.

    San Francisco, CA
    5 days ago
  •  ...keep getting returns from that scale.This role sits squarely across research and engineering. You'll develop next-generation architectures and RL algorithms, take them from a small-scale result to a frontier-scale run, and understand every place they behave differently... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    5 days ago
  • $250k

     ...cells to accelerate cancer research, improve construction site safety...  ...(RF-DETR). We build our own benchmarks grounded in real enterprise...  ...00-VL). And we partner with frontier labs to deliver the training...  ...You'll Do As a Research Scientist at Roboflow Labs, you'll sit... 
    Work at office

    Roboflow

    San Francisco, CA
    4 days ago
  • $380k

     ...can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI...  ...and for society.About the RoleWe are seeking exceptional researchers who can push the frontier of safety mitigations. You will help... 
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    8 days ago
  • Snorkel AI is hiring Forward Deployed Researchers who will partner with frontier AI labs on their most challenging data problems. This is a high-impact, customer-facing role that blends deep technical and research credibility with the ability to work directly with customer... 

    Snorkel AI

    San Francisco, CA
    3 days ago
  •  ...can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI...  ...for society. About the Role We are seeking exceptional researchers who can push the frontier of safety mitigations. You will help... 

    OpenAI

    San Francisco, CA
    4 days ago
  • $130k - $200k

     ...to local cost of living. Apart Research is hiring a Research Scientist for Manipulation Evals to design,...  ...August 2026 the EU AI Office can fine frontier labs up to 3% of global annual...  ...author public deliverables (papers, benchmark releases, technical reports) and engage... 
    Work at office
    Local area
    Remote work
    Home office
    Flexible hours

    Apart Research

    San Francisco, CA
    4 days ago
  • $165.6k - $207k

     ...and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise...  ...and will focus on building benchmarks and diagnosing model failure modes...  ...diagnostic methods that reveal where frontier models fail and why. You will... 
    Full time

    Scale AI

    San Francisco, CA
    4 days ago
  •  ...General Analysis is a frontier security lab focused on evaluating and strengthening frontier AI models against cyberdefense threats. You will lead research into measuring capabilities, mitigating misuse, and developing evaluation methodologies across real-world scenarios... 

    General Analysis

    San Francisco, CA
    4 days ago
  •  ...Halluminate is hiring an experienced Finance expert to join our research team for Applied AI in Financial Services. The role focuses on...  ...engineering and research teams, and drive innovations that push the frontier of AI-driven finance tasks and workflows. #J-18808-Ljbffr... 

    Halluminate

    San Francisco, CA
    3 days ago
  •  ...Enclosure is seeking an exceptional AI researcher to own a significant part of our AI research as an IC. We value exploration, curiosity, and grit over formal degrees. You’ll work on frontier AI models, contribute to experiments, and collaborate with security and infrastructure... 

    Enclosure

    San Francisco, CA
    3 days ago
  • $200k - $375k

     ...Snorkel Snorkel AI is the frontier AI data lab, helping teams build...  .... We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for...  ...We’re looking for a Research Scientist to advance how high-quality... 
    Local area
    Remote work

    Snorkel AI

    San Francisco, CA
    5 days ago
  • $150k - $200k

     ...creative preference datasets that power benchmarking, evaluation, and post-training for the...  ...independent creatives, Contra Labs connects frontier AI labs with a global network of top...  ...exists Contra Labs is expanding its research work with frontier AI labs across... 

    Contra

    San Francisco, CA
    5 days ago
  •  ...all the places in between. This is where research meets reality. You’ll be responsible...  ...Care deeply about evaluation, benchmarking, and failure analysis Are comfortable...  ...dexterity. This requires advancing the frontiers of data, models, and hardware, to enable... 

    Generalist

    San Francisco, CA
    5 days ago
  •  ...with a well-backed AI startup building frontier technology in a high-impact, real-world...  ...small, technical, and moving fast, with research sitting right at the core of the product...  ...quickly, rather than working purely on benchmarks or papers, this is that kind of environment... 

    Harrison Clarke

    San Francisco, CA
    4 days ago
  • $150k - $250k

     ...expert datasets, evals and RL environments for frontier AI labs. About the Role We are looking for a Research Scientist - Post Training to join a post-training...  ...also contribute to evaluation infrastructure and benchmarks across models, capabilities and domains. This... 

    Key Talent Solutions

    San Francisco, CA
    1 day ago
  • Forward Deployed Research Scientist Shape the Future of AI At Labelbox, we're building the critical...  ...three integrated solutions for frontier AI development: Enterprise Platform &...  ...Applied Research on publications and benchmarks. Our Applied Research team owns the long... 
    Flexible hours

    WeHireYou

    San Francisco, CA
    4 days ago
  • $199k - $325k

     ...work with AI. About the roleAI research at WRITER isn't just about...  ...world. As an AI research scientist, you'll be at the center of...  ...workflowsBuild novel evaluation benchmarks and methodologies that push...  ...representing WRITER at the frontier of the field and contributing... 
    Full time
    Work at office
    Local area

    Writer

    San Francisco, CA
    8 days ago
  • $160k - $220k

     ...year runway.About the RoleWe’re looking for an AI Research Scientist to advance the methodological frontier of AI in healthcare. This role is ideal for someone...  ...healthcare validation standards are higher than benchmark culture alone, and you are energized by the opportunity... 
    Temporary work
    Work at office
    Monday to Friday
    Monday to Thursday

    Sprinter Health

    San Francisco, CA
    5 days ago
  • Scale AI, Inc. seeks Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) and evaluation. The role focuses on building benchmarks and diagnosing model failure modes in text and multimodal modalities within the GenAI... 

    Scale AI, Inc.

    San Francisco, CA
    3 days ago
  •  ...and diagnostics by bringing frontier AI into clinical practice. We...  ...daily U.S. X-rays. Our research team brings experience from...  ...Research Engineer or Research Scientist to advance how we curate data...  ...to developing rigorous benchmarks for radiology report generation... 

    Alt

    San Francisco, CA
    23 hours ago
  • Prime Intellect AI is building the open frontier AI stack and seeks researchers to develop continual learning systems and evaluate agent trajectories, corrections, and failures to generate new tasks and model updates. You will compare streaming RL, batched post-training... 

    Prime Intellect AI

    San Francisco, CA
    2 days ago
  • OpenAI is seeking researchers and engineers to advance frontier-model research with a focus on safety and alignment. You will train and evaluate models, identify misalignments, and develop scalable measurement and evaluation pipelines to turn failures into safety signals... 
    Relocation package

    Precision Labs

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist - Frontier Benchmarks. Be the first to apply!