Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist - Frontier Benchmarks

$200k - $325k

Snorkel AI

About Snorkel At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data. We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes between 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler! About the Role We're looking for a Research Scientist to collaborate with partners and lead the development of the next frontier benchmarks and datasets. This is a highly visible, customer-facing role at the intersection of research, company strategy, and go-to-market. You'll design datasets taking into account frontier model performance and work with our academic partners, and then partner with delivery, product and go-to-market to scale out production. You will also serve as a credible technical partner for our customers, prospects, and drive results that impact the broader research community. This role reports directly to the Head of Research and is ideal for someone who is energized by cross-functional work and wants to understand how startups operate across research, data operations, and commercial teams. Main Responsibilities Design state of the art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships Translate benchmark insights into clear, compelling narratives that articulate the ROI of expert-curated data for customer-facing presentations, technical reports, and go-to-market materials. Work cross-functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap. Stay at the frontier of LLM evaluation research and bring best practices into Snorkel's workflows Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI Preferred Qualifications Strong research background in AI/ML evaluation, NLP, or related fields, with a track record of rigorous experimental design — especially around measuring the impact of training and evaluation data on model behavior. Exceptional communication skills — able to present complex technical findings clearly to both technical and non-technical audiences Comfort operating in a fast-moving, cross-functional environment with ambiguous problem spaces Genuine interest in GTM strategy, startup dynamics, and the commercial side of AI data services. Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered. Salary Range

$200,000 - $325,000 USD

Growth Opportunities Joining Snorkel AI means becoming part of a company that has market-proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success. Equal Employment Opportunity Statement Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. #J-18808-Ljbffr Snorkel AI

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Research Scientist - Frontier Benchmarks in San Francisco, CA vacancy
  • $176k - $304k

     ...Research Scientist, Frontier Capabilities Cambridge, MA USA; San Francisco, CA USA Your impact at LILA We're building a talent-dense...  ...hypothesis space is vast and reward signal is thin. Existing benchmarks do not capture these nuances. The goal is to build... 
    Suggested
    Full time
    Work at office
    Local area
    Flexible hours
    Shift work

    Lila Sciences

    San Francisco, CA
    2 days ago
  • $216k - $270k

    Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral...  ...team.Nice to have:Experience in crafting evaluations and benchmarks, or a background in data science roles related to LLM... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    4 days ago
  • Mercor is seeking a researcher to join its GenAI team to translate the scientific method into complex, multi-step tasks...  ...week, collaborating with researchers to ensure consistent, high-quality benchmark design and evaluation of frontier models. #J-18808-Ljbffr Mercor
    Suggested
    Remote job

    Mercor

    San Francisco, CA
    3 days ago
  • Cincinnatus LLC is recruiting researchers to design and author multi-step evaluation tasks for frontier AI benchmarks. The role emphasizes translating scientific method into practical tasks, with a focus on Python-based analysis, rigorous evaluation, and clear written conclusions... 
    Suggested
    Remote job
    Full time
    Part time

    Obsidian

    San Francisco, CA
    3 days ago
  • $150k - $250k

     ...rearchitect critical operations for the frontier of AI. Our customers include the largest...  ...goods, and global social organizations.We research and deploy technologies that power AI-...  ...want to drive incremental improvements on benchmarks or optimize an existing process but... 
    Suggested
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    3 days ago
  • Mercor is hiring PhD and Masters scientists to author AI evaluation tasks and build a robust benchmark for scientific computing. You will craft original, executable research problems that current frontier models struggle to solve, with focus on semiconductor materials and... 

    Obsidian

    San Francisco, CA
    13 hours ago
  • Traverse is a research data lab building reinforcement learning environments for frontier AI labs. As a Research Scientist, you will design and build RL environments that teach models to do work that has historically required years of human expertise. You’ll work at the... 

    Traverse

    San Francisco, CA
    4 days ago
  • Mercor is seeking PhD and Master's level scientists to author AI evaluation tasks for...  ...with leading AI labs on a new benchmark for scientific computing. You will craft original, executable research problems that current frontier models cannot solve. Responsibilities... 
    Part time
    Immediate start

    Mercor

    San Francisco, CA
    3 days ago
  • Idler, a frontier data research lab in San Francisco, seeks a Research Scientist to measure and improve how models learn from our tasks. You’ll maximize learning signals per unit time, validate data quality, and collaborate with frontier researchers to design new datasets... 

    idler

    San Francisco, CA
    2 days ago
  • Vals AI in San Francisco is seeking exceptional researchers and research engineers to design and build the next generation of AI benchmarks. You will create high-impact, challenging evaluations that push the boundaries of what we can measure in foundation models. This role... 

    Vals AI

    San Francisco, CA
    2 days ago
  • $295k

     ...can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI...  ...and for society.About the RoleWe are seeking exceptional researchers who can push the frontier of safety mitigations. You will help... 
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    7 days ago
  • $200k - $335k

     ...The role As a research scientist, you will design, implement, and optimize the large-scale...  ...training infrastructure that powers our frontier reinforcement learning stack. This is...  ...backed by partners like Kleiner Perkins, Benchmark, Sequoia, Lux, and Greenoaks. Who... 
    Full time
    Work at office
    Visa sponsorship
    Relocation package

    Applied Compute

    San Francisco, CA
    1 day ago
  •  ...Researcher Position at Hedra Hedra is building a world-class Physical AI research team...  ...researchers who are excited to go beyond benchmarks and build models that operate in the...  ...research into production Stay at the frontier of the field — synthesizing relevant literature... 
    Work at office

    HEDRA INC

    San Francisco, CA
    2 days ago
  • $180.6k - $225.75k

     ...and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise...  ...and will focus on building benchmarks and diagnosing model failure modes...  ...diagnostic methods that reveal where frontier models fail and why. You will... 
    Full time

    Scale AI

    San Francisco, CA
    3 days ago
  •  ...applying those ideas to one of the next frontiers in machine learning. At Granica, we're...  ...from structured information at scale. Our research is led by Prof. Andrea Montanari (...  ...approaches. Design rigorous experiments and benchmarks to measure model quality and efficiency.... 
    Work at office

    Granica Computing, Inc.

    San Francisco, CA
    2 days ago
  • $140k - $200k

     ...breakthrough AI models at leading research labs and enterprises. Since...  ...integrated solutions for frontier AI development: Enterprise...  ...not a traditional research scientist role. You will not spend months...  ...with evaluation and benchmarking of LLMs — designing metrics,... 
    Work at office
    Flexible hours
    2 days per week

    Labelbox

    San Francisco, CA
    3 days ago
  • $125k - $225k

    FutureSearch is looking for exceptional Research Scientists to evaluate and improve state-of-the-...  ...of engineers and researchers at the frontier of AI epistemics. We have the best publicly...  ...ICLR Workshop paper in Jan 2026, and benchmarks like Deep Research Bench and Bench to... 
    Remote work
    Flexible hours

    FutureSearch

    San Francisco, CA
    13 hours ago
  • Velvet is a data research company building the datasets that power the next...  ...quality audiovisual training data for frontier labs. We’re hiring a Research Scientist to develop and fine‑tune models...  ...Build evaluation frameworks and benchmarks to rigorously measure enhancement... 
    Immediate start
    Shift work

    Velvet

    San Francisco, CA
    3 days ago
  • $250k - $400k

     ...stealth AI start-up building frontier reasoning models for...  ...genuinely novel AI for Science research, combining frontier reasoning...  ...Building evaluation frameworks and benchmarks for complex, multi-step...  ...Researcher or experienced Research Scientist. What matters most is hands-... 

    techire ai

    San Francisco, CA
    3 days ago
  • Scale AI, Inc. seeks Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) and evaluation. The role focuses on building benchmarks and diagnosing model failure modes in text and multimodal modalities within the GenAI... 

    Scale AI, Inc.

    San Francisco, CA
    3 days ago
  • $234.3k - $349k

     ...work with AI. About the roleAI research at WRITER isn't just about...  ...world. As an AI research scientist, you'll be at the center of...  ...workflowsBuild novel evaluation benchmarks and methodologies that push...  ...representing WRITER at the frontier of the field and contributing... 
    Full time
    Work at office
    Local area

    Writer

    San Francisco, CA
    5 days ago
  • $160k - $220k

     ...year runway.About the RoleWe’re looking for an AI Research Scientist to advance the methodological frontier of AI in healthcare. This role is ideal for someone...  ...healthcare validation standards are higher than benchmark culture alone, and you are energized by the opportunity... 
    Temporary work
    Work at office
    Monday to Friday
    Monday to Thursday

    Sprinter Health

    San Francisco, CA
    5 days ago
  • # Researcher, Frontier Cybersecurity RisksOn-siteSan FranciscoAll jobsOn-site jobsCybersecurity Jobs## SkillsAI SafetyCybersecurityDeep LearningTransformer ModelsPyTorchTensorFlowData StructuresAlgorithmsSoftware Engineering PrinciplesLarge Language ModelsSupervised Fine... 

    Triwill Group

    San Francisco, CA
    4 days ago
  • $300k - $320k

     ...growing group of committed researchers, engineers, policy experts,...  ...seeking an exceptional Research Scientist to join our Life Sciences...  ...model training objectives, benchmarks, and agentic workflows. You'...  ...accelerated biology while shaping how frontier models reason about and... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    2 days ago
  •  ...enterprises. We aim to push the frontier of AI that understands real,...  ...role is for an experienced scientist who thrives both in...  ...and deep content extraction. Research, evaluate, and integrate the...  ...product impact. Develop new benchmarks, datasets, and evaluation methodologies... 

    Tensorlake Inc.

    San Francisco, CA
    3 days ago
  • Halluminate is hiring an experienced Finance expert to join our research team for Applied AI in Financial Services. The role focuses on...  ...engineering and research teams, and drive innovations that push the frontier of AI-driven finance tasks and workflows. #J-18808-Ljbffr... 

    Halluminate

    San Francisco, CA
    4 days ago
  • OpenAI is seeking a Researcher for Frontier Cybersecurity Risks to design and implement an end-to-end mitigation stack that reduces severe cyber misuse across OpenAI products. The role requires deep technical expertise in deep learning, transformer models, and safeguarding... 

    Applied Methods Ltd

    San Francisco, CA
    1 day ago
  • OpenAI in San Francisco seeks exceptional researchers to push the frontier of safety mitigations, helping derisk frontier models and advance techniques from interpretability, robustness and alignment to ensure safe deployments. This role requires deep technical experience... 

    Triwill Group

    San Francisco, CA
    4 days ago
  • About the Role We’re looking for machine learning researchers who want to shape the frontier of generative models for the atomistic microcosm. You will...  ...bridge the gap between simulation and reality. Prototype, benchmark, and iterate rapidly to transform research ideas into... 
    Work at office

    Achira

    San Francisco, CA
    2 days ago
  • Wheel the World seeks a full-time ML Research Scientist in San Francisco to advance generative AI and quantum computing. This role involves developing theoretical and practical implementations for quantum acceleration in generative models. Ideal candidates should have... 
    Full time
    Visa sponsorship

    Wheel the World

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist - Frontier Benchmarks. Be the first to apply!