Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist - Frontier Benchmarks

$200k - $325k

Snorkel AI

About Snorkel At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data. We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes between 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler! About the Role We're looking for a Research Scientist to collaborate with partners and lead the development of the next frontier benchmarks and datasets. This is a highly visible, customer-facing role at the intersection of research, company strategy, and go-to-market. You'll design datasets taking into account frontier model performance and work with our academic partners, and then partner with delivery, product and go-to-market to scale out production. You will also serve as a credible technical partner for our customers, prospects, and drive results that impact the broader research community. This role reports directly to the Head of Research and is ideal for someone who is energized by cross-functional work and wants to understand how startups operate across research, data operations, and commercial teams. Main Responsibilities Design state of the art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships Translate benchmark insights into clear, compelling narratives that articulate the ROI of expert-curated data for customer-facing presentations, technical reports, and go-to-market materials. Work cross-functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap. Stay at the frontier of LLM evaluation research and bring best practices into Snorkel's workflows Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI Preferred Qualifications Strong research background in AI/ML evaluation, NLP, or related fields, with a track record of rigorous experimental design — especially around measuring the impact of training and evaluation data on model behavior. Exceptional communication skills — able to present complex technical findings clearly to both technical and non-technical audiences Comfort operating in a fast-moving, cross-functional environment with ambiguous problem spaces Genuine interest in GTM strategy, startup dynamics, and the commercial side of AI data services. Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered. Salary Range

$200,000 - $325,000 USD

Growth Opportunities Joining Snorkel AI means becoming part of a company that has market-proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success. Equal Employment Opportunity Statement Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. #J-18808-Ljbffr Snorkel AI

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Scientist - Frontier Benchmarks in San Francisco, CA vacancy
  • $216k - $270k

    Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral...  ...team.Nice to have:Experience in crafting evaluations and benchmarks, or a background in data science roles related to LLM... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    2 days ago
  • $250k

     ...data and evaluation infrastructure that frontier AI labs use to make their models better....  ...rigorous evaluations that go beyond static benchmarks. We are a small, early team (post Series...  ...and measured. Working directly with research teams at top AI labs, you’ll experiment... 
    Suggested

    AfterQuery

    San Francisco, CA
    2 days ago
  •  ...computing offers a path through these bottlenecks. As an ML Research Scientist, you'll work at the frontier of generative modeling and quantum acceleration,...  ..., denoising, and likelihood estimation Develop and benchmark novel solver methods for diffusion ODEs/SDEs Quantum... 
    Suggested
    Full time
    Casual work
    Visa sponsorship

    Wheel the World

    San Francisco, CA
    4 days ago
  • Cincinnatus LLC is recruiting researchers to design and author multi-step evaluation tasks for frontier AI benchmarks. The role emphasizes translating scientific method into practical tasks, with a focus on Python-based analysis, rigorous evaluation, and clear written conclusions... 
    Suggested
    Remote job
    Full time
    Part time

    Obsidian

    San Francisco, CA
    1 day ago
  •  ...profound global impact. About the Role Frontier AI is moving toward scientific...  ...for this next era. We are looking for a Research Scientist who can help define Quantum AI: not just...  ...propose, test, and refine hypotheses. Benchmarking frameworks that reveal when a new computational... 
    Suggested
    Casual work
    Visa sponsorship

    Sygaldry

    San Francisco, CA
    4 days ago
  • $150k - $250k

     ...rearchitect critical operations for the frontier of AI. Our customers include the largest...  ...goods, and global social organizations.We research and deploy technologies that power AI-...  ...want to drive incremental improvements on benchmarks or optimize an existing process but... 
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    1 day ago
  • Infinity is building ResearchBench, a high-quality research-replication benchmark. A decomposition-and-testing agent converts papers into roughly 400 leaves across datasets, compute, and function implementation. A separate harness then runs backends like Claude Code, Codex... 

    Infinity Artificial Intelligence Institute

    San Francisco, CA
    3 hours ago
  • Traverse is a research data lab building reinforcement learning environments for frontier AI labs. As a Research Scientist, you will design and build RL environments that teach models to do work that has historically required years of human expertise. You’ll work at the... 

    Traverse

    San Francisco, CA
    2 days ago
  • United States Digital Space LLC is seeking energetic researchers and engineers to join their Secure Intelligence Institute (SII). You'll...  ...conduct impactful research to improve the security and privacy of frontier intelligence systems. Responsibilities include developing... 

    United States Digital Space LLC

    San Francisco, CA
    2 days ago
  •  ...Researcher Position at Hedra Hedra is building a world-class Physical AI research team...  ...researchers who are excited to go beyond benchmarks and build models that operate in the...  ...research into production Stay at the frontier of the field — synthesizing relevant literature... 
    Work at office

    HEDRA INC

    San Francisco, CA
    12 hours ago
  • $320k

     ...is a quickly growing group of committed researchers, engineers, policy experts, and...  ...beneficial AI systems. About the Team The Frontier Red Team (FRT) is a small, focused technical...  ...massive threat surface. As a Research Scientist on FRT focusing on cyber, you'll build... 
    Work at office
    Relocation
    Visa sponsorship
    Flexible hours

    Neura Market

    San Francisco, CA
    1 day ago
  • $234.3k - $349k

     ...work with AI. About the roleAI research at WRITER isn't just about...  ...world. As an AI research scientist, you'll be at the center of...  ...workflowsBuild novel evaluation benchmarks and methodologies that push...  ...representing WRITER at the frontier of the field and contributing... 
    Full time
    Work at office
    Local area

    Writer

    San Francisco, CA
    3 days ago
  • $160k - $220k

     ...year runway.About the RoleWe’re looking for an AI Research Scientist to advance the methodological frontier of AI in healthcare. This role is ideal for someone...  ...healthcare validation standards are higher than benchmark culture alone, and you are energized by the opportunity... 
    Temporary work
    Work at office
    Monday to Friday
    Monday to Thursday

    Sprinter Health

    San Francisco, CA
    3 days ago
  • Velvet is a data research company building the datasets that power the next...  ...quality audiovisual training data for frontier labs. We’re hiring a Research Scientist to develop and fine‑tune models...  ...Build evaluation frameworks and benchmarks to rigorously measure enhancement... 
    Immediate start
    Shift work

    Velvet

    San Francisco, CA
    1 day ago
  • $250k - $400k

     ...stealth AI start-up building frontier reasoning models for...  ...genuinely novel AI for Science research, combining frontier reasoning...  ...Building evaluation frameworks and benchmarks for complex, multi-step...  ...Researcher or experienced Research Scientist. What matters most is hands‑... 

    techire ai

    San Francisco, CA
    1 day ago
  • $140k - $200k

     ...breakthrough AI models at leading research labs and enterprises. Since...  ...integrated solutions for frontier AI development: Enterprise...  ...not a traditional research scientist role. You will not spend months...  ...with evaluation and benchmarking of LLMs — designing metrics,... 
    Work at office
    Flexible hours
    2 days per week

    Labelbox

    San Francisco, CA
    1 day ago
  • The role As a research scientist, you will design, implement, and optimize the large-scale training infrastructure that powers our frontier reinforcement learning stack. This is systems work at...  ...partners like Kleiner Perkins, Benchmark, Sequoia, Lux, and Greenoaks. Who... 
    Work at office
    Visa sponsorship
    Relocation package

    Applied Compute

    San Francisco, CA
    1 day ago
  • $125k - $225k

    FutureSearch is looking for exceptional Research Scientists to evaluate and improve state-of-the-...  ...of engineers and researchers at the frontier of AI epistemics. We have the best publicly...  ...ICLR Workshop paper in Jan 2026, and benchmarks like Deep Research Bench and Bench to... 
    Remote work
    Flexible hours

    Futuresearch

    San Francisco, CA
    2 days ago
  •  ...applying those ideas to one of the next frontiers in machine learning. At Granica, we're...  ...from structured information at scale. Our research is led by Prof. Andrea Montanari (...  ...approaches. Design rigorous experiments and benchmarks to measure model quality and efficiency.... 
    Work at office

    Granica Computing, Inc.

    San Francisco, CA
    3 hours ago
  • $300k - $320k

     ...growing group of committed researchers, engineers, policy experts,...  ...seeking an exceptional Research Scientist to join our Life Sciences...  ...model training objectives, benchmarks, and agentic workflows. You’...  ...accelerated biology while shaping how frontier models reason about and... 
    Visa sponsorship

    Anthropic

    San Francisco, CA
    3 days ago
  •  ...enterprises. We aim to push the frontier of AI that understands real,...  ...role is for an experienced scientist who thrives both in...  ...and deep content extraction. Research, evaluate, and integrate the...  ...product impact. Develop new benchmarks, datasets, and evaluation methodologies... 

    Tensorlake Inc.

    San Francisco, CA
    1 day ago
  • # Researcher, Frontier Cybersecurity RisksOn-siteSan FranciscoAll jobsOn-site jobsCybersecurity Jobs## SkillsAI SafetyCybersecurityDeep LearningTransformer ModelsPyTorchTensorFlowData StructuresAlgorithmsSoftware Engineering PrinciplesLarge Language ModelsSupervised Fine... 

    Triwill Group

    San Francisco, CA
    2 days ago
  • OpenAI is seeking a Researcher for Frontier Cybersecurity Risks to design and implement an end-to-end mitigation stack that reduces severe cyber misuse across OpenAI products. The role requires deep technical expertise in deep learning, transformer models, and safeguarding... 

    Applied Methods Ltd

    San Francisco, CA
    4 days ago
  • OpenAI in San Francisco seeks exceptional researchers to push the frontier of safety mitigations, helping derisk frontier models and advance techniques from interpretability, robustness and alignment to ensure safe deployments. This role requires deep technical experience... 

    Triwill Group

    San Francisco, CA
    2 days ago
  • Crucibl is building judgment at scale for enterprise AI. You will push the frontier of how models reason on high-stakes business decisions, and translate findings into testable experiments that inform product direction. You’ll design evaluation frameworks for uncertainty... 

    Crucibl

    San Francisco, CA
    1 day ago
  • DataAnnotation is seeking a Clinical Data Scientist for a remote contract role to evaluate AI-generated quantitative analyses and create benchmark problems for training AI systems. You will assess AI outputs, develop training problems across forecasting, experiment design... 
    Remote job
    Contract work

    DataAnnotation

    San Francisco, CA
    12 hours ago
  • $225k - $400k

    ABOUT THE ROLE This is a research-driven, high-impact role for ML researchers who want...  ...into working prototypes. Evaluation & Benchmarking - Design novel evaluation frameworks, datasets...  ...conversational quality. Advance the Frontier - Stay at the cutting edge of ML... 
    H1b
    Relocation

    Retell AI

    San Francisco, CA
    3 hours ago
  • Harnham is seeking a Research Scientist to tackle frontier problems in world models and RL at an on-site SF lab. This role emphasizes shipping research into real products with a data-driven approach and close collaboration with a stealth AI team. You will own end-to-end... 
    Relocation package

    Harnham

    San Francisco, CA
    3 hours ago
  • Merge Labs is a frontier research lab with the mission of bridging biological and artificial intelligence...  ...collaborates extensively with wet-lab scientists, automation engineers, and data...  ...using internal and public datasets; benchmark and validate model performance.... 

    Merge Labs

    San Francisco, CA
    1 day ago
  • $150k - $250k

    AfterQuery — Research Scientist, Post-Training Type: Full-time | On-site | San Francisco, CA Compensation...  ...and evaluation infrastructure that frontier AI labs use to improve their models....  ...evaluations that go beyond static benchmarks. Post-Series A, they've raised $30M at... 
    Full time
    Internship
    Visa sponsorship
    Shift work

    davidjoseph-co

    San Francisco, CA
    3 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist - Frontier Benchmarks. Be the first to apply!