Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Lead, Open Benchmarks Grants [Remote]

$231k - $390k

Snorkel AI

About Snorkel

Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes. 

Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!

About Open Benchmarks Grants

Open Benchmarks Grants is Snorkel’s $30M commitment to fund and support researchers and independent builders developing new AI evaluations. We support the teams behind Terminal-Bench, OSWorld 2.0, and Senior SWE-bench, and run a Research Fellows program for PhD students and postdocs. The program funds work in areas including physical AI, scientific discovery, cybersecurity, safety, and alignment, and helps teams test and strengthen their benchmarks before public release.

What you’ll do

  • Shape our research bets in open benchmarks & evaluation. Identify gaps in how frontier AI is evaluated. Review proposals with Snorkel’s senior researchers, work with prospective collaborators to strengthen their ideas, and help decide where we allocate our Open Benchmark Grants.
  • Advance frontier evaluation research with our research partners. Work alongside grantees, Research Fellows, and Snorkel research leads to define what each benchmark measures, design tasks and experiments, and turn learnings into artifacts that other researchers can build on.
  • Drive adoption and scientific exchange with frontier labs. Work directly with lab researchers to understand what they need to measure, help them integrate and interpret the benchmarks we support, and use their findings to inform subsequent research.

What we’re looking for

  • A research track record in evaluation. You’ve led or made substantial contributions to benchmarks, evaluation methods, or environments that researchers or model-development teams use. 
  • Technical judgment about quality & experimental rigor. You can assess whether an evaluation measures what it claims, recognize alternative explanations for a result, and design experiments that resolve the uncertainty. You know which limitations matter enough to change the research direction.
  • Hands-on technical depth. You’re comfortable moving between research questions and implementation: building experiments, inspecting tasks and harnesses, debugging verifiers, and analyzing model behavior.
  • The ability to lead through research collaboration. You’ve helped other researchers make difficult technical decisions and bring work to completion. 
  • Clear technical communication. Your papers, research artifacts, specifications, or reviews make complex ideas understandable and claims precise. 

Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.

Salary range(s) for this role

$231,000—$390,000 USD

Be Your Best at Snorkel

Joining Snorkel AI means becoming part of a company that has market proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success.

Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Research Lead, Open Benchmarks Grants [Remote] in San Francisco, CA vacancy
  • $200k - $340k

     ...We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions...  ...in 2019, Snorkel works with leading AI labs and enterprises to move...  ...the newest Snorkeler! About Open Benchmarks Grants Open Benchmarks Grants is... 
    Grants
    Remote job
    Local area

    Snorkel AI

    San Francisco, CA
    22 hours ago
  • $290k

     ...FAR.AI is a non-profit AI research institute working to ensure advanced...  ...papers , and convened leading AI safety events . Our work...  ...the community through targeted grants to technical researchers....  ...initially CBRN misuse, especially for open-weight models), backdoor... 
    Grants
    Full time
    For contractors
    Work at office
    Remote work
    Work from home
    Visa sponsorship

    far.ai

    Berkeley, CA
    4 days ago
  • $163k - $280k

     ...We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions...  ...in 2019, Snorkel works with leading AI labs and enterprises to move...  ...the newest Snorkeler! About Open Benchmarks Grants Open Benchmarks Grants is... 
    Grants
    Remote job
    Local area

    Snorkel AI

    San Francisco, CA
    22 hours ago
  •  ...alongside the world’s leading AI labs. Now, we’re bringing...  ...standards. Our APEX benchmarks measure how AI...  ...another, collaborate openly, and share a commitment...  ...About the Role As a Research Engineer at Mercor, you...  ...structure ~ Generous equity grant vested over 4 years... 
    Grants
    Full time
    Work at office
    Local area
    Relocation package

    mercor

    San Francisco, CA
    3 days ago
  •  ...model training through edge deployment on Jetson AGX Orin. Every research project will have a deployment milestone. This is not a lab...  ...and learning-from-demonstration systems. Fine-tune and adapt open-source VLA/foundation models for our robot platform. Build scalable... 
    Suggested
    Shift work

    Origin

    San Francisco, CA
    1 day ago
  •  ...alongside the world’s leading AI labs. Now, we’re bringing...  ...standards. Our APEX benchmarks measure how AI...  ...another, collaborate openly, and share a commitment...  ...We’re looking for a Research Scientist to lead the...  ...structure ~ Generous equity grant vested over 4 years... 
    Grants
    Full time
    Work at office
    Local area
    Relocation package

    mercor

    San Francisco, CA
    3 days ago
  • $134k - $190k

     ...autonomy, having accountability and being open to new perspectives are essential to our...  ...Why This Role, Why Now Braze is the leading customer engagement platform, helping the...  ...Total Rewards package that includes equity grants of restricted stock (RSUs) so that you will... 
    Grants
    Work at office
    Local area
    Flexible hours

    Braze

    San Francisco, CA
    8 days ago
  • $300k - $400k

     ...infrastructure alongside the worlds leading AI labs. Now were bringing...  ...and standards. Our APEX benchmarks measure how AI performs on economically...  ...one another collaborate openly and share a commitment to...  ...Benefits: ~ Generous equity grant vested over 4 years ~... 
    Grants
    Full time
    Local area
    Relocation package

    Mercor

    San Francisco, CA
    2 days ago
  •  ...infrastructure alongside the world’s leading AI labs. Now, we’re bringing...  ...and standards. Our APEX benchmarks measure how AI performs on...  ...challenge one another, collaborate openly, and share a commitment to...  ...~ Generous equity grant vested over 4 years ~ Up to... 
    Grants
    Full time
    Work at office
    Local area
    Relocation package

    mercor

    San Francisco, CA
    3 days ago
  •  ...AfterQuery is an applied research lab curating data...  ...Francisco and backed by leading investors including Altos...  ...research programs: public benchmark releases,...  ...including fellowships, grants, and joint research projects...  ...public leaderboards or open research communities.... 
    Grants
    Full time
    For contractors
    Local area

    AfterQuery

    San Francisco, CA
    4 days ago
  •  ...infrastructure alongside the world’s leading AI labs. Now, we’re bringing...  ...and standards. Our APEX benchmarks measure how AI performs on...  ...challenge one another, collaborate openly, and share a commitment to...  ...- $185k ~ Generous equity grant vested over 4 years ~ Up to... 
    Grants
    Hourly pay
    Full time
    Work at office
    Local area
    Relocation package

    mercor

    San Francisco, CA
    3 days ago
  • $290k

     ...FAR.AI is a non-profit AI research institute working to ensure advanced...  ...papers , and convened leading AI safety events . Our work...  ...the community through targeted grants to technical researchers....  ...promising way to prevent misuse of open-weight models in areas such as... 
    Grants
    Remote job
    Full time
    For contractors
    Work at office
    Visa sponsorship
    Shift work

    far.ai

    Berkeley, CA
    3 days ago
  • $240k - $295k

     ...Summary: As the Applied Science Platform Lead , you’ll lead the platform sub-team...  ...needs into platform capabilities and balance research depth, timelines, and impact. Nice...  ...$240,000 to $295,000 + meaningful Equity Grant. Compensation decisions are dependent... 
    Grants
    Remote job
    Full time
    Temporary work
    H1b
    Work at office
    Visa sponsorship
    Work visa
    Flexible hours

    standinsurance

    San Francisco, CA
    3 days ago
  •  ...infrastructure alongside the world’s leading AI labs. Now, we’re bringing...  ...and standards. Our APEX benchmarks measure how AI performs on...  ...challenge one another, collaborate openly, and share a commitment to...  ...~ Generous equity grant vested over 4 years ~ Up to... 
    Grants
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    Relocation package

    mercor

    San Francisco, CA
    3 days ago
  • $185k - $220k

    Backed by leading Silicon Valley investors, Peregrine helps public safety organizations,...  ...Establish compensation bands backed by market benchmarks and internal equity principles.Own the...  ...new-hire, promotion, and refresh equity grants, balancing attraction and retention... 
    Grants
    Work at office
    Local area
    Flexible hours

    Peregrine Technologies

    San Francisco, CA
    2 days ago
  • $150k - $190k

     ...volunteer their time and skills to maximize grant effectiveness. You can read more here...  ...opportunities and major pitches.· Leading internal demonstrations, enablement sessions...  ...learning.· Set clear expectations, performance benchmarks, and development paths for direct... 
    Grants
    Local area

    Lewis

    San Francisco, CA
    2 days ago
  • $175.9k - $219.9k

     ...Role Matters Pacific Fusion is seeking an expert Fabrication Lead - Vacuum Systems to oversee the end-to-end delivery of vacuum chamber...  ...lawful permanent residents (green card holders), and asylees and refugees with such status granted, not pending. #J-18808-Ljbffr... 
    Grants
    Permanent employment

    Pacific Fusion

    San Francisco, CA
    5 days ago
  • $259.2k - $324k

    Scale Labs, Research Scientist — AI Safety and AlignmentAs the leading data and evaluation partner for frontier...  ...some of the hardest open problems in AI safety:...  ...evaluations and benchmarks, or building tools and...  ...eligible roles are also granted equity based compensation... 
    Grants
    Full time

    Scale AI

    San Francisco, CA
    19 hours ago
  • Foster America is seeking a Development & Communications Manager to lead fundraising storytelling, grant writing, and donor relations. You will report to the Founder and Executive Director and help develop annual and three-year development plans that scale our fellowship... 
    Grants
    Full time

    Foster America

    San Francisco, CA
    17 hours ago
  •  ...Vice President & Federal Practice Lead About the Company Mission-driven organization advocating evidence-based policymaking &...  ...candidate will oversee the federal practice team, its budget and grant deliverables, performance management, and continuous improvement... 
    Grants
    Full time

    Confidential

    San Francisco, CA
    3 days ago
  •  ...a Senior Program Officer to implement regional funding programs for Wikimedian communities in Sub-Saharan Africa. You will oversee grant portfolios, build regional funding committees, and collaborate across Foundation teams to advance Knowledge Equity. The role emphasizes... 
    Grants
    Remote work

    Wikimedia Foundation, Inc.

    San Francisco, CA
    5 days ago
  • $259.2k - $324k

     ...years, Scale has been the leading AI data foundry,...  ...team, part of Scale’s Research organization, brings together...  ...RL reward signals, benchmarking autonomous agent...  ...Hands-on experience with open source LLM fine-tuning...  ...eligible roles are also granted equity based... 
    Grants
    Full time

    Scale AI

    San Francisco, CA
    5 days ago
  • $155k - $180k

     ...workforce strategy. You will lead high-impact hiring initiatives...  ...infrastructure, data science, and research domains.Lead complex offer...  ...not limited to external market benchmark data, geographic location, and...  ...for an annual bonus and equity grant.Work Environment &... 
    Grants
    Work at office
    Local area
    Flexible hours
    2 days per week

    OpenTable

    San Francisco, CA
    4 days ago
  • STGi is seeking a Lead Early Childhood Specialist to support Head Start Training and Technical Assistance in Region 9. The role is remote...  ...will provide expert TA, trainings, and policy development for grant recipients. The position emphasizes collaboration with HS/EHS... 
    Grants
    Remote job

    STG International, Inc.

    San Francisco, CA
    3 days ago
  • $164k - $225.5k

     ...join ours.About this roleWe are looking for a Strategy & Analytics Lead to drive mission critical product and business decisions. This...  ...will directly drive positive impact for Faire and our customers.Open rolesWe have multiple openings across this team, and use a general... 
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    2 days ago
  •  ...and production capability for leading robotics companies and...  ...Diagnostic instinct: you isolate opens, shorts, binding, and misalignment...  ...engineers, robotics researchers, and software engineers sit in...  ...employees in eligible roles are also granted equity based compensation,... 
    Grants
    Temporary work
    Work at office
    Flexible hours

    Foundry Robotics

    Emeryville, CA
    4 days ago
  •  ...Raza Centro Legal is seeking an Immigration Managing Attorney to lead a team of 4+ attorneys and support staff in San Francisco. The...  ...supervise volunteers and contribute to community education and grant reporting. Requirements include a J.D. #J-18808-Ljbffr La Raza... 
    Grants

    La Raza Centro Legal, San Fr

    San Francisco, CA
    3 days ago
  • $150k - $300k

     ...Prime Intellect is building the open superintelligence stack: the...  ...horizon tasks like autonomous research, and the full-stack platform our...  ...exist yet. Role Impact Lead an Applied Research team that...  ...Publications, open-source systems, benchmarks and shipped products can all... 
    Full time
    Work at office
    Visa sponsorship
    Relocation package
    Flexible hours

    PrimeIntellect

    San Francisco, CA
    3 days ago
  •  ...about as well. If you want to have your research come into contact with reality, Ando is...  ...Evaluating that judgment means building benchmarks where the ground truth includes silence...  ...& other health perks Generous equity grant vested over 4 years Health, dental, vision... 
    Grants
    Full time
    Work from home

    ando

    San Francisco, CA
    4 days ago
  •  ...and the surgeons, healthcare providers, researchers, and surgical societies that we serve. The...  ...comparative surgical modalities (robotic-assisted, open, and laparoscopy) Maintain working...  ...Understanding of Intuitive research grant pathways and other mechanisms for research... 
    Grants
    Work experience placement
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours

    Intuitive

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Lead, Open Benchmarks Grants [Remote]. Be the first to apply!