Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist - Frontier Benchmarks

$200k - $325k

Neura Market

About the Role We're looking for a Research Scientist to collaborate with partners and lead the development of the next frontier benchmarks and datasets. This is a highly visible, customer-facing role at the intersection of research, company strategy, and go-to-market. You'll design datasets taking into account frontier model performance and work with our academic partners, and then partner with delivery, product and go-to-market to scale out production. You will also serve as a credible technical partner for our customers, prospects, and drive results that impact the broader research community. This role reports directly to the Head of Research and is ideal for someone who is energized by cross‑functional work and wants to understand how startups operate across research, data operations, and commercial teams. Main Responsibilities Design state of the art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships Translate benchmark insights into clear, compelling narratives that articulate the ROI of expert‑curated data for customer‑facing presentations, technical reports, and go‑to‑market materials. Work cross‑functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap. Stay at the frontier of LLM evaluation research and bring best practices into Snorkel's workflows. Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data‑centric AI. Preferred Qualifications Strong research background in AI/ML evaluation, NLP, or related fields, with a track record of rigorous experimental design — especially around measuring the impact of training and evaluation data on model behavior. Exceptional communication skills — able to present complex technical findings clearly to both technical and non‑technical audiences. Comfort operating in a fast‑moving, cross‑functional environment with ambiguous problem spaces. Genuine interest in GTM strategy, startup dynamics, and the commercial side of AI data services. Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered. Salary Salary Range: $200,000 - $325,000 USD Equal Employment Opportunity Statement Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. #J-18808-Ljbffr Neura Market

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Research Scientist - Frontier Benchmarks in San Francisco, CA vacancy
  • $200k - $325k

    Neura Market is seeking a Research Scientist to lead the development of benchmarks and datasets that impact the research community. The role involves designing datasets, collaborating with partners, and impacting the company strategy. Candidates should have a strong AI... 
    Suggested

    Neura Market

    San Francisco, CA
    5 days ago
  •  ...computing offers a path through these bottlenecks. As an ML Research Scientist, you'll work at the frontier of generative modeling and quantum acceleration,...  ..., denoising, and likelihood estimation Develop and benchmark novel solver methods for diffusion ODEs/SDEs Quantum... 
    Suggested
    Full time
    Casual work
    Visa sponsorship

    Wheel the World

    San Francisco, CA
    2 days ago
  • $250k

     ...data and evaluation infrastructure that frontier AI labs use to make their models better....  ...rigorous evaluations that go beyond static benchmarks. We are a small, early team (post Series...  ...and measured. Working directly with research teams at top AI labs, you’ll experiment... 
    Suggested

    AfterQuery

    San Francisco, CA
    5 days ago
  • $174k - $253k

    Research Scientist, Frontier Safety Loss of Control, DeepMind DeepMind San Francisco, CA, USA X Applicants in San Francisco: Qualified applications with arrest or conviction records will be considered for employment in accordance with the San Francisco Fair Chance Ordinance... 
    Suggested

    Google Inc.

    San Francisco, CA
    4 days ago
  • $150k - $250k

     ...fast-growing AI infrastructure company as a Research Scientist, designing the datasets and evaluation frameworks that shape how frontier AI models are trained and measured....  ...environment company, AI safety organization, or benchmarking organization - Background in evaluation... 
    Suggested
    Internship

    Direct Line Workforce Solutions

    San Francisco, CA
    6 days ago
  • United States Digital Space LLC is seeking energetic researchers and engineers to join their Secure Intelligence Institute (SII). You'll...  ...conduct impactful research to improve the security and privacy of frontier intelligence systems. Responsibilities include developing... 

    United States Digital Space LLC

    San Francisco, CA
    5 days ago
  • Research Scientist / Machine Learning Scientist Location:SF Bay Area/Hybrid / Remote Type:Full-...  ...protocols that go beyond traditional benchmarks • Analyze large-scale human voting and...  ...referenced by industry leaders pushing the frontier of safe and reliable AI. Sundar Pichai... 
    Full time
    Remote work

    Lead Allies Inc

    San Francisco, CA
    5 days ago
  •  ...Hedra is building a world-class Physical AI research team to push the boundaries of action-...  ...who are excited to go beyond benchmarks and build models that operate in the real...  ...move research into production Stay at the frontier of the field — synthesizing relevant literature... 
    Work at office

    Hedra, Inc

    San Francisco, CA
    3 days ago
  •  ...enterprises. We aim to push the frontier of AI that understands real,...  ...role is for an experienced scientist who thrives both in...  ...and deep content extraction. Research, evaluate, and integrate the...  ...product impact. Develop new benchmarks, datasets, and evaluation methodologies... 

    Tensorlake Inc.

    San Francisco, CA
    4 days ago
  • $200k - $250k

     ...Safety (CAIS) is a leading research and advocacy organization focused...  ...Fund. As a Senior Research Scientist here, you will lead and...  ...the safety and reliability of frontier AI systems, taking ownership...  ...and maintain datasets and benchmarks. Run distributed training and... 
    Work at office
    Local area

    Center for AI Safety

    San Francisco, CA
    6 days ago
  • OpenAI is looking for a Researcher for Frontier Evals & Environments to help develop model environments that drive progress towards safe AGI/ASI. In this role, you will lead efforts to define research programs and evaluate results, influencing product development. You will... 

    OpenAI

    San Francisco, CA
    4 days ago
  • Merge Labs is a frontier research lab with the mission of bridging biological and artificial intelligence...  ...collaborates extensively with wet-lab scientists, automation engineers, and data...  ...using internal and public datasets; benchmark and validate model performance.... 

    Merge Labs

    San Francisco, CA
    4 days ago
  •  .... Founded by engineers and researchers who dreamed of building the...  ...evaluations that go beyond benchmarks. We've run a profitable business...  .... The Role As a Research Scientist focused on data, you’ll work...  ...the datasets that shape how frontier models behave. You’ll partner... 

    Prophet Town

    San Francisco, CA
    2 days ago
  • $300k - $320k

     ...growing group of committed researchers, engineers, policy experts,...  ...seeking an exceptional Research Scientist to join our Life Sciences...  ...model training objectives, benchmarks, and agentic workflows. You'...  ...accelerated biology while shaping how frontier models reason about and... 
    Visa sponsorship

    United States Digital Space LLC

    San Francisco, CA
    4 days ago
  • Wheel the World seeks a full-time ML Research Scientist in San Francisco to advance generative AI and quantum computing. This role involves developing theoretical and practical implementations for quantum acceleration in generative models. Ideal candidates should have... 
    Full time
    Visa sponsorship

    Wheel the World

    San Francisco, CA
    2 days ago
  • $225k - $400k

    ABOUT THE ROLE This is a research-driven, high-impact role for ML researchers who want...  ...into working prototypes. Evaluation & Benchmarking - Design novel evaluation frameworks, datasets...  ...conversational quality. Advance the Frontier - Stay at the cutting edge of ML... 
    H1b
    Relocation

    Retell AI

    San Francisco, CA
    3 days ago
  •  ...all the places in between. This is where research meets reality. You’ll be responsible...  ...systems Care deeply about evaluation, benchmarking, and failure analysis Are comfortable...  ...dexterity. This requires advancing the frontiers of data, models, and hardware, to enable... 

    Generalist

    San Francisco, CA
    2 days ago
  • $250k

     ...and evaluation infrastructure that frontier AI labs use to improve their...  ...evaluations that go beyond static benchmarks. We're a small, early team (post‑...  ...re building out our post‑training research team and hiring 2-3 Research Scientists to work together on this mission.... 
    Internship
    Shift work

    Ersilia

    San Francisco, CA
    3 days ago
  • $400k

    A dynamic technology company in San Francisco is seeking innovative individuals to push the boundaries of AI research. Candidates should have a PhD and experience in long-horizon reasoning and reinforcement learning. The role involves building systems to outperform existing... 

    Trades Workforce Solutions

    San Francisco, CA
    6 days ago
  •  ...datasets. This is a rare intersection of frontier AI and real-world scientific impact....  ...mode. The Role We’re looking for research scientists who want to work at the intersection of...  ...Evaluation: Contributing to meaningful benchmarks and evaluation methods for domain-specific... 

    Xterraai

    San Francisco, CA
    4 days ago
  • Google Inc. in San Francisco, CA is seeking a Research Scientist at DeepMind to conduct cutting-edge AI research. This role involves identifying potential risks from AI agents and ensuring robust safety protocols are established. Candidates should have a strong background... 

    Google Inc.

    San Francisco, CA
    4 days ago
  •  ...we are building a team of world-class scientists, ML researchers, and engineers to work together to...  .... We are actively exploring the next frontier of model architectures for AI x Chemistry...  ...simulation and reality. Prototype, benchmark, and iterate rapidly to transform... 
    Full time
    Work at office

    Achira

    San Francisco, CA
    2 days ago
  •  ...Team The Future of Computing Research team is an applied research team...  ...of computing. We work at the frontier of multimodal AI, helping...  ...looking for a Research Engineer / Scientist to join the Future of...  ...: success is not just higher benchmark performance, but better model... 
    Work at office
    Immediate start
    Relocation package

    Slope

    San Francisco, CA
    6 days ago
  • $60 per hour

     ...Responsibilities - Be part of a team of multidisciplinary Research Scientists and Engineers using an AI-first approach to enable safe self...  ...- Lead or contribute to an AI research project, pushing the frontiers of the field by developing new algorithms for Autonomous Vehicle... 
    Hourly pay
    Work experience placement
    Internship
    Work at office

    Waabi

    San Francisco, CA
    3 days ago
  •  ...conformational sampling. Why Achira Join a world-class team of researchers, scientists, and engineers unifying probabilistic AI/ML and molecular...  ...mechanisms informed by physical priors. Operate at the frontier scale of large models, large datasets, and high-throughput... 

    Achira

    San Francisco, CA
    5 days ago
  • About Chai Discovery Chai Discovery builds frontier AI models to design molecules and...  ...founding team brought together leading researchers in this space and top silicon valley operators...  .... About the role As an AI Research Scientist, you will conduct groundbreaking... 

    Chaidiscovery

    San Francisco, CA
    4 days ago
  • Founding Research Scientist, Human Simulation TL;DR: Listen is building the human layer of AI: a preference model trained on millions of real...  ..., or adjacent fields. Or equivalent industrial impact at a frontier lab. You pick the problems. This is a founding research... 
    Flexible hours
    Shift work

    AI Chopping Block, Inc.

    San Francisco, CA
    5 days ago
  • $100k - $300k

     ...critical breaches occur. To stay at the cutting edge, we blend frontier research with real-world execution. Alongside our core product work,...  ...AI lab at the heart of Cogent's mission. As a Research Scientist, you will drive foundational and applied research at the frontier... 

    Cogent Security

    San Francisco, CA
    4 days ago
  • About Phonic Phonic is a product and research lab focused on powering the most realistic,...  ...emotionally and perform agentic tasks with frontier intelligence. Our team includes top‑...  ...SF office. About The Role As a Research Scientist at Phonic, you'll drive original... 
    Work at office

    Phonic, Inc.

    San Francisco, CA
    5 days ago
  •  ...well known in the AI community for seminal research accomplishments at top AI labs, have run...  ...a highly experienced AI Research Scientist to play a crucial role in the development...  ...What We Offer Highly engaging work at the frontier of AI-driven drug discovery that will fundamentally... 

    Menlo Ventures

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist - Frontier Benchmarks. Be the first to apply!