Research Scientist - Frontier Benchmarks
JRNLClub
Save “ Research Scientist - Frontier Benchmarks ” at Snorkel AI , track your applications, and ask the Job Agent to rank similar roles for you.
At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data.
We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes since 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler!
ABOUT THE ROLE
We're looking for a Research Scientist to collaborate with partners and lead the development of the next frontier benchmarks and datasets. This is a highly visible, customer-facing role at the intersection of research, company strategy, and go-to-market. You'll design datasets taking into account frontier model performance and work with our academic partners, and then partner with delivery, product and go-to-market to scale out production. You will also serve as a credible technical partner for our customers, prospects, and drive results that impact the broader research community.
This role reports directly to the Head of Research and is ideal for someone who is energized by cross-functional work and wants to understand how startups operate across research, data operations, and commercial teams.
MAIN RESPONSIBILITIES
- Design state of the art datasets that drive frontier model training and evaluation based on current model performance and academic partnerships
- Translate benchmark insights into clear, compelling narratives that articulate the ROI of expert-curated data for customer-facing presentations, technical reports, and go-to-market materials.
- Work cross-functionally with data operations, product, engineering, and strategy to surface research findings that inform the company roadmap.
- Stay at the frontier of LLM evaluation research and bring best practices into Snorkel's workflows
- Represent Snorkel's research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI
PREFERRED QUALIFICATIONS
- Strong research background in AI/ML evaluation, NLP, or related fields, with a track record of rigorous experimental design — especially around measuring the impact of training and evaluation data on model behavior.
- Exceptional communication skills — able to present complex technical findings clearly to both technical and non-technical audiences
- Comfort operating in a fast-moving, cross-functional environment with ambiguous problem spaces
- Genuine interest in GTM strategy, startup dynamics, and the commercial side of AI data services.
- Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered.
Joining Snorkel AI means becoming part of a company that has market proven solutions, robust funding, and is scaling rapidly—offering a unique combination of stability and the excitement of high growth. As a member of our team, you’ll have meaningful opportunities to shape priorities and initiatives, influence key strategic decisions, and directly impact our ongoing success. Whether you’re looking to deepen your technical expertise, explore leadership opportunities, or learn new skills across multiple functions, you’re fully supported in building your career in an environment designed for growth, learning, and shared success.
Snorkel AI is proud to be an Equal Employment Opportunity employer and is committed to building a team that represents a variety of backgrounds, perspectives, and skills. Snorkel AI embraces diversity and provides equal employment opportunities to all employees and applicants for employment. Snorkel AI prohibits discrimination and harassment of any type on the basis of race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local law. All employment is decided on the basis of qualifications, performance, merit, and business need.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
#J-18808-Ljbffr- ...Roboflow is seeking a Research Scientist for Roboflow Labs in San Francisco to work at the intersection of benchmarks, models, and frontier labs, running failure analyses and turning those findings into data and evaluation specs. You will publish, extend RF100-VL, contribute...Suggested
$216k - $270k
Scale Labs, Research Scientist — Frontier Risk EvaluationsAs the leading data and evaluation partner for frontier AI companies, Scale plays an integral... ...team.Nice to have:Experience in crafting evaluations and benchmarks, or a background in data science roles related to LLM...SuggestedFull time$150k - $250k
...rearchitect critical operations for the frontier of AI. Our customers include the largest... ...goods, and global social organizations.We research and deploy technologies that power AI-... ...want to drive incremental improvements on benchmarks or optimize an existing process but...SuggestedWork at office3 days per week- ...Mercor is hiring PhD and Master's scientists to author AI evaluation tasks for a new benchmark in scientific computing. You will author original, executable research problems that today's frontier models cannot solve. Domains require depth in biology with focus on...SuggestedPart timeImmediate start
- ...OpenAI in San Francisco is seeking an Agent Post-Training researcher for Frontier Evals & Environments. You will help build north star model environments to drive progress toward safe AGI/ASI and guide the research programs behind our largest training runs. You will...Suggested
- Plato, an applied AI research lab in the San Francisco Bay Area, is hiring an individual contributor researcher to design safety environments and benchmarks. You will establish a new research direction, measure AI R&D capabilities, and work with engineers to turn designs...Relocation
- ...Cookiy Labs is hiring a researcher to own the science of the company from day one, potentially achieving a co-founder title and equity... ...environments grounded in verified human judgment, and publish benchmarks and post-training results that reflect honest performance, including...
- ...Movendi Inc. seeks a Director of Reality Research to lead independent, frontier AI work and attract top researchers, while avoiding people management duties. The role emphasizes scientific credibility and ambitious breakthroughs. You will define a multi-year research...
- ...keep getting returns from that scale.This role sits squarely across research and engineering. You'll develop next-generation architectures and RL algorithms, take them from a small-scale result to a frontier-scale run, and understand every place they behave differently...Work at officeVisa sponsorshipFlexible hours
$250k
...cells to accelerate cancer research, improve construction site safety... ...(RF-DETR). We build our own benchmarks grounded in real enterprise... ...00-VL). And we partner with frontier labs to deliver the training... ...You'll Do As a Research Scientist at Roboflow Labs, you'll sit...Work at office$380k
...can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI... ...and for society.About the RoleWe are seeking exceptional researchers who can push the frontier of safety mitigations. You will help...Work at officeLocal areaFlexible hours- Snorkel AI is hiring Forward Deployed Researchers who will partner with frontier AI labs on their most challenging data problems. This is a high-impact, customer-facing role that blends deep technical and research credibility with the ability to work directly with customer...
- ...can plan, execute, and adapt in the real world. Mitigating the frontier risks resulting from these capabilities is paramount to OpenAI... ...for society. About the Role We are seeking exceptional researchers who can push the frontier of safety mitigations. You will help...
$130k - $200k
...to local cost of living. Apart Research is hiring a Research Scientist for Manipulation Evals to design,... ...August 2026 the EU AI Office can fine frontier labs up to 3% of global annual... ...author public deliverables (papers, benchmark releases, technical reports) and engage...Work at officeLocal areaRemote workHome officeFlexible hours$165.6k - $207k
...and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise... ...and will focus on building benchmarks and diagnosing model failure modes... ...diagnostic methods that reveal where frontier models fail and why. You will...Full time- ...General Analysis is a frontier security lab focused on evaluating and strengthening frontier AI models against cyberdefense threats. You will lead research into measuring capabilities, mitigating misuse, and developing evaluation methodologies across real-world scenarios...
- ...Halluminate is hiring an experienced Finance expert to join our research team for Applied AI in Financial Services. The role focuses on... ...engineering and research teams, and drive innovations that push the frontier of AI-driven finance tasks and workflows. #J-18808-Ljbffr...
- ...Enclosure is seeking an exceptional AI researcher to own a significant part of our AI research as an IC. We value exploration, curiosity, and grit over formal degrees. You’ll work on frontier AI models, contribute to experiments, and collaborate with security and infrastructure...
$200k - $375k
...Snorkel Snorkel AI is the frontier AI data lab, helping teams build... .... We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for... ...We’re looking for a Research Scientist to advance how high-quality...Local areaRemote work$150k - $200k
...creative preference datasets that power benchmarking, evaluation, and post-training for the... ...independent creatives, Contra Labs connects frontier AI labs with a global network of top... ...exists Contra Labs is expanding its research work with frontier AI labs across...- ...all the places in between. This is where research meets reality. You’ll be responsible... ...Care deeply about evaluation, benchmarking, and failure analysis Are comfortable... ...dexterity. This requires advancing the frontiers of data, models, and hardware, to enable...
- ...with a well-backed AI startup building frontier technology in a high-impact, real-world... ...small, technical, and moving fast, with research sitting right at the core of the product... ...quickly, rather than working purely on benchmarks or papers, this is that kind of environment...
$150k - $250k
...expert datasets, evals and RL environments for frontier AI labs. About the Role We are looking for a Research Scientist - Post Training to join a post-training... ...also contribute to evaluation infrastructure and benchmarks across models, capabilities and domains. This...- Forward Deployed Research Scientist Shape the Future of AI At Labelbox, we're building the critical... ...three integrated solutions for frontier AI development: Enterprise Platform &... ...Applied Research on publications and benchmarks. Our Applied Research team owns the long...Flexible hours
$199k - $325k
...work with AI. About the roleAI research at WRITER isn't just about... ...world. As an AI research scientist, you'll be at the center of... ...workflowsBuild novel evaluation benchmarks and methodologies that push... ...representing WRITER at the frontier of the field and contributing...Full timeWork at officeLocal area$160k - $220k
...year runway.About the RoleWe’re looking for an AI Research Scientist to advance the methodological frontier of AI in healthcare. This role is ideal for someone... ...healthcare validation standards are higher than benchmark culture alone, and you are energized by the opportunity...Temporary workWork at officeMonday to FridayMonday to Thursday- Scale AI, Inc. seeks Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) and evaluation. The role focuses on building benchmarks and diagnosing model failure modes in text and multimodal modalities within the GenAI...
- ...and diagnostics by bringing frontier AI into clinical practice. We... ...daily U.S. X-rays. Our research team brings experience from... ...Research Engineer or Research Scientist to advance how we curate data... ...to developing rigorous benchmarks for radiology report generation...
- Prime Intellect AI is building the open frontier AI stack and seeks researchers to develop continual learning systems and evaluate agent trajectories, corrections, and failures to generate new tasks and model updates. You will compare streaming RL, batched post-training...
- OpenAI is seeking researchers and engineers to advance frontier-model research with a focus on safety and alignment. You will train and evaluate models, identify misalignments, and develop scalable measurement and evaluation pipelines to turn failures into safety signals...Relocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist - Frontier Benchmarks. Be the first to apply!
- research scientist machine learning deep learning San Francisco, CA
- image scientist San Francisco, CA
- health scientist San Francisco, CA
- regulatory scientist San Francisco, CA
- scientist biology San Francisco, CA
- drug safety scientist San Francisco, CA
- research associate scientist San Francisco, CA
- lead scientist San Francisco, CA
- principal applied scientist San Francisco, CA
- entry level research scientist San Francisco, CA



