Staff Data Scientist, LLM Data Quality & Evaluation
Cohere
Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation. The ideal candidate will have strong software engineering and statistical skills, along with experience in machine learning frameworks. Applicants from diverse backgrounds are encouraged to apply! #J-18808-Ljbffr Cohere
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Staff Data Scientist, LLM Data Quality & Evaluation in San Francisco, CA vacancy
- ...enterprise AI company, is hiring a Member of Technical Staff in Data Analysis and Evaluation. You will design data-collection tasks, apply statistical... ...Collaborate with researchers and engineers to improve dataset quality and model performance, including distributed training of...Quality
$164.7k - $339.08k
...Pinterest is seeking an experienced Staff Data Scientist to join our Finance &... ...catching and resolving data-quality issues.Partner broadly and... ...backtesting and forecast-accuracy evaluation, and seasonality analysis (y... ...applying modern AI/LLM tooling to real workflows —...QualityWork at officeLocal areaRelocationRelocation package$238k - $302k
...Staff Data ScientistWaymo is an autonomous driving technology company with the mission to... ...across 15+ U.S. states.Rigorous behavioral evaluation of the Waymo Driver is a critical part... ...lead key initiatives for measuring the quality and trustworthiness of the behavior evaluation...QualityFull timeRemote workWaymo
San Francisco, CA1 day ago$251k - $310k
...simulation across 15+ U.S. states. Rigorous evaluation of the Waymo Driver, including... ...hybrid role you will report to the Data Science Lead for Driving Quality & Scope Expansion. You will: Define... ...as a technical lead to junior data scientists. Frame and solve ambiguous problems...QualityFull timeRemote workWaymo
San Francisco, CA2 days ago$300k
...Staff Data ScientistGrindr is an AI-native platform powering how millions... ...ever see.As a Staff Data Scientist at Grindr, you will be working... ...to production and improve quality of life for our millions of users... ...-ended questionsDesign and evaluate experiments to measure the impact...QualityWork at officeImmediate startWorldwideFlexible hoursGrindr
San Francisco, CA5 days ago$239k - $270k
...believe technology should expand the reach, quality, and humanity of care. Every Spring... ..., Engineering in Customer Value, this Staff Data Scientist will architect the critical semantic and... ...output correctness, specifically for LLM-based systems, ensuring compliance and...QualityTemporary workWork at officeImmediate startWorldwideRelocationSleeping nights2 days per week3 days per weekSpring Health
San Francisco, CA3 days ago$212k - $265k
...better mental health outcomes. As a Staff Data Scientist, Product Analytics , you will be a senior... ...will influence what we build, how we evaluate it, and how we scale what works. This... ..., online experiments, and human-quality signals when needed. Build scalable analytical...QualityWork from homeFlexible hours- ...research for their next generation of LLM products. Join us if you: Wish to work... .... Responsibilities Own LLM evaluation processes and methods with a focus on... ...safety vulnerabilities. Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking...QualityLocal areaShift work
$195k - $257.5k
...everyone is a stakeholder.What you’ll be responsible forAs a Staff Data Scientist at Circle, you will partner closely with product, payments,... ...problem-solving skills with strong attention to detail and data quality.Preferred RequirementsDeep experience working with payments...QualityLocal areaFlexible hours- .... About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure... ...of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI...QualityFull timeWork at officeRelocation package
Mercor
San Francisco, CA1 day ago $164.7k - $339.08k
...contributor, shaping how Pinterest's Ads organization leverages data for strategic decision-making and operational excellence. You'll... ...and identifying new opportunities.Ensure Data Trustworthiness and Quality: Establish and uphold high standards for data integrity,...QualityWork at officeLocal areaRelocationRelocation package- ...Dynamo AI is seeking a candidate to lead LLM evaluation and benchmarking in San Francisco, California. You will generate high-quality data and develop innovative methods for assessing the safety and helpfulness of LLMs. The role requires domain knowledge in evaluation...Quality
Capitolis
San Francisco, CA5 days ago $155k - $189k
...the Role:Gusto is looking for a highly skilled and motivated Staff Data Scientist to join our Time Products Data Science team. In this role,... ...highlight trade-offs and limitations based on sample size and data quality.Execution: Deliver multiple high-impact projects, balancing...QualityFull timeWork at officeLocal area2 days per week3 days per week$164.7k - $339.08k
...do:Develop measurement frameworks and metrics to drive data-driven decision making, optimizing for the full user journey... .... Leadership: Mentor the scope of work for other data scientists, demonstrating high-quality output of both yourself and others for whom you mentor....QualityWork at officeLocal areaRelocationRelocation package$164.7k - $339.08k
...rhythms, executive decision-making, and strategic planning.Lead and mentor. Guide the work of at least two data scientists, raising the bar on technical quality, execution, and impact through candid, continuous feedback and coaching.What we’re looking for:8+ years of combined...QualityWork at officeLocal areaRelocationRelocation package$238k - $302k
...Francisco, is seeking a skilled professional to lead methodologies for evaluating its autonomous driving technology. This hybrid role involves... ...) and have at least seven years of industry experience in data science. The position offers a competitive salary range of $238...Quality- B Capital is seeking a data engineer to ensure high data quality for training AI models. You will own the upstream data quality for LLM post-training and design automated QA methods in a collaborative environment. Ideal candidates will have strong engineering skills, a...Quality
- ...ambitions and the need to marry those with precise data analysis. To that end, we are hiring a Machine Learning-focused Data Scientist to support our Risk team. This team is... ..., testing, and monitoring Ensure data quality and reliability across pipelines and tools Collaborate...Quality
Mercury
San Francisco, CA4 days ago $193.8k - $228k
...fall; when one rises, we all rise. Job Summary: As a Staff Data Scientist at SmithRx, you'll play a pivotal role on a high-impact Data... ...practices, continuously raising the bar for data & code quality across technical teams Amplify Organizational Impact Partner...QualityTemporary workWork at officeRemote workFlexible hoursSmithRx
San Francisco, CA3 days ago$218.4k - $273k
...Scale has been the leading AI data foundry, helping fuel the most... ...building upon our prior model evaluation work with enterprise customers... ...requires not only expertise in LLM agents and planning algorithms... ...Our products provide the high-quality data and full-stack...QualityFull time- ...stack: improving the reliability, quality, and user experience of... ...product development with core data science, ML, and analytics work... ...product experiences, and the evaluation and observability systems that... ..., human review workflows, and LLM-as-judge evaluation patterns.Analyze...QualityWork at office3 days per week
- ...applying machine learning and data mining techniques to... ...-store technologies, LLM evaluationExceptional... ...WHAT YOU'LL DOAs a Data Scientist II, you will... ...analysisDesign, implement, and evaluate models—from traditional... ...and assess LLM output quality / hallucinationsDeploy...QualityApprenticeshipWork at officeLocal areaEasy work
$170k - $178k
...re looking for a research-minded Data Scientist to join the Core Data team. This... ...to solution delivery Drive data quality, accessibility, and the... ...with exposure to or interest in LLM analytics, AI product measurement, or evaluating the impact of AI-powered featuresA...QualityMinimum wageFull timeInternshipLocal areaRemote workFlexible hours$130.1k - $165k
...thrives at the intersection of data science, growth strategy, and... ...surface intelligent recommendations.Evaluate and implement advanced... ...robust data models, improve data quality, and define scalable pipelines... ...tools, agentic workflows, or LLM-based applications that automate...QualityFull timeTemporary workWork at officeLocal areaRelocation packageFlexible hours2 days per week$164.7k - $339.08k
...Overview Pinterest is seeking an experienced Staff Data Scientist to join our Finance & Business... ...modeling, backtesting and forecast‑accuracy evaluation, seasonality analysis. Fluency in... ...AI Hands‑on experience with modern AI/LLM tooling, moving from experiment to adopted...Work at officeLocal areaRelocationRelocation package$180k - $230k
...Data Scientist Specializing In Ai Quality & EvaluationEllipsis Health is creating cutting-edge AI/ML products that... ...specializing in AI Quality & Evaluation, you will play a pivotal role in ensuring... ....Drive Continuous Improvement of LLM-as-a-Judge: Build the data and evaluation...QualityRemote workFlexible hoursEllipsis Health
San Francisco, CA4 days ago- ...The RoleAs a Senior Data Scientist on Linktree's Trust team, you will play a key role in protecting... ...You will also play a central role in evaluating and strengthening our ML and LLM-based safety systems. This includes defining high-quality ground truth datasets, establishing...QualityCasual workWork at officeRemote workHome office
Linktree
San Francisco, CA5 days ago $164.7k - $339.08k
...use AI in our recruiting process here.We are looking for a Staff Data Scientist for our Ads Delivery. You will shape the future of people-facing... ...stagesDesign and productionize robust, scalable ML and evaluation frameworks—spanning forecasting, recommendation, and causal...Temporary workWork at officeLocal areaRelocation package- ...Data EngineerAs a Data Engineer at Regard, you will help build and... ..., and help ensure the quality and availability of critical datasets... ...preferred)Practical experience with LLM-assisted development, with an... ...machine learning training, evaluation, or production...QualityWork at officeLocal areaHome officeVisa sponsorshipRelocation package1 day per week
REGARD
San Francisco, CA5 days ago - ...us, and build real world value.THE WORK:We're looking for a Staff Data Scientist to be the technical lead across Ripple's diverse product and... ...analytics vision, build the scientific frameworks the org uses to evaluate product and business performance, and use AI tooling to...Full timeWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Scientist, LLM Data Quality & Evaluation. Be the first to apply!
Related searches
- assistant scientist San Francisco, CA
- work from home data scientist San Francisco, CA
- energy data scientist San Francisco, CA
- data scientist San Francisco, CA
- python data scientist (contract) San Francisco, CA
- senior data scientist San Francisco, CA
- entry level data scientist remote San Francisco, CA
- healthcare data scientist San Francisco, CA
- python data scientist San Francisco, CA
- junior data scientist remote San Francisco, CA