Staff Data Scientist, LLM Data Quality & Evaluation
Cohere
Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation. The ideal candidate will have strong software engineering and statistical skills, along with experience in machine learning frameworks. Applicants from diverse backgrounds are encouraged to apply! #J-18808-Ljbffr Cohere
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Staff Data Scientist, LLM Data Quality & Evaluation in San Francisco, CA vacancy
$238k - $302k
...Waymo Evaluation Lead Waymo is an autonomous driving technology company with the mission... ...will lead key initiatives for measuring the quality and trustworthiness of the behavior... ...In this hybrid role you will report to a Data Science Lead. You will: Lead a roadmap...QualityFull timeRemote workLatent Logic
San Francisco, CA2 days ago$265k - $306k
.... About the Grant data science team Our job... ...a team of three data scientists within Kikoff's Data organization... ..., and you'll bring a staff-level view to the Grant... .... Build and evaluate models where they're... ...Hands-on with production-quality SQL and Python. You...QualityFull timeTemporary workLocal area$230k - $284k
Waymo Product Data Scientist Waymo is an autonomous driving technology... ...the company — from driving quality and operational efficiency to... ...role, you will report to a Staff Product Data Scientist. You... ...practices for experiment design and evaluation across the broader product...QualityFull timeRemote work$300k
Staff Data Scientist Grindr is an AI-native platform powering how millions of gay people connect... ...are deployed to production and improve quality of life for our millions of users. You... ...broad, open-ended questions Design and evaluate experiments to measure the impact of...QualityWork at officeImmediate startWorldwideFlexible hours$239k - $270k
...believe technology should expand the reach, quality, and humanity of care. Every Spring... ..., Engineering in Customer Value, this Staff Data Scientist will architect the critical semantic and... ...output correctness, specifically for LLM-based systems, ensuring compliance and...QualityTemporary workWork at officeImmediate startWorldwideRelocationSleeping nights2 days per week3 days per weekSpring Health
San Francisco, CA23 days ago- .... About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure... ...of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI...QualityFull timeWork at officeRelocation package
Mercor
San Francisco, CAmore than 2 months ago - Dynamo AI is seeking a candidate to lead LLM evaluation and benchmarking in San Francisco, California. You will generate high-quality data and develop innovative methods for assessing the safety and helpfulness of LLMs. The role requires domain knowledge in evaluation techniques...Quality
- Mercor is seeking a Data Engineer - AI Model Evaluation in London to join our frontier AI workspace. You will assess model-generated data infrastructure... ...analytics platforms, using AI coding agents to drive quality and scalability. Bring 2+ years in data engineering,...Quality
- B Capital is seeking a data engineer to ensure high data quality for training AI models. You will own the upstream data quality for LLM post-training and design automated QA methods in a collaborative environment. Ideal candidates will have strong engineering skills, a...Quality
- ...ambitions and the need to marry those with precise data analysis. To that end, we are hiring a Machine Learning-focused Data Scientist to support our Risk team. This team is... ..., testing, and monitoring - Ensure data quality and reliability across pipelines and tools -...QualityFull time
Mercury
San Francisco, CA17 days ago $202k - $282k
The Data Science team at Asana is pivotal in fulfilling our mission by fostering a data... ..., setting the technical bar for modeling quality, code rigor, data pipeline architecture,... ...mentorship and guidance to a team of data scientists at varying levels, helping them navigate...QualityWork at officeWork from home$211k - $290.5k
...using the power of tech, data, and machine learning... ...team of Applied AI/ML Scientists specialize in developing... ...Scientist on the Listing Quality team, you will own the... ...to find, easier to evaluate, and easier to buy, and... ...conversion. Build LLM-as-judge and human-in-the...QualityWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per weekFaire
San Francisco, CA2 days ago$150k - $170k
...will work closely with other data scientists, software engineers, product... ..., inference services, evaluation pipelines, and production-facing... ...inputs Develop production-quality software for data pipelines... ...productizing machine learning models, LLM applications, computer...QualityWork experience placementCasual workWork at officeRelocation package2 days per weekChaos Industries
San Francisco, CA1 day ago$190k - $283k
...Your Future Neighbors As a Data Scientist at Nextdoor, you will help... ...Make We are looking for a Staff Data Scientist to accelerate... ...investments and elevate the quality of product decision-making. This... ...and fast iteration. They will evaluate feature performance, including...QualityWork at officeLocal areaWork from home$185k - $221.4k
...biology and develop and critically evaluate therapeutic hypotheses. We... ...Build and own production data infrastructure. Design, implement... ...alerting. Model and curate high-quality data assets. Perform entity... ...that GenAI agents and LLM orchestrators depend on; ensure...QualityRemote workFlexible hoursForesite Labs
San Francisco, CA1 day ago$302.4k - $378k
...Scale has been the leading AI data foundry, helping fuel the most... ...building upon our prior model evaluation work with enterprise customers... ...requires not only expertise in LLM agents and planning algorithms... ...Our products provide the high-quality data and full-stack...QualityFull time$180k - $220k
...proprietary vertical indexes with LLM-optimized retrieval systems to... ...We are looking for a hands‑on Data Engineer to help build and... ...data, while helping ensure data quality, accessibility, and usability... ...each candidate and applicable evaluation criteria. If AI‑assisted...QualityFull timeImmediate startRemote workWork from homeFlexible hoursMixpeek
San Francisco, CA16 hours ago- ...power the AI economy. We're a leading AI data company, building the layer between... ...experiments that move core product metrics, match quality, time-to-hire, candidate experience, and... ...) to improve matching and scoring. Help evaluate LLM-powered agents: design rubrics, human-in...QualityWork at officeRelocation package
$180k - $230k
Data Scientist Specializing In Ai Quality & Evaluation Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing issues and administrative... ...implementation. Drive Continuous Improvement of LLM-as-a-Judge: Build the data and evaluation...QualityRemote workFlexible hours$130.1k - $165k
Data Scientist, Growth Analytics Los Angeles, CA (Hybrid); San Francisco,... ...intelligent recommendations. Evaluate and implement advanced statistical... ...data models, improve data quality, and define scalable... ...tools, agentic workflows, or LLM-based applications that automate...QualityFull timeTemporary workWork at officeLocal areaRelocation packageFlexible hours2 days per week$204k - $259k
...millions of miles of driving data from a diverse set of sensors,... ...models. Develop and rigorously evaluate metrics and methodologies for... ...-scale model development (LLM, VLM, or similar foundation models... ...large-scale data curation and quality assurance processes for...QualityFull timeRemote workWaymo
San Francisco, CAmore than 2 months ago- ...economy. We're a leading AI data company, building the... ...that train and evaluate the world's frontier coding models. As a Staff Software Engineer for Code... ...embeddings, models, and search quality as newer, state-of-the-... ...understanding, semantic parsing, or LLM-assisted query...QualityFull timeWork at officeRelocation package
Mercor
San Francisco, CAa month ago - As a Data Engineer at Regard, you will help build and maintain the... ..., and help ensure the quality and availability of critical datasets... ...preferred) Practical experience with LLM‑assisted development, with an... ...machine learning training, evaluation, or production workflows...QualityWork at officeLocal areaHome officeVisa sponsorshipRelocation package
$146k - $280k
...looking for a highly experienced Applied Data Scientist to play a leading role in shaping the methodologies underlying our evaluation ecosystem. This is a senior technical role... ...complex deep-dive analyses, write production-quality evaluation code, and build the...QualityOdd jobFull timeWork at officeWork from homeFlexible hoursWaabi
San Francisco, CA16 hours ago$146k - $280k
...Applied Data Scientist – Senior Technical Role We are looking for a highly experienced Applied Data Scientist to shape evaluation methodologies for autonomous driving technology. This senior... ...deep‑dive analyses, write production‑quality evaluation code, and build...QualityFull timeWork at officeWork from homeFlexible hoursWaabi
San Francisco, CA1 day ago- ...Whether you’re building LLM-powered... ...looking for a Senior/Staff Analytics Engineer... ...join our growing Data team and lead the... ...closely with analysts, scientists, data engineers,... ...strengthening data quality, improving the developer... ...including hiring, evaluation, termination,...QualityFull timeRemote workWorldwideVisa sponsorship
$195k - $257.5k
...everyone is a stakeholder.What you’ll be responsible forAs a Staff Data Scientist at Circle, you will partner closely with product, payments,... ...problem-solving skills with strong attention to detail and data quality.Preferred RequirementsDeep experience working with payments...QualityLocal areaFlexible hours$180k - $235k
Staff Data Scientist Nauto San Francisco, CA, US At Nauto you can make an impact at a high-impact company. We believe technology can help prevent... ...based on well designed experiments using real-world data to evaluate, validate and iterate Strong communication and presentation...Full timeRemote workFlexible hours$192k - $252k
...and belongingAbout the Team:The Data Science, Analytics team at... ...teams that partner with data scientists to ensure we are building a data... ...revenue.About the Role:As the Staff Data Scientist for Monetization... ...challenges, and striving for high-quality work while staying curious and...QualityWork at office2 days per week3 days per week$164.7k - $339.08k
...rhythms, executive decision-making, and strategic planning.Lead and mentor. Guide the work of at least two data scientists, raising the bar on technical quality, execution, and impact through candid, continuous feedback and coaching.What we’re looking for:8+ years of combined...QualityWork at officeLocal areaRelocationRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Scientist, LLM Data Quality & Evaluation. Be the first to apply!
Related searches
- assistant scientist San Francisco, CA
- ai data scientist San Francisco, CA
- python data scientist (contract) San Francisco, CA
- healthcare data scientist San Francisco, CA
- energy data scientist San Francisco, CA
- work from home data scientist San Francisco, CA
- senior data scientist San Francisco, CA
- data scientist San Francisco, CA
- principal data scientist San Francisco, CA
- entry level data scientist remote San Francisco, CA