Lead Data Scientist, Launch Evaluation Quality
$238k - $302kWaymo
Waymo, based in San Francisco, is seeking a skilled professional to lead methodologies for evaluating its autonomous driving technology. This hybrid role involves developing performance metrics, collaborating with product and engineering teams, and driving continuous improvement of evaluation methodologies. Ideal candidates possess a quantitative degree (PhD preferred) and have at least seven years of industry experience in data science. The position offers a competitive salary range of $238,000—$302,000 USD, along with equity incentives and a benefits program. #J-18808-Ljbffr Waymo
$175.5k - $195k
...seeking a highly skilled and motivated Lead Data Scientist to join our data science team. In this... ...the broader business context, evaluate tradeoffs, and align analytical projects... ...junior team members, overseeing project quality, and investigating root causes of complex...QualityMinimum wageFlexible hours$100 - $150 per hour
...creative and technical talent with leading AI research labs.... ...Jack Dorsey . Position: Data Scientist Talent Network Type: Contract... ...A/B test write-ups . Evaluate AI-generated or human-... ...established criteria to ensure quality and consistency. Provide...QualityContract workSummer workRemote work- ...power the AI economy. We partner with leading AI labs and enterprises to provide the... ...As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of... ...Our team's mission is to develop high-quality data types that push frontier models forward...QualityFull timeWork at officeRelocation package
$155.4k - $233.2k
...looking for a senior operator to own the quality bar behind Harvey's human evaluations. As we scale globally, the volume... ...is trusted. This role makes Human Data's signal decision-grade: rigorous,... ...bar before results inform a launch decision Ensure the quality bar holds...QualityContract work- .... Over the past years, we’ve launched Databricks Assistant , AI/... ...made significant strides in LLM quality for these products. These... .../BI Genie). Develop novel data collection, fine-tuning, and... ...hyperparameter tuning, and model evaluation, enabling rapid...QualityFull timeWork at office
- A financial technology firm in San Francisco is looking for a Data Scientist to apply data mining techniques and build high-quality prediction systems. The ideal candidate will have at least 2 years of hands-on coding experience and a solid understanding of machine learning...Quality
- Cohere, a leading security-first enterprise AI company, is hiring a Member of Technical Staff in Data Analysis and Evaluation. You will design data-collection tasks, apply statistical methods... ...and engineers to improve dataset quality and model performance, including distributed...Quality
- Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation...Quality
$210k - $385k
A leading financial technology firm seeks a Data Scientist to architect evaluation pipelines and improve answer quality through innovative evaluations. Candidates should possess a PhD or MS in a technical field with at least 4 years of relevant experience, strong skills...Quality$139.76k - $287.75k
...marketers. We leverage massive data and cutting-edge science to... ...production code in Python.Design, launch, and analyze experiments to... ...record of providing high-quality service to the DS team’s customers... ...track record of critical evaluation and verification of AI-assisted...QualityWork at officeLocal areaRelocationRelocation package$133k
...the roleWe are hiring a Sr. Data Scientist, Referrals to help us understand... ...will bring rigor to how we evaluate incrementality, attribution,... ...ROI projections ahead of launch, and supporting operational... ...Engineering to improve tracking, data quality, and the pipelines behind...QualityFull timeWork at officeLocal areaRemote work$238k - $302k
.... states. The Large Model Evaluation team is at the nexus of Waymo... ...development and deployment. Build data pipelines for signal... ...Experience evaluating the quality of ML models Demonstrated... ...JAX, Tensorflow) Experience leading a team of Engineers The expected...QualityFull timeRemote work- ...: improving the reliability, quality, and user experience of existing... ...development with core data science, ML, and analytics work... ...product experiences, and the evaluation and observability systems that... ...measurable.What you will doBuild, launch, and improve AI agents,...QualityWork at office3 days per week
$190k - $285k
.... Over the past years, we’ve launched Databricks Assistant, AI/BI Genie... ...significant strides in LLM quality for these products. These... ...and AI/BI Genie).Develop novel data collection, fine-tuning, and... ...hyperparameter tuning, and model evaluation, enabling rapid...QualityWork at officeLocal areaWorldwide- Welo Data is seeking a Data Labeling Associate to evaluate AI model outputs and improve data quality. The role requires native-level Canadian English proficiency and a relevant degree, offering a full-time, onsite position in cities including San Francisco and NYC. Responsibilities...QualityFull time
$219.7k - $323k
...TeamThe Analytics team is looking for Data Scientists to guide measurement, strategy, and tactical... ...in related industriesStrength in leading through your technical chops, and ability... ...judgment in performing job duties, including evaluating options, making informed decisions, and...Hourly payWork at officeLocal areaRemote workFlexible hours$204k - $226.7k
...clients.About the Role:We are seeking an exceptional Senior Lead Data Scientist to lead large-scale, cross-functional initiatives that are... ...manipulation, analysis, and architectural design.Expertise in evaluating and selecting cutting-edge methodologies to solve highly...Minimum wageFlexible hours- Golden Gate Regional Center is hiring a Quality Assurance Specialist to evaluate and monitor residential, day, and specialized services across three counties... ...XVII and California regulations. The role includes leading QA activities, writing reports, and providing training...Quality
$186.1k - $300.55k
..., Docusign unleashes business-critical data that is trapped inside of documents. Until... ...management (CLM).What you'll doAs a Lead Data Scientist, you will spearhead the analytical strategy... ...Engineering roadmapsDeep expertise in evaluating LLM-based product features and...Contract workWork at officeLocal areaRemote work2 days per week$162k - $258.75k
...About the Principal Data Scientist at Headspace We are... ...Principal Data Scientist to lead the evolution of data... ...us to deliver high-quality, accessible mental healthcare... ...support new product launches and partnerships (e.g.... ...modeling to evaluate engagement, and long‑term...QualityFull timeCurrently hiringWork at officeLocal areaRemote workShift work3 days per week- Turing, based in San Francisco, seeks a Video Games Domain Reviewer to support QA for LLM evaluation projects. You will review prompts, assess task quality, and ensure adherence to guidelines. The role focuses on gaming topics such as game development, platforms, genres...QualityFor contractors
- ...advancement. Responsibilities Own LLM evaluation processes and methods with a focus on... ...vulnerabilities. Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking... ...previous methods. Comfortability with leading end-to-end projects. Adaptability and...QualityLocal areaShift work
$150k - $250k
...journeys.Distyl is backed by leading investors including Lightspeed... ..., we build AI systems using Evaluation-Driven Development—an approach... ...how system quality is measured in each domain, ensuring... ...interacts with prompts, agents, data, and deployment. You design evaluation...QualityWork at office3 days per week- ...investors. As a Senior AI Engineer, Quality , you will own the evaluation infrastructure that ensures our AI... ...of the craft of engineering Data-driven rigor: You make decisions based... ...seemingly impossible walls. Fast - Launch fast with excellence, iterate to...QualityRemote jobFull timeWork at officeWork from homeFlexible hours
- ...to market with unique data, signals, and AI research... ...5B valuation. We also launched a community equity... ...group of MLEs and data scientists whose charter is... ...serving infrastructure. Evaluate new tools for their ability... ...language. Make quality measurable Build eval...QualityFull time
- ...languages. Speak first launched in South Korea in 2019... ...is one of the world’s leading AI companies, with... ...deployment, and ongoing quality of our assessment... ...Define and operationalize evaluation Implement... ...weeks/months Support data and labeling strategy...QualityFull timeLive inImmediate start
$162.8k - $203.5k
...domain with a lot of data and creative solutions... ...will be developing and launching the algorithms that power... ...with Engineers, Data Scientists, Product Managers, and... ...Write production quality code to launch machine... ...learning models at scale Evaluate machine learning...QualityHourly payFull timeWork experience placementWork at officeLocal area3 days per week$139.76k - $287.75k
...write and review production-quality code. We are looking for solid... ...Experience with large-scale data tools such as Scala, Apache... ...We expect strong judgment in evaluating AI-assisted work through testing... ...in Python. We design, launch, and analyze experiments to improve...QualityRemote workRelocation packageFlexible hours- ...pipeline from model building, evaluation, optimizing performance... ...of AI and fitness to launch and optimize product... .... Analyzing the Data : Work closely with product managers, data scientists, and engineers to find... ...maintenance. Keep a high bar for quality in everything you do....QualityFull timeWork at officeWorldwideFlexible hours3 days per week
- ...systems: problem framing, metrics, data/feature design, model training, evaluation, and online experimentation.... ...exchange and supply signals (e.g., quality, conversions, identity, fraud, content... ...automating path from learnings to launch) while applying strong judgment and...QualityFull timeWork at officeRelocationRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Scientist, Launch Evaluation Quality. Be the first to apply!
- lead data scientist San Francisco, CA
- data network cabling San Francisco, CA
- data processor San Francisco, CA
- data capturer San Francisco, CA
- clinical data coordinator remote San Francisco, CA
- data tech San Francisco, CA
- data technician San Francisco, CA
- provider data management San Francisco, CA
- data recovery San Francisco, CA
- data visualization San Francisco, CA



