Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Scientist, Launch Evaluation Quality

$238k - $302k

Waymo

Waymo, based in San Francisco, is seeking a skilled professional to lead methodologies for evaluating its autonomous driving technology. This hybrid role involves developing performance metrics, collaborating with product and engineering teams, and driving continuous improvement of evaluation methodologies. Ideal candidates possess a quantitative degree (PhD preferred) and have at least seven years of industry experience in data science. The position offers a competitive salary range of $238,000—$302,000 USD, along with equity incentives and a benefits program. #J-18808-Ljbffr Waymo

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead Data Scientist, Launch Evaluation Quality in San Francisco, CA vacancy
  •  ...candidate for a role focused on improving answer quality across Perplexity's products. You will architect evaluation pipelines, design methods to measure tool impact...  ...technical field and at least 4 years of experience in data science or machine learning, alongside strong... 
    Quality

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    5 days ago
  •  ...About Fusemachines Fusemachines is a leading AI strategy, talent, and education...  ...the world. About the Role A Lead Data Scientist is responsible for designing and implementing...  ...models, as well as ensuring data quality and system stability.   Requirements... 
    Quality
    Full time
    Local area
    Remote work

    GrabJobs

    San Francisco, CA
    1 day ago
  • A financial technology firm in San Francisco is looking for a Data Scientist to apply data mining techniques and build high-quality prediction systems. The ideal candidate will have at least 2 years of hands-on coding experience and a solid understanding of machine learning... 
    Quality

    Umba

    San Francisco, CA
    4 days ago
  • Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation... 
    Quality

    Cohere

    San Francisco, CA
    4 days ago
  • $210k - $385k

    A leading financial technology firm seeks a Data Scientist to architect evaluation pipelines and improve answer quality through innovative evaluations. Candidates should possess a PhD or MS in a technical field with at least 4 years of relevant experience, strong skills... 
    Quality

    Pantera Capital

    San Francisco, CA
    3 days ago
  •  ...on natural, conversational AI that learns from data. We seek a founding engineer to own the ML data and evaluation platform that model development runs on, with a...  ...record in distributed ML infra and data-driven quality control. You will build data pipelines, MLOps, and... 
    Quality

    MetaVoice

    San Francisco, CA
    4 days ago
  • Mercor is seeking a Data analysis / quantitative readouts Evaluator to connect elite talent with leading AI research labs. This remote position requires 5+ years of relevant...  ...evaluator will assess AI-generated documents for quality and provide feedback to enhance AI... 
    Quality
    Remote job
    Work at office

    Mercor

    San Francisco, CA
    2 days ago
  •  ...advancement. Responsibilities Own LLM evaluation processes and methods with a focus on...  ...vulnerabilities. Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking...  ...previous methods. Comfortability with leading end-to-end projects. Adaptability and... 
    Quality
    Local area
    Shift work

    Capitolis

    San Francisco, CA
    4 days ago
  • Golden Gate Regional Center is hiring a Quality Assurance Specialist to evaluate and monitor residential, day, and specialized services across three counties...  ...XVII and California regulations. The role includes leading QA activities, writing reports, and providing training... 
    Quality

    Golden Gate Regional Center (GGRC)

    San Francisco, CA
    2 days ago
  • Welo Data is seeking a Data Labeling Associate to evaluate AI model outputs and improve data quality. The role requires native-level Canadian English proficiency and a relevant degree, offering a full-time, onsite position in cities including San Francisco and NYC. Responsibilities... 
    Quality
    Full time

    Welo Data

    San Francisco, CA
    5 days ago
  •  ...headquartered in San Francisco, is looking for a Public-sector procurement / RFI response Evaluator. In this remote position, you will evaluate AI-generated artifacts against quality standards and provide structured feedback. Applicants should have over 5 years of... 
    Quality
    Remote job
    Work at office
    Flexible hours

    Mercor

    San Francisco, CA
    2 days ago
  •  ...California. This role involves designing and implementing automated evaluation pipelines for AI systems deployed in government environments....  ...models and collaborating with various teams to ensure high-quality outcomes. #J-18808-Ljbffr Gravity Engineering Services Pvt... 
    Quality

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    4 days ago
  • $80 - $120 per hour

    Mercor is seeking a Healthcare Operations Evaluator to assess AI-generated outputs based on quality standards. You'll leverage your deep expertise in healthcare operations and provide structured feedback to enhance AI performance. Successful candidates will have at least... 
    Quality
    Remote job
    Contract work
    Work at office

    Mercor

    San Francisco, CA
    4 days ago
  • $80 - $120 per hour

    Mercor is seeking a Document/deck production QA Evaluator to evaluate AI-generated content and provide structured feedback...  ...collaborating with AI research teams to enhance quality and performance of training data. Compensation ranges from $80 to $120 per hour. #J-18... 
    Quality
    Remote job
    Hourly pay
    Work at office

    Mercor

    San Francisco, CA
    4 days ago
  • Welocalize is seeking a Data Quality Associate to evaluate AI model outputs and provide structured feedback. This is a full-time, onsite role located in San Francisco. The ideal candidate possesses a Bachelor's degree and has 1-2 years of professional writing experience... 
    Quality
    Full time

    Welocalize

    San Francisco, CA
    4 days ago
  • Obsidian is seeking expert Evaluators in Biology/environmental science to review and assess AI-generated work products for accuracy and quality. In this remote, hourly role, you will leverage your expertise to provide feedback on documents and presentations, ensuring they... 
    Quality
    Remote job
    Hourly pay

    Obsidian

    San Francisco, CA
    5 days ago
  • $120 per hour

     ...creative and technical talent with leading AI research labs....  ...Document/deck production QA Evaluator Type Contract Compensation...  ...artifacts against domain‑specific quality rubrics. Identify factual, aesthetic...  ...teams to enhance training data quality and performance.... 
    Quality
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    San Francisco, CA
    4 days ago
  •  ...Welocalize is seeking a Data Quality Associate based in San Francisco for a full-time position. This role involves evaluating AI outputs and providing detailed feedback, with applicants needing native-level language proficiency and a university degree. Successful candidates... 
    Quality
    Full time

    Welocalize

    San Francisco, CA
    1 day ago
  •  ...critical government environments. We build evaluation frameworks that ensure these models...  ...continuous monitoring, regression testing, and quality assurance for ML systems. Design and...  ...or PyTorch . Background in algorithms , data structures , and object-oriented programming... 
    Quality

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    4 days ago
  • $162k - $258.75k

     ...About the Principal Data Scientist at Headspace We are looking...  ...Data Scientist to lead the evolution of data...  ...empowering us to deliver high‑quality, accessible mental...  ...support new product launches and partnerships (e.g....  ...statistical modeling to evaluate engagement and long‑... 
    Quality
    Full time
    Currently hiring
    Work at office
    Local area
    Remote work
    Shift work
    3 days per week

    Headspace

    San Francisco, CA
    5 days ago
  •  ...seeking a Model Behavior Architect to enhance AI products and evaluations. This role involves working within the AI team to design strategies...  ...collaborating with cross-functional teams, and ensuring model quality through research and analysis. Ideal candidates should have... 
    Quality

    United States Digital Space LLC

    San Francisco, CA
    5 days ago
  • $50k - $200k

    # Data Scientist, Customer ExperienceWhatnotFull TimemidSan...  ...design, implement, and evaluate A/B tests and feature...  ...accessibility, ensure data quality, and support...  ...new product features.Lead Cross-Functional Collaboration...  ...shaping how we build, launch, and iterate on... 
    Quality
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    TryApplyNow

    San Francisco, CA
    2 days ago
  •  ...Technical Staff in San Francisco to build core simulation engines, evaluation systems, and observability pipelines for self-improving...  ...collaborating with senior engineers on latency, barge-in, and audio quality challenges, while shaping architecture and #J-18808-Ljbffr... 
    Quality

    Cekura

    San Francisco, CA
    4 days ago
  • $150k - $250k

     ...journeys. Distyl is backed by leading investors including...  ...Distyl, we build AI systems using Evaluation‑Driven Development—a process...  ...environments. Define how system quality is measured in each domain, ensuring...  ...with prompts, agents, data, and deployment. Design evaluation... 
    Quality
    Work at office
    3 days per week

    Distyl

    San Francisco, CA
    4 days ago
  • $176k - $253k

    Harper is seeking a Senior Member of Technical Staff, AI Quality, in San Francisco. Your main goal will be to turn agent quality into...  ...quantifiable metrics, ensuring high standards through robust evaluation processes. You'll build capability regression evaluation suites... 
    Quality

    Harper

    San Francisco, CA
    1 day ago
  • $205.6k - $257k

    Product Manager, Public Sector GenAI Test & Evaluation (T&E) San Francisco, CA; St. Louis, MO; New York...  ...important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments... 
    Quality
    Full time

    aijoblist

    San Francisco, CA
    1 day ago
  • $213k - $263k

    Waymo is seeking experienced software engineers or data scientists to enhance software quality in autonomous driving. This hybrid role involves developing data pipelines, designing analysis tools, and maintaining robust data platforms. Candidates require a Master's or PhD... 
    Quality

    Waymo

    San Francisco, CA
    4 days ago
  • $240k - $280k

    A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably... 

    Sentry

    San Francisco, CA
    3 days ago
  • $225k - $325k

     ...center with cutting‑edge voice AI. Since launching, thousands of companies now utilize...  ...large language models and audio models, evaluate them with rigorous benchmarks (and human...  ...structured human feedback, benchmark subjective quality, and inform model iterations. Level Up... 
    Quality
    H1b

    kadence

    San Francisco, CA
    4 days ago
  • $150k - $250k

    Distyl is seeking an AI Evaluation Engineer to design evaluation systems for AI-driven solutions. Located in San Francisco, this position requires strong Python skills and a commitment to utilizing AI tools to enhance evaluation processes. The role offers a competitive... 
    Work at office
    3 days per week

    Distyl

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Scientist, Launch Evaluation Quality. Be the first to apply!