Staff Data Scientist - Evaluations & LLM Quality (Hybrid)
$210k - $385kPantera Capital
A leading financial technology firm seeks a Data Scientist to architect evaluation pipelines and improve answer quality through innovative evaluations. Candidates should possess a PhD or MS in a technical field with at least 4 years of relevant experience, strong skills in Python and SQL, and familiarity with AWS and Databricks. The role offers a hybrid work environment and a competitive salary package ranging from $210K to $385K along with comprehensive benefits. #J-18808-Ljbffr Pantera Capital
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Staff Data Scientist - Evaluations & LLM Quality (Hybrid) in San Francisco, CA vacancy
- ...enterprise AI company, is hiring a Member of Technical Staff in Data Analysis and Evaluation. You will design data-collection tasks, apply statistical... ...Collaborate with researchers and engineers to improve dataset quality and model performance, including distributed training of...Quality
- Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation...Quality
$164.7k - $339.08k
...seeking an experienced Staff Data Scientist to join our Finance &... ...team. This is a hybrid data-science / applied... ...catching and resolving data-quality issues.Partner... ...and forecast-accuracy evaluation, and seasonality analysis... ...applying modern AI/LLM tooling to real...QualityWork at officeLocal areaRelocationRelocation package$238k - $302k
...across 15+ U.S. states. The Large Model Evaluation team is at the nexus of Waymo’s AI... ...model development and deployment. Build data pipelines for signal discovery, data labeling... ..., etc. Experience evaluating the quality of ML models Demonstrated experience taking...QualityFull timeRemote workWaymo
San Francisco, CA14 hours ago$210k - $385k
...Employment Type Full time Location Type Hybrid Department Data Science Compensation $210K - $38... ...users daily with reliable, high-quality answers grounded in an LLM-first search engine and our... ...Architect and maintain automated evaluation pipelines to assess answer...QualityFull timeLocal area$170k - $248k
...professional experience as a Data Scientist or in a similar role working... ...reinforcement learning, and LLM fine-tuning techniques such as... ...experience designing, training, and evaluating large-scale models using... ...programming, production-quality code design, and modern data...QualityFull timeRemote workDoximity
San Francisco, CA4 days ago$238k - $302k
...U.S. states. Rigorous behavioral evaluation of the Waymo Driver is a critical part... ...key initiatives for measuring the quality and trustworthiness of the behavior... ...’s growth priorities. In this hybrid role you will report to a Data Science Lead. You will:...QualityFull timeRemote workWaymo
San Francisco, CA4 days ago$164.7k - $339.08k
...relevant experience in data science, analytics... ...modern AI or LLM tooling to real workflows... .... We want staff-level autonomy with... ...identify and resolve data quality issues that affect... ...a Staff Data Scientist for our Finance & Business... .... We offer a hybrid working model with...QualityFull timeWork at officeRelocation packagePinterest, Inc.
San Francisco, CA5 days ago$155k - $189k
...looking for a highly skilled and motivated Staff Data Scientist to join our Time Products Data Science... ...based on sample size and data quality.Execution: Deliver multiple high-impact... ...required. This includes non-office days for hybrid employees.Our customers come from all walks...QualityFull timeWork at officeLocal area2 days per week3 days per week$172.5k - $260.1k
...RoleWe are looking for an experienced Staff Data Scientist to support Slack's Go-to-Market (GTM)... ...methods to understand customer behavior, evaluate strategic initiatives, and optimize... ...learning.Experience developing production-quality analytical models and partnering with...QualityFull time- ...is seeking an AI Product Engineer (LLM, voice AI agent) for a full-time position... ...in San Francisco, CA. The role is hybrid with 2-3 days onsite weekly,... ...candidate scores, and run reliability evaluations to ensure consistent quality. #J-18808-Ljbffr Software Guidance...QualityFull time
$238k - $302k
...seeking a skilled professional to lead methodologies for evaluating its autonomous driving technology. This hybrid role involves developing performance metrics,... ...have at least seven years of industry experience in data science. The position offers a competitive salary...Quality- ...research for their next generation of LLM products. Join us if you: Wish to work... .... Responsibilities Own LLM evaluation processes and methods with a focus on... ...safety vulnerabilities. Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking...QualityLocal areaShift work
$230k - $284k
...across 15+ U.S. states. Waymo’s Product Data Science team works cross-functionally with... ...across the company - from driving quality and operational efficiency to market analysis... ...to new information. This role follows a hybrid work schedule and you will report to the...QualityFull timeWork experience placement$160k - $200k
The Opportunity As a Staff Data Scientist on the Clinical Performance team, you will be the lead... ...providers. While your primary focus is evaluative, you will be a key player in the broader... ...forecasting engines that predict our quality performance across various value-based...Quality$130.1k - $165k
...at the intersection of data science, growth strategy... ...environment.This is a hybrid role based out of our San... ...recommendations.Evaluate and implement advanced... ...data models, improve data quality, and define scalable pipelines... ...agentic workflows, or LLM-based applications that...QualityFull timeTemporary workWork at officeLocal areaRelocation packageFlexible hours2 days per week$202k - $282k
The Data Science team at Asana is pivotal in fulfilling our mission... ...with an office‑centric hybrid schedule. The standard in‑office... ...technical bar for modeling quality, code rigor, data pipeline architecture... ...guidance to a team of data scientists at varying levels, helping...QualityWork at officeWork from home$212k - $265k
...better mental health outcomes. As a Staff Data Scientist, Product Analytics , you will be a senior... ...will influence what we build, how we evaluate it, and how we scale what works. This... ..., online experiments, and human-quality signals when needed. Build scalable analytical...QualityWork from homeFlexible hours$164.7k - $339.08k
...Pinterest is seeking an experienced Staff Data Scientist to join our Finance &... ...Operations team. This is a hybrid data‑science / applied‑AI /... ...backtesting and forecast‑accuracy evaluation, seasonality analysis.... ...on experience with modern AI/LLM tooling, moving from experiment...Work at officeLocal areaRelocationRelocation package$134.5k - $265.1k
...ll doAs a Microsoft AI&Data FDE, you will work side... ...decisions that balance quality, safety, latency, cost,... ...data, AI, network, and hybrid cloud infrastructure. These... ...and deploying GenAI/LLM-powered solutions in... ...MLOps/LLMOps practices: evaluation frameworks, model monitoring...QualityLocal area$195k - $257.5k
...everyone is a stakeholder.What you’ll be responsible forAs a Staff Data Scientist at Circle, you will partner closely with product, payments,... ...problem-solving skills with strong attention to detail and data quality.Preferred RequirementsDeep experience working with payments...QualityLocal areaFlexible hours$164.7k - $339.08k
...contributor, shaping how Pinterest's Ads organization leverages data for strategic decision-making and operational excellence. You'll... ...and identifying new opportunities.Ensure Data Trustworthiness and Quality: Establish and uphold high standards for data integrity,...QualityWork at officeLocal areaRelocationRelocation package$164.7k - $339.08k
...do:Develop measurement frameworks and metrics to drive data-driven decision making, optimizing for the full user journey... .... Leadership: Mentor the scope of work for other data scientists, demonstrating high-quality output of both yourself and others for whom you mentor....QualityWork at officeLocal areaRelocationRelocation package$164.7k - $339.08k
...rhythms, executive decision-making, and strategic planning.Lead and mentor. Guide the work of at least two data scientists, raising the bar on technical quality, execution, and impact through candid, continuous feedback and coaching.What we’re looking for:8+ years of combined...QualityWork at officeLocal areaRelocationRelocation package$100 - $150 per hour
...Summers , and Jack Dorsey . Position: Data Scientist Talent Network Type: Contract... ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria to ensure quality and consistency. Provide detailed...QualityContract workSummer workRemote workMercor
San Francisco, CA6 days ago$175k - $234k
...Future Neighbors As Data Scientists at Nextdoor, you will... ...environment that embraces a hybrid employment model,... ...increasingly relies on LLM-driven query... ...query understanding and evaluation. Your responsibilities... ...Care deeply about data quality and empower employees...QualityWork at officeLocal areaWork from homeNextdoor
San Francisco, CAmore than 2 months ago- .... About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure... ...of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI...QualityFull timeWork at officeRelocation package
Mercor
San Francisco, CA14 hours ago - ...their company's data and fueled by WRITER... ...the world. As a staff AI research scientist, you'll be at the... .... This role is hybrid, based out of our... ...model training, evaluation, and production deployment... ...the high-quality training signal driving... ...— including LLM-as-judge...QualityFull timeWork at officeLocal areaFlexible hours
$193.6k - $242k
...to thrive.As an Applied Scientist specializing in Machine... ...with Data Scientists, Engineers,... ...contextWrite production quality code. Design, build and... ...and existing problems. Evaluate machine learning systems... ...will be in-office on a hybrid schedule — Team Members...QualityHourly payWork at officeLocal area3 days per week$60 - $70 per hour
...healthcare technology company to hire a Data Engineer, Senior for its Data Services team... ...(six-month contract term) Location: Hybrid — 2x/week onsite; San Diego, Long Beach,... ...frameworks and patterns. DevSecOps & Quality Integration Integrate security, automation...QualityContract workReleady
San Francisco, CA27 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Scientist - Evaluations & LLM Quality (Hybrid). Be the first to apply!
Related searches
- assistant scientist San Francisco, CA
- data scientist (hedge fund) San Francisco, CA
- healthcare data scientist San Francisco, CA
- data scientist San Francisco, CA
- entry level data scientist San Francisco, CA
- part time data scientist San Francisco, CA
- ai data scientist San Francisco, CA
- senior data scientist San Francisco, CA
- principal data scientist San Francisco, CA
- entry level data scientist remote San Francisco, CA