Staff Data Scientist - Evaluations & LLM Quality (Hybrid)
$210k - $385kPantera Capital
A leading financial technology firm seeks a Data Scientist to architect evaluation pipelines and improve answer quality through innovative evaluations. Candidates should possess a PhD or MS in a technical field with at least 4 years of relevant experience, strong skills in Python and SQL, and familiarity with AWS and Databricks. The role offers a hybrid work environment and a competitive salary package ranging from $210K to $385K along with comprehensive benefits. #J-18808-Ljbffr Pantera Capital
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Staff Data Scientist - Evaluations & LLM Quality (Hybrid) in San Francisco, CA vacancy
- Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation...Quality
$164.7k - $339.08k
...seeking an experienced Staff Data Scientist to join our Finance &... ...team. This is a hybrid data-science / applied... ...catching and resolving data-quality issues.Partner... ...and forecast-accuracy evaluation, and seasonality analysis... ...applying modern AI/LLM tooling to real...QualityWork at officeLocal areaRelocationRelocation package$238k - $302k
...across 15+ U.S. states. The Large Model Evaluation team is at the nexus of Waymo’s AI... ...model development and deployment. Build data pipelines for signal discovery, data labeling... ..., etc. Experience evaluating the quality of ML models Demonstrated experience taking...QualityFull timeRemote workWaymo
San Francisco, CA17 hours ago$210k - $385k
...Employment Type Full time Location Type Hybrid Department Data Science Compensation $210K - $38... ...users daily with reliable, high-quality answers grounded in an LLM-first search engine and our... ...Architect and maintain automated evaluation pipelines to assess answer...QualityFull timeLocal area$238k - $302k
...Staff Data Scientist Waymo is an autonomous driving technology company... ...states. Rigorous behavioral evaluation of the Waymo Driver is a... ...initiatives for measuring the quality and trustworthiness of the... ...priorities. In this hybrid role you will report to a Data...QualityFull timeRemote workWaymo
San Francisco, CA2 days ago$300k
...Staff Data Scientist Grindr is an AI-native platform powering how millions... ...deployed to production and improve quality of life for our millions of... ...full lives. This is a hybrid role based in our Bay Area,... ...questions Design and evaluate experiments to measure the impact...QualityWork at officeImmediate startWorldwideFlexible hoursGrindr
San Francisco, CA1 day ago$179.5k - $269.5k
...Staff Data ScientistGoFundMe is the world's most powerful... ...for a Staff Data Scientist to help shape how GoFundMe... ..., and Product to evaluate acquisition, retention... ...without compromising quality, accuracy, or review standards... ...for things like hybrid work, family planning,...QualityFull timeWork at officeFlexible hoursGoFundMe
San Francisco, CA1 day ago$155k - $189k
...looking for a highly skilled and motivated Staff Data Scientist to join our Time Products Data Science... ...based on sample size and data quality.Execution: Deliver multiple high-impact... ...required. This includes non-office days for hybrid employees.Our customers come from all walks...QualityFull timeWork at officeLocal area2 days per week3 days per week$172.5k - $260.1k
...RoleWe are looking for an experienced Staff Data Scientist to support Slack's Go-to-Market (GTM)... ...methods to understand customer behavior, evaluate strategic initiatives, and optimize... ...learning.Experience developing production-quality analytical models and partnering with...QualityFull time$202k - $282k
...The Data Science team at Asana is pivotal in fulfilling our mission... ...with an office‑centric hybrid schedule. The standard in‑office... ...technical bar for modeling quality, code rigor, data pipeline architecture... ...guidance to a team of data scientists at varying levels, helping...QualityWork at officeWork from homeAsana
San Francisco, CA4 days ago$238k - $302k
...seeking a skilled professional to lead methodologies for evaluating its autonomous driving technology. This hybrid role involves developing performance metrics,... ...have at least seven years of industry experience in data science. The position offers a competitive salary...Quality- ...research for their next generation of LLM products. Join us if you: Wish to work... .... Responsibilities Own LLM evaluation processes and methods with a focus on... ...safety vulnerabilities. Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking...QualityLocal areaShift work
$130.1k - $165k
...at the intersection of data science, growth strategy... ...environment.This is a hybrid role based out of our San... ...recommendations.Evaluate and implement advanced... ...data models, improve data quality, and define scalable pipelines... ...agentic workflows, or LLM-based applications that...QualityFull timeTemporary workWork at officeLocal areaRelocation packageFlexible hours2 days per week$212k - $265k
...better mental health outcomes. As a Staff Data Scientist, Product Analytics , you will be a senior... ...will influence what we build, how we evaluate it, and how we scale what works. This... ..., online experiments, and human-quality signals when needed. Build scalable analytical...QualityWork from homeFlexible hours$155.6k - $306.8k
...a Senior Microsoft AI&Data FDE, you will work side... ...decisions that balance quality, safety, latency, cost,... ...data, AI, network, and hybrid cloud infrastructure. These... ...and deploying GenAI/LLM-powered solutions in client... .../LLMOps practices: evaluation frameworks, model monitoring...QualityLocal area$164.7k - $339.08k
...contributor, shaping how Pinterest's Ads organization leverages data for strategic decision-making and operational excellence. You'll... ...and identifying new opportunities.Ensure Data Trustworthiness and Quality: Establish and uphold high standards for data integrity,...QualityWork at officeLocal areaRelocationRelocation package$195k - $257.5k
...everyone is a stakeholder.What you’ll be responsible forAs a Staff Data Scientist at Circle, you will partner closely with product, payments,... ...problem-solving skills with strong attention to detail and data quality.Preferred RequirementsDeep experience working with payments...QualityLocal areaFlexible hours$164.7k - $339.08k
...rhythms, executive decision-making, and strategic planning.Lead and mentor. Guide the work of at least two data scientists, raising the bar on technical quality, execution, and impact through candid, continuous feedback and coaching.What we’re looking for:8+ years of combined...QualityWork at officeLocal areaRelocationRelocation package$164.7k - $339.08k
...do:Develop measurement frameworks and metrics to drive data-driven decision making, optimizing for the full user journey... .... Leadership: Mentor the scope of work for other data scientists, demonstrating high-quality output of both yourself and others for whom you mentor....QualityWork at officeLocal areaRelocationRelocation package$185k - $221.4k
...Senior Data EngineerSan Francisco, CAForesite Labs... ...develop and critically evaluate therapeutic hypotheses.... ....Model and curate high-quality data assets. Perform entity... ...that GenAI agents and LLM orchestrators depend on... ..., generous PTO, and hybrid/remote options aligned...QualityRemote workFlexible hoursForesite Labs
San Francisco, CA2 days ago- ...Senior Data Engineer As a Senior Data Engineer at Regard,... ...and enforcing rigorous data quality standards so our analytics are... ...~ Practical experience with LLM-assisted development, with... ...deployment, and ongoing performance evaluation Hybrid work | Location | Work...QualityWork at officeLocal areaHome officeVisa sponsorshipRelocation package
REGARD
San Francisco, CA3 days ago - .... About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure... ...of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI...QualityFull timeWork at officeRelocation package
Mercor
San Francisco, CA17 hours ago - ...We are seeking a high-impact Staff Data Scientist to play a leading role on our data needs... ...and monitoring reports. Performance Evaluation and Statistical Analysis: Establish frameworks... ...0,000, bonus, and equity. #LI-IB1 #LI-Hybrid Heartflow is an Equal Opportunity...Work experience placementLocal areaWorldwideRelocation
HeartFlow
San Francisco, CA3 days ago $130k - $200k
...it starts with the data. We’re on a... ...organizations to empower scientists, engineers,... ...Role This role is hybrid (3 days/week in office... ...(semantic layer, LLM tooling, evals, and... ...Snorkel. Protect Quality: Work with Engineering... ...layers, LLMs, evaluation frameworks) reliably...QualityWork at office3 days per weekEquinox
San Francisco, CA12 hours ago$193.6k - $242k
...to thrive.As an Applied Scientist specializing in Machine... ...with Data Scientists, Engineers,... ...contextWrite production quality code. Design, build and... ...and existing problems. Evaluate machine learning systems... ...will be in-office on a hybrid schedule — Team Members...QualityHourly payWork at officeLocal area3 days per week$212k - $265k
...Staff Data Scientist, GrowthJoin us to build the measurement and decision engine for patient growth.As a Staff Data Scientist, Growth, you will... ...assumptions, offline conversion integration, and data quality monitoring so measurement is robust. Advocate for minimal, decision...QualityTemporary workShift workHeadway - Design & Development
San Francisco, CA1 day ago$100 - $150 per hour
...Summers , and Jack Dorsey . Position: Data Scientist Talent Network Type: Contract... ...pipelines , and technical reports. Evaluate AI-generated or human-created work against established criteria to ensure quality and accuracy. Provide detailed written...QualityContract workSummer workRemote workMercor
San Francisco, CA6 days ago$100 - $150 per hour
...Summers , and Jack Dorsey . Position: Data Scientist Talent Network Type: Contract... ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria to ensure quality and consistency. Provide detailed...QualityContract workSummer workRemote workMercor
San Francisco, CA12 days ago- Cacheflow is seeking a Senior Data Engineer in San Francisco to support their growing data... ...-scale data products and ensuring data quality while empowering all teams with self-... ...explain complex data flows. Cacheflow offers a hybrid work environment and a comprehensive...Quality
$175k - $234k
...Future Neighbors As Data Scientists at Nextdoor, you will... ...environment that embraces a hybrid employment model,... ...increasingly relies on LLM-driven query... ...query understanding and evaluation. Your responsibilities... ...Care deeply about data quality and empower employees...QualityWork at officeLocal areaWork from homeNextdoor
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Scientist - Evaluations & LLM Quality (Hybrid). Be the first to apply!
Related searches
- assistant scientist San Francisco, CA
- data scientist (hedge fund) San Francisco, CA
- healthcare data scientist San Francisco, CA
- data scientist San Francisco, CA
- entry level data scientist San Francisco, CA
- part time data scientist San Francisco, CA
- ai data scientist San Francisco, CA
- senior data scientist San Francisco, CA
- principal data scientist San Francisco, CA
- entry level data scientist remote San Francisco, CA