Staff Data Scientist - Evaluations & LLM Quality (Hybrid)
$210k - $385kPantera Capital
A leading financial technology firm seeks a Data Scientist to architect evaluation pipelines and improve answer quality through innovative evaluations. Candidates should possess a PhD or MS in a technical field with at least 4 years of relevant experience, strong skills in Python and SQL, and familiarity with AWS and Databricks. The role offers a hybrid work environment and a competitive salary package ranging from $210K to $385K along with comprehensive benefits. #J-18808-Ljbffr Pantera Capital
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Data Scientist - Evaluations & LLM Quality (Hybrid) in San Francisco, CA vacancy
- ...enterprise AI company, is hiring a Member of Technical Staff in Data Analysis and Evaluation. You will design data-collection tasks, apply statistical... ...Collaborate with researchers and engineers to improve dataset quality and model performance, including distributed training of...Quality
- Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation...Quality
$164.7k - $339.08k
...seeking an experienced Staff Data Scientist to join our Finance &... ...team. This is a hybrid data-science / applied... ...catching and resolving data-quality issues.Partner... ...and forecast-accuracy evaluation, and seasonality analysis... ...applying modern AI/LLM tooling to real...QualityWork at officeLocal areaRelocationRelocation package$238k - $302k
...across 15+ U.S. states. The Large Model Evaluation team is at the nexus of Waymo’s AI... ...model development and deployment. Build data pipelines for signal discovery, data labeling... ..., etc. Experience evaluating the quality of ML models Demonstrated experience taking...QualityFull timeRemote workWaymo
San Francisco, CA1 day ago$210k - $385k
...Employment Type Full time Location Type Hybrid Department Data Science Compensation $210K - $38... ...users daily with reliable, high-quality answers grounded in an LLM-first search engine and our... ...Architect and maintain automated evaluation pipelines to assess answer...QualityFull timeLocal area$155k - $189k
...looking for a highly skilled and motivated Staff Data Scientist to join our Time Products Data Science... ...based on sample size and data quality.Execution: Deliver multiple high-impact... ...required. This includes non-office days for hybrid employees.Our customers come from all walks...QualityFull timeWork at officeLocal area2 days per week3 days per week$172.5k - $260.1k
...RoleWe are looking for an experienced Staff Data Scientist to support Slack's Go-to-Market (GTM)... ...methods to understand customer behavior, evaluate strategic initiatives, and optimize... ...learning.Experience developing production-quality analytical models and partnering with...QualityFull time- ...is seeking an AI Product Engineer (LLM, voice AI agent) for a full-time position... ...in San Francisco, CA. The role is hybrid with 2-3 days onsite weekly,... ...candidate scores, and run reliability evaluations to ensure consistent quality. #J-18808-Ljbffr Software Guidance...QualityFull time
$238k - $302k
...seeking a skilled professional to lead methodologies for evaluating its autonomous driving technology. This hybrid role involves developing performance metrics,... ...have at least seven years of industry experience in data science. The position offers a competitive salary...Quality- ...research for their next generation of LLM products. Join us if you: Wish to work... .... Responsibilities Own LLM evaluation processes and methods with a focus on... ...safety vulnerabilities. Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking...QualityLocal areaShift work
$130.1k - $165k
...at the intersection of data science, growth strategy... ...environment.This is a hybrid role based out of our San... ...recommendations.Evaluate and implement advanced... ...data models, improve data quality, and define scalable pipelines... ...agentic workflows, or LLM-based applications that...QualityFull timeTemporary workWork at officeLocal areaRelocation packageFlexible hours2 days per week$230k - $284k
...across 15+ U.S. states. Waymo’s Product Data Science team works cross-functionally with... ...across the company - from driving quality and operational efficiency to market analysis... ...to new information. This role follows a hybrid work schedule and you will report to the...QualityFull timeWork experience placement$202k - $282k
The Data Science team at the company is pivotal in fulfilling our... ...with an office‑centric hybrid schedule. The standard in‑office... ...the technical bar for modeling quality, code rigor, data pipeline... ...and guidance to a team of data scientists at varying levels, helping them...QualityWork at officeLocal areaWork from homeWorldwide$212k - $265k
...better mental health outcomes. As a Staff Data Scientist, Product Analytics , you will be a senior... ...will influence what we build, how we evaluate it, and how we scale what works. This... ..., online experiments, and human-quality signals when needed. Build scalable analytical...QualityWork from homeFlexible hours$160k - $200k
The Opportunity As a Staff Data Scientist on the Clinical Performance team, you will be the lead... ...providers. While your primary focus is evaluative, you will be a key player in the broader... ...forecasting engines that predict our quality performance across various value-based...Quality$164.7k - $339.08k
...Pinterest is seeking an experienced Staff Data Scientist to join our Finance &... ...Operations team. This is a hybrid data‑science / applied‑AI /... ...backtesting and forecast‑accuracy evaluation, seasonality analysis.... ...on experience with modern AI/LLM tooling, moving from experiment...Work at officeLocal areaRelocationRelocation package$155.6k - $306.8k
...a Senior Microsoft AI&Data FDE, you will work side... ...decisions that balance quality, safety, latency, cost,... ...data, AI, network, and hybrid cloud infrastructure. These... ...and deploying GenAI/LLM-powered solutions in client... .../LLMOps practices: evaluation frameworks, model monitoring...QualityLocal area$230k - $284k
...states. Waymo’s Product Data Science team works... ...company — from driving quality and operational efficiency... .... In this hybrid role, you will report to a Staff Product Data Scientist. You will:... ...experiment design and evaluation across the broader product...QualityFull timeRemote work$195k - $257.5k
...everyone is a stakeholder.What you’ll be responsible forAs a Staff Data Scientist at Circle, you will partner closely with product, payments,... ...problem-solving skills with strong attention to detail and data quality.Preferred RequirementsDeep experience working with payments...QualityLocal areaFlexible hours$164.7k - $339.08k
...contributor, shaping how Pinterest's Ads organization leverages data for strategic decision-making and operational excellence. You'll... ...and identifying new opportunities.Ensure Data Trustworthiness and Quality: Establish and uphold high standards for data integrity,...QualityWork at officeLocal areaRelocationRelocation package$164.7k - $339.08k
...rhythms, executive decision-making, and strategic planning.Lead and mentor. Guide the work of at least two data scientists, raising the bar on technical quality, execution, and impact through candid, continuous feedback and coaching.What we’re looking for:8+ years of combined...QualityWork at officeLocal areaRelocationRelocation package$164.7k - $339.08k
...do:Develop measurement frameworks and metrics to drive data-driven decision making, optimizing for the full user journey... .... Leadership: Mentor the scope of work for other data scientists, demonstrating high-quality output of both yourself and others for whom you mentor....QualityWork at officeLocal areaRelocationRelocation package- .... About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure... ...of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI...QualityFull timeWork at officeRelocation package
Mercor
San Francisco, CA1 day ago - ...their company's data and fueled by WRITER... ...the world. As a staff AI research scientist, you'll be at the... .... This role is hybrid, based out of our... ...model training, evaluation, and production deployment... ...the high-quality training signal driving... ...— including LLM-as-judge...QualityFull timeWork at officeLocal areaFlexible hours
$193.6k - $242k
...to thrive.As an Applied Scientist specializing in Machine... ...with Data Scientists, Engineers,... ...contextWrite production quality code. Design, build and... ...and existing problems. Evaluate machine learning systems... ...will be in-office on a hybrid schedule — Team Members...QualityHourly payWork at officeLocal area3 days per week- Cacheflow is seeking a Senior Data Engineer in San Francisco to support their growing data... ...-scale data products and ensuring data quality while empowering all teams with self-... ...explain complex data flows. Cacheflow offers a hybrid work environment and a comprehensive...Quality
$60 - $70 per hour
...healthcare technology company to hire a Data Engineer, Senior for its Data Services team... ...(six-month contract term) Location: Hybrid — 2x/week onsite; San Diego, Long Beach,... ...reusable frameworks and patterns. DevSecOps & Quality Integration Integrate security,...QualityContract work$189.2k - $372.9k
...As a Lead Microsoft AI&Data FDE, you will serve as... ...onshore with clients or in hybrid onshore/offshore... ...define success metrics (quality, latency, cost, adoption... ...and oversee delivery of LLM-enabled applications including... ...and scalability.Define evaluation frameworks covering...QualityLocal areaVisa sponsorship- As a Data Engineer at Regard, you will help build and... ..., and help ensure the quality and availability of... ...Practical experience with LLM‑assisted development, with... ...learning training, evaluation, or production workflows... ...paced startup environment Hybrid Work | Location | Work...QualityWork at officeLocal areaHome officeVisa sponsorshipRelocation package
$185k - $221.4k
...develop and critically evaluate therapeutic hypotheses.... ...Build and own production data infrastructure. Design,... ...Model and curate high-quality data assets. Perform... ...that GenAI agents and LLM orchestrators depend on... ...healthcare, generous PTO, and hybrid/remote options aligned...QualityRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Scientist - Evaluations & LLM Quality (Hybrid). Be the first to apply!
Related searches
- assistant scientist San Francisco, CA
- data scientist (hedge fund) San Francisco, CA
- healthcare data scientist San Francisco, CA
- data scientist San Francisco, CA
- entry level data scientist San Francisco, CA
- part time data scientist San Francisco, CA
- ai data scientist San Francisco, CA
- senior data scientist San Francisco, CA
- principal data scientist San Francisco, CA
- entry level data scientist remote San Francisco, CA