Staff Data Scientist - Evaluations & LLM Quality (Hybrid)
$210k - $385kPantera Capital
A leading financial technology firm seeks a Data Scientist to architect evaluation pipelines and improve answer quality through innovative evaluations. Candidates should possess a PhD or MS in a technical field with at least 4 years of relevant experience, strong skills in Python and SQL, and familiarity with AWS and Databricks. The role offers a hybrid work environment and a competitive salary package ranging from $210K to $385K along with comprehensive benefits. #J-18808-Ljbffr Pantera Capital
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Staff Data Scientist - Evaluations & LLM Quality (Hybrid) in San Francisco, CA vacancy
- Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation...Quality
- ...candidate for a role focused on improving answer quality across Perplexity's products. You will architect evaluation pipelines, design methods to measure tool impact... ...technical field and at least 4 years of experience in data science or machine learning, alongside strong...Quality
- ...Full time Location Type Hybrid Department Data Science Perplexity... ...daily with reliable, high-quality answers grounded in an LLM‑first search engine and... ...our users. As a Data Scientist/Engineer on this team,... ...alignment with ground‑truth evaluations Analyze experimental...QualityFull time
$300k
...Senior Staff Data Scientist Grindr is an AI-native platform powering how... ...to production and improve quality of life for our millions of... ...live full lives. This is a hybrid role based in our Bay Area... ...strategy for designing and evaluating experiments to measure the...QualityWork at officeImmediate startWorldwideFlexible hoursGrindr
San Francisco, CA1 day ago$200k - $235k
...LiveRamp is the data collaboration platform of choice... ...global network of top-quality partners. Hundreds... ...requirements. Staff Data Scientist LiveRamp is the data... ...the performance of our LLM-based agentic system.... ...and implement rigorous evaluation methodologies to measure...QualityWork at officeWork from homeFlexible hoursNight shiftLiveRamp
San Francisco, CA9 days ago$175k - $235k
...maps and strategies with data-driven analytics and... .... As a senior/staff data scientist focused on product analytics... ...-making * Design and evaluate product experiments... ...distributed data, validating quality and delivering... ...stored in the United States. #LI-Hybrid #LI-KW1QualityWork at office3 days per weekGallup
San Francisco, CA5 days ago$180k - $270k
...the highest standards of data security and privacy... ...systems, data pipelines, or evaluation harnesses that can run... ...like for a Speech LLM, translating capabilities... ...transcription accuracy, audio quality, and reasoning of audio... ...regardless of gender. Hybrid Office: Minimum of 3x...QualityFull timeWork at officeWorldwide- Obsidian is seeking a talented Data Scientist to join our leading AI lab’s GenAI team. The role involves guiding research teams on data science methodologies and improving AI training data quality. Candidates should have a minimum of 3 years of experience in data science...Quality
$230k - $284k
...Staff Product Data Scientist, Expansion Waymo is an autonomous driving technology company with the... ...projects across the company — from driving quality and operational efficiency to market... ...information. This role follows a hybrid work schedule and you will report to...QualityFull timeRemote workWaymo
San Francisco, CA7 days ago- ...Staff Data Scientist The Data team at Imprint builds the data foundation that powers smarter, faster... ...and long-term strategy, enabling high-quality insights into customer behavior,... ...Location & Work Model This is a hybrid role requiring 2–3 days per week onsite...QualityRelocationFlexible hours2 days per week3 days per week
Imprint.com
San Francisco, CA15 days ago $155k - $189k
...Staff Data Scientist - Time Products San Francisco, CA - Hybrid; New York, NY - Hybrid; At Gusto, we're on a mission to grow the small business economy. We... ...offs and limitations based on sample size and data quality. Execution: Deliver multiple high-impact...QualityFull timeWork at officeLocal area2 days per week3 days per weekGusto
San Francisco, CA4 days ago$179.5k - $269.5k
...10. We're looking for a Staff Data Scientist (Pricing) to serve as the senior... ...and coding agents (e.g., LLM-based assistants, autonomous... ..., including monitoring, evaluation, and iteration in live environments... ...assistance for things like hybrid work, family planning, along...Full timeWork at officeLocal areaRemote workFlexible hoursShift workGoFundMe
San Francisco, CA3 days ago$187k - $230k
...looking for a highly skilled and motivated Data Scientist to join our Growth Data Science team. In... ...teams and influence org-wide decision quality in an AI native capacity. Thought... ...required. This includes non-office days for hybrid employees. Our customers come from...QualityFull timeWork at officeLocal area2 days per week3 days per weekGusto
San Francisco, CA4 days ago- ...research for their next generation of LLM products. Join us if you: Wish to work... .... Responsibilities Own LLM evaluation processes and methods with a focus on... ...safety vulnerabilities. Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking...QualityLocal areaShift work
$160k - $200k
The Opportunity As a Staff Data Scientist on the Clinical Performance team, you will be the lead... ...providers. While your primary focus is evaluative, you will be a key player in the broader... ...forecasting engines that predict our quality performance across various value-based...Quality- ...Staff AI Scientist Hybrid - San Francisco, California Our mission... ...activity, and sleep quality by using their Oura Ring... ...and learn from their data. We are building a... ...ranking, generation, and evaluation — and you will be the... ...and preserved by the LLM serving layer....QualityWork at officeLocal areaFlexible hours2 days per week3 days per week
Oura
San Francisco, CA5 days ago $175k - $234k
...Future Neighbors As Data Scientists at Nextdoor, you will... ...environment that embraces a hybrid employment model,... ...increasingly relies on LLM-driven query... ...query understanding and evaluation. Your responsibilities... ...Care deeply about data quality and empower employees...QualityWork at officeLocal areaWork from homeNextdoor
San Francisco, CAa month ago$180k - $240k
...Founding Data Scientist The platform sees more about a... ...'ll build the offline evaluation and online experimentation... ...constraints, the quality and logistics tension,... ...Google Slides included. LLM infrastructure and orchestration... ...Chicago (The Mart). Hybrid, 4 days/week in office...QualityWork at officeZoomLogi
San Francisco, CA3 days ago- ...Brisk Teaching Data Scientist Opportunity Brisk Teaching... ...automated pipelines, and LLM-powered tooling can... ...model generation, data quality monitoring, experiment... ...Bring rigor to how we evaluate features and make ship... ...times a week via our hybrid model in either our San...QualityShift work
Brisk Teaching
San Francisco, CA4 days ago $185k - $221.4k
...develop and critically evaluate therapeutic hypotheses.... ...Build and own production data infrastructure. Design,... ...Model and curate high-quality data assets. Perform... ...that GenAI agents and LLM orchestrators depend on... ...healthcare, generous PTO, and hybrid/remote options aligned...QualityRemote workFlexible hoursForesite Labs
San Francisco, CA3 days ago- ...We are seeking a high-impact Staff Data Scientist to play a leading role on our data needs... ...and monitoring reports. Performance Evaluation and Statistical Analysis: Establish frameworks... ...0,000, bonus, and equity. #LI-IB1 #LI-Hybrid Heartflow is an Equal Opportunity...Work experience placementLocal areaWorldwideRelocation
HeartFlow
San Francisco, CA4 days ago $160k - $260k
...FinTech unicorn in San Francisco is looking for a Data Engineer. In this hybrid role, you'll collaborate with data scientists to design and build data models and scalable... ...for optimizing datasets and ensuring data quality management. This position offers a competitive...Quality- Cacheflow is seeking a Senior Data Engineer in San Francisco to support their growing data... ...-scale data products and ensuring data quality while empowering all teams with self-... ...explain complex data flows. Cacheflow offers a hybrid work environment and a comprehensive...Quality
- ...financial technology company in San Francisco seeks a Data Engineer to design and maintain data models and... ...with teams to craft data solutions and uphold high data quality standards. The position allows for a hybrid work arrangement with flexible remote options and competitive...QualityRemote workFlexible hours
- Airbnb, Inc. is hiring a Senior Staff Machine Learning Engineer, focusing on driving evaluation strategies and data infrastructure for CSxAI initiatives. This role requires... ...significantly impact ... operations to ensure quality and efficiency in AI applications....QualityRemote job
- B Capital is seeking a data engineer to ensure high data quality for training AI models. You will own the upstream data quality for LLM post-training and design automated QA methods in a collaborative environment. Ideal candidates will have strong engineering skills, a...Quality
- ...Perplexity AI Data Scientist Perplexity is AI for people who expect more. This role brings that same standard to how our data team works... ..., automated dbt model generation and validation, data quality agents that detect, diagnose, and fix issues autonomously...Quality
Perplexity AI
San Francisco, CA5 days ago - ...discovery to improve quality of life and extend... ...our computational scientists something rare: a... ...: San Francisco (hybrid) Travel:... ...seeking a Senior / Staff Machine Learning Scientist... ...robot-execution data. ~ Apply... ...including rigorous evaluation, benchmarks, and reproducibility...Quality
Chemify Ltd
San Francisco, CA1 day ago $240k - $300k
Staff Finance Data Scientist, Consumption Forecasting Location: San Francisco or New York | Hybrid (3 days per week in office) Salary: $240-300k base + bonus + equity (RSUs) This... ...Build scenario simulation frameworks to evaluate pricing changes, packaging adjustments,...Work at office3 days per week- ...offices. About the Role As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data... ...of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI...QualityWork at officeRelocation package
Mercor Alabaster
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Scientist - Evaluations & LLM Quality (Hybrid). Be the first to apply!
Related searches
- assistant scientist San Francisco, CA
- python data scientist (contract) San Francisco, CA
- senior data scientist San Francisco, CA
- energy data scientist San Francisco, CA
- part time data scientist San Francisco, CA
- python data scientist San Francisco, CA
- data scientist San Francisco, CA
- principal data scientist San Francisco, CA
- entry level data scientist remote San Francisco, CA
- healthcare data scientist San Francisco, CA