Staff Data Scientist - Evaluations & LLM Quality (Hybrid)
$210k - $385kPantera Capital
A leading financial technology firm seeks a Data Scientist to architect evaluation pipelines and improve answer quality through innovative evaluations. Candidates should possess a PhD or MS in a technical field with at least 4 years of relevant experience, strong skills in Python and SQL, and familiarity with AWS and Databricks. The role offers a hybrid work environment and a competitive salary package ranging from $210K to $385K along with comprehensive benefits. #J-18808-Ljbffr Pantera Capital
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Data Scientist - Evaluations & LLM Quality (Hybrid) in San Francisco, CA vacancy
- Cohere is looking for a Member of Technical Staff in Data Analysis and Evaluation to ensure the quality and performance of large language models. The role involves designing data collection tasks, collaborating with teams, and applying statistical methods for data evaluation...Quality
- ...candidate for a role focused on improving answer quality across Perplexity's products. You will architect evaluation pipelines, design methods to measure tool impact... ...technical field and at least 4 years of experience in data science or machine learning, alongside strong...Quality
- ...Full time Location Type Hybrid Department Data Science Perplexity... ...daily with reliable, high-quality answers grounded in an LLM‑first search engine and... ...our users. As a Data Scientist/Engineer on this team,... ...alignment with ground‑truth evaluations Analyze experimental...QualityFull time
$238k - $302k
...Staff Data Scientist Waymo is an autonomous driving technology company... ...states. Rigorous behavioral evaluation of the Waymo Driver is a... ...initiatives for measuring the quality and trustworthiness of the... ...priorities. In this hybrid role you will report to a Data...QualityFull timeRemote workWaymo
San Francisco, CA5 days ago- ...research for their next generation of LLM products. Join us if you: Wish to work... .... Responsibilities Own LLM evaluation processes and methods with a focus on... ...safety vulnerabilities. Generate high quality synthetic data, curate labels, and conduct rigorous benchmarking...QualityLocal areaShift work
$230k - $284k
Waymo is seeking a Staff Product Data Scientist to work in San Francisco on data-driven infrastructure decisions. This hybrid role includes building data science models and collaborating with teams across the organization. The ideal candidate will have a Master’s degree...$230k - $284k
# Staff Product Data Scientist, InfrastructureWaymoFull TimestaffHybridSan Francisco, California, USPosted... ...Infrastructure. This is a full-time hybrid role, based in San Francisco,... ...projects across the company — from driving quality and operational efficiency to market...QualityFull timeWork experience placementRemote work$160k - $200k
The Opportunity As a Staff Data Scientist on the Clinical Performance team, you will be the lead... ...providers. While your primary focus is evaluative, you will be a key player in the broader... ...forecasting engines that predict our quality performance across various value-based...Quality$230k - $284k
...across 15+ U.S. states. Waymo’s Product Data Science team works cross-functionally with... ...across the company — from driving quality and operational efficiency to market analysis... ...adapt quickly to new information. In this hybrid role, you will report to the Product Data...QualityFull timeRemote work$185k - $221.4k
...develop and critically evaluate therapeutic hypotheses.... ...Build and own production data infrastructure. Design,... ...Model and curate high-quality data assets. Perform... ...that GenAI agents and LLM orchestrators depend on... ...healthcare, generous PTO, and hybrid/remote options aligned...QualityRemote workFlexible hoursForesite Labs
San Francisco, CA11 hours ago- ...As a Data Engineer at Regard, you will help build... ...initiatives, and help ensure the quality and availability of... ...experience with LLM‑assisted development, with... ...machine learning training, evaluation, or production... ...paced startup environment Hybrid Work | Location | Work...QualityWork at officeLocal areaHome officeVisa sponsorshipRelocation package
REGARD
San Francisco, CA3 days ago - ...their company's data and fueled by WRITER... ...the world. As a staff AI research scientist, you'll be at the... .... This role is hybrid, based out of our... ...model training, evaluation, and production deployment... ...the high-quality training signal driving... ...— including LLM-as-judge...QualityFull timeWork at officeLocal areaFlexible hours
$160k - $260k
...FinTech unicorn in San Francisco is looking for a Data Engineer. In this hybrid role, you'll collaborate with data scientists to design and build data models and scalable... ...for optimizing datasets and ensuring data quality management. This position offers a competitive...Quality- Cacheflow is seeking a Senior Data Engineer in San Francisco to support their growing data... ...-scale data products and ensuring data quality while empowering all teams with self-... ...explain complex data flows. Cacheflow offers a hybrid work environment and a comprehensive...Quality
$194k - $262.5k
...the Intuit Customer Success (ICS) Data Science team as a Staff Data Scientist. This role will be pivotal in shaping... ...the intersection of data science, LLM engineering and unstructured data mining... ...offline/online evals. Implement evaluation & observability with ground source...Work experience placementLocal areaIntuit
San Francisco, CA1 day ago- ...agentic workflows and AI-powered systems that autonomously explore data, generate hypotheses, monitor business metrics, and... ...of your choice Flexible paid time off Fully covered, high-quality healthcare, including fully covered dependent coverage Additional...QualityFlexible hours
Imprint.com
San Francisco, CA2 days ago - B Capital is seeking a data engineer to ensure high data quality for training AI models. You will own the upstream data quality for LLM post-training and design automated QA methods in a collaborative environment. Ideal candidates will have strong engineering skills, a...Quality
- Reflection in San Francisco is looking for a data engineer dedicated to enhancing data quality for LLM pre-training. Your role will involve collaborating with world-class researchers to establish high standards for data collection and processing. You will design automated...Quality
$240k - $300k
Staff Finance Data Scientist, Consumption Forecasting Location: San Francisco or New York | Hybrid (3 days per week in office) Salary: $240-300k base + bonus + equity (RSUs) This... ...Build scenario simulation frameworks to evaluate pricing changes, packaging adjustments,...Work at office3 days per week$210k - $330k
...time Location Type On-site Department Data Science Compensation $210K - $330K • Offers... ...for someone who's been a great data scientist, analytics engineer, or data engineer - the... ...dbt model generation and validation, data quality agents that detect, diagnose, and fix issues...QualityFull timeLocal area- ...company in California is seeking a Senior / Staff Frontend Engineer to design and refine... ...React. The role involves implementing high-quality UI components, mentoring teammates, and... ...This position offers a competitive salary and a hybrid work model. #J-18808-Ljbffr APIphanyQuality
$175k - $225k
...highly skilled and motivated Data Scientists with extensive experience (7+... ...a business environment. As a Staff Data Scientist, you will play... ...based on sample size and data quality. Execution: Deliver... ...includes non-office days for hybrid employees. Our customers come...QualityWork at officeLocal area2 days per week3 days per week- ...productivity. About the Role As a Data Scientist on Codex, you will measure... ...San Francisco, CA. We use a hybrid work model of 3 days in the... ...improvements (model quality signals, user feedback, evals... ...with NLP/LLMs, code models, or evaluations for generative coding About...QualityWork at officeRelocation package
OpenAI
San Francisco, CA3 days ago $170k - $216k
...Waymo Data Scientist Waymo is an autonomous driving technology company... .... Rigorous performance evaluation of the Waymo Driver is a critical... ..., and driving and service quality. Autonomous driving presents... ...design. In this hybrid role you will report to a Data...QualityFull timeRemote workLatent Logic
San Francisco, CA1 day ago$122.4k - $228k
...Senior Data Scientist This is ideally a hybrid role but open to remote. Role Overview We are looking for... ...development, MLOps, governance, and data quality. Stay current on emerging trends... ...opportunity employer. We evaluate applicants without regard to race,...QualityPart timeLocal areaRemote workBmo
San Francisco, CA14 days ago- ...for a highly motivated Senior Data Scientist to join our growing US-based... ...pipelines, from internal quality metrics to automated assessment... ...and analyze A/B tests to evaluate the effectiveness of product... ...requires a commitment to a hybrid work model, with the expectation...QualityHourly payFull timeWork at officeRemote workFlexible hours
Abridge
San Francisco, CA2 days ago $150k - $170k
...Full time Location Type Hybrid Compensation $150K – $1... ...an experienced Senior Data Platform Engineer, with... ...regulatory requirements Evaluate and integrate third-... ...Large Language Model (LLM) operations, including... ...Exposure building data quality frameworks and automation...QualityFull timeRemote workFlexible hoursEllipsis Health
San Francisco, CA2 days ago$140k - $225.08k
...business‑critical data that is trapped inside... ..., enabling high‑quality analytics, data... ...data engineers, data scientists, ML/AI engineers,... ..., high‑quality LLM outcomes Contribute... ...value Job Designation Hybrid: Employee divides... ..., training, evaluation, deployment, monitoring...QualityContract workWork at officeLocal areaRemote work2 days per weekDocuSign
San Francisco, CA3 days ago$160k - $240k
...seeking a Product Manager for Glean Model Hub to drive LLM portfolio growth and customer enablement. You will evaluate LLM models, define product strategy, and manage... ...experience and strong communication skills. This hybrid role requires 3-4 days a week in San Francisco....Quality3 days per week$210k - $385k
...Employment Type Full time Location Type Hybrid Department Data Science Compensation $210K - $3... ...users daily with reliable, high-quality answers grounded in an LLM-first search engine and... ...users. As our product evolves, our evaluations must remain fast, accurate, and actionable...QualityFull timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Scientist - Evaluations & LLM Quality (Hybrid). Be the first to apply!
Related searches
- assistant scientist San Francisco, CA
- entry level data scientist remote San Francisco, CA
- part time data scientist San Francisco, CA
- work from home data scientist San Francisco, CA
- python data scientist San Francisco, CA
- ai data scientist San Francisco, CA
- data scientist (hedge fund) San Francisco, CA
- python data scientist (contract) San Francisco, CA
- healthcare data scientist San Francisco, CA
- energy data scientist San Francisco, CA