Staff Data Scientist - LLM Evaluation & Quality Pipelines
Perplexity
Perplexity is seeking a Senior ML Evaluation Engineer to build automated evals across our products, ensuring high-quality, reliable answers. You will work on end-to-end evaluation pipelines, measurement of factual accuracy, and user-facing performance metrics, collaborating with ML, product, and data teams. You will design experiments for web-search retrieval, develop VLM-based evaluation methods, and stay current with benchmarks, contributing to product improvements and scalability across #J-18808-Ljbffr Perplexity
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Staff Data Scientist - LLM Evaluation & Quality Pipelines in California, MO vacancy
$164.7k - $339.08k
...seeking an experienced Staff Data Scientist to join our Finance &... ...end to end (data pipeline through user-facing UI... ...catching and resolving data-quality issues. Partner... ...forecast-accuracy evaluation, and seasonality analysis... ...applying modern AI/LLM tooling to real workflows...PipelineQualityWork at officeLocal areaRelocationRelocation package$215k - $265k
Join to apply for the Lead Data Engineer role at Genies... ...layer for the LLM-powered internet. Responsibilities... ...data storage services, evaluating, recommending, and... ...performant, and secure data pipelines and ETL processes, ensuring high-quality, well-documented, and maintainable...PipelineQualityFull timeWork at officeWork from homeFlexible hours$140k - $150k
...automation capabilities, modern data products, and operational... ..., and maintain scalable data pipelines, enterprise data products, APIs... ...practices including data quality validation, automated testing... ...with business stakeholders to evaluate, prioritize, and implement high...PipelineQualityClean Energy Fuels
California, MO3 days ago- ...who expect more. On the data team, that means building... ...design core data models, pipelines, semantic layers, data quality systems, governance practices... ...to AI agents, data scientists, and the rest of the company... ...Shape tooling decisions - evaluate build-versus-buy...PipelineQuality
Perplexity
California, MO3 days ago - ...to machine learning, data mining, statistical, and... ..., and normalization pipeline components using Spark... ...3 Support senior data scientists with feature engineering... ..., and A/B test setup Evaluate third-party and internal... ..., including data-quality profiling, offline experiments...PipelineQuality
$248k - $379.5k
...allows users to play high-quality PC games on various... ...diagnostic recommendations, LLM Chatbot. You will wield the power of Data and AI to help globally... ...Leadership to the team of Data Scientists and Engineers working on... ...prescriptive analytic pipelines to drive optimal...PipelineQuality- ...and practical application of data engineering within the food distribution... ...and implementation of data pipeline solutions to support the... ...new data sources to understand quality, availability and content... ...Working with semi‑structured data LLM Concepts, along with Agentic Development...PipelineQualityRemote jobPermanent employmentFull timeSummer workInternshipSummer internshipH1bLocal areaWork visaRelocation package
- ...Junior Data Engineer — Role Description & Qualifications Role Overview The Junior Data... ...design, development, and maintenance of data pipelines and data infrastructure that enable... ...structured and unstructured data, ensuring data quality, and assisting in building scalable data...PipelineQualityInternship
Enlighten Hacks - Community for Growth
California, MO2 days ago - Zingroll is seeking a Data Engineer to build pipelines that track user behavior and turn raw data into actionable insights for product teams. You will... ...and retention. A startup mindset and strong data quality are valued. 4 weeks availability and market-aligned compensation...PipelineQuality
- ...Your Role The Data Services team is responsible for technical design and end-to-end delivery... ..., building, and operating complex data pipelines and cloud data solutions while embedding... ...Integrate security, automation, and quality controls throughout the SDLC using DevSecOps...PipelineQualityFull timePart timeWork at officeWork from homeHome office2 days per week
Blue Shield Of California
California, MO5 days ago $86.4k - $176.2k
A global technology company is seeking a Data Engineer to design, develop, and maintain data solutions. Responsibilities include building scalable data pipelines, ensuring data quality, and collaborating with cross-functional teams. The role requires a Bachelor's degree...PipelineQuality$120.8k - $151k
...support you need to grow your career. Data at Brex Our Scientists and Engineers work together to make... ...units to create efficient data models, pipelines, and analytics frameworks that drive... ...maintenance of Core Data tables, our high-quality, curated data source for a wide range...PipelineQualityWork at officeRemote workWork from homeBrex
California, MO3 days ago- Jobtailor is seeking a data engineer to design, build, and own scalable Spark/Databricks pipelines for ad bidding and paid acquisition optimization across Google, Meta,... ...and feature datasets for ML models, ensure data quality, and partner across Growth, Marketing,...PipelineQuality
- ...entertainment technology firm is seeking an experienced Sr Data Engineer based in Glendale, CA. You will be responsible for maintaining and developing data pipelines, building APIs, and ensuring data quality for key stakeholders. Candidates should have over 5 years of...PipelineQuality
- INSPYR Solutions is seeking a Sr. Data Engineer for a long-term remote project in the US... ...on building data products, ETL/ELT pipelines, and scalable analytics infrastructure in... ...Live Analytics offering and deliver high-quality data systems. The candidate should have deep...PipelineQualityRemote job
- ...models for Physical AI. We seek a Member of Technical Staff - Data to design and operate large-scale data pipelines ingesting video, lidar, and robot trajectories... ...hundreds of terabytes, and a focus on provenance, licensing constraints, and data quality. #J-18808-Ljbffr VeedaPipelineQuality
$118.6k - $157.14k
...direction of the Department Leadership, the Data Engineer III is responsible for the... ...development to produce efficient and high-quality solutions, in addition to collaboration with... ...IEHP. Create and maintain optimal data pipeline architecture that meet security standards...PipelineQualityTemporary workRemote workMonday to FridayFlexible hoursInland Empire Health Plan
California, MO4 days ago$81.5k - $141.3k
...of the RoleDevelop, constructs, tests, and maintains data architectures such as databases and large-scale processing... ...They are responsible for building & maintaining data pipelines (ETL processes; ensuring data quality & reliability; designing and managing data warehouses...PipelineQualityShift workAbbott Laboratories company
California, MO4 days ago- Design, build, and own scalable Spark/Databricks data pipelines for ad bidding and paid acquisition optimization across Google,... ...clean, documented, reusable tables for analysts and data scientists Own data quality, freshness, and reliability for growth-critical datasets...PipelineQuality
$81.5k - $141.3k
Abbott Laboratories is seeking an Analytics Engineer in California to develop and maintain data architectures. Responsibilities include building data pipelines, ensuring data quality, and collaborating on projects. Candidates should have a Bachelor's in a relevant field...PipelineQuality- ...in CA Industry: Financial / Consumer / Data & Analytics Role Overview We are seeking... ...development, and optimization of modern data pipelines and analytics infrastructure. This role... ...(AWS, GCP, or Azure) Knowledge of data quality, testing, and observability frameworks Experience...PipelineQualityFull timeContract workRemote work
- ...focus on modern technologies across cloud , data , and software disciplines. Our client... ...on building and maintaining scalable data pipelines, robust data models, and modern data... ...client environments Understanding of data quality frameworks and monitoring strategies Seniority...PipelineQualityFull timeContract work
- Job Title: Sr Data Engineer Location: Glendale, CA - Onsite 4 days a week Company Headquartered... ...existing Core Data platform data pipelines Build and maintain APIs to expose data... ...Ensure high operational efficiency and quality of the Core Data platform datasets to ensure...PipelineQuality
- Perplexity is seeking a senior/staff data platform architect to shape the long-term direction... ...ecosystem. You will own end-to-end data pipelines, drive orchestration strategy, and help... ...push for strong observability and data quality. This role emphasizes scale, reliability...PipelineQuality
$141.8k - $173.3k
...donation match IMPACT YOU'LL MAKE Senior Data Engineer is responsible for writing data... ...builds and supports enterprise-class data pipelines and scalable cloud-based data solutions... ...metadata management, master data policies, data quality standards, lineage, and governance...PipelineQualityWork experience placementRemote work$131.76k - $161.06k
...is hiring a Scientific Data Engineer within the Scientific... ...composed of computer scientists, data scientists, and... ..., or scientific data pipelines Strong programming... ...learning pipelines or LLM-based agents Experience... ...Any convictions will be evaluated to determine if they directly...PipelineFull timeWork experience placementImmediate start$190k - $285k
...made significant strides in LLM quality for these products. These products... ...to-sql generation, automatic pipeline generation, knowledge QA and... ...AI/BI Genie). Develop novel data collection, fine-tuning, and... ...tuning, and model evaluation, enabling rapid experimentation...PipelineQualityWork at officeLocal areaWorldwideDatabricks
California, MO3 days ago- Join to apply for the Data Analytics Engineer I role at Jobright... ...teams to ensure data quality and provide advanced analytics... ...develop, and maintain robust data pipelines that efficiently collect, process... .... • Work closely with data scientists, business analysts, and IT...PipelineQualityFull timeWork experience placementH1b
$176.1k - $308.2k
...brings together any AI, any data, and any workflow—... ...memory management, and the evaluation frameworks that ensure... ...retrieval — RAG pipelines, hybrid search, re-ranking... ...critical dependencyofagentic quality. Model integration and... ...— not just integrating LLM APIs or building...PipelineQualityWork at officeImmediate startRemote workFlexible hoursServiceNow
California, MO1 day ago- ...recommendation systems for the LLM era. Our goal is to... ...context and connected data sources to deeply... ...Craftsmanship. We build high quality, tasteful products... ...user. Build the data and evaluation foundations that let... ...retrieval, or personalization pipelines. Taste and judgment...PipelineQuality
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Data Scientist - LLM Evaluation & Quality Pipelines. Be the first to apply!
Related searches
- data scientist California, MO
- python data scientist (contract) California, MO
- junior data scientist remote California, MO
- data scientist (hedge fund) California, MO
- energy data scientist California, MO
- entry level data scientist remote California, MO
- senior data scientist California, MO
- python data scientist California, MO
- healthcare data scientist California, MO
- sap master data California, MO