Senior AI Quality & Meta-Evaluation Scientist
$201.3k - $302.2kApple Inc.
Apple Inc. is seeking a Staff Applied Scientist in Seattle, WA, focused on AI Quality and Meta Evaluation. This role involves designing and building a Data Quality Validation framework, ensuring the trustworthiness of LLM evaluations. Key qualifications include a Master’s degree in a related field, extensive experience in data science and machine learning, and proficiency in Python. Apple offers a competitive salary range of $201,300 to $302,200, with additional benefits like comprehensive medical coverage and employee stock programs. #J-18808-Ljbffr Apple Inc.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Quality & Meta-Evaluation Scientist in Seattle, WA vacancy
$139.5k - $258.1k
Senior Applied Scientist - AI Evaluation & Quality Systems Seattle, Washington, United States Machine Learning and AI Apple Services Engineering (ASE) powers... ...for generative AI, including LLM‑as‑a‑judge design, meta‑evaluation, and failure mode analysis Familiarity with...QualitySeniorRelocationShift work$171.6k - $258.1k
Measurement Scientist, AI Evaluation Platform Seattle, Washington, United States Software and Services Apple is where individual imaginations gather... .... Develop and apply psychometric methods to assessing the quality of benchmarks, for example drawing on frameworks like item...QualityWork experience placementRelocation$75.2k - $124.1k
...Reporting and Withholding EDGE Senior Analyst EY is a leader in... ...that comes with producing high-quality, valued work and advice. Your... ...processes or tasks Compile and/or evaluate moderately complex data,... ...capital markets. Enabled by data, AI and advanced technology, EY teams...QualitySeniorSummer holidayFlexible hours- A leading technology company in Seattle is seeking a Senior Applied Scientist to develop and implement innovative quality assessment systems for AI. This role involves designing scalable evaluation frameworks and ensuring data accuracy in AI applications. The ideal candidate...QualitySenior
$55k - $151.47k
...clients, and to deliver quality. Embracing increased... ...part of the People Tech & AI team you will develop,... ...with PwC standards. As a Senior Associate you will... ...platform Executing LLM evaluation frameworks using defined... ...Working with data scientists and ML engineers Upholding...QualitySeniorFull timeWork experience placementH1bRemote workPwC
Seattle, WA3 days ago- ...VTI Aerospace VTI Aerospace builds AI-powered perception and pilot assist... ...edge solutions The Role As a Senior Software Engineer Evaluation, you will design and implement systems... ...wants to have a direct impact on the quality and reliability of our AI systems....QualitySenior
VTI Aerospace
Seattle, WA1 day ago $171.6k - $302.2k
...Senior/Staff Applied ML Engineer – AI/ML Evaluation & Simulation We're building the next generation of AI evaluation... ...outputs Collaborate with scientists and engineers to instrument and assess... ...Understanding of how model quality connects to product outcomes and...QualitySeniorRelocationApple
Seattle, WA3 days ago$159.75k
...are seeking a skilled and innovative Senior AI Research Scientist to join a new team focusing on agentic... ...visual data. Develop performance and quality metrics for agentic multimodal... ...strategy through model development, evaluation, deployment, and iteration in production...QualitySeniorWork experience placement$164k - $313.3k
...Opportunity Photoshop ART is seeking a Senior Machine Learning (ML) Systems & Efficiency... ..., with a clear mandate: deliver high-quality ML systems at substantially lower cost and... ...in areas such as Artificial Intelligence (AI), ML systems, and computer vision. Strong...QualitySeniorTemporary workLocal areaWorldwideAdobe
Seattle, WA16 hours ago$175k - $245k
...Senior Software Engineer II - Applied AI and Evaluations (Remote Eligible) -REMOTE, USA- For over 20 years, Smartsheet has helped people and teams achieve–well... ...scale from early demos to production‑grade agents, quality is the critical frontier and we are looking for an...QualitySeniorFull timeTemporary workLocal areaImmediate startRemote workSmartsheet
Bellevue, WA1 day ago$204k - $259k
...Senior Machine Learning Engineer – VLM/LLM Evaluation Waymo is an autonomous driving technology company with the mission... .... The mission of the Waymo AI Foundations team is to develop machine... ...learning (RL), for evaluating the quality, safety, and realism of embodied...QualitySeniorFull timeTemporary workRemote workWaymo
Kirkland, WA2 days ago$155k - $170k
Sr. Clinical Data Scientist - Applied Intelligence Solutions Seattle, WA Senior Clinical Data Scientist - Applied... ...consume. Generative AI reasoning: Apply an... ...and reviewing production quality analysis code (e.g.,... ...Experience designing, evaluating, or contributing to decision...QualitySeniorFor contractorsRemote workVisa sponsorshipWork visaFlexible hours- ...technology company in Seattle seeks an experienced Senior Data Scientist to enhance foundational models and improve evaluation techniques. If you have over 5 years of... ...in assessing model performance, defining data quality metrics, and leveraging LLMs for automation. Competitive...QualitySenior
$159.75k - $255.6k
...skilled and innovative Machine Learning Scientists to join our AI team, focusing on AI applications (... ...specific hardware architectures. Evaluate the performance of LLM, MLLM, CV models... ...-of-the-art research to deliver high quality models enabling multiple AI projects...QualitySeniorWork experience placementWork at officeRemote workAxon
Seattle, WA1 day ago- B Capital in Seattle is seeking a Senior Decision Scientist who excels in AI, automation, and quantitative analysis. You will build frameworks for evaluating AI systems and lead experiments that shape product strategy. The ideal candidate has over 8 years of experience...Senior
$187k - $261.5k
Senior Machine Learning Scientist Introduction to the Team Expedia Technology teams partner... ...and tools, delivering high‑quality experiences for travelers,... ...is at the forefront of AI‑driven agentic systems, dedicated... ...will: Design, build, and evaluate multi‑step agentic AI...QualitySeniorWorldwide$190.1k - $294.7k
...team is composed of research scientists and software developers who create... ...role, we seek a full‑time Senior Research Scientist to join... ...partners Contribute to high‑quality applied research outputs, including... ..., and expertise, as evaluated during the interview process....QualitySeniorPermanent employmentFull timeH1bRelocation$159.75k
...ll Do Reports to: Director of AI Research Location: This role... ...success. Collaborate with other scientists, engineers and product... ...data. Develop performance and quality metrics for computer vision and... ...through model development, evaluation, deployment, and iteration in...QualitySeniorWork experience placementWork at officeRemote work$252k - $315k
...Machine Learning Research Scientist, Reasoning San... ...New York, NY At Scale AI, our mission is to accelerate... ...access to high-quality data to drive progress... ...on our history of model evaluation with enterprise and government... ...industry leaders like Meta, Cisco, DLA Piper, Mayo...QualityFull timeScale AI
Seattle, WA16 hours ago$170.9k - $251.33k
...an experienced Applied Scientist to join our team. Our team... ...’s state-of-the‑art AI to research, design, and... ..., implementation, and evaluation of machine learning pipelines... ...reporting to a Senior Manager, Machine Learning... ...directly, prompts, and high quality data, overseeing...QualitySeniorContract workWork at officeLocal areaRemote work2 days per week$140k - $210k
...Ventures collaborate to advance AI, social media, and investment... ...future. About the Role As a senior scientific leader, you will drive... ...applied science team, mentor scientists, and partner closely with... ...Design and oversee experiments to evaluate model performance, reliability...SeniorFull timeWork visa$181.1k - $318.4k
...AIML - Senior ML Researcher in Foundation Models, Responsible AI Join us as we build world-class groundbreaking products... ...Apple's values, privacy, and quality standards. This role will be... ...methods and frameworks to train and evaluate foundation models with...QualitySeniorRelocationApple
Seattle, WA1 day ago$184.5k
...building a more open world. Join us.Senior Applied Economist -... ...services, and tools to deliver high-quality experiences for travelers,... ...how ads are ranked, priced, and evaluated in production.You will work closely... ...questionsFamiliarity with AI-driven systems, tools, or workflows...QualitySeniorLocal areaFlexible hours$134.8k - $245.8k
AI Experience Researcher, Product Evaluation, Vision Products Group Seattle, Washington, United States Machine Learning... ..., collaborating with ML and data scientists, software engineers, designers,... ...evaluations that measure those qualities reliably and at scale. This requires...QualityRelocation- ...research accelerator for frontier AI labs and a trusted partner for... ...frontier research with high-quality data, advanced training... ...Does a Typical Day Look Like? Evaluate and refine AI-generated code to... ...Google, Stripe, Amazon, Apple, Meta, Netflix, Microsoft, Datadog,...QualitySeniorFull timeFor contractorsRemote workFlexible hours
Turing
Seattle, WA4 days ago $137.5k
Machine Learning Scientist II (Multi-Product AI) Introduction to Team The Multi-Product AI team at Expedia... ...scalable data pipelines, data quality checks, and model monitoring to ensure... ...insights Use A/B tests and offline/online evaluation frameworks to measure model impact...Quality- Research Scientist, LLM Evaluation & Post-Training page is loaded## Research Scientist, LLM Evaluation & Post-Traininglocations... ...107073**About Centific**Centific is a frontier AI data foundry that curates diverse, high-quality data, using our purpose-built technology...QualityFull timeRemote work
$216k - $270k
...raw compute into breakthrough AI. You will: Architect and... ...isolate hardware failures Evaluate and integrate emerging technologies... ...Our products provide the high-quality data and full-stack... ...closely with industry leaders like Meta, Cisco, DLA Piper, Mayo Clinic...QualitySeniorFull timeScale AI
Seattle, WA3 days ago$142.7k
...group is looking for research scientists and engineers focused on post... ...of large-scale generative AI models. Our goal is to push the... ...work directly impacts the quality, efficiency, and safety of Firefly... ...AI models. Design and evaluate techniques such as RLHF, DPO/...QualitySeniorFull timeTemporary workLocal areaWorldwide$50 - $60 per hour
...DataAnnotation is committed to creating high-quality AI. Join our team to help train the next generation of AI while enjoying the flexibility... ...: Give AI chatbots diverse and complex problems and evaluate their outputs Evaluate the quality produced by AI models for...QualitySeniorHourly payContract workWork experience placementRemote workFlexible hoursData Annotation
Seattle, WAmore than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Quality & Meta-Evaluation Scientist. Be the first to apply!
Related searches
- ai scientist Seattle, WA
- ai data scientist Seattle, WA
- senior development executive Seattle, WA
- senior technical manager Seattle, WA
- senior procurement specialist Seattle, WA
- senior manager data science Seattle, WA
- senior platform engineer Seattle, WA
- senior procurement Seattle, WA
- senior director product management Seattle, WA
- senior cost manager Seattle, WA