Senior AI Evaluation Scientist — Quality & Validation
Apple Inc.
Apple Inc. in Seattle, WA is seeking a Senior Applied Scientist to advance AI evaluation and quality systems. You will design scalable ground-truth pipelines and real-time monitors, calibrate evaluators against human gold sets, and surface root-cause analysis to improve AI judgments. Collaboration with ML teams and annotators ensures practical, trustworthy results. The role emphasizes fluency in research and engineering, with strong Python skills and production experience building LLM-based #J-18808-Ljbffr Apple Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Evaluation Scientist — Quality & Validation in Seattle, WA vacancy
$159.75k - $255.6k
...a skilled and innovative Senior AI Research Scientist to join a new team focusing... ...data.Develop performance and quality metrics for agentic... ...reasoning models and systems, and validate their effectiveness in... ...through model development, evaluation, deployment, and iteration...QualitySeniorWork experience placementWork at officeRemote workAxon
Seattle, WA4 days ago$124k - $280k
...SummaryThe OpportunityAs an AI & GenAI Data Scientist - Senior Manager you will leverage... ...data engineering, data quality, and model development... ...scalable solution delivery- Evaluating model performance,... ...analytics and model outputs- Validating outcomes through experimentation...QualitySeniorFull timeH1bPwC
Seattle, WA2 days ago- Rex.zone is seeking a remote, full-time Senior AI Data Annotation role supporting training-data quality for modern AI/ML systems. You will deliver high-precision human feedback across RLHF, LLM evaluation, prompt evaluation, and QA evaluation to drive measurable model...QualitySeniorRemote jobFull time
- Flodesk, a remote-first email marketing company, seeks an experienced AI Systems professional to own prompts, agent instructions, quality definitions, and evaluation infrastructure. You’ll connect engineering, product, and language models to improve member experiences and...QualitySeniorRemote work
$77k - $202k
...Description & SummaryThe OpportunityAs an AI & GenAI Data Scientist-Senior Associate you will leverage advanced... ...models, data pipelines, and data quality checks for analytical solutions-... ...collaborating closely with team members. We evaluate these factors thoughtfully to...QualitySeniorFull timeH1bShift workPwC
Seattle, WA4 days ago$150k - $250k
...owners do not need to be expert marketers to grow. Today, our AI helps members create and edit emails, but that is only the... ...good. You will own Flodesk's prompts, agent instructions, quality definitions, evaluation criteria and continuous-improvement loop by building the...QualitySeniorImmediate startRemote workRelocationFlexible hours- General Motors is seeking a Senior Engineer for the Embodied AI Scaling Foundations team to... ...You will design and implement evaluation and introspection tools used... ...across Data, Infra, and validation groups. You will influence model quality, deployment readiness, and data...QualitySeniorRemote job
- Amazon.com Services LLC's AGI Responsible AI team seeks an Applied Scientist III to advance evaluation of frontier models, focusing on safety, fairness, and trust. You will design benchmarks, metrics, and scalable evaluation systems for large language models and generative...Senior
$184k - $287.5k
...interested in inventing human-level AI for navigation in the... ...Create training, fine-tuning, and evaluation pipelines for large-scale... ...metrics that balance perception quality, geometric consistency,... ...evaluation, simulation-based validation, and production monitoring.Ability...QualitySeniorFull timeRemote workShift workNvidia
Seattle, WA4 days ago- AI/ML Engineer**** Please note: This role is not... ...team of engineers, data scientists, and AI thought leaders... ...techniques.* Experience with AI validation, evaluation, observability, and production quality metrics such as... ...: $116,000-$145,000* Senior Consultant: $145,000-$1...QualitySeniorTemporary workWork at officeLocal area3 days per week
Slalom
Seattle, WA1 day ago $91k - $321.5k
...SummaryThe OpportunityAs a CTIO - AI Engineer- Senior Manager, you will play a... ...network to deliver quality results, motivating and coaching... ...opportunities. Your ability to validate outcomes with clients, share... ...closely with team members. We evaluate these factors thoughtfully...QualitySeniorFull timeH1bPwC
Seattle, WA1 day ago- Job Title: Senior Safety Verification and Validation Engineer Type: Contract (12-months) Contractor Work... ...applicable tests, to support safety evaluations. Identify uncertainties within... ...safety, performance, and quality requirements for core and reactor...QualitySeniorContract workFor contractorsLocal areaRemote work
System One Holdings, LLC
Bellevue, WA1 day ago $137.45k - $231k
...data foundation powering AI and self-serve analytics... ...the reliability and data quality of what ships.Serve as the senior technical lead for the team... ...retrieval pipelines, and evaluation practices that keep them... ...fraud detection tool, to validate the authenticity of applications...QualitySeniorFull timeRemote workFlexible hoursSamsara
Seattle, WA1 day ago$159.2k - $301.6k
...Opportunity We are looking for a Senior AI Systems Engineer with deep... ...service integration layers, evaluation systems, and reliability... ...execution interfaces, schemas, validation layers, and error-handling... ...Integration Engineering Build high-quality C++ components for...QualitySeniorFull timeTemporary workLocal areaRemote workWorldwideAdobe Systems
Seattle, WA1 day ago- Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on annotation guidelines compliance, content safety labeling, and...QualitySeniorRemote jobFull time
$184.7k - $324.8k
...States Machine Learning and AI Do you get excited by driving... ...impact via measurement and evaluation, for products and services used... ...teams to improve search quality and guide feature development... ...topics) to everyone from data scientists to engineers to business partners...QualitySeniorWork experience placementRelocationApple Inc.
Seattle, WA1 day ago- mpathic is seeking a Senior Clinical QA Lead to oversee clinical quality across AI safety evaluations, data annotation, labeling, and red-teaming projects. You’ll work with clinical experts, reviewers, researchers, and engineering teams to ensure human data is accurate...QualitySeniorFull timeRemote work
$160.9k - $260.7k
...built and delivered. As AI agents redefine... ...Docker is looking for a Senior Software Engineer to build... ...landscape and balance quality with pragmatism. You make... ...use AI tools critically, validate their output, and stay... ...calibration and consistent evaluations. Recordings are...QualitySeniorFull timeLocal areaRemote workWork from homeHome officeVisa sponsorshipShift work$124k - $280k
...implementing advanced AI and ML solutions... ...to deliver quality results. You motivate... .../or opportunities.Validate outcomes with clients... ...plans. As a Senior Manager, you will... ...engineers and other data scientists to deliver... ...team members. We evaluate these factors thoughtfully...QualitySeniorFull timeH1bPwC
Seattle, WA6 days ago$105.4k - $207.8k
...Deloitte is seeking an AI Cloud Security Engineer, Senior Consultant to design, build... ...lead delivery of production-quality solutions that help... ...model and prompt versioning, evaluation datasets, approval... ...implementing human approval and validation before high-impact...QualitySeniorWork experience placementLocal areaVisa sponsorshipDeloitte
Seattle, WA3 days ago- NRG Energy is seeking a Senior Program Manager, Customer Validation to define and execute validation strategies that ensure products are ready for exceptional... ..., you’ll partner with Product, Engineering, Design, Quality, Operations and Research to determine evidence needs,...QualitySenior
- NRG Energy seeks a Senior Program Manager, Customer Validation to define and execute customer validation strategies ensuring products are ready to deliver... ...partner with Product Management, Engineering, Design, Quality, Operations, and Product Research to determine...QualitySenior
- ...Solutions Inc. is seeking a Senior AI Full Stack Engineer to serve... ...orchestration, and retrieval quality controls (chunking, hybrid... ...relevance scoring, grounding validation), ensuring compliance with Section... ...508 / WCAG 2.1 A and AA. Evaluation, Testing, and AI Security...QualitySeniorPermanent employmentTemporary workFlexible hours
$144.7k - $261.3k
About the Team The Evaluation Foundations team, part of Embodied AI's Scaling... ...machine learning scientists leveraging advanced... ...About The Role As a Senior Engineer in the Embodied... ...and improve high-quality evaluation signal... ...Data, Infra, and validation teams to connect offline...QualitySeniorLocal areaRemote workWork from homeFlexible hours$264k - $379.5k
...enterprise. To usher in this new era, we seek AI-native thinkers across every function who... ...how the Snowflake product is developed, evaluated and supported. The job is no less than... ...a space that is moving fast, making high quality decisions quickly by keeping up with the...QualitySeniorSnowflake
Bellevue, WA6 days ago$116.2k - $229.1k
...Chain Optimization Data Scientist you will be... ...stakeholders.· Design and validate optimization, simulation... ...enterprise systems.· Evaluate scenarios and trade-offs... ...attention to detail and quality of work product· Ability... ...-level employees to senior leaders, we believe there...QualitySeniorLocal areaDeloitte
Seattle, WA3 days ago$180k - $225k
## Senior AI Native Software EngineerApplylocations: Seattle, Washington United States: Arlington... ..., iterating based on what you learn* Evaluate AI-generated output against Remitly's... ...for security, privacy, reliability, and quality before shipping* Participate in customer...QualitySeniorWork at officeWorldwideFlexible hours3 days per weekRemitly
Seattle, WA1 day ago$122k - $240.5k
Position Summary Agentic AI is moving from experimentation... ...attention to detail and quality of work productAbility to build... ...integration, state management, evaluation, guardrails, and human-in-the-... ...From entry-level employees to senior leaders, we believe there’s always...QualitySeniorWork at officeLocal areaVisa sponsorshipShift workDeloitte
Seattle, WA1 day ago- Systems Planning and Analysis, Inc. seeks a Testing and Evaluation AI Subject Matter Expert to provide hybrid support for DHS customers in Washington, DC. The role focuses on integrating AI T&E into DHS acquisition programs, developing robust evaluation methods, and mentoring...SeniorTemporary work
$99k - $232k
...SummaryThe OpportunityAs an AI & GenAI Data Scientist - Manager, you will play a... ...inspiring others to deliver quality. You will be responsible... ...implementation and data engineering- Validating data quality and compliance... ...with team members. We evaluate these factors thoughtfully...QualityFull timeH1bPwC
Seattle, WA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Evaluation Scientist — Quality & Validation. Be the first to apply!
Related searches
- ai data scientist Seattle, WA
- ai scientist Seattle, WA
- senior living Seattle, WA
- senior associate vice president Seattle, WA
- senior app developer Seattle, WA
- senior manufacturing engineer Seattle, WA
- senior ml engineer Seattle, WA
- senior data analyst Seattle, WA
- senior executive director Seattle, WA
- senior application support engineer Seattle, WA