AI Evaluation Scientist: Measurement & Validation
Apple Inc.
Apple Inc. in Seattle is seeking a Measurement Scientist to pioneer AI evaluation methods that are scientifically valid and trusted. You will apply psychometrics, validity frameworks, and statistical rigor to set measurement standards across AI platforms. The role bridges measurement science with cutting-edge AI work, partnering with ML researchers and engineers to productionize evaluation tools, publish results, and help scale reliable assessments across products. #J-18808-Ljbffr Apple Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Scientist: Measurement & Validation in Seattle, WA vacancy
- Apple is seeking a Research Scientist in AI Evaluation Science to advance evaluation methodology for LLMs, agentic systems, and human‑AI interaction... ...theory and practical impact, with collaboration across measurement scientists, ML researchers, and engineers. #J-18808-...Suggested
$30 - $35 per hour
...French‑Speaking AI Evaluation Specialist Remote We are looking for a French‑Speaking AI Evaluation... ...qualified people with disabilities. We measure progress toward a goal of at least7%of... ...unless such collection displays a valid OMB control number. This survey should take...SuggestedFor contractorsFor subcontractorRemote workFlexible hoursBlueprint Consulting Services
Bellevue, WA3 days ago$168k - $211k
...day, Cambia's Applied AI Team is living our mission... ...and lives better. AI Scientists work with various... ...value AI opportunities, evaluate emerging technologies,... ...initiatives that create measurable business value.... ...inference, and statistical validation. Proactively identify...SuggestedWork experience placementWork at officeImmediate startRelocation3 days per week- Apple Inc. in Seattle, WA, seeks a Senior Applied Scientist to advance AI evaluation quality systems. You will build scalable ground-truth pipelines, calibration frameworks, and autonomous QA agents to ensure data powering AI/ML systems meets high accuracy, consistency...Suggested
$266.72k - $350.07k
...The Enterprise Data & AI organization is a strategic... ...innovation, unlocks measurable value, elevates guest... ...Applied AI/ML Scientist, you define and drive... ...enterprise experimentation and validation standards that connect... ...AI systems, evaluation frameworks, and responsible...SuggestedPermanent employmentPart timeWork visa$139.5k - $258.1k
...Washington, United States - Machine Learning and AI Do you get excited by driving product impact via measurement and evaluation, for products and services used by hundreds... ...causal topics) to persons ranging from data scientists to engineers to business partners....Relocation package$80 per hour
Prolific is looking for Data Scientists and Data Analysts to join our Expert Network to evaluate AI models using technical expertise. Successful candidates can earn... ...LLMs. Responsibilities include reviewing AI data, validating statistical claims, and ensuring model...Remote jobHourly payWork from homeFlexible hours- ChatGPT Jobs is seeking a contractor for a remote position focused on evaluating AI training problems and ensuring scientific realism in task design. The ideal candidate will have a Master’s or PhD degree or substantial experience in engineering or related fields. This...Remote jobFor contractors
- ...seeking an experienced ML Engineer to design and deploy agentic AI systems that autonomously plan, reason, and act across... ...research teams, advancing agentic techniques, and maintaining robust evaluation and safety measures across diverse scenarios. #J-18808-Ljbffr Expedia, Inc.
- A leading AI research accelerator is seeking Geospatial Experts to enhance AI systems through evaluations and real-world applications. This entry-level contractor position is fully remote with flexible hours, primarily focusing on geospatial reasoning tasks. Responsibilities...Remote jobFor contractorsFlexible hours
$129.75k - $207.6k
...Computer Vision and Machine Learning Scientist to join our AI team, focusing on AI applications in... ...for specific hardware architectures. Evaluate the performance of MLLM models using... ...world datasets and design experiments to validate their effectiveness. Stay up‑to‑date...$159.75k
...seeking a skilled and innovative Senior AI Research Scientist to join a new team focusing on agentic... ...reasoning models and systems, and validate their effectiveness in real-world settings... ...strategy through model development, evaluation, deployment, and iteration in production...Work experience placement$131.08k - $196.77k
...experienced Principal Data Scientist to provide technical... ...for shaping AI and ML strategy, defining... ...solutions that create measurable business value. You have... ...counterfactual analysis, to evaluate the impact of data... ...engineering, training, validation, deployment,...Full timeTemporary workWeyerhaeuser
Seattle, WA1 day ago$88.66k - $104.3k
...maintain quantitative tools and models that measure risks to earnings and capital, including... ...default, and exposure at default. Evaluate and enhance models to ensure relevance, accuracy... ...agency and/or search firm without a valid written and signed search agreement, will...Banner Bank
Seattle, WA12 hours ago$64k - $100k
...Microsoft fabric data agents; Azure AI Services; AI and ML... ...stakeholders (experimentation, measurement, BI/reporting, engineering) to... ...dictionary, metric definitions, validation rules, and acceptance... ...RBAC, data access boundaries); evaluation metrics (accuracy, timeliness...$60 per hour
Prolific is looking for Computer Science Specialists to train and evaluate cutting-edge AI models. Ideal candidates should have a BSc in Computer Science or a related technical field and strong analytical skills. Responsibilities include comparing AI-generated responses...Hourly pay- Alignerr is seeking a Biology Subject Matter Expert to help evaluate and improve AI systems trained on advanced biological content. Your domain knowledge will shape how AI understands, reasons through, and communicates complex biology—from cellular mechanisms to biotechnology...Remote jobHourly payContract work10 hours per week
$126.65k - $171.35k
...Senior Artificial Intelligence (AI)/Lean Project Management... ...Coordinates data governance, model validation, testing, and compliance... ...implementation guidance to help leaders evaluate, prioritize, and responsibly... ...enabled solutions that drive measurable value This position is...Permanent employmentWork at officeRelocationVisa sponsorshipWork visaRelocation packageFlexible hoursShift workDay shift- Apple Inc. is seeking a data scientist to research and develop evaluation methods for improving product quality across Siri, Apple Intelligence, and other user-facing features. You will partner with engineering teams to translate methodological developments into practical...
$170k - $225k
# Data Scientist II, WW DSP AnalyticsAmazonBe an Early ApplicantFull... ...and business health measurement across the global DSP network... ...stakeholders to define KPIs, validate analytical approaches, and ensure... ...1+ years of working with or evaluating AI systems experience*...Full timeFlexible hours$140k - $170k
...high-quality features, and evaluate new data sources that feed our... ...closely with senior data scientists and engineers while developing... ...extraction, transformation, and validation; contribute to code reviews... ...statistics (similarity measures, clustering, evaluation metrics...$165k - $185k
...partnerships that deliver measurable business results. Your... ...seeking a Senior Data Scientist to serve as an... ...lifecycle: training, evaluation, deployment, A/B testing... ...beyond offline metrics — validating model behavior in live... ...tools (BigQuery, Vertex AI, Dataflow, Pub/Sub)...Temporary workWork at officeHome officeFlexible hoursShift work- ...role, you will perform advanced data analysis to drive product improvements for user-facing services like Siri through rigorous evaluation methods. The ideal candidate will have a PhD or Master's degree in relevant fields, strong data science skills, and programming expertise...
$115.2k - $230.4k
...expanding portfolio of Medicaid quality measurement work. This position will play a key role... ...technical specifications, building and validating measure logic, identifying methodology... ...motivated by an environment that embraces AI and technology-enabled tools. Work...Minimum wageWork at officeLocal areaRemote workFlexible hours3 days per week1 day per weekMercer
Seattle, WA2 days ago$80 per hour
Prolific is looking for an AI & Machine Learning Engineer to evaluate AI architectures, audit code, and refine frameworks. Ideal candidates will hold a BS, MS, or PhD in relevant fields and have experience in ML model development. Responsibilities include providing critical...Remote jobHourly payFlexible hours- ...Responsibilities Develop, train, and evaluate large-scale AI/ML models across diverse biological data types. Investigate new modeling paradigms to address open biological research questions. Translate complex scientific questions into computational frameworks, experiments...
Jobtailor
Seattle, WA2 days ago $146.6k - $183.25k
...high-reward questions in biology through AI – inventing computational methods and large... ...a curious and motivated AI Research Scientist to invent and advance machine learning methods... ...and engineers, the AI Research Scientist evaluates model performance, limitations, and...Work at officeLocal areaRemote workVisa sponsorshipWork visaRelocation packageClearCompany
Seattle, WA1 day ago$85k - $110k
...expertise among ourselves and our customers. The AI Enablement Specialist helps PitchBook... ..., and best practices, with success measured by adoption and business outcomes rather... ...through approval, installation, connectivity, validation, and user training - closing the gap...Work at officeImmediate startRemote workWorldwideVisa sponsorship- PNNL in Richland or Seattle, WA seeks a Data Scientist II - AI Assurance Researcher to investigate AI model mechanics and produce mission‑... ...involves designing large‑scale ML experiments on HPC systems, evaluating robustness and generalization, and collaborating with senior...
$165.3k - $209.2k
...Foundational Modeling team at Splunk, where we advance the state of AI for high‑volume, real‑time, multi‑modal machine‑generated data —... ...advance team capabilities and project outcomes. Explore and evaluate new AI/ML techniques, tools, and methodologies, applying...Full timeTemporary workLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Scientist: Measurement & Validation. Be the first to apply!
