AI Evaluation Scientist - Research & Measurement
Apple Inc.
Apple is seeking a Research Scientist in AI Evaluation Science to advance evaluation methodology for LLMs, agentic systems, and human‑AI interaction. You will conduct original research, publish findings, and partner with platform engineers to productionize methods into SDKs and APIs used across Apple. The role emphasizes deep theory and practical impact, with collaboration across measurement scientists, ML researchers, and engineers. #J-18808-Ljbffr Apple Inc.
- Apple Inc. in Seattle is seeking a Measurement Scientist to pioneer AI evaluation methods that are scientifically valid and trusted. You will apply psychometrics... ...with cutting-edge AI work, partnering with ML researchers and engineers to productionize evaluation tools,...Suggested
$60 per hour
Prolific is looking for Computer Science Specialists to train and evaluate cutting-edge AI models. Ideal candidates should have a BSc in Computer... ...include comparing AI-generated responses, reviewing CS research papers, and ensuring data integrity. Successful individuals...SuggestedHourly pay$30 - $35 per hour
...French‑Speaking AI Evaluation Specialist Remote We are looking for a French‑Speaking AI Evaluation Specialist to join us as we build cutting... ...opportunity to qualified people with disabilities. We measure progress toward a goal of at least7%of our workers having disabilities...SuggestedFor contractorsFor subcontractorRemote workFlexible hours- ...Responsibilities Develop, train, and evaluate large-scale AI/ML models across diverse biological data types. Investigate new modeling paradigms to address open biological research questions. Translate complex scientific questions into computational frameworks, experiments...Suggested
$146.6k - $183.25k
...on accelerating foundational research, developing standards and models... ...questions in biology through AI – inventing computational... ...curious and motivated AI Research Scientist to invent and advance machine... ..., the AI Research Scientist evaluates model performance,...SuggestedWork at officeLocal areaRemote workVisa sponsorshipWork visaRelocation package- Apple Inc. in Seattle, WA, seeks a Senior Applied Scientist to advance AI evaluation quality systems. You will build scalable ground-truth pipelines, calibration frameworks, and autonomous QA agents to ensure data powering AI/ML systems meets high accuracy, consistency...
$167.8k - $209.7k
...AI Research Scientist II – Office of the CTO The mission of the Allen Institute is to unlock the complexities of bioscience and advance our... ...standards for scalability in developing, disseminating, and evaluating AI/ML/computational methods for scientific problems across...Work experience placementWork at officeLocal areaRemote workVisa sponsorshipWork visaRelocation package$101k - $123k
Human Factors Scientist (M.S./M.A./Ph.D.) Exponent is a leading engineering and scientific... ...on‑road driving. Review and synthesize research on driver behavior to develop design guidelines... .... Participate in the design and evaluation of warnings and safety information. Qualifications...Relocation$159.75k
...you matter. We are seeking a skilled and innovative Senior AI Research Scientist to join a new team focusing on agentic video and multimodal... ...problem definition and data strategy through model development, evaluation, deployment, and iteration in production environments....Work experience placement$105k - $120k
We are currently seeking a Human Factors Scientist for our Human Factors Practice in... ...and other project support. Conducting research to obtain and review technical data, scientific... ...standards. Assisting with the design and evaluation of safety management practices and...RelocationFlexible hours- We are hiring an AI Research Scientist (New Grad) for our AI Research team. Our team is pushing the frontier of autonomous, self‑improving AI... ...refine their own capabilities and strategies Build and evaluate autonomous research agents — systems capable of autonomously...
$139.5k - $258.1k
...States - Machine Learning and AI Do you get excited by driving product impact via measurement and evaluation, for products and services... ...of languages. Description Research and develop evaluation methods... ...persons ranging from data scientists to engineers to business partners...Relocation package$40 per hour
Overview We are looking for a Research And Development Chemist (AI Trainer) to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need...Hourly payFull timeContract workPart timeRemote work- ...ML Engineer to design and deploy agentic AI systems that autonomously plan, reason, and... ...collaboration with product and research teams, advancing agentic techniques, and maintaining robust evaluation and safety measures across diverse scenarios. #J-18808-Ljbffr...
- A leading AI research accelerator is seeking Geospatial Experts to enhance AI systems through evaluations and real-world applications. This entry-level contractor position is fully remote with flexible hours, primarily focusing on geospatial reasoning tasks. Responsibilities...Remote jobFor contractorsFlexible hours
$266.72k - $350.07k
...The Enterprise Data & AI organization is a strategic... ...innovation, unlocks measurable value, elevates guest... ...Applied AI/ML Scientist, you define and drive... ...Translating emerging AI research (e.g., LLMs, multimodal... ...production AI systems, evaluation frameworks, and responsible...Permanent employmentPart timeWork visa- ChatGPT Jobs is seeking a contractor for a remote position focused on evaluating AI training problems and ensuring scientific realism in task design. The ideal candidate will have a Master’s or PhD degree or substantial experience in engineering or related fields. This...Remote jobFor contractors
$168k - $211k
...day, Cambia's Applied AI Team is living our mission... ...and lives better. AI Scientists work with various... ..., Physics, Operations Research, Bioinformatics, or Econometrics... ...AI opportunities, evaluate emerging technologies,... ...that create measurable business value. Proactive...Work experience placementWork at officeImmediate startRelocation3 days per week$211.2k - $264k
...builds some of the most powerful AI advertising solutions in the... ...We need a Staff Product Data Scientist who can bring structure, rigor... ...choose to solve, not just how we measure the outcomes. Establish a... ...closely with ML teams to design, evaluate, and iterate on model features...Temporary workWork at officeFlexible hours$212k - $265k
...health outcomes. As a Staff Data Scientist, Product Analytics , you will... ...leader for how Headway measures, learns, and improves. You will... ...what we build, how we evaluate it, and how we scale what works... ...matching, ranking, or applied AI experiences, build measurement...Work from homeFlexible hours- TikTok in Seattle is seeking a Research Scientist in Generative AI to advance cutting-edge research in computer vision and AI. You will explore diffusion models, GANs, and multi‑modal approaches, translating breakthroughs into TikTok products that empower user creativity...
- A leading tech company is seeking a Research Scientist specializing in Generative AI to join their Intelligent Creation Team in Seattle. This role involves advanced research in computer vision and machine learning, with responsibilities including the development of generative...
$202.16k - $368.22k
ByteDance is looking for a Research Scientist to develop driven agent frameworks that continuously learn and improve from user feedback. Based in Seattle, this position requires a Ph.D. in Computer Science or a related field, with strong experience in machine learning...- Overview We are hiring experienced machine learning engineers and researchers to serve as human baseliners for evaluations of open-ended machine learning research tasks. These evaluations measure how well AI agents perform on realistic AI R&D problems. To interpret agent...For contractors
- A leading research institute in Seattle seeks an AI Research Scientist II to develop AI/ML models aimed at enhancing understanding of complex biological systems. This role involves collaboration with various teams and supports open science initiatives. Candidates should...Visa sponsorshipRelocation package
$177.69k - $341.73k
ByteDance is looking for a skilled technology professional in Seattle to conduct research and development in computer vision and AI technologies. The candidate will be responsible for transferring advanced technologies to products and exploring new AI-driven initiatives...$192k - $304.75k
NVIDIA is seeking an Applied Deep Learning Research Scientist to join our Efficiency team. This role involves researching low-bit number representations and optimizing neural network performance. The ideal candidate will hold a PhD in a related field with over five years...$130k - $180k
Naver U.Hub INC is looking for an Applied Scientist to enhance AI capabilities across various domains. This role involves designing and optimizing Large Language Models and collaborative development of cutting-edge AI solutions. Ideal candidates will have 3-5 years of experience...- The Nuclear Company in Washington is seeking an experienced research professional to join its AI team. You'll tackle challenging operational problems in deploying nuclear power plants, utilizing cutting-edge AI techniques to optimize construction and security across multiple...
- A leading research organization in Seattle is seeking an AI Research Scientist II to develop and deploy large-scale machine learning models for the analysis of complex biological data. The ideal candidate will have a PhD in a relevant field and experience in AI/ML. This...Relocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Scientist - Research & Measurement. Be the first to apply!
- ai scientist Seattle, WA
- ai data scientist Seattle, WA
- historical research Seattle, WA
- neuroscience research Seattle, WA
- research and development internship Seattle, WA
- research and development engineer Seattle, WA
- vice president research Seattle, WA
- research and development chef Seattle, WA
- psychology research Seattle, WA
- research assistantship Seattle, WA

