ML Human Data Quality Lead Multilingual Evaluation
Apple Oakbrook
Apple Inc. is seeking a Machine Learning Evaluation Specialist to lead human data collection for AI features, ensuring high-quality data and effective collaboration across teams. This role requires technical expertise and program management skills to enhance data processes. The ideal candidate will hold a degree in Cognitive Science or a related field and bring extensive experience in human-centered AI and data quality frameworks. Apple offers a comprehensive benefits package and an inclusive workplace. #J-18808-Ljbffr Apple
$144.6k - $263.8k
...fueled by world-class data. The Human-centered AI team... ...Engineering is looking for an ML Evaluation Specialist, Human Data to join our Data Quality and Operations... ...improvement of large-scale, multilingual human data programs,... .... Responsibilities Lead the end‑to‑end...MultilingualQualityRelocationDay shift$38 per hour
...Welo Data is looking for experienced... ...team as Data Quality Analysts. This... ...DLAs) and Team Leads to ensure work... ...cases in both human and model outputs... ...Experience in AI/ML data workflows... ...human-in-the-loop evaluation environments... ...Welocalize delivers multilingual content...MultilingualQualityFull timeContract workRemote workVisa sponsorship$34 per hour
...Data Labeling Associate Welocalize is looking... ...-edge AI systems evaluating outputs, identifying... ...of data quality, model evaluation, and human judgment, where your... ...conversations with teammates, leads, and stakeholders.... ...delivers multilingual content transformation...MultilingualQualityFull timeContract workRemote workVisa sponsorship$218.3k - $363.7k
Senior Manager of Quality Assurance, AIML Data Operations... ...Quality Assurance to lead the QA function... ...Data Science and ML Engineering... ...quality, emerging AI evaluation methodologies,... ...managing QA for multilingual or multimodal annotation... ...Learning from Human Feedback) data...MultilingualQualityRelocation$181.1k - $318.4k
...intersection of cutting-edge AI and human-centered design, shipping... ...Develop and build multilingual, multimodal LLMs to improve... ...to deliver scalable, high-quality ML products. Stay current with... ...machine learning training/evaluation Data-centric vision and hands-on...MultilingualQualityWorldwideRelocation$167k
...Program Manager for ML and GenAI, you will lead the evolution of our multilingual operations,... ...trade-offs between quality, latency, and cost... ...global movement. Evaluate and operationalize... ...costs, providing data-driven recommendations... ...BLEU with structured human evaluation. Basic...MultilingualQualityFull time- .... At Sanas, model quality spans dimensions that... ..., build the evaluation infrastructure to... ...automated metrics and human judgment — designing... ...scientists and ML engineers to run rigorous... ...back into data acquisition and model... .... Experience with multilingual evaluation — cross...MultilingualQuality
- ...| Contract We are looking for detail-oriented Image Quality Evaluator for a multilingual AI data Annotation and Transcription Specialists with strong proficiency... ...in English. In this role, you will support AI/ML projects by annotating, labeling, and transcribing content...MultilingualQualityContract workRemote workWork from homeMonday to FridayDay shift
$150k
...universe and aid humanity in its pursuit of... ...interactions — expressive, multilingual, and reliable... ...pipeline: massive data curation, premium... ...‑training to push quality, speed, and... ...model training and evaluation. Work on pre‑training... ...efficient code for AI/ML systems. Hands‑on...MultilingualQualityTemporary work- ...on more than 100 leading companies across... ...conversation data, iterating on prompt... ...automated evaluation frameworks for AI agent quality assessment Create... ...Collaborate with ML engineers to improve... ...to learn from human agents and gather... ...Experience with multilingual voice AI systems...MultilingualQualityWork at officeFlexible hoursShift work
$26 - $28 per hour
...Overview Welo Data is looking for detail-oriented... ...-focused than evaluation-heavy roles, it still... ...pride in producing high-quality work, even across repetitive... .... Welocalize delivers multilingual content transformation... ...technology and human intelligence to collect...MultilingualQualityFull timeWork experience placementRemote workVisa sponsorship- ...smarter, safer, and more human. Every day, our... ...will provide the Data Analytics & AI team... ...and data science to evaluate product health,... ...value realization. Lead the design, execution... ...and deployment of AI/ML models, including... ...of data governance/quality controls. Working knowledge...QualityLocal areaWorldwideFlexible hours
- ...and architecture of its core data platforms. You will shape a scalable... ...metrics for driver evaluations across a global operation. You... ...collaborate with Simulation, Onboard, ML, and Commercialization teams,... ...to ensure interoperability, quality, and long-term maintainability...Quality
- Apple Inc. in Austin, TX is seeking an AI/ML Data Operations Program Manager to lead cross‑functional teams and deliver highQuality annotated data powering... ...prototype to scale, and collaborate with training, quality, data analytics, and capacity planning to build...Quality
$168k - $258.75k
Responsibilities Lead the generative data roadmap—define and evolve... ..., fine-tune, and evaluate large-scale AI systems... ...synthetic data generation, human-in-the-loop (HITL)... ...thorough data quality frameworks, including... ...Science, Data Science, AI/ML, or a related technical...Quality- ...healthcare expertise to every human. No other technology... ...researchers from leading institutions,... ...development of our model evaluation and data generation platform. In... ...the creation of high-quality training and test datasets... ...with data scientists, ML engineers, and clinicians...QualityWork at office
$89k - $94k
As a Software Quality Analyst III, you will lead test strategy and execution across multiple... ..., speech recognition, multilingual scenarios, and real‑world customer workflows. Evaluate whether assistant... ...Engineering, Program Management, Human Interface Design, Localization...MultilingualQualityHourly payTemporary workWork experience placement- ...deployment and ongoing quality iteration. You'll... ...insights from complex data, and enable WW Sales teams... ...agent quality — build evaluation frameworks, monitor production... ...Experience with multilingual or global‑scale... ...accessibility is a fundamental human right. You’ll find...MultilingualQualityWorldwide
$204k - $343k
...Engineering Manager on the Data Intelligence team, you'll lead a world‑class group... ..., and leverage high‑quality data to accelerate... ...that combine human expertise with AI‑powered... ..., and accelerate ML iteration cycles Set... ...alignment with training, evaluation, and deployment...QualityFull timeFor contractorsFor subcontractor$237.6k - $356.4k
Engineering Manager, Data for Applied AI... ...cutting-edge AI and human-centered design, shipping... ...needs. As our Data lead, you will help... ...managing the delivery and quality of data. The Data... ...to our applied ML team, jointly responsible... ...used to train and evaluate the models we ship....QualityImmediate startRelocation- Odyssey is looking for a Data Program Manager in Palo Alto to connect research, vendors,... ...requests, vendor relationships, and ensure quality measures. Requirements include 5+ years in... ...program/product management, familiarity with AI/ML, and vendor negotiation skills. This role...Quality
$204k - $343k
...Engineering Manager on the Data Intelligence team, you'll lead a world-class group... ..., and leverage high-quality data to accelerate... ...that combine human expertise with AI-powered... ..., and accelerate ML iteration cycles Set... ...alignment with training, evaluation, and deployment...QualityFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift$132.1k - $165.1k
...strategic planning and execution of 2D/3D annotation projects in Palo Alto, California. This role requires analytical skills to assess data quality and improve processes, alongside vendor management and collaboration with engineering teams. Ideal candidates will have strong...Quality$278k - $399k
Google is seeking a Software Engineering leader in Sunnyvale, CA, with a focus on acquiring high-quality data for training GenAI models. You will drive technical design and development systems, ensuring the effectiveness of data management across various stages of model...QualityFull time- ...Compusoft Services) is an AI, Data & Digital innovation... ...competition and lead the change in their industry... ...customers. Rysun believes in quality-first and is CMMI Level... ...-native deployments. Evaluate and integrate emerging... ...Experience architecting AI/ML SaaS solutions with high...Quality
$141.8k - $258.6k
...including Apple Intelligence. This role will lead complex localization workflows for multilingual software and AI‑driven features across... ..., ensuring timely delivery and high quality across global markets. Collaborate with engineering, ML modeling, design, QA, and localization...MultilingualQualityRelocation packageShift work$228.1k - $342.8k
...Engineering Manager, Data Solutions &... ...technology to industry‑leading environmental efforts... ..., and deliver high‑quality, scalable solutions... ...operational readiness Evaluate and integrate AI‑... ...or integrating AI/ML‑powered features... ...accessibility is a fundamental human right. You’ll find...QualityFull timeFor contractorsWorldwideRelocation- ...we’re looking for The Data Program Manager is the... ...the research, applied ML, and leadership and keeping... ...acquisition plans with quality bars, timelines, and... ...to Odyssey Manage the human teams (experience with... ...scale Familiarity with AI evaluation methodology or rubric design...QualityFor contractors
$224k - $356.5k
...highly analytical Product Evaluations Lead to own the evaluation,... ...of rigorous data science, GenAI product... ...benchmarks that measure model quality, reasoning, and agentic... ...focus on measuring AI/ML or GenAI systems. Master... ...evaluation datasets and human‑evaluation strategies....Quality- ...combining ServiceNow’s leading workflow... ...needed to fine‑tune, evaluate, and serve your own... ...production. We are a data‑centric team, and... ...just accuracy and quality of outputs, but... ...multimodal agents, multilingual agents, conversational... ..., and keeping our ML at the cutting...MultilingualQualityFull timeWork at officeImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Human Data Quality Lead Multilingual Evaluation. Be the first to apply!
- clinical data Cupertino, CA
- data governance Cupertino, CA
- data collection Cupertino, CA
- data loss prevention engineer Cupertino, CA
- data Cupertino, CA
- test data management Cupertino, CA
- data modeling Cupertino, CA
- data capturer Cupertino, CA
- data collection researcher Cupertino, CA
- provider data management Cupertino, CA

