Machine Learning Evaluation Engineer
Apple
Role Number: 200680655-3956 Summary We are looking for a highly motivated Machine Learning Evaluation Engineer to join our team and help define and drive the evaluation of advanced machine learning and computer vision technologies. You will work closely with algorithm, data, and engineering teams to build scalable evaluation methodologies, uncover model weaknesses, and turn complex data into actionable insights. You will play a key role in ensuring that our ML systems deliver high-quality, robust experiences across diverse real-world scenarios. The ideal candidate combines strong fundamentals in classical machine learning and computer vision with hands-on experience in metrics design, data analysis, failure analysis, visualization, and evaluation infrastructure. You should also be comfortable leveraging modern AI-assisted tools and workflows to improve engineering efficiency and accelerate analysis. Description In this role, you will define and drive the evaluation strategy for computer vision and machine learning algorithms used in complex product experiences. You will work closely with algorithm engineers to understand system behavior, identify the most meaningful quality signals, and develop evaluation frameworks that reflect real-world performance. You will design metrics and evaluation methodologies that go beyond aggregate accuracy and help the team understand performance across important data slices and scenarios. You will analyze large-scale datasets to identify gaps in data quality and coverage and develop strategies to improve the representativeness of training and evaluation data. A significant part of this role will involve failure analysis. You will investigate model failures, identify recurring patterns, develop failure taxonomies, and determine whether issues are driven by data, labeling, algorithm limitations, environmental conditions, or other system-level factors. You will build tools and visualizations that enable engineers to efficiently explore failures and understand the underlying root causes. You will also develop scalable and automated workflows for evaluation, analysis, and reporting. You will be expected to leverage modern AI-assisted tools where appropriate to accelerate data analysis, visualization development, coding, and workflow automation while maintaining technical rigor and reproducibility. As a member of the team, you will help shape evaluation best practices, influence algorithm and data decisions, and drive improvements across the ML development lifecycle. You should be comfortable navigating ambiguity, independently identifying opportunities for improvement, and partnering with cross-functional teams to deliver high-quality ML systems. Minimum Qualifications BS and a minimum of 3 years relevant industry experience 3+ years of relevant industry experience in machine learning, computer vision, algorithm evaluation, data science, or a related field. Strong background in machine learning and computer vision, including classical ML and statistical modeling techniques. Proven experience designing and implementing evaluation methodologies and quality metrics for ML algorithms. Strong expertise in failure analysis and root-cause analysis, with the ability to identify systematic model weaknesses and translate findings into actionable recommendations. Experience analyzing data quality, diversity, representativeness, and coverage gaps across large and complex datasets. Strong programming skills in Python with experience in data processing, analysis, and visualization. Experience building automated and scalable evaluation pipelines and tooling. Ability to develop clear and insightful visualizations and dashboards that communicate model performance, regressions, and failure patterns. Strong understanding of statistical analysis, experimentation, and performance measurement. Ability to independently drive ambiguous technical problems from problem definition through analysis and recommendations. Experience using AI-powered development and analysis tools to improve productivity, accelerate data exploration, automate repetitive workflows, and improve engineering efficiency. Preferred Qualifications MS in Computer Science, Computer Engineering, Electrical Engineering, Statistics, Applied Mathematics, or a related technical field (Advanced degree is a plus) Experience evaluating computer vision algorithms such as object detection, classification, tracking, segmentation, pose estimation, or hand tracking. Experience with large-scale ML datasets and data pipelines. Experience developing internal tools or platforms for ML evaluation and analysis. Experience with deep learning frameworks and modern ML systems. Experience with synthetic data, data augmentation, or automated data generation. Familiarity with model monitoring, regression detection, and production ML quality systems. Experience applying generative AI or AI-assisted workflows to engineering and analytical tasks. Experience mentoring engineers or providing technical leadership for complex evaluation initiatives. Excellent communication skills and the ability to collaborate effectively across algorithm, engineering, data, and product teams. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Apple
$150.4k - $277.6k
...CupertinoPosted: 2026-06-08SummaryThe Health Sensing Machine Learning Interpretability & Analytics (MLIA) team... .... We are looking for an exceptional ML Engineer to help us build the next generation of scalable evaluation infrastructure and lead rigorous investigations...SuggestedRelocation$184.7k - $324.8k
Role Number: 200682418Team: Machine Learning and AI, Software and ServicesLocation: Cambridge... ...macOS, watchOS, and visionOS.Our Speech Evaluation team sits at the center of Apple's ASR... ...in Computer Science, Electrical Engineering, or a related field, or equivalent practical...SuggestedRelocation$184.7k - $324.8k
Role Number: 200670397Team: Machine Learning and AILocation: CupertinoWeekly Hours: 40Posted:... ...ground up. As part of the Agentic Search Evaluation team, you will help advance Apple... ...looking for a senior Machine Learning Engineer with a passion for building scalable,...SuggestedWork experience placementRelocation$184.7k - $324.8k
Role Number: 200683055Team: Machine Learning and AI, Software and ServicesLocation: Cupertino... ...(Statistical Coverage and Large-scale Evaluation) team at Apple and contribute to a highly... ...skilled Senior Machine Learning Engineer specializing in Conversational AI. Our...SuggestedRelocation- ...built in from the ground up. As part of the Agentic Search Evaluation team, you will help advance Apple Intelligence through... ...personal data private. Description We are looking for a senior Machine Learning Engineer with a passion for building scalable, high quality...SuggestedWork experience placement
$55 - $65 per hour
...Contract opportunity.* This role focuses on AI/LLM quality evaluation and measurement, not traditional model development.*... ...for production AI/LLM systems.We are seeking an experienced Machine Learning Engineer to help define, measure, and improve the quality of AI systems...Contract workTemporary workRemote work3 days per week$184k - $287.5k
...opening new possibilities for how people learn, create, and tackle problems.... ...safeguards are working? As an expert in machine learning for Evaluations, you’ll help establish the evidence that... ...are looking for a Machine Learning Engineer / AI Researcher / Data Scientist to join...Full timeRemote work$184.7k - $324.8k
Role Number: 200692587Team: Machine Learning and AILocation: CupertinoPosted: 2026-10-30SummaryJoin Us... ...? Apple is seeking an experienced Engineering Manager to lead a team shaping the future of responsible AI evaluation for the next generation of generative features...Work experience placementRelocation$237.6k - $401.7k
Role Number: 200680256Team: Machine Learning and AI, Software and ServicesLocation: CupertinoPosted: 2026-08-27SummaryApple's AIML Evaluation team builds the systems and methodologies that... ...a senior, hands-on Machine Learning Engineering Manager to lead a small team working...Relocation$238k - $302k
...states. The Driver Understanding and Evaluation (DUE) team at Waymo is developing rich... ...behavior of the Waymo Driver. The DUE Machine Learning team will build and operate scalable machine... ...looking for researchers and software engineers who are passionate about developing...Full time- ...representative? Apple is seeking an experienced Engineering Manager to lead a team shaping the future of responsible AI evaluation for the next generation of generative... .... In this role, you will lead a team of machine learning engineers and data scientists working to assess...Work experience placement
- Weekly Hours: 40 Role Number: 200657970-0836 Summary The Productivity and Machine Learning Evaluation team ensures the quality of AI-powered features across a suite of productivity and creative applications; including Creator Studio, used by hundreds of millions of people...Shift work
$128k - $256k
Responsibilitie The Applied Machine Learning Ark team combines system engineering and machine learning to develop and operate Large Language Model (LLM) service... ...you to apply early. Responsibilities: - Design evaluation systems for LLM-based agents, covering task success...Temporary workInternshipLocal area- ...a relentless focus on outcomes. ASAPP’s AI Engineering team is seeking an enterprising, talented and curious machine learning engineer. The AI Engineering team is responsible... ...Machine Learning Engineer to help build and evaluate the core intelligence behind our agentic AI...Work at officeImmediate start
- ...a relentless focus on outcomes. ASAPP’s AI Engineering team is seeking an enterprising, talented and curious machine learning engineer. The AI Engineering team is... ...Machine Learning Engineer to help build and evaluate the core intelligence behind our agentic AI...Full timeWork at office
$281k - $356k
Senior Staff ML Engineer, Driver Understanding and Evaluation Waymo is an autonomous driving technology company with the mission to be the world's most... ...in simulation across 15+ U.S. states. The DUE Machine Learning team will build and operate scalable machine learning...Full time$251k - $310k
Staff Tech Lead Manager, Machine Learning Engineering, Simulator Evaluation Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building...Full timeRemote work$139.7k - $216.5k
Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a... ...ranking experimentsDevelop metrics to evaluate ranking performanceQualificationsQualificationsWhat... ...information retrieval techniques, or machine learning based ranking modelsCapable of deriving...Work at officeImmediate startRemote workFlexible hours$135.86k - $181.15k
...advertisements around the world.Job SummaryWe’re looking for an Engineer 2, Machine Learning who is first and foremost a systems thinker and builder.... ...and data structures. Core ML concepts (training, evaluation, metrics, overfitting). Systems fundamentals (interfaces,...Full timeNight shiftWeekend work$184.7k - $277.6k
...HardwareLocation: CupertinoPosted: 2026-09-24SummaryAre you a passionate Machine Learning Engineer with a deep love for photography? Join Apple's Camera... ...to the team and be responsible for ongoing design, evaluation, benchmarking and characterization of Apple camera...WorldwideRelocation$150.4k - $277.6k
Role Number: 200686466Team: Machine Learning and AILocation: CupertinoPosted: 2026-09-30SummaryAt... ...looking for a Senior Machine Learning Engineer to help build the next generation of... ...designing and running offline evaluations and online experiments (A/B testing) to...Relocation$150.4k - $277.6k
Role Number: 200688556Team: Machine Learning and AILocation: CupertinoWeekly Hours: 40Posted: 2... ...are looking for. Our universal search engine powers search features across a variety... ...scientists to develop, fine-tune, and evaluate domain specific Large Language Models for...Relocation$184.7k - $324.8k
Role Number: 200683064Team: Machine Learning and AI, Software and ServicesLocation: CupertinoPosted... ...in machine learning and software engineering to train and deploy models that... ...and across Apple to train, deploy, and evaluate machine learned models that power new...Relocation$175k - $215k
...billions in simulation across 15+ U.S. states. As a Perception Machine Learning Engineer, you will build the intelligent systems that "see" the... ...Ensure Model Quality: Develop methods and recipes for evaluating real-world performance of our models, and detecting regressions...Full timeRemote work- Machine Learning Engineer Location: Sunnyvale, CA or Austin, TX (hybrid, in office Tues-Thurs) ABOUT THIS FEATURED OPPORTUNITY The Machine Learning... ...inference optimization. This role will be responsible for evaluating model performance, conducting experiments, and...Work at officeFlexible hours
- ...this role, you will design and develop machine learning models, fine tune deep learning... ...understanding, and collaborate across software engineering, data science, and product to... ...large scale machine learning training/evaluation Data-centric vision and hands-on experience...
$200k - $280k
...problems from problem definition and evaluation through launch and monitoring, with a... ...and iteration. Partner with product and engineering to understand customer problems and deliver... ...6+ years of industry experience in machine learning engineering. You hold a BA/BS in...Work at officeHome officeFlexible hours$150k
GPU Kernel Engineer The GPU Kernel Engineer will play a role at the forefront of optimizing performance for the machine learning software stacks, especially at training and inference, and... ...benchmarks and testing methodologies to evaluate application performance Build tools...Visa sponsorship- ...develop the compiler for Apple proprietary Neural Engine Accelerator architecture, to enable inference of deep learning networks onto this architecture with an... ...for internal clients and 3rd party developers - Evaluate existing hardware blocks and work closely with...
$170k - $240k
...powered by scalable, interpretable AI and engineered to deliver safe, reliable, high-... ...seeking a high impact, technically deep Machine Learning Engineer to develop, optimize, and deploy... ...related technologies. Simulation and Evaluation: Analyze model performance using...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Evaluation Engineer. Be the first to apply!
- machine learning ai engineer Sunnyvale, CA
- senior ml engineer Sunnyvale, CA
- machine learning software engineer Sunnyvale, CA
- computer vision machine learning engineer Sunnyvale, CA
- ai ml engineer Sunnyvale, CA
- machine learning engineer Sunnyvale, CA
- machine learning Sunnyvale, CA
- machine learning research scientist Sunnyvale, CA
- machine learning researcher Sunnyvale, CA
- machine learning part time Sunnyvale, CA


