Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Evaluation Engineer

Apple

Role Number: 200680655-3956 Summary We are looking for a highly motivated Machine Learning Evaluation Engineer to join our team and help define and drive the evaluation of advanced machine learning and computer vision technologies. You will work closely with algorithm, data, and engineering teams to build scalable evaluation methodologies, uncover model weaknesses, and turn complex data into actionable insights. You will play a key role in ensuring that our ML systems deliver high-quality, robust experiences across diverse real-world scenarios. The ideal candidate combines strong fundamentals in classical machine learning and computer vision with hands-on experience in metrics design, data analysis, failure analysis, visualization, and evaluation infrastructure. You should also be comfortable leveraging modern AI-assisted tools and workflows to improve engineering efficiency and accelerate analysis. Description In this role, you will define and drive the evaluation strategy for computer vision and machine learning algorithms used in complex product experiences. You will work closely with algorithm engineers to understand system behavior, identify the most meaningful quality signals, and develop evaluation frameworks that reflect real-world performance. You will design metrics and evaluation methodologies that go beyond aggregate accuracy and help the team understand performance across important data slices and scenarios. You will analyze large-scale datasets to identify gaps in data quality and coverage and develop strategies to improve the representativeness of training and evaluation data. A significant part of this role will involve failure analysis. You will investigate model failures, identify recurring patterns, develop failure taxonomies, and determine whether issues are driven by data, labeling, algorithm limitations, environmental conditions, or other system-level factors. You will build tools and visualizations that enable engineers to efficiently explore failures and understand the underlying root causes. You will also develop scalable and automated workflows for evaluation, analysis, and reporting. You will be expected to leverage modern AI-assisted tools where appropriate to accelerate data analysis, visualization development, coding, and workflow automation while maintaining technical rigor and reproducibility. As a member of the team, you will help shape evaluation best practices, influence algorithm and data decisions, and drive improvements across the ML development lifecycle. You should be comfortable navigating ambiguity, independently identifying opportunities for improvement, and partnering with cross-functional teams to deliver high-quality ML systems. Minimum Qualifications BS and a minimum of 3 years relevant industry experience 3+ years of relevant industry experience in machine learning, computer vision, algorithm evaluation, data science, or a related field. Strong background in machine learning and computer vision, including classical ML and statistical modeling techniques. Proven experience designing and implementing evaluation methodologies and quality metrics for ML algorithms. Strong expertise in failure analysis and root-cause analysis, with the ability to identify systematic model weaknesses and translate findings into actionable recommendations. Experience analyzing data quality, diversity, representativeness, and coverage gaps across large and complex datasets. Strong programming skills in Python with experience in data processing, analysis, and visualization. Experience building automated and scalable evaluation pipelines and tooling. Ability to develop clear and insightful visualizations and dashboards that communicate model performance, regressions, and failure patterns. Strong understanding of statistical analysis, experimentation, and performance measurement. Ability to independently drive ambiguous technical problems from problem definition through analysis and recommendations. Experience using AI-powered development and analysis tools to improve productivity, accelerate data exploration, automate repetitive workflows, and improve engineering efficiency. Preferred Qualifications MS in Computer Science, Computer Engineering, Electrical Engineering, Statistics, Applied Mathematics, or a related technical field (Advanced degree is a plus) Experience evaluating computer vision algorithms such as object detection, classification, tracking, segmentation, pose estimation, or hand tracking. Experience with large-scale ML datasets and data pipelines. Experience developing internal tools or platforms for ML evaluation and analysis. Experience with deep learning frameworks and modern ML systems. Experience with synthetic data, data augmentation, or automated data generation. Familiarity with model monitoring, regression detection, and production ML quality systems. Experience applying generative AI or AI-assisted workflows to engineering and analytical tasks. Experience mentoring engineers or providing technical leadership for complex evaluation initiatives. Excellent communication skills and the ability to collaborate effectively across algorithm, engineering, data, and product teams. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Apple

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Machine Learning Evaluation Engineer in Sunnyvale, CA vacancy
  • $150.4k - $277.6k

     ...CupertinoPosted: 2026-06-08SummaryThe Health Sensing Machine Learning Interpretability & Analytics (MLIA) team...  .... We are looking for an exceptional ML Engineer to help us build the next generation of scalable evaluation infrastructure and lead rigorous investigations... 
    Suggested
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $184.7k - $324.8k

    Role Number: 200682418Team: Machine Learning and AI, Software and ServicesLocation: Cambridge...  ...macOS, watchOS, and visionOS.Our Speech Evaluation team sits at the center of Apple's ASR...  ...in Computer Science, Electrical Engineering, or a related field, or equivalent practical... 
    Suggested
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $184.7k - $324.8k

    Role Number: 200670397Team: Machine Learning and AILocation: CupertinoWeekly Hours: 40Posted:...  ...ground up. As part of the Agentic Search Evaluation team, you will help advance Apple...  ...looking for a senior Machine Learning Engineer with a passion for building scalable,... 
    Suggested
    Work experience placement
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $184.7k - $324.8k

    Role Number: 200683055Team: Machine Learning and AI, Software and ServicesLocation: Cupertino...  ...(Statistical Coverage and Large-scale Evaluation) team at Apple and contribute to a highly...  ...skilled Senior Machine Learning Engineer specializing in Conversational AI. Our... 
    Suggested
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  •  ...built in from the ground up. As part of the Agentic Search Evaluation team, you will help advance Apple Intelligence through...  ...personal data private. Description We are looking for a senior Machine Learning Engineer with a passion for building scalable, high quality... 
    Suggested
    Work experience placement

    Apple

    Cupertino, CA
    1 day ago
  • $55 - $65 per hour

     ...Contract opportunity.* This role focuses on AI/LLM quality evaluation and measurement, not traditional model development.*...  ...for production AI/LLM systems.We are seeking an experienced Machine Learning Engineer to help define, measure, and improve the quality of AI systems... 
    Contract work
    Temporary work
    Remote work
    3 days per week

    TEKsystems

    Cupertino, CA
    1 day ago
  • $184k - $287.5k

     ...opening new possibilities for how people learn, create, and tackle problems....  ...safeguards are working? As an expert in machine learning for Evaluations, you’ll help establish the evidence that...  ...are looking for a Machine Learning Engineer / AI Researcher / Data Scientist to join... 
    Full time
    Remote work

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184.7k - $324.8k

    Role Number: 200692587Team: Machine Learning and AILocation: CupertinoPosted: 2026-10-30SummaryJoin Us...  ...? Apple is seeking an experienced Engineering Manager to lead a team shaping the future of responsible AI evaluation for the next generation of generative features... 
    Work experience placement
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $237.6k - $401.7k

    Role Number: 200680256Team: Machine Learning and AI, Software and ServicesLocation: CupertinoPosted: 2026-08-27SummaryApple's AIML Evaluation team builds the systems and methodologies that...  ...a senior, hands-on Machine Learning Engineering Manager to lead a small team working... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $238k - $302k

     ...states. The Driver Understanding and Evaluation (DUE) team at Waymo is developing rich...  ...behavior of the Waymo Driver. The DUE Machine Learning team will build and operate scalable machine...  ...looking for researchers and software engineers who are passionate about developing... 
    Full time

    Latent Logic

    Mountain View, CA
    1 day ago
  •  ...representative? Apple is seeking an experienced Engineering Manager to lead a team shaping the future of responsible AI evaluation for the next generation of generative...  .... In this role, you will lead a team of machine learning engineers and data scientists working to assess... 
    Work experience placement

    Apple

    Cupertino, CA
    1 day ago
  • Weekly Hours: 40 Role Number: 200657970-0836 Summary The Productivity and Machine Learning Evaluation team ensures the quality of AI-powered features across a suite of productivity and creative applications; including Creator Studio, used by hundreds of millions of people... 
    Shift work

    Apple

    Cupertino, CA
    1 day ago
  • $128k - $256k

    Responsibilitie The Applied Machine Learning Ark team combines system engineering and machine learning to develop and operate Large Language Model (LLM) service...  ...you to apply early. Responsibilities: - Design evaluation systems for LLM-based agents, covering task success... 
    Temporary work
    Internship
    Local area

    ByteDance

    San Jose, CA
    1 day ago
  •  ...a relentless focus on outcomes. ASAPP’s AI Engineering team is seeking an enterprising, talented and curious machine learning engineer. The AI Engineering team is responsible...  ...Machine Learning Engineer to help build and evaluate the core intelligence behind our agentic AI... 
    Work at office
    Immediate start

    ASAPP

    Mountain View, CA
    10 days ago
  •  ...a relentless focus on outcomes. ASAPP’s AI Engineering team is seeking an enterprising, talented and curious machine learning engineer.   The AI Engineering team is...  ...Machine Learning Engineer to help build and evaluate the core intelligence behind our agentic AI... 
    Full time
    Work at office

    asapp-2

    Mountain View, CA
    7 days ago
  • $281k - $356k

    Senior Staff ML Engineer, Driver Understanding and Evaluation Waymo is an autonomous driving technology company with the mission to be the world's most...  ...in simulation across 15+ U.S. states. The DUE Machine Learning team will build and operate scalable machine learning... 
    Full time

    Waymo

    Mountain View, CA
    1 day ago
  • $251k - $310k

    Staff Tech Lead Manager, Machine Learning Engineering, Simulator Evaluation Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $139.7k - $216.5k

    Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a...  ...ranking experimentsDevelop metrics to evaluate ranking performanceQualificationsQualificationsWhat...  ...information retrieval techniques, or machine learning based ranking modelsCapable of deriving... 
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Moveworks

    Mountain View, CA
    4 days ago
  • $135.86k - $181.15k

     ...advertisements around the world.Job SummaryWe’re looking for an Engineer 2, Machine Learning who is first and foremost a systems thinker and builder....  ...and data structures. Core ML concepts (training, evaluation, metrics, overfitting). Systems fundamentals (interfaces,... 
    Full time
    Night shift
    Weekend work

    Comcast

    Sunnyvale, CA
    1 day ago
  • $184.7k - $277.6k

     ...HardwareLocation: CupertinoPosted: 2026-09-24SummaryAre you a passionate Machine Learning Engineer with a deep love for photography? Join Apple's Camera...  ...to the team and be responsible for ongoing design, evaluation, benchmarking and characterization of Apple camera... 
    Worldwide
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $150.4k - $277.6k

    Role Number: 200686466Team: Machine Learning and AILocation: CupertinoPosted: 2026-09-30SummaryAt...  ...looking for a Senior Machine Learning Engineer to help build the next generation of...  ...designing and running offline evaluations and online experiments (A/B testing) to... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $150.4k - $277.6k

    Role Number: 200688556Team: Machine Learning and AILocation: CupertinoWeekly Hours: 40Posted: 2...  ...are looking for. Our universal search engine powers search features across a variety...  ...scientists to develop, fine-tune, and evaluate domain specific Large Language Models for... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $184.7k - $324.8k

    Role Number: 200683064Team: Machine Learning and AI, Software and ServicesLocation: CupertinoPosted...  ...in machine learning and software engineering to train and deploy models that...  ...and across Apple to train, deploy, and evaluate machine learned models that power new... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $175k - $215k

     ...billions in simulation across 15+ U.S. states. As a Perception Machine Learning Engineer, you will build the intelligent systems that "see" the...  ...Ensure Model Quality: Develop methods and recipes for evaluating real-world performance of our models, and detecting regressions... 
    Full time
    Remote work

    Waymo

    Mountain View, CA
    15 days ago
  • Machine Learning Engineer Location: Sunnyvale, CA or Austin, TX (hybrid, in office Tues-Thurs) ABOUT THIS FEATURED OPPORTUNITY The Machine Learning...  ...inference optimization. This role will be responsible for evaluating model performance, conducting experiments, and... 
    Work at office
    Flexible hours

    INSPYR Solutions

    Sunnyvale, CA
    1 day ago
  •  ...this role, you will design and develop machine learning models, fine tune deep learning...  ...understanding, and collaborate across software engineering, data science, and product to...  ...large scale machine learning training/evaluation Data-centric vision and hands-on experience... 

    Apple

    Cupertino, CA
    1 day ago
  • $200k - $280k

     ...problems from problem definition and evaluation through launch and monitoring, with a...  ...and iteration. Partner with product and engineering to understand customer problems and deliver...  ...6+ years of industry experience in machine learning engineering. You hold a BA/BS in... 
    Work at office
    Home office
    Flexible hours

    Glean.info

    Mountain View, CA
    1 day ago
  • $150k

    GPU Kernel Engineer The GPU Kernel Engineer will play a role at the forefront of optimizing performance for the machine learning software stacks, especially at training and inference, and...  ...benchmarks and testing methodologies to evaluate application performance Build tools... 
    Visa sponsorship

    Institute of Foundation Models

    Sunnyvale, CA
    1 day ago
  •  ...develop the compiler for Apple proprietary Neural Engine Accelerator architecture, to enable inference of deep learning networks onto this architecture with an...  ...for internal clients and 3rd party developers - Evaluate existing hardware blocks and work closely with... 

    Apple

    Sunnyvale, CA
    1 day ago
  • $170k - $240k

     ...powered by scalable, interpretable AI and engineered to deliver safe, reliable, high-...  ...seeking a high impact, technically deep Machine Learning Engineer to develop, optimize, and deploy...  ...related technologies. Simulation and Evaluation: Analyze model performance using... 
    Work at office

    Gatik AI

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Evaluation Engineer. Be the first to apply!