ML Engineering Manager, Agentic Search Evaluation
$206.2k - $356.4kApple
Role Number: 200672920Team: Machine Learning and AILocation: CupertinoWeekly Hours: 40Posted: 2026-09-25SummaryThe Siri team is redefining how hundreds of millions of people access information across Apple devices, with privacy built in from the ground up. As part of the Agentic Search Evaluation team, you will help advance Apple Intelligence through personalized search, result ranking, and low-latency production services that power experiences across Siri, Spotlight, Safari, Messages, and more. Your team researches and builds deep search systems for Personal Question Answering, enabling Siri to answer questions about a user's emails, messages, events, files, and more, while keeping personal data private.DescriptionWe are looking for a Machine Learning Engineering Manager with a passion for building scalable, high-quality solutions to evaluate personalized search applications. In this role, you will directly shape how Apple assesses and improves the quality of Agentic Search — driving solutions across search quality, data quality, and both offline and online metrics to enable iterative product improvements. You will lead a team focused on evaluating Agentic Search experiences that power personalized Siri AI and enable answers to users' personal questions, with privacy at the forefront. Your team designs and builds evaluation systems, develops data generation and curation methods, and creates metrics frameworks for quality assessment and continuous improvement.Minimum Qualifications6 or more years of industry experience building machine learning or machine learning evaluation systems at scale2 or more years of industry experience in technical leadership or managementKnowledge of machine learning fundamentals, neural network architectures, and software engineering in Python or C/C++Communication and collaboration skillsBachelor's degree in Computer Science, Engineering, Statistics, or a related fieldPreferred QualificationsExperience designing and building production machine learning systems in search, natural language processing, recommendation systems, or information retrievalExperience in data collection, data generation, or data quality assessment of language, image, or multimodal dataAdvanced degree (Master's or Ph.D.) in Computer Science, Engineering, Statistics, or a related field, or equivalent industry experiencePay & BenefitsAt Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $206,200 and $356,400, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple BenefitsNote: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.EEO StatementApple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicantAccessibilityAt Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.Learn about accessibility in Apple’s workplaceLearn about reasonable accommodations for job applicantsApplication DeadlineApple accepts applications to this posting on an ongoing basis.
$201.3k - $352.3k
...It all started when engineer Fred Luddy wrote... ...engineers, and product managers with a dual mission... ...Manager, Agentic & GenAI Benchmarking and Evaluations to establish and lead... ...Pipelines : Partner with search and data fabric... ...high-performing AI/ML teams. ~ Experience...SuggestedFull timeWork experience placementWork at officeImmediate startRemote workFlexible hoursShift work$237.6k - $401.7k
...27SummaryApple's AIML Evaluation team builds the systems... ...foundation models and agentic experiences. We are... ...hands-on Machine Learning Engineering Manager to lead a small team... ...to production-quality ML pipelines, while mentoring... ...optimization, agent-search methods, evaluator...SuggestedRelocation$184.7k - $324.8k
...representative? Apple is seeking an experienced Engineering Manager to lead a team shaping the future of responsible AI evaluation for the next generation of generative... ...environmentExperience working with multimodal models, agentic systems, and/or diverse languages and...SuggestedWork experience placementRelocation$230k - $316.25k
...Role We’re looking for Deep Agentic Reasoning Engineer (open rank) to design and build... ...What You’ll Do Develop and Evaluate Models: build and evaluate... ...a strong track record of AI/ML success. AI/ML Expertise: 6+... ...Thought (CoT), agentic tree search methods, continual learning,...SuggestedPermanent employmentFull timeWork at officeDay shift$254.4k - $381.6k
...customer experience. The AI, Search & Knowledge Platforms team... ...seeking an exceptional Senior Engineering Manager to lead the engineering organization responsible for Agentic AI and Intelligent Reasoning... ...designing scalable evaluation systems for reasoning quality...SuggestedRelocation$184.7k - $324.8k
...Coverage and Large-scale Evaluation) team at Apple and... ...evaluates Siri and AI/ML models at scale to delight... ...Senior Machine Learning Engineer specializing in Conversational... ....Proven experience managing large-scale datasets... ...Language Models (LLMs) and agentic systems.Track record of...Relocation$190.9k - $334.1k
...all started when engineer Fred Luddy wrote code... ...for a Senior Manager of Machine Learning... ...generation of AI Search and Retrieval capabilities... ...and Agentic experiences. You will... ...functional stakeholders to evaluate emerging AI... ...Experience with modern AI/ML technologies,...Full timeTemporary workWork at officeImmediate startRemote workFlexible hours$207k - $300k
...AIGC) quality frameworks and agentic flows to generate content... ...content through advanced context engineering and agentic feedback loops... ....Conduct advanced quality evaluations and leverage downstream dense... ...and extend well beyond web search. We're looking for engineers...- ...-grained video understanding, robotics evaluation, and intelligent video analysis. As a... ...cutting-edge AI research with practical engineering, working across the entire machine learning... ...learning, reinforcement learning, and agentic Al to improve model capabilities....Internship
$218.8k - $335.3k
...vehicle portfolio.Autonomy Evaluation helps the AV program... ...caused them.The RoleAs Manager of Subsystem Evaluation... ...you'll lead a team of engineers and data scientists and... ...autonomous systems, robotics, ML evaluation, or applied... ...assist with your job search or application for...Full timeLocal areaRemote workWork from homeRelocation package$150.4k - $277.6k
...sensing features. We are looking for an exceptional ML Engineer to help us build the next generation of scalable evaluation infrastructure and lead rigorous investigations... ...or related fieldExperience evaluating LLMs or agentic systems (e.g., LLM-as-a-judge, RAG evaluation)...Relocation$144.6k - $263.8k
...standard of quality requires evaluation systems that are scalable,... ...for the complexity of agentic AI. Evaluation signals inform... ...a Siri release ships.As an Engineering Program Manager for Siri Evaluation, you will... ...different teams.Familiarity with ML development workflows,...Relocation$184.7k - $277.6k
...26-10-28SummaryAs a Machine Learning Engineer, you will design and build AI/ML systems — from classical predictive models to LLM-powered agentic applications — that drive meaningful... ...supervised/unsupervised learning, model evaluation, and feature engineeringExperience...WorldwideRelocation$142.3k - $263.3k
...Clara; SeattlePosted: 2026-05-07SummaryThe Search and Knowledge Quality team is redefining... ...and advance state-of-the-art LLM and ML techniques to better understand user queries... ...abilities.Experimental rigor when training/evaluating LLMs for the purpose of benchmarking LLM...Relocation$169k - $338k
...OfficeAs a Distinguished AI/ML Engineer within Walmart Global Tech’s... ...development of next-generation agentic AI systems and intelligent automation... ...agents that transform how we manage change and performance,... ...—across every transaction, search, and interaction spanning Walmart...Full timeTemporary workPart time$232k
...scale. We are now hiring a Staff ML Engineer to architect, productionize,... ...end‑to‑end. Experience with agentic architectures is a major plus... ...service—LLM orchestration, evaluation, safety guardrails, multilingual... ..., where the agent can search across different knowledge sources...Full timeWork at officeImmediate startRemote work$184k - $287.5k
...machine learning for Evaluations, you’ll help establish... ...for a Machine Learning Engineer / AI Researcher / Data... ...within Enterprise Risk Management. Engaging directly in... ...sound comparisons for ML systems, including selecting... ...multimodal models, or agentic systems through...Full time$178.42k - $230.5k
...the tools and services engineers here at GM use every... ...Productivity Org, the AV Agentic Developer Engineer is... ...technical roadmap by evaluating new tools and technologies... ...~ Ability to manage competing priorities,... ...assist with your job search or application for employment...Full timeWork experience placementLocal areaWork from homeFlexible hours$170k - $210k
...building a production-grade AI/ML capability spanning intelligent automation, agentic systems, predictive analytics, and data engineering. As AI/ML Engineering Manager, you will lead a team while... ...human-in-the-loop controls, and evaluation frameworks Own the AI/ML technical...For contractorsWork experience placement$296.3k - $423.9k
...Principal Technical Lead Manager (TLM) to lead the... ...shape the algorithms and ML systems that translate... ...high-performing team of engineers building ML-driven trajectory... ...-based training or evaluation of driving policies. Remote... ...assist with your job search or application for...Full timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$207k - $300k
...frameworks and methodologies for evaluating the quality and effectiveness... ...of experience in building ML systems and infrastructure (e... ...:Master’s degree or PhD in Engineering, Computer Science, or a related... ..., and extend well beyond web search. We're looking for engineers...$184.7k - $324.8k
...excited by driving product impact via measurement and evaluation, for products and services used by hundreds of millions... ...and rigorous use of data. You will partner with various engineering teams to improve search quality and guide feature development with data, to deliver...Work experience placementRelocation$250k - $384.6k
...vehicle portfolio. Autonomy Evaluation helps the AV program... ...The RoleAs a Principal Engineer in Autonomy Evaluation,... ...systems, robotics, ML evaluation, or applied... ...organizations you don't manage.Strong stakeholder engagement... ...assist with your job search or application for...Full timeLocal areaRemote workWork from homeFlexible hours$225k - $245k
Principal AI/ML Engineer - AI Safety & EvaluationAbout the Team We’re building a future where AI systems are not only powerful but safe... .... Our work blends applied research, systems engineering, and evaluation design to ensure safety is built into our models at every...Full timeFor subcontractorLocal area$272k - $431.25k
...expand enterprise-grade agentic AI systems at one of... ...business results across engineering, IT, supply chain,... ...tool integration, and evaluation pipelines. Define and... ...memory models, multi-agent management (e.g., LangChain,... ...working with agentic search and orchestration platforms...Full time- ...collection and model training to evaluation, optimization, and production... ...-world data and practical engineering to build scalable, reliable,... ...deployment efficiency. 3 - Agentic Video Understanding &... ...Build and improve large-scale ML pipelines covering data processing...Full time
$169.78k - $282.26k
...improves mostly by hand: engineers collect data, train... ...model code. They then evaluate the results, diagnose failures... ...machine learning, agentic systems, and autonomous... ...generation, evolutionary search, and targeted data... ...Publications at top ML or robotics venues (NeurIPS...- ...particular role covers. ️ About Our Engineering Teams The Search & Indexing team, part of Compute and... ...curation, training set construction and ML research. You'd be the first hire in... ...quarters. You'll work with ML, Data, Evaluation and Platform teams, and support other...Full timeWork at officeRemote workVisa sponsorshipRelocation packageFlexible hoursShift work
$140k - $265k
...advanced enterprise search has evolved into a... ...powers Glean’s agentic capabilities - AI... ...Glean is looking for engineers to help build the... ...question-answering, evaluation, and... ...Proficiency in your ML framework of choice... ...regulate the way we manage the data of job applicants...Home officeFlexible hours$240.1k - $420.2k
...DescriptionIt all started when engineer Fred Luddy wrote code... ...role As a Principal ML Engineer, you set the... ...development, testing, evaluation, and operational... ...governance, and guardrails for agentic systems running in... ...and exposure management, identity security, risk...Work at officeImmediate startRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Engineering Manager, Agentic Search Evaluation. Be the first to apply!
- computer vision machine learning engineer Cupertino, CA
- machine learning software engineer Cupertino, CA
- ai ml engineer Cupertino, CA
- machine learning engineer Cupertino, CA
- senior ml engineer Cupertino, CA
- junior machine learning research engineer Cupertino, CA
- machine learning ai engineer Cupertino, CA
- machine learning scientist Cupertino, CA
- machine learning Cupertino, CA
- artificial intelligence - machine learning intern Cupertino, CA



