Software Engineer, Agentic Evaluation
Apple Oakbrook
Weekly Hours: 40
Role Number: 200664500-0836
Summary
We're a team at Apple building software that helps shape the next generation of Siri and AI-powered experiences. The work spans frameworks, tooling, and infrastructure — including a strong focus on how we evaluate and measure the quality of what we ship. We can't say much about specifics, but the problems are new, the surface area is large, and the reach is enormous. We're a collaborative, humble, and curious group that learns from each other and builds together.
Description
You'll work alongside engineers, designers, and researchers to design and build software end-to-end — from early prototypes to production systems running on real devices. You'll have meaningful autonomy in how you get there, and the opportunity to shape both what we build and how we know it's working. The work is hard enough to stretch you, and the team is generous enough to support you while you grow.
Minimum Qualifications
3+ years of software engineering experience with strong CS fundamentals
Proficiency in Swift, Objective-C, Python, or another modern language — strong engineers in adjacent stacks will pick up the rest
You've shipped software that people used, and you're ready to own bigger pieces end-to-end
Expert in using generative AI models for coding — you've integrated tools like Claude, Cursor, or Codex deeply into how you work, and have a point of view on where they help and where they don't
An interest in software evaluation and quality — you care about whether what you build actually works, and want to be on a team that takes measurement seriously
Comfortable with ambiguity; when you're stuck, you dig in
Strong communication and a track record of working well across teams
BS in Computer Science or equivalent experience
Preferred Qualifications
Experience in one or more iOS/macOS domains: system services, UI frameworks, concurrent application architecture, or performance
Background building developer tools, test infrastructure, evaluation systems, or data pipelines
Familiarity with how AI systems are evaluated — offline eval, human eval, A/B, or model-graded approaches
Proficiency with one or more scripting languages (Python, Ruby, Bash)
You seek out feedback and learn fast from those around you
Close to the frontier — curious about new models and techniques, and have a point of view on where human-AI interaction is headed
$126.8k - $220.9k
...ML Engineer, Proactive - Agentic Systems Evaluation Are you passionate about working on the next generation of personalized intelligence systems? In this... ..., you will need a deep understanding of system-level software operations to deliver next-generation capabilities....SuggestedRelocation- ...Hands on experience designing Agents and Agentic Workflows using LangGraph Hands on experience in MCP Implementation Good grip... ...employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven...Suggested
$170k - $265k
...employee. This foundation powers Glean's agentic capabilities - AI agents that automate... ..., Google Gemini) and internal evaluation frameworks to improve quality and predictability... .... You are: ~3+ years of software engineering experience building production distributed...SuggestedHome officeFlexible hours3 days per week$181.1k - $318.4k
...AIML - Sr Software Data Engineer, Evaluation Are you excited about using data to shape the experience of products used by hundreds of millions of people around the world? The Evaluation Data Engineering team, part of Apple's SWE organization, builds the scalable and...SuggestedRelocation- ...Developer experience platform team is looking for an extraordinary Software engineer to join our team. You will help design, implement various... ...impact. You’ll contribute to building the backbone of our agentic AI platform, balancing reliability and scale with experimentation...Suggested
$184k - $287.5k
...We are looking for a Senior Software Engineer to help build NeMo Platform, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role... ...Our roadmap is increasingly focused on agentic development and automated agent improvement...Remote work- ...experiences. About the Organization The Evaluation team builds and evolves the evaluation... ...-level results into clear feedback for engineering and leadership, and help accelerate... ...to introspect autonomous driving software performance atinterfaces across the autonomy...Local areaRemote workWork from homeRelocationRelocation packageFlexible hours
$181.1k - $318.4k
Senior Software Engineer: Agentic Systems Cupertino, California, United States Software and Services Join a passionate, dynamic team responsible for creating experiences that enable users to get help with—and discover all the things they love about—their Apple products...Relocation$143k - $191k
...Eightfold is building the next generation of Agentic AI products that help millions of... ...talent decisions. We’re looking for a Software Engineer to design and build highly scalable, user... ...with ML engineers to integrate, evaluate, and productionize models Write clean...Work at officeRemote workFlexible hours$140k - $390k
...What to Expect Tesla AI's Agentic Tooling team builds the harness and skill ecosystem... ...Optimus. Our agents already do real engineering work day-to-day for engineers across the... ...layer, the observability stack, and the evaluation system that gates every prompt, skill,...Hourly payFull timeTemporary workFlexible hours$184k - $287.5k
...We are looking for a skilled Agentic AI Software Engineer to join our team. The ideal candidate is passionate about building autonomous, multi... ...NVIDIA inference services Develop test harnesses and evaluation pipelines to validate agent behavior, tool-call correctness...$181.1k - $318.4k
...AIML - Sr. Software Development Engineer, Evaluation At Apple, we create world-class innovative products that seamlessly combine cutting-edge hardware with intelligent software experiences, powered by advanced machine learning technologies. The Evaluation org is responsible...Immediate startRelocation$147.4k - $272.1k
...AIML - Software Engineer - AI, Evaluation Work Locations (2) Submit Resume Summary Do you get excited by building software systems to enhance the automatic evaluation of various Apple AI products? Our Evaluation organization is responsible for providing principled...Relocation$136k - $199.2k
## Senior Software Engineer, Autonomy EvaluationApplyremote type: Remote/Hybridlocations: Sunnyvale, California, United States of Americatime... ...vehicle experiences.**About the Organization**The Evaluation team builds and evolves the evaluation ecosystem that powers...Remote workRelocationRelocation packageFlexible hours$165k - $180k
...ADAS) and Autonomous Systems, AI Systems Engineering, and Industry AI. We develop scalable,... ...: Design, build, and evaluate agentic AI systems that can plan, reason, act,... ...computer science or engineering Strong software engineering skills in Python Hands-...Full timeTemporary workWork experience placementWorldwide$207k - $300k
Staff Software Engineer, Agentic Data and Evals Location: Sunnyvale, CA, USA. You will design, develop, test, deploy, maintain, and enhance large‑scale software solutions for data generation and evaluation of Generative AI models. The role requires versatile engineering...Full time$147.4k - $272.1k
...iOS Software Engineer, AIML Evaluation At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Do you want to make Siri...Relocation$181.1k - $318.4k
Senior Software Engineer, On-Device Health Agentic Systems Cupertino, California, United States Hardware We are seeking a senior iOS Software Engineer with deep experience building applications powered by Large Language Models (LLMs). This is a hands‑on development role...Relocation- ...California, seeks a qualified candidate to design and evaluate AI systems with a focus on agentic functionalities. The ideal individual will hold a degree in computer science or engineering and have strong software engineering skills in Python. A competitive salary range...
- ...Agentic AI - Senior Software Engineer Mastercard Foundry R&D is seeking a Senior Software Engineer to join the Agentic AI Engineering team. This... ..., and integrations for AI and agentic systems Evaluate models, frameworks, and tools across quality, cost, latency...
$181.1k - $318.4k
...AI/ML - Senior OS Software Engineer, Evaluation For the engineer that obsesses on how software can enable OS developers to evaluate and improve their features, there is no better place than Apple's Experimentation team. The Experimentation team builds an end-to-end...Work experience placementRelocation$147.4k - $272.1k
...Full Stack Software Engineer - Camera & Photos Tools & AI Team At Apple, new ideas have a way... ...Photos, and Image Quality teams measure, evaluate, and improve the imaging experience on... ...tools, including LLM integrations, agentic workflows, and vision model pipelines for...RelocationShift work$174k - $252k
Senior Software Engineer, Infrastructure, CoreOS Agentic Engineering Sunnyvale, CA, USA Mid Experience driving progress, solving problems, and mentoring more junior team members; deeper expertise and applied knowledge within relevant area. Apply Bachelor’s degree or...Full timeWorldwide- ...We are seeking a Senior Agentic Platform Engineer to serve as the lead architect and implementer for our Intelligence Layer. This role is designed... ...& Experience Requirements ~10+ years of Senior Software & Data Engineering experience, with a proven track record...For contractors
- ...years' experience 10 years Job Title* and Job band Senior Agentic Platform Engineer Detailed job description - Skill Set*: Senior Agentic... ...AI deployment Mandatory Skills *10 years of Senior Software & Data Engineering experience, with a proven track record...Contract workLocal area
$162.78k - $221.47k
...seeking a Senior Kubernetes Engineer to help design and implement... ...purpose-built for scientific and agentic workflows. This role is... ..., and GitOps workflows Evaluate and introduce new technologies... .../CD pipelines for scientific software, data processing workflows, and...WorldwideFlexible hoursNight shift$272k - $431.25k
...to develop and expand enterprise-grade agentic AI systems at one of the world’s most advanced... ...and accelerate business results across engineering, IT, supply chain, finance, HR, and... ..., orchestration, tool integration, and evaluation pipelines.* Define and advance NVIDIA’s...$229.9k - $262.4k
Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One,... ...develop, test, deploy, and support AI software components including foundation... ...search, guardrails, model evaluation, experimentation, governance, and...Full timePart timeLocal area$272k - $431.25k
...from smart personal assistants and engineering-productivity tools to data-... ...and operational excellence so our Agentic AI applications behave like mature software, not prototypes. Build reusable... ..., memory and context services, evaluation frameworks, telemetry, and...Live in$229.9k - $262.4k
...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible... ..., test, deploy, and support AI software components including foundation... ...similarity search, guardrails, model evaluation, experimentation, governance, and...Full timePart timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, Agentic Evaluation. Be the first to apply!
- rust software engineer Cupertino, CA
- senior software design engineer Cupertino, CA
- software engineer amazon Cupertino, CA
- software developer positions Cupertino, CA
- software engineer full time Cupertino, CA
- software engineer Cupertino, CA
- software engineer intern Cupertino, CA
- agile software developer Cupertino, CA
- senior software engineer remote Cupertino, CA
- software developer internship Cupertino, CA


