Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Agentic Evaluation

Apple Oakbrook

Weekly Hours: 40

Role Number: 200664500-0836

Summary

We're a team at Apple building software that helps shape the next generation of Siri and AI-powered experiences. The work spans frameworks, tooling, and infrastructure — including a strong focus on how we evaluate and measure the quality of what we ship. We can't say much about specifics, but the problems are new, the surface area is large, and the reach is enormous. We're a collaborative, humble, and curious group that learns from each other and builds together.

Description

You'll work alongside engineers, designers, and researchers to design and build software end-to-end — from early prototypes to production systems running on real devices. You'll have meaningful autonomy in how you get there, and the opportunity to shape both what we build and how we know it's working. The work is hard enough to stretch you, and the team is generous enough to support you while you grow.

Minimum Qualifications

  • 3+ years of software engineering experience with strong CS fundamentals

  • Proficiency in Swift, Objective-C, Python, or another modern language — strong engineers in adjacent stacks will pick up the rest

  • You've shipped software that people used, and you're ready to own bigger pieces end-to-end

  • Expert in using generative AI models for coding — you've integrated tools like Claude, Cursor, or Codex deeply into how you work, and have a point of view on where they help and where they don't

  • An interest in software evaluation and quality — you care about whether what you build actually works, and want to be on a team that takes measurement seriously

  • Comfortable with ambiguity; when you're stuck, you dig in

  • Strong communication and a track record of working well across teams

  • BS in Computer Science or equivalent experience

Preferred Qualifications

  • Experience in one or more iOS/macOS domains: system services, UI frameworks, concurrent application architecture, or performance

  • Background building developer tools, test infrastructure, evaluation systems, or data pipelines

  • Familiarity with how AI systems are evaluated — offline eval, human eval, A/B, or model-graded approaches

  • Proficiency with one or more scripting languages (Python, Ruby, Bash)

  • You seek out feedback and learn fast from those around you

  • Close to the frontier — curious about new models and techniques, and have a point of view on where human-AI interaction is headed

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, Agentic Evaluation in Cupertino, CA vacancy
  • $126.8k - $220.9k

     ...ML Engineer, Proactive - Agentic Systems Evaluation Are you passionate about working on the next generation of personalized intelligence systems? In this...  ..., you will need a deep understanding of system-level software operations to deliver next-generation capabilities.... 
    Suggested
    Relocation

    Apple

    Cupertino, CA
    2 days ago
  •  ...Hands on experience designing Agents and Agentic Workflows using LangGraph Hands on experience in MCP Implementation Good grip...  ...employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven... 
    Suggested

    Diverse Lynx

    Sunnyvale, CA
    3 days ago
  • $170k - $265k

     ...employee. This foundation powers Glean's agentic capabilities - AI agents that automate...  ..., Google Gemini) and internal evaluation frameworks to improve quality and predictability...  .... You are: ~3+ years of software engineering experience building production distributed... 
    Suggested
    Home office
    Flexible hours
    3 days per week

    Glean.info

    Mountain View, CA
    2 days ago
  • $181.1k - $318.4k

     ...AIML - Sr Software Data Engineer, Evaluation Are you excited about using data to shape the experience of products used by hundreds of millions of people around the world? The Evaluation Data Engineering team, part of Apple's SWE organization, builds the scalable and... 
    Suggested
    Relocation

    Apple

    Cupertino, CA
    2 days ago
  •  ...Developer experience platform team is looking for an extraordinary Software engineer to join our team. You will help design, implement various...  ...impact. You’ll contribute to building the backbone of our agentic AI platform, balancing reliability and scale with experimentation... 
    Suggested

    Apple

    Sunnyvale, CA
    2 days ago
  • $184k - $287.5k

     ...We are looking for a Senior Software Engineer to help build NeMo Platform, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role...  ...Our roadmap is increasingly focused on agentic development and automated agent improvement... 
    Remote work

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...experiences. About the Organization The Evaluation team builds and evolves the evaluation...  ...-level results into clear feedback for engineering and leadership, and help accelerate...  ...to introspect autonomous driving software performance atinterfaces across the autonomy... 
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $181.1k - $318.4k

    Senior Software Engineer: Agentic Systems Cupertino, California, United States Software and Services Join a passionate, dynamic team responsible for creating experiences that enable users to get help with—and discover all the things they love about—their Apple products... 
    Relocation

    Apple Inc.

    Cupertino, CA
    3 days ago
  • $143k - $191k

     ...Eightfold is building the next generation of Agentic AI products that help millions of...  ...talent decisions. We’re looking for a Software Engineer to design and build highly scalable, user...  ...with ML engineers to integrate, evaluate, and productionize models Write clean... 
    Work at office
    Remote work
    Flexible hours

    Eightfold LLC

    Santa Clara, CA
    4 days ago
  • $140k - $390k

     ...What to Expect Tesla AI's Agentic Tooling team builds the harness and skill ecosystem...  ...Optimus. Our agents already do real engineering work day-to-day for engineers across the...  ...layer, the observability stack, and the evaluation system that gates every prompt, skill,... 
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    4 days ago
  • $184k - $287.5k

     ...We are looking for a skilled Agentic AI Software Engineer to join our team. The ideal candidate is passionate about building autonomous, multi...  ...NVIDIA inference services Develop test harnesses and evaluation pipelines to validate agent behavior, tool-call correctness... 

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $181.1k - $318.4k

     ...AIML - Sr. Software Development Engineer, Evaluation At Apple, we create world-class innovative products that seamlessly combine cutting-edge hardware with intelligent software experiences, powered by advanced machine learning technologies. The Evaluation org is responsible... 
    Immediate start
    Relocation

    Apple

    Cupertino, CA
    11 hours ago
  • $147.4k - $272.1k

     ...AIML - Software Engineer - AI, Evaluation Work Locations (2) Submit Resume Summary Do you get excited by building software systems to enhance the automatic evaluation of various Apple AI products? Our Evaluation organization is responsible for providing principled... 
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $136k - $199.2k

    ## Senior Software Engineer, Autonomy EvaluationApplyremote type: Remote/Hybridlocations: Sunnyvale, California, United States of Americatime...  ...vehicle experiences.**About the Organization**The Evaluation team builds and evolves the evaluation ecosystem that powers... 
    Remote work
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    11 hours ago
  • $165k - $180k

     ...ADAS) and Autonomous Systems, AI Systems Engineering, and Industry AI. We develop scalable,...  ...: Design, build, and evaluate agentic AI systems that can plan, reason, act,...  ...computer science or engineering  Strong software engineering skills in Python Hands-... 
    Full time
    Temporary work
    Work experience placement
    Worldwide

    Bosch Group

    Sunnyvale, CA
    12 days ago
  • $207k - $300k

    Staff Software Engineer, Agentic Data and Evals Location: Sunnyvale, CA, USA. You will design, develop, test, deploy, maintain, and enhance large‑scale software solutions for data generation and evaluation of Generative AI models. The role requires versatile engineering... 
    Full time

    Google Inc.

    Sunnyvale, CA
    4 days ago
  • $147.4k - $272.1k

     ...iOS Software Engineer, AIML Evaluation At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Do you want to make Siri... 
    Relocation

    Apple

    Cupertino, CA
    11 hours ago
  • $181.1k - $318.4k

    Senior Software Engineer, On-Device Health Agentic Systems Cupertino, California, United States Hardware We are seeking a senior iOS Software Engineer with deep experience building applications powered by Large Language Models (LLMs). This is a hands‑on development role... 
    Relocation

    Apple Inc.

    Cupertino, CA
    2 days ago
  •  ...California, seeks a qualified candidate to design and evaluate AI systems with a focus on agentic functionalities. The ideal individual will hold a degree in computer science or engineering and have strong software engineering skills in Python. A competitive salary range... 

    Robert Bosch Group

    Sunnyvale, CA
    2 days ago
  •  ...Agentic AI - Senior Software Engineer Mastercard Foundry R&D is seeking a Senior Software Engineer to join the Agentic AI Engineering team. This...  ..., and integrations for AI and agentic systems Evaluate models, frameworks, and tools across quality, cost, latency... 

    Dynamic Yield

    Mountain View, CA
    1 day ago
  • $181.1k - $318.4k

     ...AI/ML - Senior OS Software Engineer, Evaluation For the engineer that obsesses on how software can enable OS developers to evaluate and improve their features, there is no better place than Apple's Experimentation team. The Experimentation team builds an end-to-end... 
    Work experience placement
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $147.4k - $272.1k

     ...Full Stack Software Engineer - Camera & Photos Tools & AI Team At Apple, new ideas have a way...  ...Photos, and Image Quality teams measure, evaluate, and improve the imaging experience on...  ...tools, including LLM integrations, agentic workflows, and vision model pipelines for... 
    Relocation
    Shift work

    Apple

    Cupertino, CA
    2 days ago
  • $174k - $252k

    Senior Software Engineer, Infrastructure, CoreOS Agentic Engineering Sunnyvale, CA, USA Mid Experience driving progress, solving problems, and mentoring more junior team members; deeper expertise and applied knowledge within relevant area. Apply Bachelor’s degree or... 
    Full time
    Worldwide

    Google Inc.

    Sunnyvale, CA
    11 hours ago
  •  ...We are seeking a Senior Agentic Platform Engineer to serve as the lead architect and implementer for our Intelligence Layer. This role is designed...  ...& Experience Requirements ~10+ years of Senior Software & Data Engineering experience, with a proven track record... 
    For contractors

    Yochana

    Cupertino, CA
    4 days ago
  •  ...years' experience 10 years Job Title* and Job band Senior Agentic Platform Engineer Detailed job description - Skill Set*: Senior Agentic...  ...AI deployment Mandatory Skills *10 years of Senior Software & Data Engineering experience, with a proven track record... 
    Contract work
    Local area

    eTeam

    Sunnyvale, CA
    11 hours ago
  • $162.78k - $221.47k

     ...seeking a Senior Kubernetes Engineer to help design and implement...  ...purpose-built for scientific and agentic workflows. This role is...  ..., and GitOps workflows Evaluate and introduce new technologies...  .../CD pipelines for scientific software, data processing workflows, and... 
    Worldwide
    Flexible hours
    Night shift

    Stanford University

    Menlo Park, CA
    2 days ago
  • $272k - $431.25k

     ...to develop and expand enterprise-grade agentic AI systems at one of the world’s most advanced...  ...and accelerate business results across engineering, IT, supply chain, finance, HR, and...  ..., orchestration, tool integration, and evaluation pipelines.* Define and advance NVIDIA’s... 

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One,...  ...develop, test, deploy, and support AI software components including foundation...  ...search, guardrails, model evaluation, experimentation, governance, and... 
    Full time
    Part time
    Local area

    Capital One Financial Corp

    San Jose, CA
    11 hours ago
  • $272k - $431.25k

     ...from smart personal assistants and engineering-productivity tools to data-...  ...and operational excellence so our Agentic AI applications behave like mature software, not prototypes. Build reusable...  ..., memory and context services, evaluation frameworks, telemetry, and... 
    Live in

    NVIDIA

    Santa Clara, CA
    29 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible...  ..., test, deploy, and support AI software components including foundation...  ...similarity search, guardrails, model evaluation, experimentation, governance, and... 
    Full time
    Part time
    Local area

    Capital One

    San Jose, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Agentic Evaluation. Be the first to apply!