Automation and Triage Engineer, Siri

Automation And Triage Engineer, Siri

Siri is how hundreds of millions of people interact with Apple every day - asking questions, getting things done, and navigating their lives. The quality of that experience matters deeply, and this role sits at the heart of making it better. If you're passionate about AI quality, intelligent systems, and building the kind of rigorous evaluation infrastructure that makes great products possible - this is your opportunity to define what excellence looks like. You'll dig deep into complex failures across Siri's AI pipeline and shape the direction of a product used by people around the world.

As an Automation And Triage Engineer for Siri Quality, you will build the tools and systems that hold Siri to the highest standard. You'll design frameworks and automated pipelines that rigorously test how Siri performs across Apple platforms - evaluating whether it truly understands user intent, leverages available on-device context, and delivers an experience that feels effortless and intelligent. Your work transforms subjective quality into measurable signal, giving engineering and ML teams the clarity they need to move fast and ship with confidence.

Responsibilities

• Design and maintain end-to-end test automated test suite for Siri across iOS, macOS, iPadOS, CarPlay, and other Apple platforms.
• Author and scale evaluation scenarios that reflect real-world user intent and on-device context.
• Investigate and triage complex failures across Siri's AI stack — planner behavior, tool execution, search, context retrieval, and response generation.
• Distinguish true product regressions from infrastructure noise, and drive root cause analysis to clear, actionable outcomes.
• Partner with engineering, ML, and product experience teams to define quality metrics, track regressions, and validate improvements before they ship.

Minimum Qualifications

• Bachelor's Degree in Computer Science or related field.
• 8+ years of experience in a software development or test engineering role, with demonstrated leadership in quality strategy, and automation.
• Strong software engineering fundamentals with hands-on experience in Python, Swift, or both, and a track record of building test automation frameworks, CI/CD pipelines, or evaluation infrastructure for complex software systems.
• Experience with agentic coding systems, using AI-assisted development tools to accelerate implementation, prototype evaluation pipelines, and tackle complex engineering problems with speed and precision.
• Familiarity with machine learning concepts and LLM-based systems - including evaluation methodologies, prompt design, and model behavior analysis.

Preferred Qualifications

• Experience with on-device AI, natural language understanding, or conversational systems is a strong plus, as is familiarity with scenario-based testing, or agent trajectory analysis.
• Prior work on quality or reliability for consumer-facing AI products is especially valued.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $172,100 and $305,600, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant At Apple, we believe accessibility is a fundamental human right. You'll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong. Learn about accessibility in Apple's workplace Learn about reasonable accommodations for job applicants Apple accepts applications to this posting on an ongoing basis.