Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

CI Systems Engineer (AI Failure Analysis), Developer Workflows

$181.1k - $318.4k

Apple Oakbrook

CI Systems Engineer (AI Failure Analysis), Developer Workflows

Apple's Software Developer Workflows team delivers fast, reliable CI systems that make Apple's software easier to develop and ship. We believe that streamlined development unlocks creativity, innovation, and potential for developers. We're looking for a skilled CI Systems Engineer to join our team and help build intelligent AI-assisted systems that enable Apple's OS engineers to understand, diagnose, and resolve build and test failures at scale. We value diverse perspectives and unique skills. More than specific experience, we seek an engineer passionate about building great software, applying AI thoughtfully to real problems, continuous learning, and solving complex technical challenges.

Description

In this role, you will design and maintain infrastructure for collecting, processing, and analyzing massive volumes of CI results data - and you will integrate AI capabilities that transform how developers interact with failure information. Your work will turn complex failure signals into actionable insights that accelerate development, using AI to summarize failures, separate genuine issues from distractions, and help engineers focus on what needs attention. Success requires flexibility, proactivity, and thriving in a supportive environment with challenging problems. You'll need excellent judgment for timely technical decisions, ability to collaborate effectively on design discussions, and strong technical depth to make informed tradeoffs about when and how AI can genuinely improve developer workflows. In your role as a CI Systems Engineer, you will work at the intersection of AI and developer tools, shaping how thousands of engineers across Apple diagnose failures. You'll have the autonomy to evaluate new AI approaches, influence infrastructure architecture, and see your work directly reduce friction in Apple's software development process.

Responsibilities
  • Develop AI-assisted failure analysis systems that transform raw CI data into actionable insights, helping developers quickly diagnose root causes and understand test failure patterns
  • Design and implement AI-powered triage workflows that intelligently summarize failures, identify patterns across large result sets, and distinguish signal from noise
  • Build and integrate tools that give AI systems structured access to CI data, enabling intelligent querying and analysis
  • Optimize data structures and database design for fast storage and deduplication of build and test failures, ensuring AI systems have efficient access to the context they need
  • Drive performance improvements and optimization initiatives for results storage and query latency to meet developer needs
  • Collaborate with OS engineering teams across platforms (iOS, macOS, etc.) to understand diagnostic needs and refine AI-assisted analysis capabilities
  • Implement observability and alerting for the CI results infrastructure itself, ensuring reliability and detecting systemic failure patterns
  • Evaluate and iterate on AI approaches, measuring their effectiveness at reducing triage time and improving developer experience
  • Share technical knowledge and best practices with team members on failure analysis, AI integration patterns, data systems design, and infrastructure challenges
Minimum Qualifications
  • BS in Computer Science or equivalent professional experience
  • 8+ years of software engineering experience, preferably 2+ years focused on CI infrastructure, data systems, or failure analysis
  • Experience applying AI/ML or LLM-based approaches to software development workflows, tooling, or automation
  • Proficiency in one or more languages suited to systems and data work (Swift, Scala, Python, Go, C/C++, etc.)
  • Proven ability to work independently on complex problems and collaborate effectively on team initiatives
  • Strong communication skills to collaborate with diverse teams and translate complex failure data into developer-friendly insights
  • Demonstrated experience in designing or contributing to systems that handle scale, data integrity, and query performance
Preferred Qualifications
  • Experience building or integrating with AI agents using the latest-available tools such as Skills, MCP Servers, Plugins, or LLM-powered tooling
  • Proven experience integrating AI into developer workflows with measurable impact on engineering efficiency; code review, testing, debugging, triage, or productivity tooling
  • Familiarity with machine learning techniques applied to failure correlation, anomaly detection, or pattern recognition
  • Deep expertise in data storage, retrieval, and analysis, including experience with relational and NoSQL databases
  • Experience building data pipelines or working with distributed data processing frameworks
  • Background working on large-scale data systems, observability platforms, or analytics infrastructure
  • Experience with CI/CD failure analysis, test result aggregation, or build system diagnostics, including root cause analysis, diagnostic tooling, and observability practices
  • Knowledge of iOS or macOS internals, development environments, build agents, and testing infrastructure
Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant At Apple, we believe accessibility is a fundamental human right. You'll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong. Learn about accessibility in Apple's workplace Learn about reasonable accommodations for job applicants Apple accepts applications to this posting on an ongoing basis. Submit Resume Back to search results See all roles in Cupertino

Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the CI Systems Engineer (AI Failure Analysis), Developer Workflows in Cupertino, CA vacancy
  • A leading technology company located in Cupertino, California, is seeking a CI Systems Engineer to enhance software development workflows using AI integration. The role involves designing infrastructure for CI results data, implementing AI-assisted systems, and collaborating... 
    Suggested

    Apple Inc.

    Cupertino, CA
    1 day ago
  •  ...Position: Staff Software Engineer – Simulation & Workflow Systems Location: Sunnyvale,...  ...domains. You’ll develop high-performance...  .... • Experience with AI assisted programming...  ...services (REST/gRPC), plus CI/CD and automated...  ...useful in shape-driven analysis). • SaaS/Cloud based... 
    Suggested
    Contract work

    Agile Global Solutions Inc

    Sunnyvale, CA
    12 hours ago
  • $125k - $185k

     ...Software Engineer - Systems Engineering Ai Tooling Sunnyvale, California...  ...platforms and workflows that support development...  ...Applied Intuition. You'll develop scalable backend...  ..., and change impact analysis. Refactor...  ...services and working with CI/CD pipelines. ~ Strong... 
    Suggested
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    1 day ago
  •  ...by unifying software engineering, reliability analysis, and release...  ...Release Engineers, Systems Engineers, DevOps, and AI/ML teams to design and...  ...simulation, on-road, and CI/CD validation signals...  ...release candidates. Develop automated triage and failure analysis systems to... 
    Suggested
    Local area
    Work from home

    General Motors

    Sunnyvale, CA
    3 days ago
  • $198k - $260k

     ...Senior Staff DevOps Engineer - CI/CD & Release...  ...transformation to AI-enabled software-defined...  ...think in terms of systems, supply chains,...  ...integration of static analysis (Coverity) and...  ...for changes, change failure rate, and mean...  ...versioning, promotion workflows, and customer... 
    Suggested
    Work at office
    Worldwide
    Flexible hours
    Shift work

    Sonatus

    Sunnyvale, CA
    2 days ago
  • $152k - $241.5k

     ...potential of AI to define the...  ...chip design engineers by building tools...  ...shelf-life systems spanning...  ...stability. Our core workflow...  ...This isn't a CI/CD pipeline configuration...  ...platforms Develop reliable...  ...systems thinking: failures, retries/...  ...clear root-cause analysis, remediation,... 

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $136.5k - $276.5k

     ...Senior Software Engineer, Systems/Solutions Test...  ...Engineering, you will develop customer-specific test...  ...manual tests, analyze failures, and isolate...  ...perform root-cause analysis, and drive corrective...  ...technologies, including AI-assisted testing workflows. Required... 
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise Development LP

    Sunnyvale, CA
    2 days ago
  • $160k - $210k

     ...nEye.ai, a well-funded optical switch...  ...Software Engineer who will design...  ...Responsibilities Develop and maintain...  ...& reliability workflows. Collaborate...  ...confidently. Support failure analysis by...  ...reproducible, documented systems for multiple...  ...with Docker, CI/CD for lab code... 

    nEye Systems

    Santa Clara, CA
    1 day ago
  • $135.96k - $197.76k

     ...Sr Software Engineer, Integration...  ...responsible for developing and...  ...reliable deployment workflows for packaging...  ...in local and CI/CD environments...  ...vehicles and lab systems Work with...  ...time, and failure modes Perform...  ...root-cause analysis of deployment...  ...Generative AI or Large Language... 
    Permanent employment
    Temporary work
    Casual work
    Local area

    Cariad, Inc.

    Mountain View, CA
    1 day ago
  • $172k - $349k

     ...Principal Software Engineer, Systems/Solutions Test This role has...  ...Champion adoption of AI-assisted testing workflows, including LLM- and agent...  ...test design, triage, and analysis. Influence roadmap decisions...  ...distributed/network failures and driving closure across... 
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    HPE

    Sunnyvale, CA
    2 days ago
  •  ...servers into one unified system. You’ll join a team of engineers and architects who are...  ...experience designing, developing, and deploying secure web...  ...to perform critical analysis of security properties...  ...Comfort building and using AI-assisted workflows that enhance efficiency... 

    Apple

    Cupertino, CA
    4 days ago
  • $79.21 - $104.97 per hour

     ...Overview As a Principal System Engineer - Cloud Services,...  ..., generative AI, machine learning,...  ...Enable and maintain CI/CD pipelines and...  ...Perform root cause analysis and implement...  ...Automation and Scripting: Develop and maintain...  ...AI models and ML workflows. Security: Thorough... 
    Hourly pay
    Work experience placement

    Stanford Health Care

    Palo Alto, CA
    2 days ago
  • $147.4k - $220.9k

     ...Software Engineer, SDLC Analytics...  ...building elegant systems that make...  ...development workflows. We are seeking...  ...historical analysis and trend identification...  ..., testing, CI/CD, and...  ..., Change Failure Rate, Mean Time...  ...using AI-powered solution...  ...you grow and develop within a role... 
    Relocation

    Apple

    Cupertino, CA
    2 days ago
  • $132.3k - $198.45k

     ...Software Engineer, Distributed Compute System Mountain View, California...  ...cutting-edge AI with automotive-...  ...Design and develop scalable, reliable...  ...Experience with workflow management tools...  ...Experience with data analysis, includes...  ...integration/delivery (CI/CD) At Nuro... 

    Nuro

    Mountain View, CA
    2 days ago
  • $184k - $287.5k

     ...unlimited potential of AI to define the next...  ...you’ll be doing: Develop use cases and system requirements for L3...  ...Perform system-level analysis to define...  ...Data Analytics, Test Engineering, and System Integration...  ...science, and analytics workflows. Strong software... 

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $125k - $191.7k

     ...Role: As a Senior Software Systems Engineer on the Software Validation team...  ...methodologies for AI systems and other ADAS features...  ...meet the testing needs of AI developers, systems engineers, and safety...  ...comfortableautonomousvehicle operations. Own analysis and characterization of one... 
    Local area
    Remote work
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $165k - $241.4k

     ...Cisco Distributed System Engineering (DSE) group owns...  ...growing demands of AI/ML workloads and...  ...expertise in developing scalable systems,...  ...GDB) and memory analysis tools (e.g., Valgrind...  ...reviews, and testing workflows. Experience...  ..., Jenkins and CI/CD pipeline tools... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Cisco

    Milpitas, CA
    2 days ago
  • $170.6k - $261.3k

     ...hardware and battery systems to intuitive...  .... Our Embodied AI teams are redefining...  ...a Senior Software Engineer on the Secondary Driving...  ...be doing: Develop and optimize production...  ...to primary stack failures. Own features...  ..., and data analysis. ~ Experience in... 
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $184k - $287.5k

     ...unlimited potential of AI to define the...  ...software systems for rack, networking...  ...Software Engineer - Datacenter Systems...  ...be doing: Develop and manage...  ...Build and maintain CI/CD pipelines...  ...and automation workflows that simplify software...  ...monitoring and analysis. Experience... 
    Remote work

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $181.1k - $318.4k

    Software Engineer - Systems (DFT Initiative) Cupertino, California...  ...is an opportunity to develop software tools that...  ...components that manage testing workflows, test scheduling, result tracking, and data analysis Writing clean,...  ...Interest in exploring AI applications in... 
    Relocation

    Apple Inc.

    Cupertino, CA
    12 hours ago
  • $152k - $208.5k

     ...leader in materials engineering solutions used to...  ...our world – like AI and IoT. If you want...  ...you to learn, develop, and grow your career...  ...in intricate systems, deciphering code,...  ...structural codebase analysis. Move beyond text-...  ...assisted development workflows across Applied... 
    Full time
    Relocation

    Applied Materials

    Santa Clara, CA
    15 hours ago
  • $160.36k - $240.54k

     ...Senior Software Engineer – GenAI...  ...Infrastructure & Agent Systems for Engineering...  ...cutting-edge AI with automotive...  ...how software is developed, tested, and operated...  ...generation and CI/CD to debugging...  ..., triage, and workflow automation...  ...CD for testing, failure attribution,... 

    Nuro

    Mountain View, CA
    3 days ago
  •  ...experiences-from AI and data...  ...gaming and embedded systems. Grounded in a...  ...Staff Software Engineer - AI Agentic Infrastructure...  ...Engineer to develop the deep...  ...development workflow. In this role...  ...and Feasibility Analysis to determine solvability...  ...isolated CI/CD pipelines.... 

    Advanced Micro Devices , Inc.

    San Jose, CA
    1 day ago
  •  ...experiences-from AI and data centers,...  ...gaming and embedded systems. Grounded in a culture...  ...accessible to developers everywhere. THE...  ...Senior Staff AI Infra Engineer who is passionate...  ...and performance-analysis tools for GPU...  ...and autonomous AI workflows, including tool use... 

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    3 days ago
  •  ...Principal Software Engineer (C /Python, Simulation Systems) Location:...  ...domains. You'll develop high-performance...  ...computation services, workflow orchestration,...  ...Experience with AI assisted...  ...REST/gRPC), plus CI/CD and automated...  ...in shape-driven analysis). • SaaS/Cloud... 

    Javen Technologies

    Mountain View, CA
    4 days ago
  • $190.2k - $360.5k

     ...Creative Cloud Engineering organization is...  ...generation of AI-powered engineering...  ...to accelerate developer productivity...  ...into AI-driven workflows across developer...  ...for a Senior AI Systems Engineer who...  ...workflows across CI/CD, developer tooling...  ..., build failure triage, and autonomous... 
    Temporary work
    Local area
    Worldwide

    Adobe

    San Jose, CA
    4 days ago
  • $180k

     ...mission is to create AI systems that can accurately understand...  ..., and focused on engineering excellence. This...  ...enable frictionless developer workflows. Maintain Kubernetes...  ...Secure and enhance CI/CD pipelines. Integrate...  .... Apply critical analysis and problem-solving... 
    Permanent employment
    Temporary work
    Relocation

    xAI

    Palo Alto, CA
    a month ago
  • $147.4k - $272.1k

     ...Infrastructure Engineer Do you...  ...efficient processor, system-on-chip (SoC)...  ...and operate CI/CD pipelines...  ...aggregation, failure triage, and root cause analysis across large...  ...embedded developers to deploy toolchain...  ...tasks and workflows Experience...  ...Generative AI for developer... 
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  •  ...Powered by the Illumio AI Security Graph, our breach...  ...the infrastructure, systems, and organizations that...  ...Our Team's Vision: Our Engineering team is shaping the future...  ...conducting root cause analysis, implementing...  ...Strong understanding of CI/CD principles and experience... 
    Work experience placement

    Illumio

    Sunnyvale, CA
    3 days ago
  • $162.78k - $221.47k

     ...and operate the systems that let...  ...Senior Kubernetes Engineer to help design...  ...scientific and agentic workflows. This role...  .... AI-driven agentic...  ...experimental science Develop cloud-native architectures...  ...acquisition, analysis, and...  ...and implement CI/CD pipelines for... 
    Worldwide
    Flexible hours
    Night shift

    Stanford University

    Menlo Park, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to CI Systems Engineer (AI Failure Analysis), Developer Workflows. Be the first to apply!