Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI/ML - Senior OS Software Engineer, Evaluation

$181.1k - $318.4k

Apple Oakbrook

AI/ML - Senior OS Software Engineer, Evaluation

For the engineer that obsesses on how software can enable OS developers to evaluate and improve their features, there is no better place than Apple's Experimentation team. The Experimentation team builds an end-to-end platform spanning the OS, data, and server for all the Apple OSes, operating at a scale of 2.5+ billion devices. We are addressing key challenges to accelerate the adoption of AI and an experimentation culture mindset across all Apple products/services. We are seeking seasoned engineers that can push the boundaries of low-level operating system technologies while maintaining a customer-centric focus on the developer and user experience.

The mission of Evaluation is to measure, understand, and proactively improve all Apple features. We are looking for an experienced engineer to build and extend the experimentation system for Apple to use across all our operating systems. You will be responsible for the on-device daemon and framework, that is at the heart of the experimentation platform. You will partner with feature teams across Apple to enable them to make a positive impact for the customers. You will ship code that runs on devices you use every day and powers a variety of Apple products. You will obsess over memory, power, performance in addition to the developer experience. Your technical leadership will drive critical design discussions, elevate peers through code reviews, and push the boundaries across the operating system.

Responsibilities
  • Design and implement new features and APIs for the on-device Experimentation service that is deployed across multiple Apple operating systems
  • Develop and maintain high-performance libraries that are easy to use by developers
  • Participate in all phases of software development cycle: from problem definition and design, through implementation, testing, and debugging
  • Diagnose and resolve issues across different layers of the software stack
  • Write unit and integration tests for new and existing code
  • Work with cross-functional teams to enable developer and product features
  • An appreciation how an OS design impacts end-user experience
Minimum Qualifications
  • BS in Computer Science, or a related field with 7 years of work experience; or a MS in Computer Science, or related field with 5 years work experience
  • Industry experience in Objective-C, Swift, C/C++, Kotlin, or similar languages
  • System design and architecture skills
  • Strong understanding of operating system fundamentals such as threading, synchronization primitives, inter-process communication, and scheduling
  • Excellent collaborative skills, with the ability to work with a team to design system architecture
  • Proven ability to deliver Operating Systems production grade software
Preferred Qualifications
  • Skilled at programming interface design
  • Experience in iOS, macOS, or similar operating systems
  • An appreciation of how a platform design impacts end-user experience
  • Experience in experimentation or A/B testing and AI

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant At Apple, we believe accessibility is a fundamental human right. You'll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong. Learn about accessibility in Apple's workplace Learn about reasonable accommodations for job applicants Apple accepts applications to this posting on an ongoing basis.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI/ML - Senior OS Software Engineer, Evaluation in Cupertino, CA vacancy
  • $136k - $199.2k

    ## Senior Software Engineer, Autonomy EvaluationApplyremote type: Remote/Hybridlocations...  ...About the Organization**The Evaluation team builds and evolves the...  ...develop new statistical and ML methods to quantify...  ...systems.* Experience leveraging AI-assisted development and... 
    Senior
    Remote work
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  • $166k - $244k

    Senior Software Engineer, AI/ML GenAI, Google Workspace link Copy link corporate_fare Google Sunnyvale, CA, USA Mid Experience driving progress...  ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). 1 year of experience... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    1 day ago
  • $166k - $244k

    Senior Software Engineer, AI/ML GenAI, Google Cloud AI Google Sunnyvale, CA, USA Qualifications Bachelor’s degree or equivalent practical experience...  ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). 3 years of... 
    Senior
    Full time
    Worldwide

    Google Inc.

    Sunnyvale, CA
    9 hours ago
  • $110k - $190k

     ...Role Overview We are hiring a Senior Software & AI Engineer to build production-grade AI systems,...  ...generation (RAG), and agent-based workflows Evaluate tradeoffs between foundation models,...  ...real-world use Apply traditional ML techniques where appropriate (e.g.,... 
    Senior

    Covalent

    Sunnyvale, CA
    9 hours ago
  • $174k - $252k

    Senior Software ML Engineer, AI/ML GenAI, Gemini Enterprise corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree in Computer...  ...millions of enterprise users. You will architect automated evaluation frameworks, design optimization algorithms, and solve... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    4 days ago
  • $55k - $151.47k

     ...in data and analytics engineering focus on leveraging advanced...  ...of the People Tech & AI team you will develop,...  ...PwC standards. As a Senior Associate you will analyze...  ...data engineering, AI/ML engineering, or quality...  ...platform Executing LLM evaluation frameworks using... 
    Senior
    Full time
    Work experience placement
    H1b
    Remote work

    PwC

    San Jose, CA
    1 day ago
  • $147.4k - $272.1k

     ...AIML - Software Engineer - AI, Evaluation Work Locations (2) Submit Resume Summary Do you get excited by building software systems to enhance the automatic evaluation of various Apple AI products? Our Evaluation organization is responsible for providing principled... 
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $181.1k - $318.4k

     ...Senior Software Engineer - AI Experiences We're a small team at Apple betting on what comes next. We believe AI will fundamentally change how people...  ...works — then making it real Partnering with Design, ML, and AI researchers to shape features and translate cutting... 
    Senior
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $143k - $191k

     ...the next generation of Agentic AI products that help millions...  ...decisions. We’re looking for a Software Engineer to design and build highly...  ...managers, designers, and AI/ML engineers to bring intelligent...  ...with ML engineers to integrate, evaluate, and productionize models... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Eightfold LLC

    Santa Clara, CA
    2 days ago
  • $296.3k

    Scale up introspection and evaluation tools that work with billions of examples and enable utilization of our large datasets, delivering...  ...-edge technology and a collaborative, high-impact team of AI/ML engineers, data scientists and engineers who are passionate about... 
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  •  ...About the Organization The Evaluation team builds and evolves the...  ...results into clear feedback for engineering and leadership, and help...  ...introspect autonomous driving software performance atinterfaces across...  ...develop new statistical and ML methods to quantify performance... 
    Senior
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    3 days ago
  •  ...foundation for physical AI — a unified...  ...universal Physical AI OS, making robots as...  ...and deploy as software. Today, robotics is...  ...are looking for a Senior AI Engineer to design, build,...  ...Develop systematic evaluation frameworks (evals,...  ...webhooks; Python for AI/ML integration and... 
    Senior
    Full time

    Dexmate

    Santa Clara, CA
    9 hours ago
  • $172.43k - $230.95k

     ...Senior Software Engineer For The Ai Model Lifecycle Team Crusoe is on a mission to accelerate the abundance of energy and intelligence. As the...  ...model, and experiment management: versioning, lineage, evaluation, and reproducible fine-tuning at scale. What You'll... 
    Senior
    Temporary work

    Crusoe

    Sunnyvale, CA
    3 days ago
  • $193.3k - $261.5k

     ...builds AWS Neuron, the software development kit used to...  ...Inferentia and Trainium ML accelerators. This...  ...software boundary, our engineers build systematic infrastructure...  ...of what's possible in AI acceleration. As...  ...sharing and mentorship. Our senior members enjoy one-on-... 
    Senior
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    5 hours ago
  • $170k - $210k

     ...Senior Software Engineer, AI Engineer Hybrid - SF Bay Area About Midi Health Midi Health is the...  ...of healthcare-grade safety and evaluation. What You Will Do Design, build...  ...recent time building production LLM / ML features ~ Strong hands-on coding skills... 
    Senior
    Work at office
    Immediate start
    Remote work
    Shift work
    2 days per week

    Midi Health

    Palo Alto, CA
    3 days ago
  • $174k - $252k

    Google Inc. is seeking a Senior Software ML Engineer in Sunnyvale, CA to lead the development of agentic features that enhance enterprise productivity using Generative AI technologies. The candidate must possess a Bachelor's degree in Computer Science or a related field... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    4 days ago
  • $174k - $252k

    Senior Software Engineer, AI/ML, AI and Infrastructure Apply X Note: By applying to this position you will have an opportunity to share your preferred...  ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). Preferred... 
    Senior
    Full time
    Worldwide

    Google Inc.

    Mountain View, CA
    1 day ago
  • $174k - $252k

    Senior Software Engineer, Generative AI, Ads Query Understanding corporate_fare Google place Mountain View, CA, USA Apply...  ...architecture. 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging)... 
    Senior
    Full time

    Google Inc.

    Mountain View, CA
    9 hours ago
  • $174k - $252k

    Senior Software Engineer, AI/ML, Youtube Ads Mountain View, CA, USA Qualifications Bachelor’s degree or equivalent practical experience. 5 years...  ...with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging). Experience using Python... 
    Senior
    Full time

    Google Inc.

    Mountain View, CA
    9 hours ago
  • $166k - $244k

    Senior Software Engineer, AI/ML Recommendations, Rankings, Predictions, YouTube Mountain View, CA, USA Experience driving progress, solving problems...  ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). Preferred... 
    Senior
    Full time

    Google Inc.

    Mountain View, CA
    2 days ago
  • $174k - $252k

    Senior Software Engineer, AI/ML, Shopping link Copy link corporate_fare Google place Mountain View, CA, USA Mid Experience driving progress, solving...  ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). Experience... 
    Senior
    Full time
    Local area

    Google Inc.

    Mountain View, CA
    4 days ago
  • $181.1k - $318.4k

    Sr. Applied AI Software Engineer- Vision Products Group & Siri Sunnyvale, California, United States Software and Services Apple builds products...  ...on. You will need to be comfortable writing Swift code, evaluating AI/ML algorithms for on‑device integration, collaborating on... 
    Senior
    Relocation

    Apple Inc.

    Sunnyvale, CA
    1 day ago
  • $207k - $307k

    A leading tech company in Sunnyvale, CA is seeking a Software Engineer to lead the design and architecture of customer-facing systems. Applicants...  ...in software development, focusing on distributed systems and AI/ML applications. You will drive project outcomes, implement best... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    4 days ago
  • $170.9k - $231.2k

     ...looking for a motivated engineer to join Arm’s Developer...  ..., extending its evaluation framework, and ensuring...  ...registries. Our team works on software development...  ...you will help shape how AI agents interact with Arm...  ...evaluation frameworks for AI/ML systems or developer tools... 
    Senior

    Arm Limited

    San Jose, CA
    2 days ago
  •  ...California, is seeking a Sr Machine Learning Engineer, Tech Lead for Autograder Systems. In this high...  ...role, you will define the technical vision for evaluating model outputs and lead a team of MLEs to enhance generative AI features. Candidates should have a Master's or... 
    Senior

    Apple Inc.

    Cupertino, CA
    2 days ago
  • A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    9 hours ago
  • $188k - $237.5k

     ...driving the transformation to AI-enabled software-defined vehicles....  ...seeking a highly motivated Senior AI Engineer to join our team and help...  ...large models, traditional ML models, etc. (AI depth)...  ...feature engineering, and model evaluation techniques. Familiarity... 
    Senior
    Work at office
    Local area
    Worldwide
    Flexible hours
    Shift work

    Sonatus

    Sunnyvale, CA
    3 days ago
  • $165k - $180k

    A health technology startup is seeking a Senior Software Engineer to develop innovative software for a 3D ultrasound system. The role involves designing robust architecture, integrating AI/ML models, and optimizing performance. Candidates should have a BS/MS in computer... 
    Senior

    iSono Health Inc.

    Sunnyvale, CA
    9 hours ago
  • $125k - $156.3k

     ...Natera is seeking an experienced Senior Software Engineer with modern data engineering and AI-enabled development skills with...  ...products that support analytics, ML, or AI applications Strong data...  ...end pipeline lifecycle Ability to evaluate emerging data and AI... 
    Senior
    Work at office
    Immediate start
    Remote work
    Worldwide

    GrabJobs

    San Jose, CA
    1 day ago
  • $248k - $349k

    Senior Staff Software Engineer, AI/ML GenAI, Google Cloud AI corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent...  ...scale ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning). 5 years of... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI/ML - Senior OS Software Engineer, Evaluation. Be the first to apply!