AI/ML - Senior OS Software Engineer, Evaluation
$181.1k - $318.4kApple Oakbrook
AI/ML - Senior OS Software Engineer, Evaluation
For the engineer that obsesses on how software can enable OS developers to evaluate and improve their features, there is no better place than Apple's Experimentation team. The Experimentation team builds an end-to-end platform spanning the OS, data, and server for all the Apple OSes, operating at a scale of 2.5+ billion devices. We are addressing key challenges to accelerate the adoption of AI and an experimentation culture mindset across all Apple products/services. We are seeking seasoned engineers that can push the boundaries of low-level operating system technologies while maintaining a customer-centric focus on the developer and user experience.
The mission of Evaluation is to measure, understand, and proactively improve all Apple features. We are looking for an experienced engineer to build and extend the experimentation system for Apple to use across all our operating systems. You will be responsible for the on-device daemon and framework, that is at the heart of the experimentation platform. You will partner with feature teams across Apple to enable them to make a positive impact for the customers. You will ship code that runs on devices you use every day and powers a variety of Apple products. You will obsess over memory, power, performance in addition to the developer experience. Your technical leadership will drive critical design discussions, elevate peers through code reviews, and push the boundaries across the operating system.
Responsibilities
- Design and implement new features and APIs for the on-device Experimentation service that is deployed across multiple Apple operating systems
- Develop and maintain high-performance libraries that are easy to use by developers
- Participate in all phases of software development cycle: from problem definition and design, through implementation, testing, and debugging
- Diagnose and resolve issues across different layers of the software stack
- Write unit and integration tests for new and existing code
- Work with cross-functional teams to enable developer and product features
- An appreciation how an OS design impacts end-user experience
Minimum Qualifications
- BS in Computer Science, or a related field with 7 years of work experience; or a MS in Computer Science, or related field with 5 years work experience
- Industry experience in Objective-C, Swift, C/C++, Kotlin, or similar languages
- System design and architecture skills
- Strong understanding of operating system fundamentals such as threading, synchronization primitives, inter-process communication, and scheduling
- Excellent collaborative skills, with the ability to work with a team to design system architecture
- Proven ability to deliver Operating Systems production grade software
Preferred Qualifications
- Skilled at programming interface design
- Experience in iOS, macOS, or similar operating systems
- An appreciation of how a platform design impacts end-user experience
- Experience in experimentation or A/B testing and AI
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant At Apple, we believe accessibility is a fundamental human right. You'll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong. Learn about accessibility in Apple's workplace Learn about reasonable accommodations for job applicants Apple accepts applications to this posting on an ongoing basis.
$136k - $199.2k
## Senior Software Engineer, Autonomy EvaluationApplyremote type: Remote/Hybridlocations... ...About the Organization**The Evaluation team builds and evolves the... ...develop new statistical and ML methods to quantify... ...systems.* Experience leveraging AI-assisted development and...SeniorRemote workRelocationRelocation packageFlexible hours$166k - $244k
Senior Software Engineer, AI/ML GenAI, Google Workspace link Copy link corporate_fare Google Sunnyvale, CA, USA Mid Experience driving progress... ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). 1 year of experience...SeniorFull time$166k - $244k
Senior Software Engineer, AI/ML GenAI, Google Cloud AI Google Sunnyvale, CA, USA Qualifications Bachelor’s degree or equivalent practical experience... ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). 3 years of...SeniorFull timeWorldwide$110k - $190k
...Role Overview We are hiring a Senior Software & AI Engineer to build production-grade AI systems,... ...generation (RAG), and agent-based workflows Evaluate tradeoffs between foundation models,... ...real-world use Apply traditional ML techniques where appropriate (e.g.,...Senior$174k - $252k
Senior Software ML Engineer, AI/ML GenAI, Gemini Enterprise corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree in Computer... ...millions of enterprise users. You will architect automated evaluation frameworks, design optimization algorithms, and solve...SeniorFull time$55k - $151.47k
...in data and analytics engineering focus on leveraging advanced... ...of the People Tech & AI team you will develop,... ...PwC standards. As a Senior Associate you will analyze... ...data engineering, AI/ML engineering, or quality... ...platform Executing LLM evaluation frameworks using...SeniorFull timeWork experience placementH1bRemote work$147.4k - $272.1k
...AIML - Software Engineer - AI, Evaluation Work Locations (2) Submit Resume Summary Do you get excited by building software systems to enhance the automatic evaluation of various Apple AI products? Our Evaluation organization is responsible for providing principled...Relocation$181.1k - $318.4k
...Senior Software Engineer - AI Experiences We're a small team at Apple betting on what comes next. We believe AI will fundamentally change how people... ...works — then making it real Partnering with Design, ML, and AI researchers to shape features and translate cutting...SeniorRelocation$143k - $191k
...the next generation of Agentic AI products that help millions... ...decisions. We’re looking for a Software Engineer to design and build highly... ...managers, designers, and AI/ML engineers to bring intelligent... ...with ML engineers to integrate, evaluate, and productionize models...SeniorWork at officeRemote workFlexible hours$296.3k
Scale up introspection and evaluation tools that work with billions of examples and enable utilization of our large datasets, delivering... ...-edge technology and a collaborative, high-impact team of AI/ML engineers, data scientists and engineers who are passionate about...Flexible hours- ...About the Organization The Evaluation team builds and evolves the... ...results into clear feedback for engineering and leadership, and help... ...introspect autonomous driving software performance atinterfaces across... ...develop new statistical and ML methods to quantify performance...SeniorLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours
- ...foundation for physical AI — a unified... ...universal Physical AI OS, making robots as... ...and deploy as software. Today, robotics is... ...are looking for a Senior AI Engineer to design, build,... ...Develop systematic evaluation frameworks (evals,... ...webhooks; Python for AI/ML integration and...SeniorFull time
$172.43k - $230.95k
...Senior Software Engineer For The Ai Model Lifecycle Team Crusoe is on a mission to accelerate the abundance of energy and intelligence. As the... ...model, and experiment management: versioning, lineage, evaluation, and reproducible fine-tuning at scale. What You'll...SeniorTemporary work$193.3k - $261.5k
...builds AWS Neuron, the software development kit used to... ...Inferentia and Trainium ML accelerators. This... ...software boundary, our engineers build systematic infrastructure... ...of what's possible in AI acceleration. As... ...sharing and mentorship. Our senior members enjoy one-on-...SeniorWork experience placementInternshipLocal areaFlexible hours$170k - $210k
...Senior Software Engineer, AI Engineer Hybrid - SF Bay Area About Midi Health Midi Health is the... ...of healthcare-grade safety and evaluation. What You Will Do Design, build... ...recent time building production LLM / ML features ~ Strong hands-on coding skills...SeniorWork at officeImmediate startRemote workShift work2 days per week$174k - $252k
Google Inc. is seeking a Senior Software ML Engineer in Sunnyvale, CA to lead the development of agentic features that enhance enterprise productivity using Generative AI technologies. The candidate must possess a Bachelor's degree in Computer Science or a related field...SeniorFull time$174k - $252k
Senior Software Engineer, AI/ML, AI and Infrastructure Apply X Note: By applying to this position you will have an opportunity to share your preferred... ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). Preferred...SeniorFull timeWorldwide$174k - $252k
Senior Software Engineer, Generative AI, Ads Query Understanding corporate_fare Google place Mountain View, CA, USA Apply... ...architecture. 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging)...SeniorFull time$174k - $252k
Senior Software Engineer, AI/ML, Youtube Ads Mountain View, CA, USA Qualifications Bachelor’s degree or equivalent practical experience. 5 years... ...with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging). Experience using Python...SeniorFull time$166k - $244k
Senior Software Engineer, AI/ML Recommendations, Rankings, Predictions, YouTube Mountain View, CA, USA Experience driving progress, solving problems... ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). Preferred...SeniorFull time$174k - $252k
Senior Software Engineer, AI/ML, Shopping link Copy link corporate_fare Google place Mountain View, CA, USA Mid Experience driving progress, solving... ...with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging). Experience...SeniorFull timeLocal area$181.1k - $318.4k
Sr. Applied AI Software Engineer- Vision Products Group & Siri Sunnyvale, California, United States Software and Services Apple builds products... ...on. You will need to be comfortable writing Swift code, evaluating AI/ML algorithms for on‑device integration, collaborating on...SeniorRelocation$207k - $307k
A leading tech company in Sunnyvale, CA is seeking a Software Engineer to lead the design and architecture of customer-facing systems. Applicants... ...in software development, focusing on distributed systems and AI/ML applications. You will drive project outcomes, implement best...SeniorFull time$170.9k - $231.2k
...looking for a motivated engineer to join Arm’s Developer... ..., extending its evaluation framework, and ensuring... ...registries. Our team works on software development... ...you will help shape how AI agents interact with Arm... ...evaluation frameworks for AI/ML systems or developer tools...Senior- ...California, is seeking a Sr Machine Learning Engineer, Tech Lead for Autograder Systems. In this high... ...role, you will define the technical vision for evaluating model outputs and lead a team of MLEs to enhance generative AI features. Candidates should have a Master's or...Senior
- A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates...SeniorFull time
$188k - $237.5k
...driving the transformation to AI-enabled software-defined vehicles.... ...seeking a highly motivated Senior AI Engineer to join our team and help... ...large models, traditional ML models, etc. (AI depth)... ...feature engineering, and model evaluation techniques. Familiarity...SeniorWork at officeLocal areaWorldwideFlexible hoursShift work$165k - $180k
A health technology startup is seeking a Senior Software Engineer to develop innovative software for a 3D ultrasound system. The role involves designing robust architecture, integrating AI/ML models, and optimizing performance. Candidates should have a BS/MS in computer...Senior$125k - $156.3k
...Natera is seeking an experienced Senior Software Engineer with modern data engineering and AI-enabled development skills with... ...products that support analytics, ML, or AI applications Strong data... ...end pipeline lifecycle Ability to evaluate emerging data and AI...SeniorWork at officeImmediate startRemote workWorldwide$248k - $349k
Senior Staff Software Engineer, AI/ML GenAI, Google Cloud AI corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent... ...scale ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning). 5 years of...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI/ML - Senior OS Software Engineer, Evaluation. Be the first to apply!
- machine learning ai engineer Cupertino, CA
- machine learning engineer Cupertino, CA
- junior machine learning research engineer Cupertino, CA
- machine learning software engineer Cupertino, CA
- ai ml engineer Cupertino, CA
- senior ml engineer Cupertino, CA
- computer vision machine learning engineer Cupertino, CA
- data scientist machine learning engineer Cupertino, CA
- rust software engineer Cupertino, CA
- senior software design engineer Cupertino, CA


