AIML - Sr. Software Development Engineer, Evaluation
$184.7k - $324.8kApple Inc.
AIML - Sr. Software Development Engineer, Evaluation San Francisco Bay Area, California, United States Software and Services At Apple, we create world-class innovative products that seamlessly combine cutting-edge hardware with intelligent software experiences, powered by advanced machine learning technologies. The Evaluation org is responsible for building platforms and tools to measure, understand, and proactively enhance Apple Intelligence features while protecting user data. Description We’re seeking an experienced Senior Backend Software Engineer to join our team responsible for designing and developing our Annotation Platform, critical to the development and optimization of Apple’s AI/ML features. Responsibilities As a Senior Backend Engineer in the Evaluation organization, you will lead the backend development of the platform meant to optimize data generation and collection process, allowing ML engineers to efficiently evaluate and train machine learning models. You should love to take on challenges, tackle problems with imaginative solutions, work well in collaborative teams, and produce high-quality software under tight deadlines and constraints. We expect you to enjoy mentoring and guiding other engineers, helping to elevate the skill set of the team and fostering a collaborative learning environment. You will be working with teams across different domains to drive projects and feature development from concept to completion. Minimum Qualifications At least 7 years of hands‑on experience with Java, demonstrating in-depth knowledge of advanced concepts and best practices in software design and development. Strong understanding and hands‑on experience with the Spring Boot framework, including dependency injection, REST API development, and micro‑services architecture. Proven track record in designing, building and maintaining complex, scalable web applications. Strong ability and passion for creating reliable, resilient, high‑performance, reusable code and modules. Proficiency with testing frameworks to ensure the stability, reliability, and performance of the applications. Knowledge of databases systems, data model design and experience with both SQL and NoSQL databases. Demonstrated ability to creatively solve complex technical challenges with innovative solutions and a strong focus on trade-offs. BS/MS in Computer Science, Distributed Systems, Software Engineering, or related field Preferred Qualifications Experience in AI engineering and ML system is a plus. Experience with cloud‑based infrastructure (AWS) and hybrid ecosystems. Experience with ETL pipelines, stream processing and batch data processing is a plus. Strong emphasis on code reviews to maintain code quality and foster team collaboration. Strong ability to communicate technical and architectural challenges clearly and concisely, while collaborating with frontend team to iteratively develop self‑service solutions. Able to think big picture while addressing immediate project needs. Skilled at balancing innovation with practicality to maximize impact. At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $324,800, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here - in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong. Learn about accessibility in Apple's workplace Learn about reasonable accommodations for job applicants Apple accepts applications to this posting on an ongoing basis. #J-18808-Ljbffr Apple Inc.
- ...Francisco Bay Area seeks a Senior Backend Software Engineer to design and build the Annotation... ...AI/ML features. You will lead backend development, mentor engineers, and collaborate across... ...while focusing on data generation, evaluation workflows, and user data protection....Senior
- ...leading autonomous driving technology firm is seeking a Senior Software Engineer to architect evaluation methodologies for their simulator. The ideal candidate will have over 5 years of software development experience, proficiency in Python or C++, and a strong understanding...Senior
$204k - $259k
Waymo is looking for a Senior Software Engineer to evaluate their simulator's performance and improve simulation accuracy. This role involves architecting... ...The ideal candidate should have over 5 years of software development experience, strong design principles, and a keen data...Senior- Senior Software Engineer, Simulator Evaluation Mar 02, 2026 Waymo is an autonomous driving technology company with the mission to be the world's most... ...technology. You have: 5+ years of software development experience. Proficiency in Python or C++, with experience...SeniorFull timeRemote work
$204k - $259k
...reflect reality. To guide the development of our simulator components, we create metrics and evaluation methodologies to measure... ...schedule and reports to a Senior Engineering Manager. You will: Develop... ...years of industry experience in software development. Software...Senior$204k - $259k
...billions in simulation across 15+ U.S. states. Waymo's Release Evaluation org ensures that each version of the Waymo Driver is safe... ...objectives under resource constraints. Collaborate with other engineers, data scientists, statisticians and the leadership team to deliver...SeniorFull timeRemote work- Luma AI is seeking a Research Engineer to design and scale the infrastructure powering model evaluation efforts. You will build pipelines, metrics, and automated systems... ...role emphasizes scalable systems, CI/CD, and measurement-driven development. #J-18808-Ljbffr Luma AISenior
- Altruist in San Francisco is seeking an experienced engineer to design and build an end-to-end evaluation platform for their AI solutions. This role emphasizes collaboration with backend engineers and financial planning professionals to ensure high-quality outputs. The...Senior
$200k - $250k
Fieldguide, a remote-first company based in San Francisco, is seeking a Senior AI Engineer to lead the evaluation infrastructure for AI agents. This role focuses on enhancing the reliability and performance of AI systems to support top accounting and consulting firms. The...SeniorRemote jobFlexible hours$176k - $253k
...metrics, ensuring high standards through robust evaluation processes. You'll build capability... ...design grading systems, and work directly with engineers to ensure our AI systems excel. Ideal candidates have 3-6 years of software experience, particularly in LLM and agent evaluations...Senior$80 per hour
Prolific is seeking an AI & Machine Learning Engineer in San Francisco to evaluate and refine AI models. The role involves auditing ML code, providing human feedback on AI frameworks, and analyzing model reasoning. Candidates should have a relevant degree and experience...SeniorRemote jobHourly payWork from homeFlexible hours$240k - $280k
A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably...Senior- Skyrocket Ventures is looking for engineers who are proficient in Python and willing to learn... ...building and improving simulation and evaluation platforms for AI agents in San Francisco... ...will have 5-10 years of experience in software engineering, particularly in backend systems...Senior
$171.6k - $302.2k
...intelligent experiences on Apple products & services? As a software engineer on the Machine Learning Platform team, you will be responsible... ...following responsibilities: Lead the architecture, design, development, and operations of systems designed for running machine...SeniorWork experience placementRelocation$166k - $200k
...The Role Pilot is hiring a Senior Software Engineer to join our Enterprise team. This team builds the firm-facing features for our newest... ...with agentic workflows, including orchestration, security, evaluation and observability. Pilot’s backend is written in fully typed...SeniorFull timeTemporary workPart timeWork at office3 days per week$155.58k - $320.32k
...competition Develop counterfactual and what‑if frameworks for evaluating bidding strategies, budget allocation, and pacing algorithms... ...technical direction for simulation and AI infrastructure and mentor engineers on the team What we’re looking for Systems programming...SeniorLocal area- ...JOB DESCRIPTION We're looking for a talented, senior engineering professional ready to take their career to new heights at one... ...hypervisor layers using structured troubleshooting methods. Evaluate proposed server BOMs for Hyper-V suitability, providing performance...Senior
$150k
Tzafon is seeking a skilled engineer to enhance their machine intelligence systems in San Francisco. As part of the team, you'll be responsible for building evaluation infrastructure, designing data pipelines, and implementing fine-tuning processes. Ideal candidates have...- ...portfolio companies (Seed/Series A) are hiring engineers to build the next generation of AI-native systems across enterprise software, security, healthcare, developer tools, and... ...implement reliability mechanisms including evaluation, guardrails, recovery, and human-in-the-...Senior
$170k - $216k
...driving technology company is looking for a Software Engineer in San Francisco, California. You will implement evaluation metrics and build scalable data processing pipelines... ...at least 2 years of experience in software development and proficiency in languages such as Python...$170k - $216k
...powers the Waymo Driver. Our software allows the Waymo Driver to... ...sensors, enabling software engineers like you to develop multi-modal... ...Help set the perception development direction to allow the stack... ...mission-critical automation and evaluation frameworks that establish...$170k - $216k
...ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge... ...is \"real\"?" We are looking for a Software Engineer to build the metrics and pipelines... ...years of industry experience in software development. Solid proficiency in Python or C++,...Full timeRemote work- Anthropic is seeking a skilled engineer to build evaluation infrastructure for detecting AI misuse. In this role, you'll craft experiments and... ...emphasizes trust in automated abuse detection methods, contributing to AI's beneficial development. #J-18808-Ljbffr Anthropic
- ...is a global organization of engineers, product developers, designers... ...teams collaborate in the development of supporting components, such... ..., and others. As a Senior Software Engineer of our team, you will... ...and refine prompts and evaluation of workflows when working with...SeniorWork experience placementWork at office
- ...Overview Applies advanced software concepts and objectives to medium to large projects... ...situations or data requires an in‑depth evaluation of variable factors. Selects tools, methods... ..., including prototyping and UI development Provide ongoing support and maintenance...Senior
$149.6k - $308k
...Contribute to and lead each step of the product development process, from ideation to... ...components and features you develop Grow as an engineer by working with world‑class peers on... ...Strong track record of critical evaluation and verification of AI‑assisted work (e...SeniorLocal areaRelocation package$138.4k - $173k
Description We are hiring a senior‑level Software Engineer to join our Leasing Signals Team and contribute to our rapid product development pace. We work collaboratively to set the... ...Optimization: Formulate, implement, and evaluate algorithms and database queries to...SeniorFull time$155.58k - $320.32k
...technical lead and mentor on a distributed engineering team. What We’re Looking For Strong... ...reason about experiment design, model evaluation, and when simpler approaches beat... ...Codex, or similar AI coding assistants for development, debugging, testing, and refactoring....SeniorWork at officeLocal areaRelocationRelocation package- Key Responsibilities Design and maintain end‑to‑end evaluation pipelines for multimodal generative and vision‑based models. Develop automated... ...skills, able to translate technical findings into product‑ready insights. #J-18808-Ljbffr Gravity Engineering Services Pvt Ltd.
- ...autonomous driving technology company in California is seeking experienced software engineers and data scientists for a hybrid role focused on improving software quality and performance evaluation. Candidates should have strong skills in statistical analysis, C++, and...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AIML - Sr. Software Development Engineer, Evaluation. Be the first to apply!
- ngo software engineer San Francisco, CA
- software developer San Francisco, CA
- software developer internship no experience San Francisco, CA
- junior software developer San Francisco, CA
- part time software developer remote San Francisco, CA
- financial software developer San Francisco, CA
- senior software engineer ruby on rails San Francisco, CA
- software engineer amazon San Francisco, CA
- senior software design engineer San Francisco, CA
- software engineer part time San Francisco, CA


