Director, Applied AI Evaluation & Autograder Systems
Apple Inc.
Apple Inc. in Cupertino, California, is seeking an experienced Manager to lead Applied AI Scientists building autograder systems for automatic grading and quality assessment of internal GenAI products. You will set the technical direction for autograding at Apple and grow the team responsible for scalable AI product evaluation. You will work across the company to make trustworthy automated evaluation a foundation for every AI product team, delivering cutting-edge evaluation platforms and #J-18808-Ljbffr Apple Inc.
Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Director, Applied AI Evaluation & Autograder Systems in Cupertino, CA vacancy
- ...platform team shaping how agentic systems are built, evaluated, and deployed at scale. This... ...agent and generative AI techniques into reliable, reusable... ...capabilities. As an Applied Artificial Intelligence and Machine Learning Director at JPMorganChase within the Agent...Suggested
JPMorgan Chase & Co.
Palo Alto, CA2 days ago $196k - $300k
...unleashing the potential of generative AI to power the transformation of... ...across post-silicon & system hardware development cycle:... ...in opportunities with d-Matrix apply directly through our official... ...maintain a consistent and fair evaluation of al applicants. Thank you for...Suggested3 days per weekd-Matrix
Santa Clara, CA6 days ago- ...and scientific discovery to powering AI and the technologies people rely on every... ...across AI Research Engineering, Applied AI, ML Systems, and AI/ML Platform teams. This role will... ...workflows, reinforcement learning, inference, evaluation infrastructure, agentic/recursive self...SuggestedShift work
AMD
Santa Clara, CA6 days ago $237k - $261k
...programs across Cluster Orchestration and Applied Training within our AI/ML Platform Services organization.... ...-tuning, reinforcement learning, evaluations, and sandboxed experimentation.... ...driving programs across orchestration systems such as Slurm‑on‑Kubernetes (SUNK),...SuggestedPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA2 days ago$90.1k - $209.5k
...teams.This role combines hardware systems engineering expertise with... ...delivery.In this role, you will:Apply GPU and CPU system engineering... ...and production readiness.Evaluate hardware and software integration... ...to life-saving care. And with AI embedded across our products and...SuggestedTemporary workFor contractorsImmediate startFlexible hoursOracle Corporation
Santa Clara, CA4 days ago$166.5k - $291.4k
...meaningful work. Today, ServiceNow is the AI control tower for business reinvention.... ...people.Job DescriptionTeam Bio:ServiceNow’s Applied AI Forward Deployed Engineering (FDE)... ...designers, and customers, to deliver intelligent systems that address mission-critical challenges...Work at officeImmediate startRemote workFlexible hoursServiceNow
Santa Clara, CA4 days ago$275k - $350k
...centered robotics company developing AI-powered robots to support... ...at the cutting edge of Applied AI, applying our expertise across... ...with our data collection and evaluation team on benchmarks, real-world... ...equivalent) in mechanical, electrical, systems, or robotics engineering, or a...Local areaPerot Jain
Mountain View, CA1 day ago$180k - $230k
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training... ...out more about what it's like to work at Cerebras here! Apply today and become part of the forefront of groundbreaking...Cerebras Systems
Sunnyvale, CA6 days ago$240k - $300k
...looking for experts for product engineering of AI-based Autonomous Driving systems.Job DescriptionAs the Director for Simulation and Evaluation, you will sit at the center of the Global... ...(e.g., ISO 26262, SOTIF) as they apply to virtual validation.Additional InformationEqual...Full timeWork experience placementLocal areaFlexible hoursRobert Bosch
Sunnyvale, CA4 days ago$190k - $414.4k
...sensor fusion, multimodal AI, embodied AI, robot... ...effectively. As Senior Director, Robotics, you will lead... ...deploy and manage robotic systems at scale. You will partner across applied science, engineering, product... ...architecture, training, evaluation, inference design, API...Temporary workFlexible hoursOracle
Santa Clara, CA2 days ago$235.03k - $352.29k
...and profound opportunity for AI to drive positive change in the... ...the technical roadmap for the systems that validate and verify the intelligence... ...will lead the development of evaluation tooling that ensures our... ...or lower pay range would apply. This position is also eligible...Immediate startFlexible hoursNuro
Mountain View, CA6 days ago- ...NVIDIA seeks a Director, Supply Planning for our Boards and Systems products in Santa Clara, CA. You will coordinate end-to-end supply planning for Data Center... ...with cross-functional owners, and advance planning via AI-enabled capabilities to improve time-to-market and...
- ...Expert (SME) in Digital Test & Evaluation (T&E), with responsibility for... ...requirements, mission and systems engineering, modeling and simulation... ...decision support. ● Apply working knowledge of test... ...engineering, test automation, AI-enabled T&E, data engineering,...Flexible hours
Advanced Automation Corporation
Mountain View, CA22 days ago $240k - $333k
...manage e2e engineering development and landing of next-gen ML TPU systems through NPI PLC process from concept to production and... ...for machine learning infrastructure (e.g., TPU, GPU, or similar AI-compute clusters).Preferred qualifications:10 years of experience...WorldwideGoogle
Sunnyvale, CA3 days ago$173.9k - $235.2k
...Hardware, Engineering, Legal, Responsible AI, and Privacy.- Define the metrics that... ...fields- Advanced knowledge of AI/ML systems, AI model evaluation frameworks, and responsible AI... ...information. If the country/region you’re applying in isn’t listed, please contact your Recruiting...Local areaFlexible hoursAmazon
Sunnyvale, CA3 days ago$240k - $333k
...Senior Technical Program Manager II, NPI, AI/ML (TPU) Systems Share Senior Technical Program Manager II, NPI, AI/ML (TPU) Systems corporate... ..., are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc....WorldwideGoogle LLC
Sunnyvale, CA3 days ago- ...to set the gold standard for integrated AI infrastructure Crux AI is a newly formed... ...and ongoing operations as one integrated system. Crux is being capitalized to plan... ...mode this role exists to prevent. You will evaluate Crux's full portfolio of 40-plus live project...Work at officeRemote workShift work
Crux AI
Palo Alto, CA2 days ago $163k - $236k
...Technical Infrastructure, Cloud Systems Share Technical Program... ...Google place Sunnyvale, CA, USA Apply Bachelor's degree in a technical... ...silos into a single automated/AI-assisted source of truth.... ...by the Alphabet Inc. board of directors or its delegate, the terms of...WorldwideShift work$155k - $240k
...world’s most advanced AI-native platform. We work... ...large scale distributed systems, processing almost 3... ...Role:We are seeking a Director of Revenue Technical Accounting... ...and PolicyLead the evaluation of complex customer... ...substantial experience applying ASC 606 to SaaS or technology...Full timeContract workWork experience placementWork at officeLocal areaFlexible hoursCrowdStrike
Sunnyvale, CA4 days ago- ...Technology team is looking for an AI Enablement Lead to partner... ...technology, process design, and applied AI. The ideal candidate... ..., scalability and accuracy Evaluate opportunities based on operational... ...practices for deploying AI-enabled systems responsibly within enterprise...
Apple Inc.
Cupertino, CA2 days ago $240k - $379.5k
...redefining what is possible with AI, and we are building the next... ...detection and recommender systems and helps customers unlock... ...model quality, training speed, evaluation coverage, and time‑to‑release... ...using AI in daily work, and applying AI to streamline program operations...Full timeFlexible hoursNvidia
Santa Clara, CA7 days ago$150k - $200k
...the potential of generative AI to power the transformation of... ...Finance, and IT to build reliable systems and a trusted source of... ...requirements gathering, RFPs, vendor evaluation, and implementation when new... ....Demonstrated experience applying AI and emerging technologies...d-Matrix
Santa Clara, CA4 days ago- ...complex, cross-functional initiatives across software, hardware, and systems teams. This role focuses on runtime systems, device drivers,... ..., and hardware enablement, ensuring reliable and scalable AI platforms. You will collaborate with software, hardware, and...
$250k - $285k
...centered robotics company developing AI-powered robots to support... ...at the cutting edge of Applied AI, applying our expertise across... ...data pipelines, training and evaluation infrastructure, model release... ...reliable iteration on robot learning systems. Perception Program...Work at officeLocal areaShift workPerot Jain
Sunnyvale, CA22 hours ago$166.5k - $291.4k
...work. Today, ServiceNow is the AI control tower for business... ...friction actually sits, so the whole system improves on a loop instead of... ...for it, is the job.We treat evaluation as a product surface rather... ...production behavior.Forward-deployed, applied AI, or embedded delivery...Live inWork at officeImmediate startRemote workFlexible hoursShift workServiceNow
Santa Clara, CA4 days ago$200k - $322k
...solutions power the most powerful AI Platforms and High Performance... ...we can accomplish when we apply our technology to it. NVIDIA is... ...and software stacks, from evaluation/proof-of-concept to design/development... ...for complex OEM/ODM System Level integration, development...Full timeWork experience placementNvidia
Santa Clara, CA3 days ago- ...own the processes, tools, and systems that enable our software releases... ...collection cycles, and model evaluation Define program structure,... ...GitHub, risk matrices, dashboards, AI agents) to match the program’s... ..., we encourage you to apply anywayExperience in autonomous...Shift work
- ...fault-tolerant quantum systems. Quantum computers harness... ...supercomputers or AI systems will never reach... ...scrutiny the U.S. government applies to emerging technology,... ...real. Job Summary:The Director, Platform & System will... ...layer.Identify, evaluate and work with partners...Full timeContract workLocal areaRemote workShift work
PsiQuantum
Palo Alto, CA5 days ago $195.42k - $370.53k
...Advisory.KPMG is currently seeking a Director, Private Equity IT M&A -Due... ...add-onacquisitions; utilize AI-powered tools to accelerate... ...Bachelor's degree in Information Systems, Computer Science, Finance, or... ...are considered as they apply, until the opportunity is filled...H1bLocal areaKPMG
Santa Clara, CA4 days ago- ..., high-performance computing, cloud, and AI. Whether you’re designing next-gen processors... ...and connectivity technologies. This Director-level role is responsible for shaping the... ...CXL, Ethernet, and high-performance AI/HPC systems.Working across silicon, firmware,...
AMD
San Jose, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Director, Applied AI Evaluation & Autograder Systems. Be the first to apply!
Related searches
- director of inventory management Cupertino, CA
- director of innovation Cupertino, CA
- science director Cupertino, CA
- director of credit Cupertino, CA
- director of fulfillment Cupertino, CA
- director of culinary Cupertino, CA
- director of administration Cupertino, CA
- director of loss prevention Cupertino, CA
- director of automation Cupertino, CA
- director solutions architecture Cupertino, CA