AI Evaluation Engineer for LLM & Multimodal Systems
Apple Inc.
Apple Inc. in Cupertino, California, is seeking a Machine Learning Engineer to build evaluation systems and scalable infrastructure for AI experiences across Apple products. You will develop models, evaluators, and methodologies to measure and improve quality of LLMs and multimodal AI, working with ML researchers, software engineers, and product teams. You will translate research into production-ready solutions, analyze large-scale data, and push innovative benchmarking approaches to advance AI #J-18808-Ljbffr Apple Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Engineer for LLM & Multimodal Systems in Cupertino, CA vacancy
$180k
xAI in Palo Alto is seeking a Multimodal Engineer to develop advanced AI experiences across image, video, and audio modalities. You... ...capabilities, improve data quality, and design evaluation frameworks for cutting-edge AI systems. The ideal candidate will have a strong...Suggested$139k - $257.55k
..., reusable design systems, and collaboration... ...next generation of AI-native creative... ...forward-thinking engineers who are excited to... ...agentic systems, multimodal AI, reusable creative... ...Design and integrate LLM-powered and... ...experience.Develop evaluation and quality frameworks...SuggestedFull timeTemporary workLocal areaWorldwide$201.3k - $352.3k
...DescriptionIt all started when engineer Fred Luddy wrote code... ..., ServiceNow is the AI control tower for... ...enterprise-scale search systems that power Now Assist,... ...search, re-ranking, and evaluation — as a critical dependency... ...retrieval. Exposure to LLM fine-tuning or...SuggestedWork experience placementWork at officeImmediate startRemote workFlexible hours$184k - $287.5k
...architecture, silicon, systems, and manufacturing. The... ...System Co-Design Workflow Engineer to lead the methodology... ...-loop checkpoints, and evaluation-based CI gates running... ...that makes AI genuinely usable in a rigorous... ...today depending on an LLM-backed tool you built.Deep...SuggestedFull timeImmediate start$152k - $208.5k
...global leader in materials engineering solutions used to... ...connect our world - like AI and IoT. If you want to... ...expertise in intricate systems, deciphering code, and... ...internal systems. Establish evaluation frameworks to track... ...on exposure to on‑prem LLM deployment and...SuggestedFull timeRelocation- ServiceNow seeks a senior backend/infrastructure engineer to build and operate evaluation and observability tooling for its enterprise AI agent platform. You will design runtimes... ...tracing, and building non-deterministic systems that yield meaningful evaluation signals....
$185k - $215k
...this role, you will operate as a Staff AI Systems Engineer, setting technical direction across... ...guide the design, implementation, and evaluation of our Advanced Driver Assistance Systems... ...deployment for transformer-based or multimodal AI architectures. Experience with AI/...Odd jobWork experience placementLocal area$120k - $220k
...information powered by advanced AI, recommendation systems, and adtech.Recognized by... ...cycle.We're hiring the engineer who owns this agent end-to-... ...creative critic loop — Extend our LLM critic + performance-... ...up the next batch.How We’ll Evaluate YouTake-home: build a small...Full timeLocal areaWork from home$272k - $431.25k
...framework for serving generative AI and reasoning models across multi... ...accelerators feel like a single system at datacenter scale. As large language... ...deployment of cutting-edge LLM workloads.We are seeking a Principal Systems Engineer to define the vision and roadmap...Full timeLocal areaRemote work$229.9k - $262.4k
...Sr. Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been... ...similarity search, guardrails, model evaluation, experimentation, governance, and...Full timePart timeLocal areaCapital One
San Jose, CA3 days ago- ...performance computing, cloud, and AI. Whether you’re designing next... ...team of multi-disciplined engineers that operates across industry... ...use of AI coding assistants and LLM-powered developer tools: daily... ...fundamentals: Linux operating systems, networking, filesystems,...Flexible hours
$169k - $338k
...Summary...What you'll do...As a Distinguished AI/ML Engineer within Walmart Global Tech’s Reliability... ...of next-generation agentic AI systems and intelligent automation solutions that... ...frameworks, autonomous decision-making systems, LLM-based agents, and agent orchestration...Full timeTemporary workPart time$197.3k - $225.1k
Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been... ...search, guardrails, model evaluation, experimentation, governance, and...Full timePart timeLocal areaCapital One Financial Corp
San Jose, CA2 days ago- Otter.ai is seeking a Senior AI Agent & LLM Engineer to build and improve the AI systems behind Otter’s conversational knowledge engine and AI Chat. You will own end-to-end... ...to enhance knowledge extraction, indexing, evaluation datasets, and release gates for scalable AI...
$175k - $287k
...needs of the team. LinkedIn’s Core AI is building the Evaluation Operating System (EOS), a foundational Agent Evaluation... ...pipelines, evaluator models (e.g., LLM-as-a-judge, reward models), and... ...all LinkedIn AI Agents.As a Staff Engineer, you will own the end-to-end technical...For contractorsWork experience placementWork at officeFlexible hours- A leading cybersecurity firm is seeking a candidate to enhance LLM security by architecting monitoring and filtering systems. This role requires expertise in deploying AI systems, managing prompts, and safeguarding against emerging threats. The ideal candidate will have...
- ...Job Description: Senior AI Search & Agentic Systems Engineer Onsite - Santa Clara, CA W2 Position Name Required Python... ...and Q&A experiences, integrating vector search with LLM-based generation. Design and deploy Claude-based agents...
Saransh Inc
Santa Clara, CA3 days ago - ...is building a proactive AI chat app for everyday... ...world task completion. The system must handle multi-step... ...for a Full Stack Engineer - AI Systems to build the... ...recovery mechanisms for LLM and tool failures in production... ...through iteration, evaluation, and monitoring...Immediate start
$184k - $287.5k
...into the unlimited potential of AI to define the next era of... ...looking for talented Software Engineers to work on developing and deploying... ...building AI-driven software systems, ideally applied to complex engineering... ...systems (e.g., RL, planning, LLM-based agents) to optimize...- NVIDIA is seeking a Senior Agentic AI Software Engineer (Finance) to build agentic systems and advance AI inference workloads in real-world finance contexts... ...AI research at scale. This role collaborates with evaluation teams, researchers, and engineers to ensure high-quality...
- NVIDIA in Santa Clara, CA is seeking outstanding AI systems engineers to advance the inference software stack. You will design and optimize kernels, build new abstractions for LLM serving engines, and contribute to accelerators and runtimes that power large language models...
- Bosch USA in Sunnyvale, CA, seeks an experienced AI researcher to design, build, and evaluate agentic systems for long-horizon tasks. You will work on memory architectures... ...products, collaborating with researchers and engineers to push the boundaries of trustworthy AI in real-...
- ...Cupertino, CA is seeking a Machine Learning Research Engineer (SIML - ISE) to advance multimodal perception and reasoning using Vision-Language Models... ...ecosystem. The role emphasizes design, experimentation, and evaluation of state-of-the-art models, with a path toward...
$143k - $210k
...AI Engineer Livingston, NJ / New York, NY / Sunnyvale, CA CoreWeave... ...where AI and deterministic based systems meet live production... ...system should stop. Build and evaluate retrieval over a large body of... ...Experience diagnosing failures in LLM applications and fixing the...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA2 days ago- ...AI Engineer Location: Austin, TX Onsite/ Remote: Onsite Looking for... ...), agentic AI workflows, and LLM-based automation, with the ability to integrate AI systems into complex enterprise environments... .... Experience with RAG evaluation, prompt engineering, and...Remote work
Yantran LLC
Sunnyvale, CA2 days ago $100k - $200k
...OPPO AI Center is seeking a passionate AI Engineer to help build next-generation AI... ...intelligent agent systems. In this role, you... ...and deploy advanced LLM and AI Agent technologies... ...based on LLMs and multimodal foundation models,... ..., including AI evaluation, debugging, and tuning...Full timeOPPO US Research Center
Palo Alto, CA2 days ago$55 - $63 per hour
...Job Description Job Title :AI Engineer Position Description :... ..., Marketo, and other Martech systems. Contribute to the enterprise... ...execution. Build AI evaluation, monitoring, and observability... ...Hand -on experience building LLM applications or AI agents....Contract workRemote workProtingent
Santa Clara, CA1 day ago$160k - $400k
...AI Engineer Sunnyvale, CA The future of defense will be decided... ...developing and deploying multimodal foundation models that power... ...directly influence how our system reasons, plans, remembers and... ...the stack: model training and evaluation, reinforcement learning, evaluation...Full timeRelocation packageScout AI
Sunnyvale, CA3 days ago- ...Role focuses on: Context Engineering, Memory and SystemWhat... ...Youll DoAs a Founding AI Engineer, you will own... ...AI assistant across multimodal signals, context... ...Understanding: Build AI systems that understand real-world... ..., APIs, storage, evaluation, monitoring, and privacy...Full timeWork experience placementVisa sponsorship
Noscen
Sunnyvale, CA1 day ago $225k - $300k
...AI Engineer Location - Sunnyvale, CA - (Hybrid – 3 Days Per Week)... ...Machine Learning, Autonomous Systems, Automotive Software, Software... ...portfolio through cutting-edge LLM applications, agentic AI... ...maintain machine learning models Evaluate emerging large language...Work at officeVisa sponsorship3 days per weekRecruiting from Scratch
Sunnyvale, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Engineer for LLM & Multimodal Systems. Be the first to apply!
Related searches
- ai developer Cupertino, CA
- ai engineer Cupertino, CA
- senior windows systems engineer Cupertino, CA
- senior linux systems engineer Cupertino, CA
- advanced systems engineer Cupertino, CA
- senior staff systems engineer Cupertino, CA
- sr systems engineer Cupertino, CA
- healthcare systems engineer Cupertino, CA
- computer system validation engineer Cupertino, CA
- operations support system engineer Cupertino, CA