AI Evaluation Engineer for LLM & Multimodal Systems
Apple Inc.
Apple Inc. in Cupertino, California, is seeking a Machine Learning Engineer to build evaluation systems and scalable infrastructure for AI experiences across Apple products. You will develop models, evaluators, and methodologies to measure and improve quality of LLMs and multimodal AI, working with ML researchers, software engineers, and product teams. You will translate research into production-ready solutions, analyze large-scale data, and push innovative benchmarking approaches to advance AI #J-18808-Ljbffr Apple Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Evaluation Engineer for LLM & Multimodal Systems in Brooklyn, NY vacancy
- Innovaccer is seeking an AI Engineer to join the growing AI team and build production-grade AI systems at scale. Collaborate with product, engineering, and data teams to design... ..., and deploy AI-powered applications including LLM-based solutions, AI agents, and RAG workflows....Suggested
- ...Hospital in Memphis, TN seeks a Senior AI Engineer to lead advanced AI models and secure HPC... ...This hands-on, onsite role focuses on evaluating, fine-tuning, deploying, and... ...enforcing safety guardrails for agentic systems. You will collaborate with image data scientists...Suggested
- ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously... ...GCP. Familiarity with LLM observability, evaluation, and performance optimization. Experience...Suggested
2T Consulting
Woodside, NY19 hours ago - Integrated Medical Systems, Inc. is seeking an AI Systems Engineer to design, build, and deploy intelligent AI applications that connect with enterprise data... ...rather than model training, with a focus on MCP, LLM orchestration, APIs, and tool calling. You will implement...Suggested
$130k - $150k
AI Systems Engineer Founded in 1994, Integrated Medical Systems, Inc. (IMS) is one of the nation’s... ...heavily with Model Context Protocol (MCP), LLM orchestration, APIs, tool calling,... ...workflows. Orchestrate Large Language Models Evaluate and select the appropriate LLM for...SuggestedFlexible hours- ...discovery to powering AI and the technologies people... ...platform that lets engineers ask natural-language questions... ...information. Build an evaluation framework for retrieval... ..., RAG, agentic systems, evaluation, and efficient... ...experience with LLM prompting, structured generation...Worldwide
- ...healthcare. Our AI sensing platform... ...for an Applied AI Engineer to take our growing... ...landscape cold, treats evaluation as a first-class... ..., and some of the systems you'll touch are... ..., TTS, streaming LLM) Production RAG... ..., robotics, LLMs, multimodal sensing Transparent...Full time
Norbert Health
Brooklyn, NYmore than 2 months ago - ...high-performance computing, cloud, and AI. Whether you’re designing next-gen processors... .... THE ROLE: We are seeking an AI Systems Engineer to join our AMD ITcomputeplatforms engineering... ...technicalexpertise. Monitor and evaluate the performance of AI systems and clusters...
- Valicy is seeking a Gameplay / Systems Engineer in Greenville, NC to rapidly prototype, implement, evaluate, and refine gameplay systems for land-based gaming products. The... ...intersection of engineering, gameplay feel, AI-assisted development, and practical execution....
$125k - $150k
...interest of our team. SUMMARY The AI Engineer builds agent-based systems and intelligent workflows that power... ...Improve agent reliability through evaluation pipelines, observability metrics,... ...applications. ~ Experience working with LLM APIs or AI frameworks . ~...Full timeWork at officeLocal areaAEG Presents
Brooklyn, NY1 day ago- ...USCs/GCs are eligible Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems Level Distinguished / Principal... ...architecture, AIRP, LLM platform, AI gateway, model evaluation, observability, RAG, agentic AI, governance,...
United Software Group
Jersey City, NJ2 days ago - ...LLM / Agentic AI / Full-Stack AI Engineering Level - Senior Individual Contributor Target / alternate titles... ...pipeline exposure; cannot explain evaluation, security, or rollback controls.... ...and optimize enterprise-grade AI systems powered by foundation models, LLMs...
Echo IT Solutions
Jersey City, NJ1 day ago $142.32k - $213.48k
...From deploying advanced AI to helping shape global markets, we build systems that matter. We are seeking... ...Learning Systems Engineer with extensive ML Ops experience... ...by designing and evaluating multifaceted alternatives... ...Large Language Models (LLM)MLOps & ML Lifecycle Management...Full time$65 - $70 per hour
...Gen-AI Engineer Location: NJ/NY Area Experience Required:... ...Gen-AI use cases, integrate LLM-based solutions with enterprise... ...AI solutions with enterprise systems, APIs, databases, and cloud platforms... .... Support model evaluation, testing, monitoring, and production...SysMind Tech
Jersey City, NJ19 hours ago- ...Distinguished AI Engineer NTT DATA Services is seeking a Distinguished... ...enterprise AI architecture, LLM platforms, model hubs, AI... ...for AI SDLC, LLMOps, MLOps, evaluation, release management, operational... ...design reviews for critical AI systems and provide technical...Temporary workWork at officeRemote workFlexible hours
Sierra Systems, An Ntt Data Company
Jersey City, NJ4 days ago - Thomson Reuters in the United States is seeking a Senior AI Engineer to architect and deliver AI agent systems end-to-end, spanning multi-component pipelines and... ...build production-grade AI agents on top of modern LLM APIs and agent SDKs, contributing to observability and...
- Collaboration.Ai in Minneapolis, MN seeks a senior software engineer to build production agent systems, data pipelines, and retrieval quality for AI-driven capabilities on NetworkOS... ...production-grade agent workflows, ensure LLM quality with evals and observability, and...
$117.5k - $235.7k
...nation's premier science and engineering lab for national security and... ...Like We are seeking a motivated AI engineer to join Department 5... ...processors, real-time systems, and FPGA-based architectures... ...software systems. Ability to evaluate emerging AI coding tools, define...Part timeRemote workWork from homeWorldwideRelocationRelocation packageFlexible hours$142.32k - $213.48k
...seeking a highly hands-on Senior AI Engineer to design, build, and deploy... ..., and reliability.Agentic Systems: Develop and integrate agentic... ...applications integrating LLM‑driven workflows and AI coding... ...experimentation and improvement.Evaluation & Optimization: Define and...Full time$110.7k - $372.9k
...Americans rely on a healthcare system whose decision-making... .... Deloitte has a new AI-first effort, backed by... ...lab. As an Agentic AI Engineer, you will design, build... ...and operationalize the LLM- and SLM-powered... ...right time. Reliability, evaluation & safety • Implement observability...Local areaVisa sponsorship$175k - $215k
...fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer... ...role. You'll build and iterate on LLM pipelines, RAG systems, and agentic workflows using Agno; optimize... ...output quality continuously - build evaluation datasets and automated scoring...Full timeLocal area- ...latest reading and neuroscience with AI. As the leader in third-generation edtech... ...school district’s Intelligent Growth Engine, driving instructional coherence by... ...develop, and maintain automated educational evaluation and learning systems leveraging speech recognition, NLP,...Remote workWorldwideRelocationFlexible hours
- ...generation of enterprise AI — and we need the best minds in LLM inference to help us do it... ...large-scale production systems, directly influencing how... ....As a Principal Software Engineer at JPMorganChase within the... ...inference engine upgrade evaluations: new scheduler...
$210k - $260k
...collapse it into a single AI-native platform that... ...writing a ticket, while engineering teams retain the... ...decisions that matter - LLM selection, agentic architecture, RAG design, evaluation frameworks, and the interaction... ...architecture, RAG system design, prompt engineering...Full timeLocal areaHome office- Talener is seeking an AI Software Engineering Manager to lead a high-impact team in Hoboken, NJ, focused on building a greenfield AI platform... ...candidate will have strong technical expertise in AI/LLM systems and leadership experience in engineering. This is a full-time...Full time
- As an Lead Software Engineer at JPMorganChase within Enterprise Technology... ...scalable large language model systems and agentic AI platforms for enterprise use cases leveraging LLM Suite. You will design cloud-native solutions, establish evaluation and observability standards,...
- ...place.As a Principal Software Engineer at JPMorganChase within the Corporate Sector - AI/ML & Data Platforms for LLM Suite, you will lead a... ...retrieval, memory, guardrails, and evaluation harnesses.Write production-... ...standards for agentic AI systems and lead design reviews...
$141 - $180 per hour
...President, Global Red Team & AI Security Operations leads enterprise... ...partnership with defensive, engineering, and governance teams.Key... ...testing of AI and LLM systems (e.g., prompt injection, tool... ...remediation, and re-test workflows.Evaluate AI-assisted developer tools (...Full timeWork at officeLocal areaRemote work1 day per week$151.4k - $311k
...Summary Director, Applied AI Engineering Role Overview: As a Director... ...upstream and downstream systems. Leading across product... ...context-driven development, evaluations, AI agent orchestration, and... ...-on GenAI experience across LLM integration (OpenAI, Anthropic...Work at officeLocal areaVisa sponsorship3 days per week$176.72k - $265.08k
...ProfessionalCompany: CitiLead Applied AI Engineer, Banking Technology - C14 (... ...advanced agent‑based systems (perception, reasoning, planning... ...), integrating multiple LLM providers (OpenAI, Anthropic,... ...to achieve fast time‑to‑value.Evaluation & Optimization: Define rigorous...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Engineer for LLM & Multimodal Systems. Be the first to apply!
Related searches
- ai research engineer Brooklyn, NY
- machine learning ai engineer Brooklyn, NY
- ai developer Brooklyn, NY
- senior ai engineer Brooklyn, NY
- ai engineer Brooklyn, NY
- ai ml engineer Brooklyn, NY
- ai prompt engineer Brooklyn, NY
- ai engineer remote Brooklyn, NY
- system engineer remote Brooklyn, NY
- senior windows systems engineer Brooklyn, NY