Agentic AI Evaluation Engineer (Edge & Classified)
Anduril Industries
Anduril Industries is seeking a Discovery engineer to build and validate evaluation infrastructure for agentic AI and ML models across classified platforms and edge hardware. You will design test scenarios, develop simulation environments, and establish metrics and pipelines to ensure reliable performance in mission-critical settings, partnering with cross-functional teams and owning end-to-end evaluation.
#J-18808-LjbffrVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Agentic AI Evaluation Engineer (Edge & Classified) in Costa Mesa, CA vacancy
$91.1k - $179.5k
Position Summary Agentic AI is moving from experimentation to... ...scale. We're growing a team of engineers who want to work at the... ...Engineering leverages cutting-edge engineering capabilities to build... ...integration, state management, evaluation, guardrails, and human-in-the...SuggestedWork at officeLocal areaVisa sponsorshipShift workDeloitte
Costa Mesa, CA23 hours ago- ...powered by Lattice OS, an AI-powered operating... ...committed to bringing cutting-edge autonomy, AI, computer... .... The Anduril AI-Engineering team exists to collapse... ...We are looking for an Agentic AI Engineer to automate... ...and data integrations, evaluation harnesses, and guardrails...SuggestedFull timeWork experience placementWork at officeImmediate start
Anduril Industries
Costa Mesa, CA3 days ago - ...team is where embodied AI meets real robots, real... ...architectures, combining rigorous engineering with learning systems... ...a strong emphasis on agentic AI (tool use, memory,... ..., fine-tune and evaluate models, optimize inference... ...deploying AI in edge or resource-constrained...SuggestedLocal area
FieldAI
Irvine, CAa month ago $112.2k - $190.7k
...forefront of leveraging cutting-edge technologies to drive... ...across the IT ecosystem. Our AI Center of Excellence (CoE) is... ...developing autonomous and intelligent Agentic AI systems.Your role:We are seeking... ...and motivated Agentic AI Engineer to join our AI CoE. In this hands...SuggestedFull timeTemporary workWorldwideIngram Micro
Irvine, CA1 day ago$158.9k - $270.1k
...schedule.About the Role:We are seeking a hands-on Manager, Agentic AI Engineering to lead a team of approximately 10 early-career Agent Builders... ...GenAI, LLM, or agentic solutions to production.Experience evaluating and testing LLM or agent systems (evaluation sets,...SuggestedFull timeTemporary workWorldwideIngram Micro
Irvine, CA4 days ago$91.1k - $179.5k
Position Summary Join our AI & Engineering team in transforming... ...Engineering leverages cutting-edge engineering capabilities to... ...or implementing production agentic workflows involving capabilities... ..., state management, evaluation, guardrails, and human-in-the...Local areaVisa sponsorshipDeloitte
Costa Mesa, CA15 hours ago- ...highly motivated and self-driven AI Engineer with a strong background in building scalable Gen AI/Agentic AI data engineering solutions... ...including Custom Extractors, Classifiers, and Splitters), ensuring... ...CDE), CDE training/tuning) and evaluating extraction model performance...Full timeWork experience placementLocal areaFlexible hours
CoreLogic
Irvine, CA3 days ago $176.7k - $302.9k
...teams develop cutting-edge solutions that help people... ...data analytics and AI to cybersecurity, we use... ...Learning, Generative AI, Agentic AI, and intelligent... ...design reviews and ensure engineering excellenceBe actively involved... ...frameworks to evaluate accuracy, drift, bias,...Minimum wageFull timeWork experience placementWork at officeLocal areaRemote workUnitedHealth Group
Irvine, CA4 days ago- ...materials. The solution will leverage advanced Agentic AI capabilities to significantly reduce... ...integrations- Implement strict evaluation and observability frameworks to monitor... ...stakeholders, product managers, and the engineering team to translate strategic goals into...
Luxoft
Irvine, CA2 days ago $124.78k - $146.8k
Job TitleSenior AI EngineerJob Description SummaryBuild the next... ...systems, and world-class engineering practices. Cushman & Wakefield... ...performance. - Establish standards for agentic workflows, intelligent search... ...delivery teams: - AI evaluation framework design — golden-...Minimum wageFull timeContract workFlexible hoursCushman & Wakefield
Costa Mesa, CA4 days ago- ...systems with modern, cloud-based, AI-powered technology built to... ..., collaboration is our edge, and impact is our fuel. If you... ...looking for an AI-Powered Software Engineer who treats AI agents as a primary... ...prompts, orchestrating agentic workflows, and rapidly prototyping...Temporary workWork at officeFlexible hours
Planet DDS
Irvine, CA1 day ago - ...integration frameworks supporting AI, analytics, and business... ...stakeholders, product managers, and engineering teams to translate business... ...with LangGraph, LangChain, agentic workflows, or orchestration... ...for AI applications; evaluations.Familiarity with modern AI tooling...
Luxoft
Irvine, CA2 days ago $191k - $253k
...is powered by Lattice OS, an AI-powered operating system that... ...committed to bringing cutting-edge autonomy, AI, computer vision,... ...Planning, Hardware, and Test Engineering to solve some of the hardest problems... ...required to train, evaluate, host, and serve complex AI models...Full timeWork experience placementImmediate startAnduril Industries
Costa Mesa, CA4 days ago$153.84k - $246.15k
...and learn new ones “I can succeed as a AI Engineer Lead at Capital Group.”As a AI Engineer... ...assistants, knowledge-search experiences, and agentic workflows — as reliable, production-... ...acceptance criteria up front, build evaluation harnesses, and measure correctness,...Full timeTemporary workLocal areaFlexible hoursCapital Group
Irvine, CA1 day ago$166k - $220k
...systems is powered by Lattice OS, an AI-powered operating system that turns thousands... ...is committed to bringing cutting-edge autonomy, AI, computer vision, sensor... ...years.ABOUT THE ROLEAnduril is seeking a Classified Platform Engineer to serve as the technical lead for our...Full timeWork experience placementImmediate startAnduril Industries
Costa Mesa, CA15 hours ago- ...~5 years of experience in software engineering data engineering or AI/ML engineering ~ Strong proficiency... ...LlamaIndex Experience implementing LLM evaluation and observability frameworks... ...embeddings vector search RAG pipelines Agentic/LLM Tooling: LangChain LlamaIndex...Full timeVisa sponsorship
Tata Consultancy Services
Irvine, CA6 days ago $148.19k - $231.98k
...SalesforceSalesforce is the #1 AI CRM, where humans with agents... ...transformation in the agentic era? You’re in the right place... ...sellers, and close to Product, Engineering, Support, and delivery teams.... ...field specialist for customers evaluating, implementing, and expanding...Full timeWork experience placementImmediate startRemote workSalesforce
Irvine, CA3 days ago$91.1k - $179.5k
...significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations... .../chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry.Deliver governed datasets and feature engineering/serving...Local areaDeloitte
Costa Mesa, CA2 days ago$122k - $240.5k
...significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations... .../chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry.Deliver governed datasets and feature engineering/serving...Local areaVisa sponsorshipDeloitte
Costa Mesa, CA2 days ago- ...Title: AI Automation Engineer Location: Irvine, CA (Onsite) Duration: Full-time Must... ...Code / Claude Skills or an equivalent agentic coding assistant (e.g., OpenAI Codex,... ...Employer. All applicants and employees are evaluated without discrimination, based solely...Full timeWork at officeShift work
Diverse Lynx
Irvine, CA3 days ago - ...in Irvine, CA Our client seeks an AI/ML Engineer to apply advanced machine learning and... ...PyTorch proficiency. Experience with Azure, agentic AI frameworks, RAG, and LLMs is... ...requirements and deliver solutions. Evaluate architectures and document solution designs...Hourly payTemporary workLocal area
Eliassen Group
Irvine, CA13 days ago - ...Title AI Engineer Location: Newport Beach Must have: 7+ years of experience in full-stack development, with a strong focus... ...Testing : Implement rigorous testing frameworks to evaluate the performance of AI models. Continuously refine and optimize...
3B Staffing LLC
Newport Beach, CA23 hours ago - ...the global midterm rental market with full-stack, AI-powered solutions. We are a rare tech startup based... ...We're on the lookout for a highly skilled AI Engineer to join our newly formed DOGE-X team-a cutting-edge division within our Market Technology Department inspired...Local area
Month2Month
Irvine, CA4 days ago - ...Role : Generative AI Engineer (GenAI Engineer) Location :USA PST time zone (Remote / Hybrid ). Time zone to follow: PST Number of... ...Experience with MCP servers, tool calling, function calling, or agentic workflows. Personal projects, GitHub contributions,...InternshipRemote work
Tekfortune Inc
Irvine, CA2 days ago $107.6k - $198.4k
...strategies, advanced analytics, Generative AI, transformative technologies, and... ...scientists, operators, creatives, designers, engineers, and architects. Our team balances business... ...software delivery, AI agent development, and agentic system implementation by helping teams...Local areaDeloitte
Costa Mesa, CA4 days ago$174k - $252k
...testability, and adherence to engineering best practices.... ...chosen field, focusing on agentic prompts and multi-turn... ...deployment, model evaluation, optimization, data processing... ...is building the core AI-driven platform that... ...innovation, applying cutting-edge machine learning and...WorldwideGoogle
Irvine, CA2 days ago- ...or Woburn, MA Our client seeks an AI/ML Engineer to design, build, and productionize... ...Python and PyTorch skills, experience with agentic frameworks and RAG, and the ability to... ...Prepare for and complete Python technical evaluations during the interview process....Hourly payContract workLocal area3 days per week
Eliassen Group
Irvine, CA19 days ago - ...in Irvine, CA Our client seeks an AI/ML Engineer to apply advanced machine learning and... ...PyTorch proficiency. Experience with Azure, agentic AI frameworks, RAG, and LLMs is... ...requirements of the position. All AI-assisted evaluations and responses are reviewed by human...Hourly payLocal area
Eliassen Group
Irvine, CA12 days ago $50 - $70 per hour
...design by designing and conducting relevant experiments and evaluations including numerical verification. · Prepare full documentation... ...prototypes to generate concept and model approvals. · Write engineering reports and create presentations as required to document and...Planet Pharma
Irvine, CA1 day ago$153.84k - $246.15k
...existing skills and learn new ones “I can succeed as a Senior AI AppSec Engineer at Capital Group”As a Senior AI AppSec Engineer, you will... ...solutions support scalable, secure adoption of AI. You will use agentic tooling to review code, build data flow diagrams, establish...Full timeTemporary workLocal areaFlexible hoursCapital Group
Irvine, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Agentic AI Evaluation Engineer (Edge & Classified). Be the first to apply!
