Senior AI Engineer: Evaluation & Optimization (Remote)

Vantaca

Vantaca is seeking a Senior AI Engineer, Evaluation & Optimization to own the production AI infrastructure, experiments, and feedback loops for millions of tasks. You will design evaluation methods, benchmark models, and optimization loops across prompts, routing, and configurations, primarily using TypeScript.

The role emphasizes rigorous production testing, cross-provider model experimentation, and cost-aware improvements in a high-volume environment.

#J-18808-Ljbffr

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Senior AI Engineer: Evaluation & Optimization (Remote) in United States vacancy

Senior AI Engineer, Evaluation & Optimization
$200k - $260k
...association management industry. Our AI workforce platform... .... This transformation optimizes labor costs, enables growth... ...production and are hiring a Senior AI Engineer, Evaluation & Optimization to own the systems... ...1K with Company Match. ~ Remote Flexible - come to the...
Remote work
Senior
Temporary work
Work at office
Flexible hours
Vantaca
Palo Alto, CA
4 days ago
Senior NLP AI Engineer - Enterprise LLMs (Remote)
...Technologies is seeking a highly experienced NLP AI Engineer with 10+ years in AI/ML/NLP to design, fine-tune, optimize, and deploy enterprise-scale LLMs. Expertise in... ...distributed training, data pipelines, model evaluation, and collaboration across AI research, engineering...
Remote work
Senior
Bright Vision Technologies
Alpharetta, GA
2 days ago
Senior Cleared Intel AI Engineer
...services. We’re a nonprofit engineering, applied research, and... ...:MITRE’s Multi-INT AI Engineering Department... ...data types to include remote sensing data. Remote... ...’s mission.Select and evaluate AI models to solve a... ...settingExperience deploying robust, optimized solutions through...
Remote work
Senior
Work experience placement
Internship
Local area
Mitre
McLean, VA
5 days ago
Senior AI Engineer
$170k - $190k
...science, machine learning, AI, and deep clinical... ...problems today. Non-optimized medications therapies... ...interventions at scale. As a Senior AI Engineer, you will play a key... ...ML models and can evaluate trade-offs between different... ...in healthcare.Remote Work Requirements:An established...
Remote work
Senior
Live in
Arine
San Francisco, CA
4 days ago
Senior Context Fusion AI Engineer - Autonomous Vehicles
$184k - $287.5k
...looking for a strong engineer to join the DRIVE Road... ...inventing human-level AI for navigation in the... ...training, fine-tuning, and evaluation pipelines for large-... ..., training, and optimizing deep-learning models in... ...Santa Clara; US, NV, Remote; US, WA, Redmond; US,...
Remote work
Senior
Full time
Shift work
Nvidia
Seattle, WA
2 days ago
Senior AI Engineer (REMOTE)
...Position Summary: The Senior AI Engineer is a hands-on individual contributor who builds, trains, and evaluates machine learning models. The role combines knowledge engineering... ...in it. ~ Working knowledge of policy optimization methods for language models, such as PPO,...
Remote work
Senior
Full time
EnableComp
Remote
7 days ago
Senior AI/ML Engineer - Supply Chain Optimization (Remote)
...Samsara is hiring an experienced AI/ML Engineer to join its supply chain AI transformation. You will design and deploy ML models forecasting demand, inventory needs, and supplier risk using real‑time IoT signals and ERP data. You’ll build end‑to‑end features, ensure...
Remote work
Senior
Samsara
United States
2 days ago
Senior AI Engineer, Legal - USA Remote
$185k - $200k
...everything possible. The Senior Legal Engineer is responsible for... ..., and deploying AI-powered solutions that... ...frameworks. Develop and optimize document processing pipelines... ...monitoring. Design evaluation and quality framework... ...of flexible, remote working arrangements...
Remote work
Senior
Full time
Contract work
Work from home
Flexible hours
Danaher Corporation
New York, NY
5 days ago
AI Software Engineer, Senior
$86.9k - $198k
AI Software Engineer, SeniorThe Opportunity:As an experienced software engineer... ...(RAG), agentic workflows, evaluation pipelines, and human-in-the... ...and external tools while optimizing for performance, cost,... ...cameras on during meetings.Remote: If this position is listed...
Remote work
Senior
Full time
Contract work
Part time
Work at office
Local area
Booz Allen Hamilton
Honolulu, HI
4 days ago
Senior AI Engineer (Remote)
$100k - $250k
...part of something bigger.Position Purpose:The Senior AI Engineer is responsible for designing, building, scaling, and optimizing production-grade Agentic AI systems that... ...experience in establishing Responsible AI, evaluation frameworks, reliability engineering, and AI...
Remote work
Senior
Full time
Work experience placement
Night shift
Home Depot
Atlanta, GA
1 day ago
Senior AI Systems Engineer
...operational support of AI platforms, tools, and services... ..., monitor, and optimize AI infrastructure, working... ..., cloud, and platform engineering teams.Operationalize... ...and business objectives.Evaluate emerging AI tools, frameworks... ...may be performed fully remote, hybrid, or onsite at...
Remote work
Senior
Full time
Work at office
Applied Research Associates
Raleigh, NC
5 days ago
Senior AI Engineer - Agentic AI & Generative AI
...1-04Salary Range: Senior Associate-75,000-1... ...onsite and 2 days remote (onsite Tuesdays,... ...deliver next-generation AI capabilities that... ...are automated, optimized, and enhanced... ...skilled Senior AI Engineer with hands-on experience... ..., monitoring, evaluation, security, observability...
Remote work
Senior
Flexible hours
DTCC- The Depository Trust & Clearing Corporation
Jersey City, NJ
1 day ago
Senior AI Engineer
...role We are looking for a Senior AI Engineer to own and scale the AI... ...systems, structured outputs, evaluation, observability, and model selection... ...hours of CET. This ensures optimal collaboration and... ...our vibrant team! We offer: Remote Work Environment: Embrace...
Remote work
Senior
Full time
For contractors
Flexible hours
Ruby Labs
Georgia
19 days ago
Senior AI Engineer
$208k - $312k
...company and a leading AI platform for... ...bring sun-drenched optimism and drive. Whether... ...re forming small, senior, cross-functional... ...product leaders, AI engineers, and full-stack builders... ...layers, and evaluation mechanisms necessary... ...-person time and remote. Our approach...
Remote work
Senior
Full time
Work at office
Home office
Flexible hours
Workday
Pleasanton, CA
1 day ago
Senior Principal AI Engineer
$238.2k - $322.2k
...Our Engineering organization is scaling its AI Engineering capabilities under... ...We’re looking for Senior Principal AI Engineers... ...and inference optimization, and you stay hands... ...optimization and evaluation, with evals as the... .... #LI-CG1 #LI-Remote About Rapid7...
Remote work
Senior
Full time
Work experience placement
Local area
Rapid7
California
8 days ago
Senior AI Engineer
$200k
...the productionization of AI capabilities across the publishing... ...this role.THE ROLEAs a Senior AI Engineer (Full-Stack / Applications... ...AI-powered systems: from evaluating and optimizing models, to integrating... ...position is classified as remote but is tied to our New York...
Remote work
Senior
Full time
Contract work
Temporary work
Work at office
Local area
Macmillan
New York, NY
2 days ago
Senior Applied AI Engineer
...Location: San Diego, CA, United States (Remote)Job Role: Senior Applied AI Engineer Location : San Diego, CAPosition... .... Prompt Engineering & LLM Optimization: Develop and refine sophisticated... ...architectures, system instructions, and evaluation frameworks that ensure consistent...
Remote work
Senior
Work at office
Immediate start
Monday to Friday
InstantServe
San Diego, CA
2 days ago
Senior AI/ML Engineer - Remote
$120.1k - $214.5k
...advanced data analytics and AI to cybersecurity, we... ...and software engineers through data extraction... ...the flexibility to work remotely * from anywhere within... ...engineering, training, evaluation, deployment, monitoring... ...time-series forecasting, optimization, or reinforcement...
Remote work
Senior
Minimum wage
Full time
Work experience placement
Work at office
Local area
UnitedHealth Group
San Diego, CA
5 days ago
AI Evaluation Engineer
...in Financial Services & Insurance AI Evaluation Engineer PRIMARY PURPOSE: The AI Evaluation Engineer... ...throughout their lifecycle. Fully remote role, open to U.S. based candidates.... ...to partner with Data Scientists to optimize model performance Strong Python skills...
Remote work
Full time
Local area
Sedgwick
Remote
7 days ago
Senior AI/ML Engineer - Remote - Central Time Zone Preferred
$120.1k - $214.5k
...advanced data analytics and AI to cybersecurity, we use innovative... ...the flexibility to work remotely * from anywhere within the U... ...stakeholders to design, evaluate, and optimize agentic AI workflows using quantitative... ...orchestration, or workflow engines experienceFastAPI, Express,...
Remote work
Senior
Minimum wage
Full time
Work experience placement
Work at office
Local area
UnitedHealth Group
Eden Prairie, MN
2 days ago
Senior Agentic AI Software Engineer
$146.3k - $178.1k
...Location: United States – Remote Clearance: Ability to... ...LTS is seeking a Senior Agentic AI Software Engineer to build the intelligence... ...Systems Design and optimize Retrieval-Augmented Generation... ...Implement testing, evaluation, monitoring, observability...
Remote work
Senior
Full time
LTS
Remote
8 days ago
Senior Staff AI Engineer
...role:SoFi’s SeniorStaff AI Engineer is a hands-on AI... .... This is a critical, senior role responsible for setting... ...failoversDeep Model Optimization: Pioneer and institutionalize... ...GenAI, LLMs, and NLP, evaluating and experimenting with... ...unable to accommodate remote work from Hawaii,...
Remote work
Senior
SoFi
San Francisco, CA
2 days ago
Senior AI Engineer, Product Engineering
$200k - $250k
...are building the AI Search Infrastructure... ...indexes with LLM‑optimized retrieval systems... ...Our team includes engineers, researchers, product... ..., vertical feeds, evaluation tooling, and new... ...credibility with senior engineers and commercial... ...of our hybrid/remote team's cell phone...
Remote work
Senior
Full time
Immediate start
Work from home
Flexible hours
Early shift
Alumni Ventures
San Francisco, CA
4 days ago
Senior AI-Augmented Software Engineer
...for technology value optimization (TVO), enabling IT, finance... ...model for software engineering: a small, autonomous... ...engineering fundamentals with AI coding agents to... ...break down problems, evaluate generated solutions, and... ...coding tasks #LI-REMOTE #LI-DL1 #LI-...
Remote work
Senior
Full time
Internship
Local area
Flexera
Remote
19 days ago
Cleared AI Senior Software Engineer (Hybrid)
...Azusa Solutions is seeking an AI Senior Software Engineer to join our team of... ...to design, implement, and optimize AIpowered solutions built on... ..., and iteratively tune and evaluate agent behavior to deliver reliable... ...referral incentive ~ Remote or Hybrid telework arrangements...
Remote work
Senior
Temporary work
Local area
Immediate start
Azusa Solutions LLC
Washington DC
5 days ago
Senior AI Engineer - Agentic Systems and LLM
$124.8k
...Our partner is looking for a Senior AI Engineer – Agentic Systems and LLM... ...agentic systems. In this fully remote role, you will take... ...implementation to deployment and optimization. You will build intelligent... ...implement strategies for evaluating AI systems, ensuring accuracy...
Remote work
Senior
Hourly pay
Full time
Jobgether
Remote
8 days ago
Senior Applied AI Engineer
$100k
...About Givzey | Version2.ai Givzey | Version2.ai ( is a fully remote, AI-native company... ...Role We're hiring a Senior Applied AI Engineer to lead the... ...production applications. Evaluation, observability, and... ...controls. Build and optimize retrieval-augmented...
Remote work
Senior
Full time
Givzey
Remote
12 days ago
Senior AI Systems Engineer (RAG)
$170k - $200k
...Fully remote, well-funded AI startup. Excellent benefits, stable future... ...Fully Remote Well-funded Senior team of proven engineers Autonomy and upward... ...candidate has built and optimized these systems in production... ...response quality. Build Evaluation and Measurement Frameworks...
Remote work
Senior
Local area
Jobot
South Jordan, UT
3 days ago
Senior Staff AI Engineer - Agentic AI Platform (Remote Eligible)
$286.2k - $326.7k
...Job Description Senior Staff AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating... ...search, guardrails, model evaluation, experimentation, governance, and... ...state-of-the-art foundation model optimization techniques to improve the...
Remote work
Senior
Full time
Part time
Local area
Capital One
McLean, VA
7 days ago
Senior Director, AI Engineering
...Remote or Remote | Information Technology | Full Time... ...the enterprise AI strategy, leads a cross... ...solutions to save costs and optimize AI performance for... ...legal contract review, engineering design, sales and reporting... ...laws. The Company evaluates such export license situations...
Remote work
Senior
Permanent employment
Full time
Contract work
Work at office
Shift work
Night shift
Benchmark Electronics Inc
Tempe, AZ
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Engineer: Evaluation & Optimization (Remote). Be the first to apply!