Senior Lead AI Engineer: Gen AI Evaluation SDKs
Capital One Bank
Capital One is seeking a Senior Lead AI Engineer to partner with engineers and product teams to build AI-powered services in a responsible, scalable way. The role covers model training, inference, similarity search, guardrails, governance, and observability across a broad AI stack. You will optimize LLM workloads, improve latency and cost, and help shape the long-term AI strategy. This is a hands-on, leadership-focused role within Capital One's IFX AI initiatives. #J-18808-Ljbffr Capital One
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Lead AI Engineer: Gen AI Evaluation SDKs in Mc Lean, VA vacancy
$229.9k - $262.4k
## Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)Applylocations: McLean, VA: San Francisco, CA: Cambridge, MA: San Jose, CA: New York, NYtime type: Full timeposted on: Posted Todayjob requisition id: R247480Senior Lead AI Engineer (SDK's: Gen AI Evaluation and...SeniorFull timePart timeLocal area$229.9k - $262.4k
Senior Lead AI Engineer,(MLX, Agentic AI, Gen AI platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing... ...inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc....SeniorFull timePart timeLocal areaCapital One
McLean, VA11 hours ago$229.9k - $262.4k
Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems,... ...language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc....SeniorFull timePart timeLocal areaCapital One
McLean, VA3 days ago$229.9k - $262.4k
...Overview Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and... ...language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc....SeniorFull timePart timeLocal area$197.3k - $225.1k
...Lead AI Engineer Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years... ...model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Leverage...SuggestedFull timePart timeLocal areaCapital One Financial Corporation
McLean, VA11 hours ago- ...services. We’re a nonprofit engineering, applied research, and... ...at our core, we lead federally funded research... ...s Trustworthy & Secure AI (TSAI) Department consists... ..., engineering, evaluation, and integration of secure... ...interdisciplinary teams and engage senior mission stakeholders...Work experience placementInternshipLocal area
- ...difference with us.The Generative and Agentic AI Engineering Department works across the full range... ..., identity resolution and AI/GenAI evaluation.Roles & Responsibilities:The position... ...of a lab/experimental settingExperience leading mid-sized or large teams to solve...Work experience placementInternshipLocal area
- ...services. We’re a nonprofit engineering, applied research, and advanced... ...integrity at our core, we lead federally funded research and... ...and help shape the future.Our AI-enhanced Discovery and Decisions... ...science, AI testing and evaluation, multi-agent systems, knowledge...SeniorInternshipLocal areaImmediate start3 days per week
$122k - $240.5k
...Summary Agentic AI is moving from experimentation... ...'re growing a team of engineers who want to work at the... ...Ability to lead projects or workstreamsAbility... ..., state management, evaluation, guardrails, and human-... ...entry-level employees to senior leaders, we believe there...SeniorWork at officeLocal areaVisa sponsorshipShift work- ...conducts research and development in software engineering, systems engineering, cybersecurity, and... ...discipline of software engineering to AI systems. What We Do The CERT Threat... ...offers of employment. Beyond credentials, we evaluate the role and responsibilities, your valuable...SeniorFull timeWork experience placementWork at office
$229.9k - $262.4k
...Overview Senior Lead Software Engineer, Full Stack (Golang, Python, GenAI) (Cloud Operations... ...priority will be designing AI-driven systems to automate... ...data topologies, and next-gen cloud-native design—ensuring... ...(PoCs), and rigorously evaluate codebases to validate technical...SeniorFull timePart timeInternshipLocal areaCapital One
McLean, VA9 days ago- ...Requisition #: 1394 Job Tittle: Senior Full Stack Developer – Agentic AI and Data Engineer (2) Location: McLean, VA... ...work under the Senior Technical Lead to design, build, and demonstrate... ...o Integrate commercial model SDKs (Gemini Enterprise, Anthropic for...SeniorFull timeFor contractorsFor subcontractorWork at officeRemote work
Agile Defense
McLean, VA11 hours ago - ...CERT Division of the Software Engineering Institute (SEI) is seeking applicants for the role of Senior AI Security Software Engineer.... ...-edge technologies alongside leading experts in AI, cybersecurity,... ...employment. Beyond credentials, we evaluate the role and responsibilities...SeniorFull timeWork experience placementRelocation package
$197.3k - $225.1k
...Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview At Capital One, we are creating responsible and reliable AI systems,... ...language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc....Full timePart timeLocal areaCapital One
McLean, VA2 days ago$104k - $166k
ResponsibilitiesNext-Gen AI/ML Systems Engineer - Data Fusion & Sense-MakingWithin... ....What you’ll do: Lead the design of AI-enabled data... ...limitations, and mission impact to senior leadership, customers, and... ...AI testing, validation, and evaluation methodologiesBroad...Full timeContract workImmediate startShift work$229.9k - $262.4k
...Senior Lead Software Engineer, Full Stack (Python, ReactJS, AWS) Do you love building and pioneering in... ...from time to time, be asked to code or evaluate code Collaborate with digital product... ...~ Experience leveraging interactive AI tooling to accelerate productivity, utilizing...SeniorFull timePart timeInternshipLocal areaCapital One
McLean, VA11 hours ago$180k - $230k
...government agencies with cutting‑edge AI/ML and data solutions. We are a... ...Americans. About the role As Lead AI/ML Software Engineer for [R]AIMS, you will serve as a senior technical leader responsible... ...across the [R]AIMS platform, evaluating tradeoffs across performance, scalability...Remote workRaft
McLean, VA4 days ago$155k - $200k
...innovation meets mission. Our AI, cloud, cyber, and... ...has an immediate need for a Senior AI Software Engineer to join our growing AI and... ...AI & LLM Solution Delivery Lead the design, development, prototyping... ..., response synthesis, evaluation, and deployment of reliable...SeniorTemporary workImmediate startWorldwideCredence company
McLean, VA19 hours ago- ...company at the forefront of AI-native innovation. We partner... ...generation, agent-powered workflows engineered to scale in real-world... ...beginning to understand what leading technology companies have demonstrated... ...equivalent; familiarity with evaluation tooling, logging, monitoring,...SeniorFull timeWork experience placementLive inWork at officeLocal area
$180k - $200k
...Secret Level of Experience: Senior This opportunity... ...architecture, reverse engineering, software and hardware... ...Mission Technologies is leading the next evolution of national... ...range from C5ISR, AI and Big Data, cyber operations... ..., model, integrate and evaluate datasets.Employs...SeniorFull timeWork at officeLocal areaWork from homeWorldwideHome office$209k - $238.5k
...Senior Lead Software Engineer, Full Stack - Shopping (Remote Eligible) Do you love building and pioneering... ...time to time, be asked to code or evaluate code Collaborate with digital product... ...~ Experience leveraging interactive AI tooling to accelerate productivity, utilizing...SeniorFull timePart timeInternshipLocal areaRemote workCapital One
McLean, VA2 days ago$229.9k - $262.4k
...Senior Lead Software Engineer, Fullstack (Typescript/Nodejs/Python) Do you love building and pioneering... ...from time to time, be asked to code or evaluate code Collaborate with digital... ...~ Experience leveraging interactive AI tooling to accelerate productivity, utilizing...SeniorFull timePart timeInternshipLocal areaCapital One
McLean, VA3 days ago$229.9k - $262.4k
...Senior Lead Software Engineer, Full Stack Do you love building and pioneering in the technology space... ...technology solutions across the company. The AI Harness Engineering team is focused... .... We build the tools, contracts, evaluation systems, and release controls that...SeniorFull timePart timeInternshipLocal areaCapital One
McLean, VA3 days ago$229.9k - $262.4k
...Senior Lead Software Engineer Do you love building and pioneering in the technology space? Do you enjoy... ...streaming pipelines and services that evaluate credit card transactions for fraud as... ...~ Experience leveraging interactive AI tooling to accelerate productivity, utilizing...SeniorFull timePart timeInternshipLocal areaCapital One
McLean, VA2 days ago- ...environments. JOB DESCRIPTION Iron EagleX is seeking a Senior Principal Agentic AI/ML Engineer to support our AI team in Crystal City, VA. This role... ..., model development, agentic workflow design, evaluation, integration, deployment, and operational sustainment....SeniorContract work
General Dynamics Information Technology
Arlington, VA20 days ago - ...well. Please find the job details below: Job Title: Lead AI Engineer Agentic Test Automation Location: Tysons, VA... ...gates" via agents ~ Build automated review agents that evaluate user stories/requirements for minimum required clarity and data...Contract work
SmartIPlace
Tysons, VA2 days ago - ...Role - GenAI / Agentic Test Automation Engineer Location - Tysons, VA Let's create... ...with the power of cloud, data, AI, engineering, and other emerging technologies... ...structured outputs/JSON schemas, guardrails, evaluation, and hallucination reduction. Strong...Contract work
The AES Group
Tysons, VA3 days ago $65 - $90 per hour
...insights (commit/PR correlation) ~ Produce outputs consumable by engineering leadership and teams (dashboards, markdown summaries in PRs,... ...gates" via agents ~ Build automated review agents that evaluate user stories/requirements for minimum required clarity and...Hourly payContract workTemporary workWork experience placementMcLean, VA8 days ago- ...seeking a talented and driven AI Process Integration Engineer to support a critical... ...Process Integration Engineer, Senior bridges the gap between... ...Optimize Existing Tools: Evaluate approved AI/ML tools on the... ...analysts, targeters, and mission leads to deliver hands-on...SeniorFull time
Praescient Analytics
McLean, VA4 days ago $106.9k - $176.5k
...world. The opportunity We are seeking an AI Systems Engineer to own the delivery, model-serving,... ...air-gapped environments. Works with senior engineers to test and develop capabilities... ...(Grafana), LLM debugging and evaluation (LangSmith/Langfuse), and SLA/alert notifications...SeniorSummer holidayFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Lead AI Engineer: Gen AI Evaluation SDKs. Be the first to apply!
Related searches
- lead operating engineer Mc Lean, VA
- lead engineer Mc Lean, VA
- senior ai engineer Mc Lean, VA
- ai developer Mc Lean, VA
- ai engineer Mc Lean, VA
- senior network engineer remote Mc Lean, VA
- senior app developer Mc Lean, VA
- senior manager legal Mc Lean, VA
- sr project manager Mc Lean, VA
- senior account executive Mc Lean, VA