Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
$229.9k - $262.4kCapital One
Senior Lead AI Engineer (SDK’s: Gen AI Evaluation and MCP) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine learning — position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to continuing to build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build. Team Description The Intelligent Foundations and Experiences (IFX) team is at the center of bringing our vision for AI at Capital One to life. We work hand-in-hand with our partners across the company to advance the state of the art in science and AI engineering, and we build and deploy proprietary solutions that are central to our business and deliver value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance their products with the transformative power of AI, in responsible and scalable ways for the highest leverage impact. In this role, you will: Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One. Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more. Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems. Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One. The Ideal Candidate You love to build systems, take pride in the quality of your work, and also share our passion to do the right thing. You want to work on problems that will help change banking for good. Passion for staying abreast of the latest research, and an ability to intuitively understand scientific publications and judiciously apply novel techniques in production. You adapt quickly and thrive on bringing clarity to big, undefined problems. You love asking questions and digging deep to uncover the root of problems and can articulate your findings concisely with clarity. You have the courage to share new ideas even when they are unproven. You are deeply Technical. You possess a strong foundation in engineering and mathematics, and your expertise in hardware, software, and AI enable you to see and exploit optimization opportunities that others miss. You are a resilient trail blazer who can forge new paths to achieve business goals when the route is unknown. Basic Qualifications Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies At least 6 years of experience programming with Python, Go, Scala, or Java Preferred Qualifications 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud) Experience designing, developing, integrating, delivering, and supporting complex AI systems Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. Cambridge, MA: $229,900 - $262,400 for Sr. Lead AI Engineer McLean, VA: $229,900 - $262,400 for Sr. Lead AI Engineer New York, NY: $250,800 - $286,200 for Sr. Lead AI Engineer San Francisco, CA: $250,800 - $286,200 for Sr. Lead AI Engineer San Jose, CA: $250,800 - $286,200 for Sr. Lead AI Engineer Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate’s offer letter. This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan. Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. No agencies please. No agencies please. No agencies please. No agencies please. No agencies please. "No agencies please." #J-18808-Ljbffr
- Capital One in San Francisco, CA is seeking a Senior Lead AI Engineer to architect, build, and scale AI-powered solutions across platforms.... ...to deliver production-grade ML components, including model evaluation, governance, and observability. The role emphasizes strong...Senior
$229.9k - $262.4k
Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems,... ...language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc....SeniorFull timePart timeLocal area$147k - $202k
...Prologis, we don’t just lead the industry—we... ....Job Title:Lead AI EngineerCompany:PrologisTitle... ...lifeThe Lead AI Engineer builds production... ...orchestration, evaluation, and human review.Build... ...as OpenAI Agents SDK, LangChain, LangGraph, LlamaIndex, MCP, AutoGen, CrewAI, n...SuggestedFull timeWork at office$13 per hour
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...career at the company leading workforce... ...the same founders and engineers who built the original... ...this for 20 years."As a Senior/Lead AI Software Engineer... ...and reliably.Critically evaluate code (Human or AI-generated...SeniorFull timeImmediate start- Amplitude is seeking an SDK Engineer in San Francisco to lead AI-assisted SDK development. In this role, you will optimize SDK performance, own the developer experience, and create enhancements that benefit thousands of developers. This position demands experience in building...SeniorFlexible hours
- ...Senior AI Application Engineer Working with Us Challenging. Meaningful... ...increments. Develop MCP-accessible services... ..., Observability, and Evaluation Create and maintain... ...Engineers, Pod Leads, architects, and product... ..., Claude Agent SDK, or similar tools....Senior
$240k - $280k
A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably...Senior- Skyrocket Ventures is looking for engineers who are proficient in Python and willing to learn new technologies. The role focuses on building and improving simulation and evaluation platforms for AI agents in San Francisco. Successful candidates will have 5-10 years of experience...Senior
$166.6k - $218.7k
...deliberate, company-wide bet on AI. Frontier users are already... ...platform foundationBuild and evolve MCP servers that connect internal... ...interface for agents and engineers.Expand and operate our LLM gateway... ...holding.Build playgrounds and evaluation harnesses so internal AI...SeniorShift work$229.9k - $262.4k
...creating responsible and reliable AI systems, changing banking for good... ...build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough... ...similarity search, guardrails, model evaluation, experimentation, governance, and...SeniorFull timePart timeLocal area$163.2k - $220.8k
...growth. Wilson Sonsini is looking for a Senior AI Security Engineer to join the Security Operations team... ...to architect how one of the world’s leading law firms builds and deploys AI... ...function: designing secure AI pipelines, evaluating MCP server integrations and agentic...SeniorFull timeWork experience placementRemote workWorldwideShift work- ...enhance, build, and deliver top-notch technology products.As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Sector,... ...and deploy secure, scalable cloud platforms optimized for AI/ML workloads.Partner with AI teams to translate compute needs...SeniorFor contractors
$192k - $259.8k
...unique perspectives that lead to better solutions.... ...Job Summary: Drata's AI Platform team builds the... ...compliance platform — from MCP servers that make Drata'... ...agent developers, product engineers, and an embedded SRE... ...reproducible deployments, SDK version compatibility, workflow...SeniorFull timeWork at officeImmediate startWorldwideMonday to FridayFlexible hours$250k - $400k
...designers work in the AI era. We're backed by top... ...Homebrew, Scribble and senior leaders from OpenAI, Meta... ...a Senior Applied AI Engineer to ship the AI features... ...day. You'll prototype, evaluate, and refine product capabilities... ..., DSPy, Vercel AI SDK, or equivalents) ~...Senior$139k - $257.55k
...the next generation of AI-native creative systems... ...looking for forward-thinking engineers who are excited to... ...experience.Develop evaluation and quality frameworks... ...platforms.Familiarity with MCP, AI orchestration frameworks... .... Adobe’s industry-leading offerings including...SeniorFull timeTemporary workLocal areaWorldwide$156.06k - $211.14k
Afresh, the AI platform for grocery, began by tackling the... ...knowledge you feed them is not.As a Senior AI Platform Engineer, you build the AI and data... ...built on top of it, and the evaluation and serving infrastructure... ..., etc.) and hybrid search.MCP or similar tool/context...SeniorFull timeLive inWork at officeLocal areaRemote workWork from homeHome officeFlexible hours3 days per week$229.9k - $286.2k
Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems... ...model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Leverage...SeniorFull timePart timeLocal area$300k - $400k
...reinvent how designers work in the AI era. We’re backed by top... ..., Homebrew, Scribble and senior leaders from OpenAI, Meta, Google... ...the Role We’re hiring an Lead AI Engineer to own and scale our AI infrastructure... ...you’ll design the pipelines, evaluate tradeoffs, and lead execution...Full time$150k - $250k
About Distyl AI Distyl is an applied AI technology company partnering... ...journeys.Distyl is backed by leading investors including... ...Distyl, we build AI systems using Evaluation-Driven Development—an... ...in production.AI Evaluation Engineers focus on designing and implementing...Work at office3 days per week- Cacheflow is seeking a Senior Applied Research Engineer to enhance the effectiveness of our AI systems through focused research and experimentation. This role involves designing information retrieval strategies and collaborating with engineers to turn validated approaches...SeniorFlexible hours
$166.5k - $266.2k
...something unprecedented — an AI foundation that will push the... ...repeatable system standards and evaluation practices that scale across... ....The Forward Deployed AI Engineer is the connective tissue between... ...petabytes of multi-omics data, leading end-to-end deployments from...Flexible hours$203.5k
General Information Job Title Lead, AI Engineering Job ID 102641 Work Areas Analytics... ...— collaborating closely with senior engineers, product managers, and data... ...the full stack: model experimentation, evaluation design, and production system deploymentBuild...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per week- ...Senior. Distinguished AI Engineer (Agentic AI Platform) At Capital One, we are creating... ...to deliver our industry leading capabilities with... ...agentic workflows: you will evaluate agentic frameworks such LangGraph... ...an end to end GenAI SDK, CLI and starter kits that...SeniorWork at officeRemote work
- Sail is the foundation of useful, agentic AI. We are here to take a big swing at the most ambitious engineering challenge of our careers. Everyone working at Sail will become an expert; nothing less will do in our immensely competitive market. Inference is just one piece...SeniorWork at officeImmediate start
$200k - $350k
...across multiple systems and platforms. We are seeking a Senior AI Engineer to develop, deploy, and optimize production AI systems.... ...generative AI, and modern ML frameworks. Build inference and evaluation pipelines. Optimize model performance, latency, and cost....SeniorRemote jobFull timeImmediate start$163k - $246.5k
...gets smarter as you build, with AI that learns your context to... ...Security Testing and is trusted by leading organizations, including Vanta... ...About the role As an AI engineer, you’ll apply LLM technologies... ...solutions and rigorously evaluate the efficacy of different prompts...SeniorFull timeCurrently hiringLocal areaRemote workWeekend work3 days per week- ...Fieldguide. About the Role Fieldguide is building AI agents for the most complex audit and advisory... ...Combinator, Elad Gil, and other top-tier investors. As a Senior AI Engineer, Quality , you will own the evaluation infrastructure that ensures our AI agents perform...SeniorRemote jobFull timeWork at officeWork from homeFlexible hours
- ...Forward Deployed Engineers (FDE) don’t just build AI solutions, they... ...impact, pairing leading class engineering... ...serve as the senior practitioner-leader... ....Define evaluation frameworks covering... ...adoption. ServiceNow SDK experience with... ...agentic workstreams, MCP orchestration,...Local areaShift work
$314.8k - $359.3k
{"description": "Senior Distinguished AI Engineer At Capital One, we are creating responsible and... ...teams to deliver our industry leading capabilities with breakthrough product... ...similarity search, guardrails, model evaluation, experimentation, governance, and observability...SeniorFull timePart timeLocal area- ...forefront of integrating modern AI and LLMs into the Oura... ...reasoning systems, and robust evaluation - not as “chatbots with vibes... ...over months and years. As a Senior AI Engineer, you will design, build, and... ...and safety for AI workflows: Lead the design and implementation...SeniorFull timeTemporary workWork at officeLocal areaRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP). Be the first to apply!
- lead web developer San Francisco, CA
- lead industrial engineer San Francisco, CA
- lead operating engineer San Francisco, CA
- lead algorithm engineer San Francisco, CA
- lead app. developer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- lead network engineer San Francisco, CA
- lead engineer San Francisco, CA
- lead system engineer San Francisco, CA
- ai ml engineer San Francisco, CA


