Senior Lead AI Engineer - AI Foundations

Salary: $229,900 - 286,200 per year Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus a minimum of 6 years of experience developing AI and ML algorithms or technologies, or a Masters degree in a similar field with at least 4 years of experience
• At least 6 years of experience coding in Python, Go, Scala, or Java
• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud) is preferred
• Proven experience in designing, developing, integrating, delivering, and supporting complex AI systems
• Demonstrated capability to lead and mentor an engineering team and influence cross-functional stakeholders
• Expertise in developing AI and ML algorithms or technologies, including LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory
• Background in optimizing training and inference software for improved hardware utilization, latency, throughput, and cost
• Strong communication and presentation abilities, making it easy to convey complex AI concepts to peers
• A passion for staying updated with the latest AI research and judiciously applying new techniques in production

• Collaborate with a diverse team of engineers, research scientists, technical program managers, and product managers to create AI-driven products that transform how our associates operate and how customers engage with Capital One
• Design, build, test, deploy, and maintain AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Utilize a wide array of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, etc.
• Innovate and implement cutting-edge LLM optimization techniques to enhance the performance—scalability, cost-effectiveness, latency, and throughput—of large-scale production AI systems
• Shape the technical vision and long-term strategy for foundational AI systems at Capital One

• AI
• AWS
• Azure
• Cloud
• Hardware
• Support
• Java
• LLM
• Machine Learning
• PyTorch
• Python
• Scala
• C#
• Golang

More:

At Capital One, we are dedicated to building responsible and reliable AI systems that revolutionize banking for the better. As a leader in the industry, we leverage machine learning to enhance customer experiences in real-time. Our significant investments in technology infrastructure and exceptional talent enable us to be at the forefront of AI. The Intelligent Foundations and Experiences (IFX) team plays a crucial role in realizing our AI vision, collaborating closely with various partners to advance scientific and engineering excellence. We empower teams across the organization with AI models and platforms that facilitate impactful and responsible innovation. We offer a competitive array of health, financial, and other benefits that support overall well-being.

last updated 33 week of 2026