Senior AI Engineer - Cambridge

Salary: $225,400 - 280,600 per year Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with a minimum of 6 years of experience in developing AI and ML algorithms or technologies, or a Masters degree in the same fields with at least 4 years of experience.
• A minimum of 6 years of programming experience in Python, Go, Scala, or Java.
• 7 years of experience in deploying scalable and responsible AI solutions on cloud platforms (such as AWS, Google Cloud, Azure, or equivalent private cloud) is preferred.
• Experience in designing, developing, integrating, delivering, and supporting complex AI systems.
• Proven ability to lead and mentor an engineering team, influencing cross-functional stakeholders.
• Experience in developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using languages such as Python, C++, C#, Java, or Golang.
• Familiarity with state-of-the-art techniques for optimizing training and inference software for improved hardware utilization, latency, throughput, and cost.
• Strong communication and presentation skills, able to clearly express complex AI concepts to peers.

• Collaborate with a diverse team of engineers, research scientists, technical program managers, and product managers to create AI-driven products that enhance our associates work and customer interactions with Capital One.
• Architect, develop, test, deploy, and maintain AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Utilize an extensive range of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch.
• Innovate and implement cutting-edge LLM optimization techniques to boost performance in scalability, cost-efficiency, latency, and throughput of production-scale AI systems.
• Contribute to the technical vision and long-term strategy for foundational AI systems at Capital One.

• AI
• AWS
• Architect
• Azure
• C#
• Cloud
• Golang
• Hardware
• Java
• LLM
• Machine Learning
• PyTorch
• Python
• Scala
• Support

More:

At Capital One, we are dedicated to creating responsible and reliable AI systems that transform banking for the better. As an industry leader in machine learning, we focus on delivering real-time, personalized experiences for our customers. Our Intelligent Foundations and Experiences (IFX) team collaborates closely with various departments to enhance AI engineering and build proprietary solutions that add value to millions of customers. In this role, you will be part of a committed team focused on leveraging the latest in AI technology to elevate customer-centric products and services. We offer a competitive salary, comprehensive benefits, and a commitment to professional development in an inclusive workplace.

last updated 33 week of 2026