Sr. Manager, AI Engineer - New York

Salary: $229,900 - 286,200 per year Requirements:

• We require a bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 6 years of experience developing AI and ML algorithms or technologies, or a masters degree in one of those fields plus at least 4 years of relevant experience.
• We require at least 1 year of people leadership experience.
• We prefer 3 years of experience managing and leading an engineering team.
• We prefer 6 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud environments.
• We prefer experience developing AI and ML technologies such as LLM inference, similarity search and VectorDBs, guardrails, or memory using Python, C++, C#, Java, CUDA, or Golang.
• We prefer experience building agentic AI systems and agentic workflows.
• We prefer a strong interest in the latest AI research and the ability to apply new techniques judiciously in production.
• We prefer excellent communication and presentation skills with the ability to explain complex AI concepts to peers.
• We prefer experience setting technical strategy for a multi-disciplinary AI team while balancing research exploration and production delivery.
• We prefer familiarity with MLOps and AI observability, including evaluation pipelines, drift monitoring, and model/version governance.
• We prefer a record of mentoring engineers and scientists to productize prototypes and meet production SLOs.
• We prefer experience right-sizing models, instance counts, and hardware types based on requirements such as context length, token inputs, and token outputs.

• We partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how our customers interact with Capital One.
• We oversee the design, development, testing, deployment, and support of AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• We make informed build-versus-buy decisions across a broad stack of open source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, and PyTorch.
• We invent and introduce foundation model optimization techniques to improve scalability, cost, latency, and throughput in large-scale production AI systems.
• We help define the technical vision and long-term roadmap for foundational AI systems at Capital One.
• We attract and retain top AI talent while supporting personal and professional growth through a culture of learning.
• We translate enterprise AI goals into actionable team roadmaps with measurable outcomes and regular updates.
• We operationalize Responsible AI by establishing review gates, documentation and evaluation standards, and rollout and rollback practices for production AI systems.
• We create strong collaboration channels with Research, Data, and Platform teams to accelerate the model lifecycle.

• Agentic AI
• AI
• AWS
• Azure
• C#
• Cloud
• CUDA
• Golang
• Hardware
• Support
• Java
• LLM
• MLOps
• Model Training
• PyTorch
• Python
• Machine Learning

More:

We are Capital One, creating responsible and reliable AI systems to help change banking for good. Our Intelligent Foundations and Experiences (IFX) team sits at the center of bringing our AI vision to life, working closely with partners across the company to advance science and AI engineering while building proprietary solutions that serve millions of customers. We offer a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support overall well-being, along with performance-based incentive compensation that may include cash bonuses and long-term incentives. This role includes salary ranges that vary by location, with positions in Cambridge, McLean, New York, and San Jose, and we may sponsor a new qualified applicant for employment authorization for this position.

last updated 38 week of 2026