Staff AI Engineer - New York

Salary: $244,700 - 279,200 per year Requirements:

• We require a bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 8 years of experience developing AI and ML algorithms or technologies; or a masters degree in one of these fields plus at least 6 years of comparable experience.
• We require at least 8 years of programming experience with Python, Go, Scala, or Java.
• Preferred qualifications include 8 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or similar private cloud environments.
• Preferred qualifications include experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
• Preferred qualifications include demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level.
• Preferred qualifications include experience developing AI and ML technologies such as LLM inference, similarity search, VectorDBs, guardrails, and memory using Python, C++, C#, Java, or Golang.
• Preferred qualifications include experience applying advanced techniques to optimize training and inference software for better hardware utilization, latency, throughput, and cost.
• Preferred qualifications include strong awareness of current AI research and systems, with the ability to apply new methods thoughtfully in production.
• Preferred qualifications include excellent communication and presentation skills and the ability to explain complex AI concepts clearly to peers.

• We partner with cross-functional engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that reshape how our associates work and how our customers engage with Capital One.
• We design, build, test, deploy, and support AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• We work with a broad set of open source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch, and related tools.
• We invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput in large-scale production AI systems.
• We contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.

• AI
• AWS
• Azure
• C#
• Cloud
• Golang
• Hardware
• Support
• Java
• LLM
• Model Training
• PyTorch
• Python
• Scala
• Machine Learning

More:

We are Capital One, building responsible and reliable AI systems to improve banking for good. Our Intelligent Foundations and Experiences (IFX) team sits at the center of our AI vision, working closely with partners across the company to advance science and AI engineering and to create proprietary solutions that serve millions of customers. We are open to hiring a remote employee for this opportunity. This role is also eligible for performance-based incentive compensation and a comprehensive, competitive, and inclusive benefits package that supports total well-being. We may also consider sponsoring a new qualified applicant for employment authorization for this position.

last updated 36 week of 2026