AI Engineer (MLX) - New York

Salary: $229,900 - 286,200 per year Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 6 years of experience developing AI/ML algorithms or technologies; or a masters degree in one of these fields and at least 4 years of relevant experience
• At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java
• Preferred: Experience leading AI system development and making tradeoffs among cost, latency, throughput, and accuracy
• Preferred: 7 or more years deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud
• Preferred: Experience designing, developing, delivering, and supporting complex AI systems, including LLM inference, similarity search, vector databases, guardrails, memory, and agentic workflows
• Preferred: Experience optimizing training and inference software, improving hardware utilization, and right-sizing models, instances, and hardware to meet system requirements
• Preferred: Experience integrating rule-based, retrieval-augmented, and generative AI components into production pipelines
• Preferred: Experience setting ethical AI standards, including explainability, fairness, and human-in-the-loop review
• Preferred: Strong communication and presentation skills, and the ability to explain complex AI concepts
• A strong engineering and mathematics foundation; curiosity about AI research and the ability to apply relevant findings in production
• Adaptability, resilience, clear communication, and a commitment to high-quality work and responsible AI

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for our associates and customers
• Design, develop, test, deploy, and support AI software components, including foundation model training, LLM inference, agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability
• Use open-source and SaaS AI technologies, such as AWS Ultraclusters, Hugging Face, vector databases, and PyTorch
• Develop foundation-model optimization techniques to improve production system scalability, cost, latency, and throughput
• Help shape our technical vision and long-term roadmap for foundational AI systems
• Build and optimize multi-model orchestration pipelines that combine LLMs, vector search, and domain-specific models
• Lead cost-performance governance reviews, monitoring GPU utilization, model throughput, and inference efficiency
• Lead design councils or review boards to support technical consistency and compliance with AI engineering standards
• Mentor Principal- and Manager-level AI engineers and strengthen technical capability across domains

• AI
• AWS
• Azure
• Cloud
• CUDA
• Hardware
• Support
• Java
• LLM
• Machine Learning
• Model Training
• PyTorch
• Python
• Scala
• Agentic AI
• C#
• Golang

More:

We are hiring an AI Engineer 5 for Capital Ones Intelligent Foundations and Experiences team, which works across the company to advance AI science and engineering and deliver proprietary, responsible, scalable solutions used by millions of customers. Our broader mission is to apply AI and machine learning to make banking simpler and more personal. This role is listed in Cambridge, McLean, New York City, San Francisco, and San Jose. Posted full-time annual salary ranges are $229,900–$262,400 in Cambridge and McLean, and $250,800–$286,200 in New York City, San Francisco, and San Jose; pay varies by location, and the offer letter will state the salary for the hired candidate. The role may also include performance-based incentives and access to our health, financial, and other benefits, with eligibility depending on role status and level. We will consider sponsoring a qualified new applicant for employment authorization.

last updated 40 week of 2026