Senior AI Engineer (FM Hosting, LLM Inference)

Salary: $229,900 - 286,200 per year Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus a minimum of 6 years of experience in developing AI and ML algorithms or technologies, or a Masters degree in the same fields with at least 4 years of experience.
• At least 6 years of experience in programming with Python, Go, Scala, or Java.
• 7 years of experience deploying scalable AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent).
• Experience in designing, developing, integrating, delivering, and supporting complex AI systems.
• Proven ability to lead and guide an engineering team and influence cross-functional stakeholders.
• Familiarity with AI and ML algorithm development (e.g., LLM Inference, Similarity Search, Guardrails) using Python, C++, C#, Java, or Golang.
• Experience in optimizing training and inference software for improved hardware efficiency, latency, throughput, and cost.
• Strong interest in current AI research and the practical application of novel techniques.
• Exceptional communication and presentation skills, with the capability to explain complex AI concepts clearly to peers.

• Collaborate with a diverse team of engineers, research scientists, program managers, and product managers to deliver AI-driven products that transform both associate workflows and customer interactions with Capital One.
• Design, develop, test, deploy, and maintain AI software components, including foundation model training, large language model inference, similarity search, and model evaluation.
• Utilize a wide range of Open Source and SaaS AI technologies, such as AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.
• Create and implement advanced LLM optimization techniques to enhance scalability, cost-efficiency, latency, and throughput of large-scale AI systems.
• Contribute to the overarching technical vision and long-term roadmap of foundational AI systems at Capital One.

• AI
• AWS
• Azure
• C#
• Cloud
• Golang
• Hardware
• Support
• Java
• LLM
• Machine Learning
• PyTorch
• Python
• Scala

More:

At Capital One, we are at the forefront of creating responsible AI systems that redefine banking for good. Our commitment to investing in cutting-edge technology and top-notch talent has established us as leaders in machine learning, enabling personalized customer experiences and operational efficiency. The Intelligent Foundations and Experiences (IFX) team plays a crucial role in actualizing our AI vision, collaborating closely with various partners across the organization to develop proprietary solutions that benefit millions of customers. We offer competitive salaries, performance-based incentives, and a comprehensive benefits package designed to support our employees total well-being in a dynamic and inclusive workplace.

last updated 32 week of 2026