Senior AI Engineer, Generative AI Services

Salary: $229,900 - 286,200 per year Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields, with at least 6 years of experience in developing AI and ML algorithms, or a Masters degree in the same fields with at least 4 years of experience
• At least 6 years of programming experience in Python, Go, Scala, or Java
• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud (preferred)
• Experience in designing, developing, integrating, delivering, and supporting complex AI systems (preferred)
• Proven ability to lead and mentor engineering teams and influence cross-functional stakeholders (preferred)
• Experience in developing AI and ML algorithms, including LLM Inference, Similarity Search, Guardrails, Memory, using languages such as Python, C++, C#, Java, or Golang (preferred)
• Expertise in optimizing training and inference software to enhance hardware utilization, latency, throughput, and cost (preferred)
• Strong communication and presentation skills, capable of articulating complex AI concepts clearly to peers (preferred)

• Collaborate with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-driven products that transform our associates work and customer interactions
• Design, develop, test, deploy, and maintain AI software components, including foundation model training, large language model inference, similarity search, guardrails, model assessment, experimentation, governance, and observability
• Utilize a diverse range of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch
• Innovate and implement cutting-edge LLM optimization strategies to enhance performance metrics such as scalability, cost, latency, and throughput for large-scale production AI systems
• Contribute to the overarching technical vision and long-term roadmap for foundational AI systems at Capital One

• AI
• AWS
• Azure
• C#
• Cloud
• Golang
• Hardware
• Java
• LLM
• Machine Learning
• PyTorch
• Python
• Scala
• Support

More:

At Capital One, we are pioneering responsible and dependable AI systems, aimed at transforming banking for the better. We are recognized as leaders in implementing machine learning to create personalized customer experiences. Our commitment to technological innovation and top-tier talent, coupled with our extensive experience in machine learning, positions us at the forefront of enterprise AI applications. Join the Intelligent Foundations and Experiences (IFX) team, where we bring our AI vision to life through collaboration with partners across the organization. We create proprietary solutions that provide substantial value to millions of customers, advancing the capabilities of AI in a responsible, scalable manner. This role offers competitive compensation and benefits, and provides an exciting opportunity to make a meaningful impact on how we serve our customers.

last updated 32 week of 2026