Lead AI Engineer, Generative AI Services

Salary: $215,200 - 245,600 per year Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with a minimum of 4 years in developing AI and ML algorithms or technologies, or a Masters degree with at least 2 years of similar experience.
• At least 4 years of programming experience with Python, Go, Scala, or Java.
• 6 years of experience in deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure).
• Proven track record in designing, developing, delivering, and supporting AI services.
• Experience in AI and ML algorithms or technologies such as LLM Inference, Similarity Search, Guardrails, Memory using languages like Python, C++, C#, Java, or Golang.
• Expertise in developing and enhancing techniques for optimizing training and inference software for better hardware utilization, latency, throughput, and cost efficiencies.
• Strong passion for keeping updated with current AI research and systems, with the ability to apply new techniques thoughtfully in production.

• Collaborate with a diverse group of engineers, research scientists, technical program managers, and product managers to create AI-driven products that transform associate workflows and customer interactions.
• Design, implement, test, deploy, and maintain AI software components including foundational model training, large language model inference, and more.
• Utilize a wide range of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, and VectorDBs.
• Develop innovative LLM optimization strategies to enhance the performance metrics of large-scale production AI systems.
• Contribute to the overarching technical vision and future roadmap for foundational AI systems at Capital One.

• AI
• AWS
• Azure
• C#
• Cloud
• Golang
• Hardware
• Support
• Java
• LLM
• Python
• Scala
• Machine Learning
• PyTorch

More:

At Capital One, we are at the forefront of transforming banking through the development of responsible and effective AI systems. Our Intelligent Foundations and Experiences (IFX) team works collaboratively across the organization to advance AI science and engineering, deploying proprietary solutions that deliver value to millions of customers. We value not only technical proficiency but also the passion to help redefine customer experiences. We offer a competitive and comprehensive benefits package to support our team members overall well-being, reflecting our commitment to an inclusive workplace.

last updated 37 week of 2026