Senior AI Engineer: Scalable LLM & AI Infrastructure

At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to deliver real‑time, personalized customer experiences. Our investments in technology infrastructure and world‑class talent put us at the forefront of enterprises leveraging AI, from informing customers about unusual charges to answering their questions in real time. We are committed to building world‑class applied science and engineering teams to deliver breakthrough product experiences and scalable, high‑performance AI infrastructure. In this role, you will: Partner with cross‑functional engineers, research scientists, technical program managers, and product managers to deliver AI‑powered products that change how associates work and how customers interact with Capital One. Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. Leverage Open‑Source and SaaS AI technologies such as Amazon Web Services, Hugging Face, VectorDBs, Nemo Guardrails, PyTorch, and more. Invent and introduce state‑of‑the‑art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput of large‑scale production AI systems. Contribute to the technical vision and long‑term roadmap of foundational AI systems at Capital One. The Ideal Candidate: Shows a passion for building systems, takes pride in the quality of work, and shares a commitment to responsible AI. Stays abreast of the latest research and can apply novel techniques in production. Adapts quickly, thrives on bringing clarity to large, undefined problems, asks questions, digs deep, and articulates findings concisely. Has a strong foundation in engineering and mathematics, with expertise that enables hardware and software optimization opportunities. Is a resilient trailblazer able to forge new paths to achieve business goals when routes are unknown. Basic Qualifications: Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields and at least 4 years of experience developing AI and ML algorithms or technologies; or Master’s degree in a related field and at least 2 years of experience. At least 4 years of programming experience with Python, Go, Scala, or Java. Preferred Qualifications: 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud). Experience designing, developing, delivering, and supporting AI services. Experience developing AI and ML algorithms or technologies such as LLM inference, similarity search, vector databases, guardrails, and memory using Python, C++, C#, Java, or Golang. Experience applying state‑of‑the‑art techniques to optimize training and inference software for hardware utilization, latency, throughput, and cost. Passion for staying abreast of AI research and applying novel techniques in production. Salary and Benefits: Salary ranges by location: Cambridge, MA: $193,400 - $220,700; McLean, VA: $193,400 - $220,700; New York, NY: $211,000 - $240,800; San Francisco, CA: $211,000 - $240,800; San Jose, CA: $211,000 - $240,800. Role is eligible for performance‑based incentive compensation. Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support total well‑being. Equal Employment Opportunity Statement: Capital One is an equal opportunity employer committed to non‑discrimination in compliance with applicable federal, state, and local laws. We consider qualified applicants with a criminal history in accordance with applicable privacy and employment regulations. #J-18808-Ljbffr Capital One