Senior AI Engineer: LLM Gateway & Hosting
Jobleads-US
Capital One is seeking an AI Engineer 5 to advance foundational AI systems within the IFX group in McLean, VA. You will design, implement, and optimize AI components including model training, inference, and orchestration, partnering with engineers, researchers, and PMs to deliver production-ready AI products.
You will work with Open Source and SaaS tools like AWS, HuggingFace, VectorDBs, and PyTorch, applying state-of-the-art techniques to improve latency, cost, and throughput at scale.
#J-18808-Ljbffr Jobleads-USVacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer: LLM Gateway & Hosting in McLean, VA vacancy
$197.3k - $225.1k
...AI Engineer 4 (LLM Gateway, FM Hosting) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital... ...compliance standards are met Mentor Principal and Senior Associates on scalable design, performance tuning and...SuggestedFull timePart timeLocal areaCapital One National Association
McLean, VA9 hours ago$229.9k - $262.4k
## Senior Lead AI Engineer (FM Hosting, LLM Inference)Applylocations: McLean, VA: New York, NY: San Jose, CAtime type: Full timeposted on: Posted Todayjob requisition id: R234418Senior Lead AI Engineer (FM Hosting, LLM Inference)****Overview:****At Capital One, we are...SeniorFull timePart timeLocal areaCapital One Group
McLean, VA1 day ago$229.9k - $262.4k
Senior Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized...SeniorFull timePart timeLocal areaCapital One
McLean, VA2 days ago$229.9k - $262.4k
...we are creating responsible and reliable AI systems, changing banking for good. For years... ...to build world‑class applied science and engineering teams to deliver our industry leading... ...and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs...SuggestedFull timePart timeLocal areaCapital One National Association
McLean, VA9 hours ago$229.9k - $262.4k
...AI Engineer 5 (FM Hosting, LLM Inference) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences...SuggestedFull timePart timeLocal areaCapital One National Association
McLean, VA9 hours ago- ...Capital One invites applications for an AI Engineer 5 focused on AI Foundations and VLM customization. This role partners with cross‑functional... ...deploy AI software components, including foundation models, LLM inference, and multi‑model workflows. The ideal candidate...Senior
- ...Capital One is seeking an AI Engineer 5 to help build and scale responsible AI systems. You will collaborate with cross-functional teams on foundation models, LLM inference, and multi-model orchestration within a scalable AI infrastructure. The role emphasizes performance...Senior
- ...Capital One is seeking an AI Engineer 4 focused on AI Foundations, LLM customization and finetuning to advance responsible AI in banking. You will design and deliver AI powered products with cross-functional teams. You will train models, optimize inference pipelines...Senior
- ...Capital One is seeking an AI Engineer 5 to build and optimize foundational AI systems within the Intelligent Foundations and Experiences... ...support AI components, including foundation model training and LLM inference, across a broad stack of open-source and SaaS technologies...Senior
- ...Capital One is seeking an AI Engineer 4 to help build responsible AI systems and scalable AI infrastructure. You will design and deploy AI components, training pipelines, inference engines, and governance mechanisms while partnering with cross-functional teams across software...Senior
$145k - $205k
...science, software engineering, artificial intelligence... ...generative AI or LLMs into production... ...frameworks, model gateways, MCP-compatible services... ...source, or locally hosted LLMs in cloud, on-... .... Implement LLM techniques including... ...differently. This Senior AI/ML Software Engineer...SeniorFull timeVantor
Herndon, VA2 days ago$145k - $205k
...level. We are seeking a Senior AI/ML Software Engineer to integrate secure chatbot... ...skills, practical LLM experience, and an understanding... ...orchestration frameworks, model gateways, MCP-compatible services,... ..., open-source, or locally hosted LLMs in cloud, on-premises,...SeniorVantor
Herndon, VA2 days ago- ...Precise Software Solutions, Inc. is seeking a Senior AI Engineer to deliver hands-on, senior-level development for secure AI-enabled applications... ...serving U.S. government clients. You will build and tune LLM, RAG, and agentic workflows, lead adversarial testing, and...Senior
$229.9k - $262.4k
...AI Engineer 5 (AI Foundations, LLM Core and Agentic AI) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer...Full timePart timeLocal areaCapital One National Association
McLean, VA9 hours ago- ...defense technology company, is seeking an AI Implementation Engineer to be part of our Warfare Systems... ...available AI tooling/chat, hosting LLM servers and has demonstrated ability... ...NVIDIA preferred) Experience with AI Gateways Experience with LLM servers and model...Full timeWork at officeLocal areaImmediate startShift work
Innovative Defense Technologies
Arlington, VA24 days ago - ...front line needs and what is delivered. Our AI-native platform, Air Enterprise... ...Description We are seeking an experienced Senior AI Engineer to join our Agentic AI team as we scale... ...measurement. ~ Strong understanding of modern LLM systems, including model inference,...SeniorFull timeWork at officeRemote work
Air
Arlington, VA24 days ago - ...Capital One is seeking an AI Engineer 5 to join the Intelligent Foundations and Experiences team... ...VA. The role focuses on AI foundations, LLM customization, fine-tuning, and... ...-model orchestration. You will mentor senior engineers and collaborate across product,...Senior
- ...Capital One is seeking an AI Engineer to join the Intelligent Foundations and Experiences (IFX) team in McLean, VA. You will design, develop... ...AI software components including foundation model training, LLM inference, agents and multi-agent workflows, similarity search,...Senior
$286.2k - $326.7k
...Senior Staff AI Engineer (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For... ...Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails,...SeniorFull timePart timeLocal areaRemote workCapital One National Association
McLean, VA9 hours ago- ...Capital One is seeking an experienced AI Engineer 5 to advance AI foundations, LLM core and agentic AI capabilities. You will build scalable AI systems, optimize foundation models, and contribute to governance and roadmap across Capital One's AI platforms. The role...Senior
- ...Capital One is seeking a Sr. Manager, AI Engineer in McLean, VA to lead cross-functional teams building scalable AI-powered products. You will oversee foundation model work, LLM inference, vector databases, and model optimization to improve performance, cost, and latency...Senior
- ...Capital One is seeking an AI Engineer 5 to join the IFX team in McLean, VA. You will partner... ...role focuses on foundation model training, LLM inference, multi-agent workflows, and cost... ...governance, with opportunities to mentor senior engineers and shape the AI roadmap. #J-...Senior
$135.2k - $306.4k
...Ph.D. in Computer Science, AI/ML, Engineering, or a related discipline, or... ...production systems, or equivalent Senior Staff / Principal-level... ...require strong knowledge of LLM application patterns, including... ...model serving, inference gateways, agent runtimes, workflow engines...SeniorFull timeFlexible hoursOracle
Washington DC3 days ago- ...needs and what is delivered. Our AI-native platform, Air... ...We are seeking an experienced Senior AI Engineer specializing in AI security to... ...understanding of how modern LLM and agentic systems operate,... ...systems, vector stores, model gateways, or other components of modern...SeniorFull timeWork at officeRemote work
- ...architecture, design patterns, and engineering standards for how we build and deploy AI agents and ML systems... ...a track record as a senior individual contributor /... ...language models. Self-hosting open-weight models, fine... ...models) in addition to LLM systems Ontology /...Full time
Stellent IT LLC
Arlington, VA2 days ago - ID.me is hiring a Staff Software Development Engineer to lead the Tools Team in McLean, VA. You will champion AI-native engineering, architect production-grade solutions... ...in full-stack engineering, including hands-on LLM integration experience. This on-site role fosters...
- ...health, transportation, and citizen services. We’re a nonprofit engineering, applied research, and advanced technology organization working... ...and help shape the future.Department Summary:MITRE’s Multi-INT AI Engineering Department effectively combines the deep technical...SeniorWork experience placementInternshipLocal areaRemote work
Mitre
McLean, VA1 day ago $114.6k - $252.1k
Job Title: Senior AI EngineerJob Category: Information TechnologyTime Type: Full timeMinimum... ...CACI is seeking an accomplished Senior AI Engineer to support the Department of Homeland... ...and in our legacy.Pay Range: There are a host of factors that can influence final salary...SeniorContract workWork experience placementWork at officeFlexible hoursCACI International
Washington DC3 days ago$75 - $80 per hour
...pay range $75.00/hr - $80.00/hr Direct message the job poster from Matlen Silver Award Winning Senior Technical Recruiter at Matlen Silver Job Title: Senior AI/LLM Engineer Duration: 12+ Months Location: Washington, DC Required Pay Scale: $75-$80/hour W2 ***Due to client...Full time- ...health, transportation, and citizen services. We’re a nonprofit engineering, applied research, and advanced technology organization working... .... Roles & Responsibilities:This role focuses on applying AI/ML solutions to the field of embedded security. Engineers in this...SeniorWork experience placementInternshipLocal areaImmediate start3 days per week
Mitre
McLean, VA13 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Engineer: LLM Gateway & Hosting. Be the first to apply!
Related searches
- senior ai engineer McLean, VA
- ai developer McLean, VA
- ai prompt engineer McLean, VA
- ai engineer McLean, VA
- ai engineer remote McLean, VA
- senior manager customer operations McLean, VA
- senior java developer McLean, VA
- senior software engineer ruby on rails McLean, VA
- sr finance manager McLean, VA
- senior customer service McLean, VA