Senior AI Engineer: LLM Gateway & Hosting
Capital One National Association
Capital One is seeking an AI Engineer 5 to advance foundational AI systems within the IFX group in McLean, VA. You will design, implement, and optimize AI components including model training, inference, and orchestration, partnering with engineers, researchers, and PMs to deliver production-ready AI products. You will work with Open Source and SaaS tools like AWS, HuggingFace, VectorDBs, and PyTorch, applying state-of-the-art techniques to improve latency, cost, and throughput at scale. #J-18808-Ljbffr Capital One National Association
$229.9k - $262.4k
AI Engineer 5 (FM Hosting, LLM Inference) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences...SuggestedFull timePart timeLocal area$229.9k - $262.4k
AI Engineer 5 (FM Hosting, LLM Inference) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences...SuggestedFull timePart timeLocal area- ...Capital One invites applications for an AI Engineer 5 focused on AI Foundations and VLM customization. This role partners with cross‑functional... ...deploy AI software components, including foundation models, LLM inference, and multi‑model workflows. The ideal candidate...Senior
$112.8k - $257k
AI Gateway Security Engineer, LeadThe Opportunity:Designs, deploys, integrates, and maintains enterprise AI gateway capabilities across complex, multi... ..., and machine-to-machine authentication supporting LLM inference and agent-based architectures. Works without considerable...SuggestedFull timeContract workPart timeWork at officeLocal areaRemote work$110.7k - $372.9k
Position Summary Senior Agentic AI Engineer — Healthcare AI Three hundred fifty million Americans... ...design, build, and operationalize the LLM- and SLM-powered systems behind real... ...Google, OpenAI) and/or open-weight/self-hosted models (e.g., Llama via vLLM),...SeniorLocal areaVisa sponsorship$145k - $205k
...poly level. We are seeking a Senior AI/ML Software Engineer to integrate secure chatbot... ...skills, practical LLM experience, and an understanding... ...orchestration frameworks, model gateways, MCP-compatible services,... ..., open-source, or locally hosted LLMs in cloud, on-premises,...SeniorFull time- Capital One is seeking an AI Engineer 4 to advance AI foundations, customization, finetuning, reinforcement learning, and responsible AI at scale. You will partner with engineers, researchers, product managers to deliver AI-powered products that transform how associates...Senior
$160k - $200k
...'s latest suite of enterprise AI tools and services. This Jobot Job is hosted by: Charles Simmons Are you a... ...platform works. We’re looking for a senior machine learning engineer to take the lead on this... ...scoped and kicked off our first LLM fine-tuning cycle We’re...SeniorLocal areaRemote work- ...needs and what is delivered. Our AI-native platform, Air... ...We are seeking an experienced Senior AI Engineer specializing in AI security to... ...understanding of how modern LLM and agentic systems operate,... ...systems, vector stores, model gateways, or other components of modern...SeniorFull timeWork at officeRemote work
$286.2k - $326.7k
...responsible and reliable AI systems, changing... ...class applied science and engineering teams to deliver our industry... ...coach and evangelize - hosting architecture office... ...Staff, Principal and Senior engineers, authoring technical... ...or technologies (e.g. LLM Inference, Similarity...SeniorRemote jobFull timePart timeWork at officeLocal area- ...Job Title : Senior AI Engineer - Subject Matter Expert III Location: Tysons Corner, VA (Remote) Employment Type: Full-Time Job Summary... ...Qualifications Experience with Generative AI and LLM-based solutions Familiarity with MLOps and model deployment...SeniorFull timeRemote work
- ...and citizen services. We’re a nonprofit engineering, applied research, and advanced technology... ...purpose — and help shape the future.Our AI-enhanced Discovery and Decisions department... ...technical areas: large language models (LLM), generative and agentic AI, decision science...SeniorInternshipLocal areaImmediate start3 days per week
$122k - $240.5k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving... .../agentic applications); OpenAI Service (LLM integration for reasoning, planning, and... ...From entry-level employees to senior leaders, we believe there’s always room...SeniorLocal areaVisa sponsorship- ...integrate, deploy, and operate the AWS-hosted chatbot and orchestration... ...years of experience in MLOps, cloud engineering, platform engineering, DevSecOps, or production AI application development. ~... ...Amazon Bedrock and/or SageMaker, API Gateway, ECS or EKS, ECR, S3, IAM,...SeniorFull time
- ...At Rohirrim, we're building the AI that powers how the government buys - from billion-... ...looking for a talented, self-driven Agentic AI Engineer to join our core engineering team and help... ...government acquisition artifacts. LLM Integration & Evaluation Select and integrate...SeniorWork at office3 days per week
$150k - $190k
...team where innovation meets mission. Our AI, cloud, cyber, and modernization... ...an immediate need for a highly skilled Senior Google AI Engineer. We are growing our Google Cloud AI engineering... ...Store, Model Monitoring) andGemini/LLM services—optimized for performance, cost...SeniorTemporary workImmediate startWorldwide- ...Capital One is seeking an AI Engineer 5 to join the Intelligent Foundations and Experiences team... ...VA. The role focuses on AI foundations, LLM customization, fine-tuning, and... ...-model orchestration. You will mentor senior engineers and collaborate across product,...Senior
$220k - $300k
...Senior Applied AI Engineer $220,000 - $300,000 Base Salary + Equity A high-growth, venture-backed software company is hiring a Senior Applied... ...in AI, machine learning, agent frameworks, and LLM technologies Highlights Production AI & Agent Development...Senior- ...Capital One is seeking an AI Engineer in a role that delivers AI-powered products in collaboration with engineers, scientists, and product... ...and support AI software components, including foundation models, LLM inference, and guardrails, while ensuring governance and...Senior
$146k - $234k
ResponsibilitiesThe Senior AI Platform Engineer will stand up and operate a bare-metal container platform, support a feasibility assessment of all... ...understanding of agentic platform modeling/hosting/servicesPreferred Qualifications:Excellent verbal and written...SeniorContract workRemote workFlexible hoursShift work- ...Capital One is seeking an AI Engineer 5 to advance AI foundations, LLM core and agentic AI across banking applications. You will collaborate with engineers... ...while guiding technical direction and mentoring senior engineers. A strong AI/ML background and hands-on cloud...Senior
- Capital One is seeking an experienced AI Engineer 5 to advance AI foundations, LLM core and agentic AI capabilities. You will build scalable AI systems, optimize foundation models, and contribute to governance and roadmap across Capital One's AI platforms. The role requires...Senior
- ...front line needs and what is delivered. Our AI-native platform, Air Enterprise... ...Description We are seeking an experienced Senior AI Engineer to join our Agentic AI team as we scale... ...measurement. ~ Strong understanding of modern LLM systems, including model inference,...SeniorFull timeWork at officeRemote work
$150k - $190k
...Computer Science, Data Science, Engineering, Mathematics, or a related... ...A masters degree or PhD in AI/ML, Data Science, Computer Science... ...Vertex AI and Gemini or other LLM services, optimizing performance... ...More: We are hiring a Senior Google AI Engineer to expand our...SeniorFull time- ...Job Description Job Title : Senior AI Engineer - Subject Matter Expert III \n Location: Tysons Corner, VA (Remote) \n Employment Type... ...Qualifications \n \n Experience with Generative AI and LLM-based solutions \n Familiarity with MLOps and model...SeniorFull timeRemote work
$128.4k - $192.5k
...Government and Infrastructure - Technology Consulting - AI & Data - AI Automation Engineer - Senior ConsultantFrom strategy to execution, Government and... ...batch and legacy runtimes).· Develop static-analysis and LLM-assisted extraction to identify application components,...SeniorFor contractorsSummer holidayWork at officeLocal areaImmediate startFlexible hours- ...defense technology company, is seeking an AI-Native Software Engineer to be part of our Warfare Systems team... ...You Will Do:Use generative AI tools (LLM copilots, autonomous coding agents, AI... ...deploying or operating self-hosted LLMs in secure environmentsProficiency...Full timeWork at officeImmediate start
- ...IDT), a leading defense technology company, is seeking an AI Implementation Engineer to be part of our Warfare Systems team and based out of... ...experience with commercially available AI tooling/chat, hosting LLM servers and has demonstrated ability to build end-to-end...Full timeWork at officeLocal areaImmediate startShift work
$229.9k - $262.4k
...Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems... ..., and more. Invent and introduce state-of-the-art LLM optimization techniques to improve the performance ? scalability...SeniorFull timePart timeLocal area- Pyramid Systems, Inc. seeks a Senior Principal Full Stack AI Engineer to lead design, development, and delivery of large-scale AI systems on a modern cloud stack (Next.js, Terraform, GitHub, AWS, Azure, GCP). You will own enterprise architecture, governance, and innovation...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Engineer: LLM Gateway & Hosting. Be the first to apply!
- senior ai engineer Mc Lean, VA
- ai developer Mc Lean, VA
- ai engineer Mc Lean, VA
- senior safety specialist Mc Lean, VA
- senior service designer Mc Lean, VA
- senior sales recruiter Mc Lean, VA
- senior mulesoft developer Mc Lean, VA
- senior java software engineer Mc Lean, VA
- senior business manager Mc Lean, VA
- senior mainframe developer Mc Lean, VA







