AI Infrastructure Engineer

$200k - $250k

thejosefgroup.com

AI Infrastructure Engineer
Top Secret or TS/SCI is required to start
$200K to $250K
Chantilly, VA
What You'll Do

Deploy and optimize self-hosted LLM inference servers (vLLM, Ollama, and similar).
Containerize AI workloads using Docker and orchestrate production environments with Kubernetes, including GPU scheduling.
Build and maintain AI serving infrastructure, including gateways, load balancing, authentication, TLS, and rate limiting.
Optimize GPU utilization, memory management, quantization, batching, and capacity planning to balance performance and cost.
Develop and maintain CI/CD pipelines, observability, monitoring, and incident response processes.

What You'll Bring (Required)

Hands-on experience deploying and serving Large Language Models (LLMs) in production.
Strong experience with Docker and production Kubernetes environments, including GPU scheduling.
Deep understanding of self-hosted AI infrastructure, including model formats, quantization, GPU memory management, batching, and inference optimization.
Experience supporting production applications with networking, reverse proxies, load balancing, authentication, and TLS.
Proficiency with Linux administration and Python and/or Bash scripting.
Ownership mindset with the ability to operate and improve production AI infrastructure.

Nice to Have

Experience with CUDA, NVIDIA drivers, GPU Operators, or other GPU infrastructure technologies.
Experience with Infrastructure as Code (Terraform, Helm).
Familiarity with observability and monitoring tools such as Prometheus and Grafana.
Experience building Retrieval-Augmented Generation (RAG) pipelines and working with vector databases (pgvector, Qdrant, Weaviate).
Experience with LLM gateway tools such as LiteLLM.

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in Chantilly, Loudoun County, VA vacancy

Enterprise Cybersecurity AI Infrastructure Engineer
$77.6k - $176k
Enterprise Cybersecurity AI Infrastructure EngineerThe Opportunity: Are you technically inclined, intellectually curious, and adaptable, with... ...mission needs change? As a Cybersecurity AI Infrastructure Engineer, you will operate as a hands-on technical contributor...
Suggested
Full time
Contract work
Part time
Local area
Remote work
Booz Allen Hamilton
McLean, VA
3 days ago
Vectra AI Cloud-Native Engineer
$99k - $225k
Vectra AI Cloud-Native EngineerThe Opportunity:We are seeking a Vectra AI Cloud‑Native Engineer to design, integrate, and optimize Vectra AI Detect and Recall and support... ...microservices, distributed systems, event streaming, infrastructure‑as‑code, and high‑availability security...
Suggested
Full time
Contract work
Part time
Local area
Remote work
Booz Allen Hamilton
Reston, VA
5 days ago
Azure Ops/AI Engineer (US Remote)
$108.48k - $184.41k
The WorkICF is seeking an Azure Operations/AI Engineer to support enterprise AI capabilities in a secure federal cloud environment.... ...operational and engineering support for AI services, related Azure infrastructure, and the DevSecOps practices that move AI capabilities into...
Suggested
Full time
Contract work
Work experience placement
Work at office
Remote work
ICF
Reston, VA
3 days ago
Lead AI Enablement Engineer - Software Delivery Lifecycle & Developer Platform
$121.56k
...with Enterprise Architecture and Security teams to define the AI architecture supporting the software development lifecycle, aligned... ...coding, testing, security, release management, and operations.Engineering & DeliveryBuild production-grade integrations and proof-of-...
Suggested
Overseas
SWIFT
Manassas, VA
3 days ago
AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluations)
$229.9k - $262.4k
AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluations) At Capital One, we are creating responsible and reliable... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...
Suggested
Full time
Part time
Local area
Capital One
McLean, VA
2 days ago
AI Engineer 5 (GenAI Platform, Agentic Infrastructure)
$229.9k - $262.4k
AI Engineer 5 (GenAI Platform, Agentic Infrastructure) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer...
Full time
Part time
Local area
Capital One
McLean, VA
2 days ago
AI Platform Engineer
...About the job AI Platform Engineer AI Platform Engineer Company Overview Glint Tech Solutions is a women-owned global staffing and IT recruiting firm connecting top technical talent with leading enterprise clients across the United States. Project...
Glint Tech Solutions LLC
Reston, VA
2 days ago
Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)
$229.9k - $262.4k
Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible... ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in...
Full time
Part time
Local area
Capital One
McLean, VA
2 days ago
Senior AI Engineer - Generative AI / RAG
...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team.Job Title: Senior AI Engineer - Generative AI / RAG Job Location: Chantilly, VAJob Summary We are seeking a Senior AI Engineer with strong expertise in...
Ampcus
Chantilly, Loudoun County, VA
4 days ago
Senior Cleared Intel AI Engineer
...health, transportation, and citizen services. We’re a nonprofit engineering, applied research, and advanced technology organization working... ...and help shape the future.Department Summary:MITRE’s Multi-INT AI Engineering Department effectively combines the deep technical...
Work experience placement
Internship
Local area
Remote work
Mitre
Chantilly, Loudoun County, VA
2 days ago
AI Developer and Engineer
$99k - $225k
AI Developer and EngineerThe Opportunity:Are you ready to build the infrastructure and systems that power next-generation artificial intelligence? Rapid advances in large... ...At Booz Allen, you can apply your systems engineering, infrastructure design, and full-stack development...
Full time
Contract work
Part time
Local area
Remote work
Booz Allen Hamilton
Chantilly, Loudoun County, VA
3 days ago
AI Engineer
DescriptionSAIC is seeking a AI/ Artificial intelligence Engineer Subject Matter Expert to provide SETA support to SAIC’s Program, Landmark in Chantilly, VA. Landmark is a large SETA program, supporting the NRO’s Ground Enterprise Directorate (GED), responsible for the...
Science Applications International Corporation
Chantilly, Loudoun County, VA
5 days ago
Cyber - AI Cloud Security Engineer - Manager
$134.5k - $265.1k
Position Summary Deloitte is seeking an AI Cloud Security Engineer, Manager to lead the design, implementation, and security of artificial... ..., containers, serverless workloads, Kubernetes, and infrastructure-as-code controlsDirecting AI-assisted vulnerability and threat...
Work experience placement
Local area
Visa sponsorship
Deloitte
McLean, VA
4 days ago
Cyber - AI Cloud Security Engineer - Senior Consultant
$105.4k - $207.8k
Position Summary Deloitte is seeking an AI Cloud Security Engineer, Senior Consultant to design, build, and secure next-generation AI-... ...protection, containers, serverless workloads, Kubernetes, and infrastructure-as-code controlsBuilding AI-assisted capabilities to...
Work experience placement
Local area
Visa sponsorship
Deloitte
McLean, VA
4 days ago
AI Solutions Engineer
$166.4k - $249.6k
...Aerospace’s digital transformation. The Digital Innovation Division is seeking Senior Project Engineers to serve as technical project leads for initiatives within the corporate AI portfolio, reporting to the Director, AI Systems and Delivery. Each lead owns one initiative...
Full time
Work experience placement
Immediate start
Remote work
Relocation package
Flexible hours
The Aerospace Corporation
Chantilly, Loudoun County, VA
3 days ago
AI Cyber Engineer
...candidate to join our talented Team.Job Title: AI Cyber EngineerLocation(s): Chantilly, VAJob Summary:The AI Cyber Engineer is a senior technical role responsible for... ...:Continuously Client vulnerabilities across infrastructure, applications, and AI systems.Generate...
Shift work
Ampcus
Chantilly, Loudoun County, VA
5 days ago
Lead Cloud Data & AI Engineer / Solutions Architect (Google Cloud Platform)
...Role Title: Lead Cloud Data & AI Engineer / Solutions Architect (Google Cloud Platform) Location - Reston, VA (Onsite) We are currently seeking Senior Cloud Data & AI Engineers to support customer engagements within our Google Public Sector (GPS) Professional Services...
Talent Vista Partners Inc
Reston, VA
4 days ago
AI Software Engineer
$120k - $160k
...AI Software Engineer Chantilly/Herndon, VA Dark Wolf constructs and deploys data management and analytics solutions for the defense and intelligence communities. We're proud to boast a world-class engineering team that thrives on rolling up their sleeves to solve...
Full time
For contractors
Shift work
Dark Wolf Solutions
Chantilly, Loudoun County, VA
5 days ago
AI/ML Engineer
...capabilities include data science, software development, network engineering, intelligence, surveillance, and reconnaissance (ISR), and... ...Artificial Intelligence/Machine Learning (Al/ML) Engineer. The AI/ML Engineer shall design, develop, test, evaluate, and deploy Al...
Contract work
Work at office
SOSi
Chantilly, Loudoun County, VA
5 days ago
AI/ML Engineer
$150k - $190k
...Our work includes enterprise architectural assessments, systems engineering and integration, test, planning and execution, cost estimating... ...part of our high-caliber team!SPA has an immediate need for an AI/ML Engineer. Responsibilities SPA is looking for a AI/ML...
Full time
Work at office
Immediate start
Flexible hours
MCR
Chantilly, Loudoun County, VA
2 days ago
AI/ML Engineer (Senior)
...capabilities include data science, software development, network engineering, intelligence, surveillance, and reconnaissance (ISR), and... ...Description*Position is contingent upon contract award*SOSi is seeking a AI/ML Engineer to support our government customer in Chantilly, VA...
Contract work
Work at office
SOSi
Chantilly, Loudoun County, VA
5 days ago
AI/ML Engineer (Expert)
...capabilities include data science, software development, network engineering, intelligence, surveillance, and reconnaissance (ISR), and... ...*Position is contingent upon contract award*SOSi is seeking an AI/ML Engineer to support our government customer in Chantilly, VA...
Contract work
Work at office
SOSi
Chantilly, Loudoun County, VA
5 days ago
AI-Enabled Solutions Developer (Cloud Engineer 3)- 30464
$100.17k - $145k
...DescriptionHII Mission Technologies seeks an innovative remote AI-Enabled Solutions Developer to join our enterprise Program Management... ...; artificial intelligence, machine learning (AI/ML) experts; engineers; technologists; scientists; logistics experts; and business...
Full time
Contract work
Work experience placement
Work at office
Local area
Remote work
Worldwide
HII Mission Technologies Division
Fairfax, VA
3 days ago
AI Systems Engineer
$200k - $240k
...Description SAIC has 2 immediate openings on a newly awarded contract for Artificial Intelligence (AI) experts to perform in a Systems Engineering and Technical Assistant (SETA) role and support operational, engineering, and research related activities. Successful candidates...
Contract work
Immediate start
SAIC
Chantilly, Loudoun County, VA
3 days ago
Senior AI Systems Engineer
$160k - $200k
...Description SAIC is seeking a Senior AI Systems Engineer to provide Systems Engineering and Technical Advisory (SETA) support to a... ...vendor data engineers and architects to ensure data pipelines, infrastructure, and compute environments are optimized for model...
Work at office
SAIC
Chantilly, Loudoun County, VA
4 days ago
AI/ML Engineer
...AI/ML Engineer LOCATION Chantilly, VA 20151 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are seeking a passionate and innovative AI/ML Engineer to join our team and drive cutting-edge solutions...
Temporary work
For contractors
Immediate start
Flexible hours
Cymertek
Chantilly, Loudoun County, VA
2 days ago
AI / ML Engineer
$120.5k - $221.8k
...the hands-on development and support for integrating an Agentic AI system with existing data platforms. The role will focus on... ...Model Context Protocol Experience with agent frameworks, data engineering, vector databases, SQL engines, distributed systems, RAG Bachelors...
Live in
Work at office
Local area
Accenture
Chantilly, Loudoun County, VA
14 hours ago
AI and ML Engineer
$55.2k - $126k
...Job Number: R0250044 AI and ML Engineer The Opportunity: As a programmer, you know that machine learning (ML) is critical to understanding and processing massive datasets. Your ability to conduct statistical analyses on business processes using ML techniques makes...
Full time
Contract work
Part time
Local area
Remote work
Booz Allen Hamilton
Chantilly, Loudoun County, VA
2 days ago
AI/ML Engineer
...Position Title: AI/ML Engineer Position Type: Full-time, On-site Location : Chantilly, VA Clearance: Active TS/SCI w/CI Poly Waypoint's client is seeking an AI/ML Engineer to support advanced modeling and simulation efforts for government satellite programs...
Full time
Flexible hours
Waypoint Human Capital
Chantilly, Loudoun County, VA
14 hours ago
AI/ML Engineer, Senior
$160.8k - $251.33k
Responsibilities Noblis is seeking an experienced AI/ML Engineer to support mission-critical national security initiatives. In... ...deploy advanced machine learning solutions while building the infrastructure required to operationalize AI capabilities in secure,...
Full time
Contract work
Part time
Local area
Remote work
Noblis
Chantilly, Loudoun County, VA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!