AI Infrastructure Engineer

$200k - $250k

thejosefgroup.com

AI Infrastructure Engineer
Top Secret or TS/SCI is required to start
$200K to $250K
Chantilly, VA
What You'll Do

Deploy and optimize self-hosted LLM inference servers (vLLM, Ollama, and similar).
Containerize AI workloads using Docker and orchestrate production environments with Kubernetes, including GPU scheduling.
Build and maintain AI serving infrastructure, including gateways, load balancing, authentication, TLS, and rate limiting.
Optimize GPU utilization, memory management, quantization, batching, and capacity planning to balance performance and cost.
Develop and maintain CI/CD pipelines, observability, monitoring, and incident response processes.

What You'll Bring (Required)

Hands-on experience deploying and serving Large Language Models (LLMs) in production.
Strong experience with Docker and production Kubernetes environments, including GPU scheduling.
Deep understanding of self-hosted AI infrastructure, including model formats, quantization, GPU memory management, batching, and inference optimization.
Experience supporting production applications with networking, reverse proxies, load balancing, authentication, and TLS.
Proficiency with Linux administration and Python and/or Bash scripting.
Ownership mindset with the ability to operate and improve production AI infrastructure.

Nice to Have

Experience with CUDA, NVIDIA drivers, GPU Operators, or other GPU infrastructure technologies.
Experience with Infrastructure as Code (Terraform, Helm).
Familiarity with observability and monitoring tools such as Prometheus and Grafana.
Experience building Retrieval-Augmented Generation (RAG) pipelines and working with vector databases (pgvector, Qdrant, Weaviate).
Experience with LLM gateway tools such as LiteLLM.

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in Chantilly, Loudoun County, VA vacancy

Senior AI Infrastructure Engineer
...Senior AI Infrastructure Engineer Austin, Texas, United States; Reston, Virginia, United States Seekr is building the infrastructure that powers the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate the...
Suggested
Work experience placement
Flexible hours
Seekr
Reston, VA
5 days ago
AI Platform Engineer
...About the job AI Platform Engineer AI Platform Engineer Company Overview Glint Tech Solutions is a women-owned global staffing and IT recruiting firm connecting top technical talent with leading enterprise clients across the United States. Project...
Suggested
Glint Tech Solutions LLC
Reston, VA
15 hours ago
Distinguished AI Engineer (Agentic AI Platform)
$269.1k - $307.2k
Distinguished AI Engineer (Agentic AI Platform) At Capital One, we are creating responsible and reliable AI systems, changing banking... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...
Suggested
Full time
Part time
Work at office
Local area
Capital One
McLean, VA
4 days ago
Sr. Lead AI Engineer (Gen AI Platform Services)
$229.9k - $262.4k
Sr. Lead AI Engineer (Gen AI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...
Suggested
Full time
Part time
Local area
Capital One
McLean, VA
6 days ago
Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI)
$229.9k - $262.4k
...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable... ...customer experiences. Our investments in technology infrastructure and world-class talent - along with our deep experience in machine...
Suggested
Full time
Part time
Local area
Capital One Financial Corp
McLean, VA
1 day ago
AI Solutions Engineer
$170k - $210k
...We are seeking an experienced AI Solutions Engineer with an active security clearance to join our team. The successful candidate will lead the development and implementation of an innovative AI application designed to enhance the facilities operation and maintenance preventive...
Hourly pay
Contract work
Local area
3 days per week
Amentum
Chantilly, Loudoun County, VA
2 days ago
Network Deployment Engineer
...MANTECH seeks a motivated, career and customer-oriented Network Deployment Engineer to join our team in Chantilly, VA . This is an onsite position. Responsibilities include but are not limited to: Coordinate and execute site deployments, including planning...
Full time
Work at office
MANTECH
Chantilly, Loudoun County, VA
4 days ago
AI Engineer
...AI Engineer AI Engineer Chantilly, VA Active TS/SCI with Polygraph Company Overview: Cornerstone Defense is the Employer of Choice within the Intelligence, Defense, and Space communities of the U.S. Government. Realizing early on that our most prized assets are our...
Cornerstone Defense
Chantilly, Loudoun County, VA
3 days ago
Senior AI Software Engineer
$131.3k - $237.35k
...Description The Leidos National Solutions team is seeking a Senior AI Software Engineer to lead advanced development efforts and collaborate closely with pipeline engineering and deployment teams. The FS2 Sea task order supports multiple operational, cloud-deployed...
Local area
Immediate start
Leidos
Chantilly, Loudoun County, VA
4 days ago
Knowledge Management Specialist
Job Summary Serves as a key contributor supporting the development, refinement, and publication of large-scale technical documentation. Responsible for producing clear, consistent, and structured content while collaborating with subject matter experts and stakeholders ...
Hirebridge
Chantilly, Loudoun County, VA
1 day ago
Data & AI Engineer
...surpasses the epitome of excellence. Our core services include systems engineering technical advice, technical support, and administrative... ...our organization works with data, internal systems, and emerging AI technologies. This role is intentionally broad and hands-on....
Full time
For contractors
Remote work
Sciolex Corporation
Chantilly, Loudoun County, VA
3 days ago
Senior AI Systems Engineer
$160k - $200k
...Description SAIC is seeking a Senior AI Systems Engineer to provide Systems Engineering and Technical Advisory (SETA) support to a... ...vendor data engineers and architects to ensure data pipelines, infrastructure, and compute environments are optimized for model...
Work at office
SAIC
Chantilly, Loudoun County, VA
3 days ago
AI/ML Engineer
...AI/ML Engineer LOCATION Chantilly, VA 20151 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are seeking a passionate and innovative AI/ML Engineer to join our team and drive cutting-edge solutions...
Temporary work
For contractors
Immediate start
Flexible hours
Cymertek
Chantilly, Loudoun County, VA
14 hours ago
AI / ML Engineer
$120.5k - $221.8k
...the hands-on development and support for integrating an Agentic AI system with existing data platforms. The role will focus on... ...Model Context Protocol Experience with agent frameworks, data engineering, vector databases, SQL engines, distributed systems, RAG Bachelors...
Live in
Work at office
Local area
Accenture
Chantilly, Loudoun County, VA
5 days ago
AI/ML Engineer
$55.2k - $126k
...Job Number: R0236420 AI/ML Engineer The Opportunity: As a programmer, you know that machine learning is critical to understanding and processing massive datasets. Your ability to conduct statistical analyses on business processes using ML techniques makes you...
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Chantilly, Loudoun County, VA
5 days ago
AI & ML Engineer
$99k - $225k
...Job Number: R0242901 AI & ML Engineer The Opportunity: As an experienced engineer, you know that machine learning is critical to understanding and processing massive datasets. Your ability to conduct statistical analyses on business processes using ML techniques...
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Chantilly, Loudoun County, VA
4 days ago
AI/ML Systems Engineer
$155k - $220k
...Our work includes enterprise architectural assessments, systems engineering and integration, test, planning and execution, cost estimating... ...part of our high-caliber team! SPA has a future need for a AI/ML Systems Engineer. Responsibilities The AI/ML Systems...
Full time
Work at office
Flexible hours
Systems Planning and Analysis, Inc
Chantilly, Loudoun County, VA
14 hours ago
AI/ML Systems Engineer
$100k - $195k
...Overview VTG is seeking an AI/ML Systems Engineer , located in Chantilly, Va . What will you do? The engineer sought here serves a USG Program Office leading Research & Development (R&D) of evolutionary, revolutionary, and transformational artificial intelligence...
Work experience placement
Work at office
VTG Defense
Chantilly, Loudoun County, VA
4 days ago
AI/ML Systems Engineer
$132.9k - $207.75k
...an experienced Artificial Intelligence/Machine Learning Systems Engineer to join our team of professionals providing technical and... ...Chantilly, VA. Responsibilities Include: Evaluation of advanced AI/ML concepts, systems, technologies, designs, architectures,...
Full time
Contract work
Part time
Work experience placement
Work at office
Local area
Remote work
Noblis
Chantilly, Loudoun County, VA
3 days ago
Cloud Architect
...career goals. We look forward to you joining our family. *** SIMILAR CAREER TITLES Cloud Engineer, Solutions Architect, Enterprise Architect, DevOps Architect, Infrastructure Architect, Cloud Consultant, Systems Architect, Network Architect, Platform Architect, Cloud...
Temporary work
For contractors
Immediate start
Flexible hours
Cymertek
Chantilly, Loudoun County, VA
15 hours ago
Senior Cloud Software Engineer
$250k - $260k
...Senior Software Engineer (Python / AWS / Terraform) Location: Onsite - Chantilly, VA Clearance: TS/SCI and Poly Required... ...an experienced engineer who thrives in hands-on development, infrastructure automation, and modern AWS-based architectures. You will work...
thejosefgroup.com
Chantilly, Loudoun County, VA
2 days ago
Cloud Infrastructure Engineer
$86.8k - $198k
...Job Number: R0240283 Cloud Infrastructure Engineer The Opportunity: Everyone is trying to "harness the cloud," but not everyone knows how... ...to verify your identity and prevent fraud. Candidate AI Usage Policy AI is a part of our daily work at Booz Allen...
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Chantilly, Loudoun County, VA
5 days ago
Senior Cloud Engineer
...Senior Cloud Engineer Are you looking for an opportunity to make a difference in the government space? What if you could find a... ..., and related utilities and hardware that comprise the cloud infrastructure. They conduct analysis and make reliable engineering recommendations...
Work experience placement
Local area
Solvarus
Chantilly, Loudoun County, VA
15 hours ago
Cloud Solutions Engineering
...Cloud Engineer LOCATION Chantilly, VA 20151 CLEARANCE TS/SCI Full Poly (... ...DevOps Engineer, Site Reliability Engineer, Infrastructure Engineer, Systems Engineer, Cloud... ...emerging cloud trends Familiarity with AI/ML integrations Advanced data storage...
Temporary work
For contractors
Immediate start
Flexible hours
Cymertek
Chantilly, Loudoun County, VA
15 hours ago
Physical AI Engineering Consultant - Senior - Consulting - Open Location
$106.2k - $194.6k
...-paced environment and the opportunity to develop your own career path for your unique skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront of revolutionizing how businesses leverage artificial intelligence. Your role will involve researching...
Full time
Work experience placement
Summer holiday
Flexible hours
EY
Chantilly, Loudoun County, VA
3 days ago
Senior Cloud Engineer
...seeks a motivated, career and customer-oriented Senior Cloud Engineer to join our team in Chantilly, VA . The Senior Cloud... ...to include designing, implementing, and managing secure cloud infrastructures, responding to security monitoring requirements, and completing...
Work at office
Local area
ManTech
Chantilly, Loudoun County, VA
2 days ago
Cloud Developer
$80k - $120k
...This role is expected to be onsite in Chantilly,VA the majority of the time. Responsibilities: Design and deploy cloud infrastructure using AWS CDK and SDK. Work extensively with AWS services, including Gateway, Lambda, Step Functions, S3, RDS Postgres,...
Local area
Strategic Business Systems
Chantilly, Loudoun County, VA
3 days ago
Cloud and Storage Engineer
...Cloud and Storage Engineer Employment Type: Full-Time, Experienced CGS is seeking a Cloud and Storage Engineer to develop and... ...Storage Area Network (SAN) architecture for a large EMC-based SAN infrastructure in support of a large federal agency. The ideal candidate...
Full time
Work experience placement
Flexible hours
Contact Government Services LLC
Chantilly, Loudoun County, VA
2 days ago
Cloud Engineer
...Job Title: Cloud Engineer Department: Operations/Services Reports To: RSekure Program Manager Location: Chantilly, VA Schedule: Monday - Friday Hours: Full-time, 40-hours/week Clearance Req: TS/SCI - Full-Scope Polygraph FLSA Status: Salaried...
Full time
Work experience placement
Work at office
Monday to Friday
RSEKURE
Chantilly, Loudoun County, VA
14 hours ago
Cloud Engineer
$50k - $290k
...Reston, VA. Our capabilities include Software Development, Engineering & IT, Data Science, Cyber Enablement, Logistics, and Training... ...cycles; automate processes where applicable. Manage AWS infrastructure including S3 buckets, EC2 instances, subnets, auto-scaling groups...
Contract work
Work experience placement
The Swift Group
Chantilly, Loudoun County, VA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!