AI Infrastructure Engineer
$200k - $250kthejosefgroup.com
AI Infrastructure Engineer
Top Secret or TS/SCI is required to start
$200K to $250K
Chantilly, VA
What You'll Do
Top Secret or TS/SCI is required to start
$200K to $250K
Chantilly, VA
What You'll Do
- Deploy and optimize self-hosted LLM inference servers (vLLM, Ollama, and similar).
- Containerize AI workloads using Docker and orchestrate production environments with Kubernetes, including GPU scheduling.
- Build and maintain AI serving infrastructure, including gateways, load balancing, authentication, TLS, and rate limiting.
- Optimize GPU utilization, memory management, quantization, batching, and capacity planning to balance performance and cost.
- Develop and maintain CI/CD pipelines, observability, monitoring, and incident response processes.
- Hands-on experience deploying and serving Large Language Models (LLMs) in production.
- Strong experience with Docker and production Kubernetes environments, including GPU scheduling.
- Deep understanding of self-hosted AI infrastructure, including model formats, quantization, GPU memory management, batching, and inference optimization.
- Experience supporting production applications with networking, reverse proxies, load balancing, authentication, and TLS.
- Proficiency with Linux administration and Python and/or Bash scripting.
- Ownership mindset with the ability to operate and improve production AI infrastructure.
- Experience with CUDA, NVIDIA drivers, GPU Operators, or other GPU infrastructure technologies.
- Experience with Infrastructure as Code (Terraform, Helm).
- Familiarity with observability and monitoring tools such as Prometheus and Grafana.
- Experience building Retrieval-Augmented Generation (RAG) pipelines and working with vector databases (pgvector, Qdrant, Weaviate).
- Experience with LLM gateway tools such as LiteLLM.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in Chantilly, Loudoun County, VA vacancy
$86.8k - $198k
AWS AI Cloud EngineerThe Opportunity: As an AWS AI Cloud Engineer, you can resolve a problem with a complete end-to-end GenAI solution in a fast, agile environment. If you’re looking for the chance to not just develop software, but to create a system that will make a difference...SuggestedFull timeContract workPart timeWork at officeLocal areaRemote work$86.8k - $198k
...Job Number: R0243693 AWS AI Cloud Engineer The Opportunity: As an AWS AI Cloud Engineer, you can resolve a problem with a complete end-to-end GenAI solution in a fast, agile environment. If you're looking for the chance to not just develop software, but to create...SuggestedFull timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Chantilly, Loudoun County, VA23 hours ago$100k - $150k
...AI Infrastructure Engineer-Remote Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well...SuggestedFull timeH1bLocal areaRemote workVisa sponsorshipBright Vision Technologies
Reston, VA4 days ago- ...Senior AI Infrastructure Engineer Austin, Texas, United States; Reston, Virginia, United States Seekr is building the infrastructure that powers the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate the...SuggestedPermanent employmentWork experience placementFlexible hours
Seekr
Reston, VA13 hours ago $121.56k
...with Enterprise Architecture and Security teams to define the AI architecture supporting the software development lifecycle, aligned... ...coding, testing, security, release management, and operations.Engineering & DeliveryBuild production-grade integrations and proof-of-...SuggestedOverseas$269.1k - $307.2k
...Distinguished AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...Full timePart timeWork at officeRemote workCapital One
McLean, VA13 hours ago$229.9k - $262.4k
...Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI... ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in...Full timePart timeLocal areaCapital One
McLean, VA1 day ago$229.9k - $262.4k
...Senior Lead AI Engineer (Gen AI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...Full timePart timeLocal areaCapital One
McLean, VA1 day ago- ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team.Job Title: Senior AI Engineer - Generative AI / RAG Job Location: Chantilly, VAJob Summary We are seeking a Senior AI Engineer with strong expertise in...
- DescriptionSAIC is seeking a AI/ Artificial intelligence Engineer Subject Matter Expert to provide SETA support to SAIC’s Program, Landmark in Chantilly, VA. Landmark is a large SETA program, supporting the NRO’s Ground Enterprise Directorate (GED), responsible for the...
$125k - $185k
...Job Description Job Description AI Platform Engineer Location: McLean, VA (Onsite 5 Days per Week) Employment Type: Full-Time... ...role in building, maintaining, securing, and optimizing the infrastructure that supports advanced Artificial Intelligence (AI) workloads...Full timeTemporary workImmediate startPGTEK
McLean, VA2 days ago- ...Red Arch Solutions is seeking a senior AI/ML Data Engineer to design and lead enterprise-scale data platforms powering vector search, RAG... ..., and cybersecurity teams to deliver secure, scalable AI infrastructure and guide leadership on operational impact and risks associated...
$197.3k - $225.1k
...Lead AI/ML Engineer (Platform, kubeflow) Overview At Capital One, we are creating responsible and reliable AI systems, changing... ...personalized customer experiences. Our investments in technology infrastructure and world-class talent - along with our deep experience in...Full timePart timeLocal areaCapital One
McLean, VA2 days ago$197.3k - $225.1k
...Overview Lead AI Engineer (GenAI Platform, AI Foundations, LLM Core and Agentic AI) Overview Lead AI Engineer At Capital... ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in...Full timePart timeLocal areaCapital One
McLean, VAmore than 2 months ago$170k - $210k
...We are seeking an experienced AI Solutions Engineer with a high-level active security clearance to join our team in Chantilly, Virginia. The successful candidate will lead the development and implementation of an innovative AI application designed to enhance the facility...Hourly payContract workLocal area3 days per weekAmentum
Chantilly, Loudoun County, VA3 days ago- ...candidate to join our talented Team.Job Title: AI Cyber EngineerLocation(s): Chantilly, VAJob Summary:The AI Cyber Engineer is a senior technical role responsible for... ...:Continuously Client vulnerabilities across infrastructure, applications, and AI systems.Generate...Shift work
- ...MANTECH seeks a motivated, career and customer-oriented Network Deployment Engineer to join our team in Chantilly, VA . This is an onsite position. Responsibilities include but are not limited to: Coordinate and execute site deployments, including planning...Work at office
MANTECH
Chantilly, Loudoun County, VA-36 - ...and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: AI / ML Solutions Engineer Location: Chantilly, VA Education and Training:Bachelor's degree in Computer Science, Software Engineering, or...
- ...partnership. If this sounds like the choice you want to make, then choose MITRE - and make a difference with us.MITRE’s Multi-INT AI Engineering Department effectively combines the deep technical knowledge required to develop capabilities with critical domain knowledge to...Work experience placementInternshipLocal areaRemote work
- ...helping them shape their hybrid cloud and AI journeys. With support from our... ...responsibilities As an AI Forward Deployed Engineer, you will work with customers to understand... ...with customer data sources, APIs, and infrastructure, and deploy these solutions into real operational...Worldwide
IBM
Chantilly, Loudoun County, VA3 days ago $99k - $225k
AI/ML EngineerThe Opportunity:Data scientists and intelligence analysts rely on multi‑step workflows that are time‑sensitive, detail‑rich, and critical to national security. As an AI/ML Engineer, you will work directly with mission users to capture these workflows, document...Full timeContract workPart timeWork at officeLocal areaRemote work$130k - $170k
...Senior AI Software Engineer Dark Wolf constructs and deploys data management and analytics solutions for the defense and intelligence communities. We're proud to boast a world-class engineering team that thrives on rolling up their sleeves to solve your mission's biggest...Full timeFor contractorsDark Wolf Solutions
Chantilly, Loudoun County, VA4 days ago$99k - $225k
AI & ML EngineerThe Opportunity: As an experienced engineer, you know that machine learning is critical to understanding and processing massive datasets. Your ability to conduct statistical analyses on business processes using ML techniques makes you an integral part of...Full timeContract workPart timeWork at officeLocal areaRemote work- ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: AI Engineer (GenAI & Agentic Systems). Location: Chantilly, VA. Job Description:The AI Engineer (GenAI & Agentic Systems) designs,...
$99k - $225k
Computer Vision AI EngineerThe Opportunity: Booz Allen is seeking an innovative and experienced AI Developer specializing in Computer... ...your expertise in AI, data science, and machine learning (ML) engineering to train, test, deploy, and maintain models that learn from...Full timeContract workPart timeWork at officeLocal areaRemote work- ...We are in search of a highly motivated candidate to join our talented Team.Job Title: AI Coding Tools EngineerJob Location: Chantilly, VA.Job Description.The AI Coding Tools Engineer (GenAI & Agentic Systems) evaluates, pilots, operationalizes, maintains, and scales adoption...Work at office
- ...using your expertise to protect our country from threats. Job Description Transform technology into opportunity as an AI Software Engineer (SME) with GDIT. We are seeking a hands-on software engineer with expertise in designing, developing, and sustaining cloud‑...For contractorsWork experience placement
General Dynamics Information Technology
Chantilly, Loudoun County, VA14 days ago - ...seeks a motivated, career and customer-oriented Senior Cloud Engineer to join our team in Chantilly, VA . The Senior Cloud... ...knowledge to design, implement, and manage secure multi-cloud infrastructures across AWS, Azure, Google Cloud Platform (GCP), and Oracle Cloud...Work at office
MANTECH
Chantilly, Loudoun County, VA-36 $120k - $160k
...and intelligence communities. We're proud to boast a world-class engineering team that thrives on rolling up their sleeves to solve your... ...challenges. Dark Wolf is seeking a highly skilled Senior AI Engineer to architect, build, and deploy advanced, secure AI-driven...Full timeFor contractorsShift workDark Wolf Solutions
Chantilly, Loudoun County, VA2 days ago- ...impact by using your expertise to protect our country from threats. Job Description Role Overview We are seeking a senior AI Engineer to lead the design, development, and secure integration of AI and machine learning capabilities into mission systems operating on...
General Dynamics Information Technology
Chantilly, Loudoun County, VA14 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!
Related searches
- ai developer Chantilly, Loudoun County, VA
- ai engineer Chantilly, Loudoun County, VA
- senior infrastructure engineer Chantilly, Loudoun County, VA
- remote infrastructure engineer Chantilly, Loudoun County, VA
- infrastructure developer Chantilly, Loudoun County, VA
- infrastructure engineer Chantilly, Loudoun County, VA
- gen ai developer
- entry level ai ml engineer
- ai engineer contract
- azure ai engineer