AI Infrastructure Engineer
$200k - $250kthejosefgroup.com
AI Infrastructure Engineer
Top Secret or TS/SCI is required to start
$200K to $250K
Chantilly, VA
What You'll Do
Top Secret or TS/SCI is required to start
$200K to $250K
Chantilly, VA
What You'll Do
- Deploy and optimize self-hosted LLM inference servers (vLLM, Ollama, and similar).
- Containerize AI workloads using Docker and orchestrate production environments with Kubernetes, including GPU scheduling.
- Build and maintain AI serving infrastructure, including gateways, load balancing, authentication, TLS, and rate limiting.
- Optimize GPU utilization, memory management, quantization, batching, and capacity planning to balance performance and cost.
- Develop and maintain CI/CD pipelines, observability, monitoring, and incident response processes.
- Hands-on experience deploying and serving Large Language Models (LLMs) in production.
- Strong experience with Docker and production Kubernetes environments, including GPU scheduling.
- Deep understanding of self-hosted AI infrastructure, including model formats, quantization, GPU memory management, batching, and inference optimization.
- Experience supporting production applications with networking, reverse proxies, load balancing, authentication, and TLS.
- Proficiency with Linux administration and Python and/or Bash scripting.
- Ownership mindset with the ability to operate and improve production AI infrastructure.
- Experience with CUDA, NVIDIA drivers, GPU Operators, or other GPU infrastructure technologies.
- Experience with Infrastructure as Code (Terraform, Helm).
- Familiarity with observability and monitoring tools such as Prometheus and Grafana.
- Experience building Retrieval-Augmented Generation (RAG) pipelines and working with vector databases (pgvector, Qdrant, Weaviate).
- Experience with LLM gateway tools such as LiteLLM.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in Chantilly, Loudoun County, VA vacancy
$200k - $250k
...AI Infrastructure Engineer Top Secret or TS/SCI is required to start $200K to $250K Chantilly, VA What You'll Do Deploy and optimize self-hosted LLM inference servers (vLLM, Ollama, and similar). Containerize AI workloads using Docker and orchestrate...Suggestedthejosefgroup.com
Chantilly, Loudoun County, VA14 hours ago$86.8k - $198k
AWS AI Cloud EngineerThe Opportunity: As an AWS AI Cloud Engineer, you can resolve a problem with a complete end-to-end GenAI solution in a fast, agile environment. If you’re looking for the chance to not just develop software, but to create a system that will make a difference...SuggestedFull timeContract workPart timeWork at officeLocal areaRemote work- ...Senior AI Infrastructure Engineer Austin, Texas, United States; Reston, Virginia, United States Seekr is building the infrastructure that powers the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate the...SuggestedPermanent employmentWork experience placementFlexible hours
Seekr
Reston, VA1 day ago $104k - $166k
...Cloud AI Engineer Job Locations US Requisition ID 2026-170002 Position Category Information Technology... ...Azure, Google Cloud Platform (GCP), and Oracle Cloud Infrastructure (OCI). Location: Remote, but must reside and perform all...SuggestedContract workRemote workShift workPeraton
Reston, VA1 day ago$121.56k
...with Enterprise Architecture and Security teams to define the AI architecture supporting the software development lifecycle, aligned... ...coding, testing, security, release management, and operations.Engineering & DeliveryBuild production-grade integrations and proof-of-...SuggestedOverseas- ...motivated candidate to join our talented Team. Job Title: AI Platform Engineer - 50092-1 Location(s): 100% Remote Duration: 6... ...across Azure, MuleSoft, and Salesforce Agentforce, using infrastructure-as-code (Terraform, Bicep, ARM) and CI/CD pipelines....Work at officeRemote work
Ampcus
Reston, VA3 days ago - ...About the job AI Platform Engineer AI Platform Engineer Company Overview Glint Tech Solutions is a women-owned global staffing and IT recruiting firm connecting top technical talent with leading enterprise clients across the United States. Project...
Glint Tech Solutions LLC
Reston, VA1 day ago $229.9k - $262.4k
...Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-...Full timePart timeLocal areaCapital One
McLean, VA1 day ago$229.9k - $262.4k
...Sr. Lead AI Engineer (Gen AI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...Full timePart timeLocal areaCapital One
McLean, VA3 days ago$229.9k - $262.4k
Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...Full timePart timeLocal areaCapital One
McLean, VA4 days ago- DescriptionSAIC is seeking a AI/ Artificial intelligence Engineer Subject Matter Expert to provide SETA support to SAIC’s Program, Landmark in Chantilly, VA. Landmark is a large SETA program, supporting the NRO’s Ground Enterprise Directorate (GED), responsible for the...
$86.8k - $198k
Operational Technology AI EngineerThe Opportunity: As a cyber warfare engineer, you know how critical it is to stay ahead of evolving threats by identifying and exploiting vulnerabilities before adversaries can. At Booz Allen, you'll bring that expertise to a mission-focused...Full timeContract workPart timeWork at officeLocal areaRemote work- ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team.Job Title: Senior AI Engineer - Generative AI / RAG Job Location: Chantilly, VAJob Summary We are seeking a Senior AI Engineer with strong expertise in...
$150k - $190k
...Job Description Job Description Senior AI Platform & Data Engineer Job Number: 868 This is a remote position. Ad Hoc is a technology... ...modernize legacy systems, and build the digital service infrastructure necessary to scale their mission impact. Primary...Work at officeRemote workFlexible hoursAd Hoc
McLean, VA13 days ago- ...candidate to join our talented Team.Job Title: AI Cyber EngineerLocation(s): Chantilly, VAJob Summary:The AI Cyber Engineer is a senior technical role responsible for... ...:Continuously Client vulnerabilities across infrastructure, applications, and AI systems.Generate...Shift work
- ...partnership. If this sounds like the choice you want to make, then choose MITRE - and make a difference with us.MITRE’s Multi-INT AI Engineering Department effectively combines the deep technical knowledge required to develop capabilities with critical domain knowledge to...Work experience placementInternshipLocal areaRemote work
- ...and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: AI / ML Solutions Engineer Location: Chantilly, VA Education and Training:Bachelor's degree in Computer Science, Software Engineering, or...
- ...MANTECH seeks a motivated, career and customer-oriented Network Deployment Engineer to join our team in Chantilly, VA . This is an onsite position. Responsibilities include but are not limited to: Coordinate and execute site deployments, including planning...Work at office
MANTECH
Chantilly, Loudoun County, VA3 hours ago - ...Job Title : AI Engineer Location: Chantilly, VA Type: Direct Hire / Perm Work Model: Hybrid – onsite and remote Security Clearance: Must possess and maintain a TS Security Clearance with the ability to obtain SCI with a CI Poly...Permanent employmentLocal areaRemote work
System One Holdings, LLC
Chantilly, Loudoun County, VA1 day ago $99k - $225k
AI and ML EngineerThe Opportunity: As an experienced engineer, you know that machine learning (ML) is critical to understanding and processing massive datasets. Your ability to conduct statistical analyses on business processes using ML techniques makes you an integral...Full timeContract workPart timeWork at officeLocal areaRemote work- ...surpasses the epitome of excellence. Our core services include systems engineering technical advice, technical support, and administrative... ...our organization works with data, internal systems, and emerging AI technologies. This role is intentionally broad and hands-on....Full timeFor contractorsRemote work
Sciolex Corporation
Chantilly, Loudoun County, VA4 days ago - ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: AI Engineer (GenAI & Agentic Systems). Location: Chantilly, VA. Job Description:The AI Engineer (GenAI & Agentic Systems) designs,...
- ...capabilities include data science, software development, network engineering, intelligence, surveillance, and reconnaissance (ISR), and... ...Artificial Intelligence/Machine Learning (Al/ML) Engineer. The AI/ML Engineer shall design, develop, test, evaluate, and deploy Al...Contract workWork at office
$99k - $225k
AI/ML EngineerThe Opportunity:Data scientists and intelligence analysts rely on multi‑step workflows that are time‑sensitive, detail‑rich, and critical to national security. As an AI/ML Engineer, you will work directly with mission users to capture these workflows, document...Full timeContract workPart timeWork at officeLocal areaRemote work- Job Summary: Serves as a key contributor supporting the development, refinement, and publication of large-scale technical documentation. Responsible for producing clear, consistent, and structured content while collaborating with subject matter experts and stakeholders...
Diligent Solutions
Chantilly, Loudoun County, VA1 day ago $99k - $225k
Computer Vision AI EngineerThe Opportunity: Booz Allen is seeking an innovative and experienced AI Developer specializing in Computer... ...your expertise in AI, data science, and machine learning (ML) engineering to train, test, deploy, and maintain models that learn from...Full timeContract workPart timeWork at officeLocal areaRemote work- ...We are in search of a highly motivated candidate to join our talented Team.Job Title: AI Coding Tools EngineerJob Location: Chantilly, VA.Job Description.The AI Coding Tools Engineer (GenAI & Agentic Systems) evaluates, pilots, operationalizes, maintains, and scales adoption...Work at office
$120k - $160k
...and intelligence communities. We're proud to boast a world-class engineering team that thrives on rolling up their sleeves to solve your... ...challenges. Dark Wolf is seeking a highly skilled Senior AI Engineer to architect, build, and deploy advanced, secure AI-driven...Full timeFor contractorsShift workDark Wolf Solutions
Chantilly, Loudoun County, VA15 days ago- ...Generative AI Engineer Client: Interon IT Solutions Location: Chantilly, VA (onsite) Employment: Full-time Experience: 1 5 years Work authorization: U.S. Citizen or Green Card holder Job Description Interon IT Solutions is...Full time
Interon IT Solutions
Chantilly, Loudoun County, VA3 days ago - ...helping them to feel confident in their IT infrastructure. With DCCA, these organizations can be... ...within AWS GovCloud environments. AI/ML Integration: Seamlessly integrate predictive... ...of hands-on experience in software engineering with a primary focus on deploying and operationalizing...Flexible hours
International Executive Service Corps
Chantilly, Loudoun County, VA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!
Related searches
- machine learning ai engineer Chantilly, Loudoun County, VA
- ai ml engineer Chantilly, Loudoun County, VA
- ai engineer Chantilly, Loudoun County, VA
- ai engineer remote Chantilly, Loudoun County, VA
- ai developer Chantilly, Loudoun County, VA
- remote infrastructure engineer Chantilly, Loudoun County, VA
- infrastructure engineer Chantilly, Loudoun County, VA
- security infrastructure engineer Chantilly, Loudoun County, VA
- infrastructure developer Chantilly, Loudoun County, VA
- senior infrastructure engineer Chantilly, Loudoun County, VA