AI Infrastructure Engineer
$200k - $250kthejosefgroup.com
AI Infrastructure Engineer
Top Secret or TS/SCI is required to start
$200K to $250K
Chantilly, VA
What You'll Do
Top Secret or TS/SCI is required to start
$200K to $250K
Chantilly, VA
What You'll Do
- Deploy and optimize self-hosted LLM inference servers (vLLM, Ollama, and similar).
- Containerize AI workloads using Docker and orchestrate production environments with Kubernetes, including GPU scheduling.
- Build and maintain AI serving infrastructure, including gateways, load balancing, authentication, TLS, and rate limiting.
- Optimize GPU utilization, memory management, quantization, batching, and capacity planning to balance performance and cost.
- Develop and maintain CI/CD pipelines, observability, monitoring, and incident response processes.
- Hands-on experience deploying and serving Large Language Models (LLMs) in production.
- Strong experience with Docker and production Kubernetes environments, including GPU scheduling.
- Deep understanding of self-hosted AI infrastructure, including model formats, quantization, GPU memory management, batching, and inference optimization.
- Experience supporting production applications with networking, reverse proxies, load balancing, authentication, and TLS.
- Proficiency with Linux administration and Python and/or Bash scripting.
- Ownership mindset with the ability to operate and improve production AI infrastructure.
- Experience with CUDA, NVIDIA drivers, GPU Operators, or other GPU infrastructure technologies.
- Experience with Infrastructure as Code (Terraform, Helm).
- Familiarity with observability and monitoring tools such as Prometheus and Grafana.
- Experience building Retrieval-Augmented Generation (RAG) pipelines and working with vector databases (pgvector, Qdrant, Weaviate).
- Experience with LLM gateway tools such as LiteLLM.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in Chantilly, Loudoun County, VA vacancy
$86.8k - $198k
AWS AI Cloud EngineerThe Opportunity: As an AWS AI Cloud Engineer, you can resolve a problem with a complete end-to-end GenAI solution in a fast, agile environment. If you’re looking for the chance to not just develop software, but to create a system that will make a difference...SuggestedFull timeContract workPart timeWork at officeLocal areaRemote work$66.5 - $115 per hour
AI Platform Engineer needed for a Long-Term Contract opportunity with SOC’s client to work onsite in Chantilly, VA. *Candidate must have... ...for this role. JOB SUMMARYAs a key member of the infrastructure support team, the Mid-Level AI Platform Engineer will be responsible...SuggestedLong term contractContract work- ...Senior AI Infrastructure Engineer Austin, Texas, United States; Reston, Virginia, United States Seekr is building the infrastructure that powers the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate the...SuggestedWork experience placementFlexible hours
Seekr
Reston, VA3 days ago $127k - $183k
Be highly collaborative and work closely with data producers, consumers and Data and AI Engineering teams across public sector customers and teams to understand the data needs, provide consultation, and design and develop solutions.Analyze on-premise and cloud database...SuggestedLocal area$121.56k
...with Enterprise Architecture and Security teams to define the AI architecture supporting the software development lifecycle, aligned... ...coding, testing, security, release management, and operations.Engineering & DeliveryBuild production-grade integrations and proof-of-...SuggestedOverseas$86.8k - $198k
...Job Number: R0243693 AWS AI Cloud Engineer The Opportunity: As an AWS AI Cloud Engineer, you can resolve a problem with a complete end-to-end GenAI solution in a fast, agile environment. If you're looking for the chance to not just develop software, but to create...Full timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
McLean, VA3 days ago$152.6k - $190.7k
Title: AI Systems Engineer KBR is seeking a visionary AI Systems Engineer to join our team, providing critical technical services to the U.S. Government (USG). This role supports a dedicated USG Program Office, in shaping, designing, and deploying cutting-edge AI and...Full timeContract workFor contractorsWork at officeLocal areaFlexible hours$209k - $238.5k
Senior Lead AI Engineer, Gen AI Platform Overview: At Capital One, we are creating responsible and reliable AI systems, changing... ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in...Full timePart timeLocal areaCapital One
McLean, VA1 day ago$229.9k - $262.4k
Senior Lead AI Engineer (GenAI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...Full timePart timeLocal areaCapital One
McLean, VA1 day ago- ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team.Job Title: Senior AI Engineer - Generative AI / RAG Job Location: Chantilly, VAJob Summary We are seeking a Senior AI Engineer with strong expertise in...
- DescriptionSAIC is seeking a AI/ Artificial intelligence Engineer Subject Matter Expert to provide SETA support to SAIC’s Program, Landmark in Chantilly, VA. Landmark is a large SETA program, supporting the NRO’s Ground Enterprise Directorate (GED), responsible for the...
- ...and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: AI / ML Solutions Engineer Location: Chantilly, VA Education and Training:Bachelor's degree in Computer Science, Software Engineering, or...
- ...candidate to join our talented Team.Job Title: AI Cyber EngineerLocation(s): Chantilly, VAJob Summary:The AI Cyber Engineer is a senior technical role responsible for... ...:Continuously Client vulnerabilities across infrastructure, applications, and AI systems.Generate...Shift work
$197.3k - $225.1k
Lead AI/ML Engineer (Platform, kubeflow) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...Full timePart timeLocal areaCapital One
McLean, VA5 days ago- ...partnership. If this sounds like the choice you want to make, then choose MITRE - and make a difference with us.MITRE’s Multi-INT AI Engineering Department effectively combines the deep technical knowledge required to develop capabilities with critical domain knowledge to...Work experience placementInternshipLocal areaRemote work
$170k - $210k
...We are seeking an experienced AI Solutions Engineer with a high-level active security clearance to join our team in Chantilly, Virginia. The successful candidate will lead the development and implementation of an innovative AI application designed to enhance the facility...Hourly payContract workLocal area3 days per weekAmentum
Chantilly, Loudoun County, VA11 hours ago- ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: AI Engineer (GenAI & Agentic Systems). Location: Chantilly, VA. Job Description:The AI Engineer (GenAI & Agentic Systems) designs,...
$99k - $225k
AI & ML EngineerThe Opportunity: As an experienced engineer, you know that machine learning is critical to understanding and processing massive datasets. Your ability to conduct statistical analyses on business processes using ML techniques makes you an integral part of...Full timeContract workPart timeWork at officeLocal areaRemote work- ...Job Title : AI Engineer Location: Chantilly, VA Type: Direct Hire / Perm Work Model: Hybrid – onsite and remote Security Clearance: Must possess and maintain a TS Security Clearance with the ability to obtain SCI with a CI Poly...Permanent employmentLocal areaRemote work
System One Holdings, LLC
Chantilly, Loudoun County, VA3 days ago - ...AI Engineer AI Engineer Chantilly, VA Active TS/SCI with Polygraph Company Overview: Cornerstone Defense is the Employer of Choice within the Intelligence, Defense, and Space communities of the U.S. Government. Realizing early on that our most prized assets are our...
Cornerstone Defense
Chantilly, Loudoun County, VA1 day ago $99k - $225k
Computer Vision AI EngineerThe Opportunity: Booz Allen is seeking an innovative and experienced AI Developer specializing in Computer... ...your expertise in AI, data science, and machine learning (ML) engineering to train, test, deploy, and maintain models that learn from...Full timeContract workPart timeWork at officeLocal areaRemote work- ...We are in search of a highly motivated candidate to join our talented Team.Job Title: AI Coding Tools EngineerJob Location: Chantilly, VA.Job Description.The AI Coding Tools Engineer (GenAI & Agentic Systems) evaluates, pilots, operationalizes, maintains, and scales adoption...Work at office
- ...surpasses the epitome of excellence. Our core services include systems engineering technical advice, technical support, and administrative... ...our organization works with data, internal systems, and emerging AI technologies. This role is intentionally broad and hands-on....Full timeFor contractorsRemote work
Sciolex Corporation
Chantilly, Loudoun County, VA17 hours ago $90.3k - $189.6k
Job Title: Platform Engineer Job Category: Engineering Time Type: Full time Minimum Clearance Required to Start: TS/SCI Employee... ...service improvement through the modernization of IT system infrastructure. CACI is looking for an experienced, innovative, and motivated...Full timeContract workWork experience placementInterim roleLocal areaRemote workFlexible hours- ...Artificial Intelligence (AI) Engineer Velocity-X, a VelocityBlack company, constructs and deploys data management and analytics solutions... ...Design, develop, and implement scalable AI/ML computing infrastructures and application stacks. Build and deploy machine learning...
BuddoBot
Chantilly, Loudoun County, VA5 days ago $100k - $195k
OverviewVTG is seeking an AI/ML Systems Engineer, located in Chantilly, Va.What will you do?The engineer sought here serves a USG Program Office leading Research & Development (R&D) of evolutionary, revolutionary, and transformational artificial intelligence and machine...Work experience placementWork at office- DescriptionGalileo seeks an Artificial Intelligence/Machine Learning Systems Engineer to join our team of professionals providing technical and... ...your personal desires and capabilities:Evaluation of advanced AI/ML concepts, systems, technologies, designs, architectures,...Work experience placementWork at office
$120k - $160k
...seeking a highly experienced and innovative Staff II/Staff III AI/ML Engineer to lead the design, development, evaluation, and deployment... ...AI, and zero trust principlesExperience with GPU infrastructure, model optimization, and scalable inference architecturesFamiliarity...Work experience placement- ...Description SAIC is seeking an AI/ML Systems Engineer to join our dynamic Landmark AOS team in Chantilly, VA. Landmark AOS is SAIC’s Prime... ...customer AND vendor data engineers & architects to ensure the infrastructure and data pipelines are optimized for ML model deployment....
SAIC
Chantilly, Loudoun County, VA2 days ago $69.4k - $158k
...camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.Candidate AI Usage PolicyAI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools....Full timeContract workPart timeWork at officeLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!
Related searches
- ai developer Chantilly, Loudoun County, VA
- ai engineer Chantilly, Loudoun County, VA
- senior infrastructure engineer Chantilly, Loudoun County, VA
- infrastructure engineer Chantilly, Loudoun County, VA
- infrastructure developer Chantilly, Loudoun County, VA
- remote infrastructure engineer Chantilly, Loudoun County, VA
- gen ai developer
- ai automation engineer
- ai engineer remote
- gen ai engineer