Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer

Pacer Group

AI Infrastructure EngineerArchitect and build custom Artificial Intelligence (AI) infrastructure solutions leveraging the client Kubernetes Platform and AI. You will be responsible for designing high-performance computational stacks that integrate AI, high-speed software-defined storage, and GPU-accelerated nodes. Your mission is to make AI infrastructure "invisible" by optimizing for performance, power consumption, and seamless hybrid-multicloud scalability across on-prem.As an AI Infrastructure Engineer, you will design tailored AI solutions that bridge the gap between private data centers and public cloud. Your day-to-day will involve optimizing the client computational stack for large language models (LLMs) and generative AI workloads. You will serve as the SME for AI, ensuring that compute, storage (client Objects/Files), and networking (Flow) are perfectly tuned for AI model training and inference.ResponsibilitiesHybrid Multicloud Architecture: Design seamless AI workflows using NC2 on Prem, allowing for rapid bursting of AI workloads from on-prem AHV clusters to the public cloud.Data Services for AI: Architect high-performance storage backends using Objects (S3-compatible) to handle the massive datasets required for AI/ML.Kubernetes & Orchestration: Deploy and manage AI workloads using client Kubernetes Platform to ensure containerized AI models are scalable and resilient.Infrastructure-as-Code: Implement IaC using Calm or Terraform to automate the lifecycle of GPU-enabled nodes.Observability: Design frameworks (monitoring, logging, alerting) for proactive issue detection. Hands on experience on Prometheus, Grafana, ELK, and OpenTelemetry.Ensure high availability, disaster recovery, and fault tolerance across all systems.Networking & Security: Familiarity with Zero-Trust architectures, enterprise networking, storage, and virtualization.Invisible Infrastructure: Modernize legacy 3-tier AI silos into a unified, web-scale environment.Professional & Technical SkillsCore: Deep proficiency in AOS (Acropolis Operating System) and AHV (Native Hypervisor).AI Performance: Experience with GPU Passthrough and vGPU configurations to optimize AI training performance.Security: Applying work Flow for micro segmentation to secure sensitive AI training data.Cost Management: Using Cloud Manager (NCM) Cost Governance to monitor and optimize spend across hybrid environments.

Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in Washington DC vacancy
  • $184k - $287.5k

    AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical... 
    Suggested
    Full time
    Remote work

    Nvidia

    Washington DC
    18 hours ago
  • $120k - $150k

     ...Description Lead Cloud AI Engineer (Lead / Senior) Location: Various U.S. Federal Client Sites (Onsite) Travel: Yes –...  ...provider of enterprise IT modernization, cloud transformation, and infrastructure solutions supporting U.S. Federal Government agencies. As we... 
    Suggested
    Full time
    Temporary work
    Immediate start

    Pgtek

    Washington DC
    23 hours ago
  • $220k - $350k

     ...actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.SR. AI ENGINEER, PLATFORM INFRASTRUCTURE, SPECIAL PROGRAMSAs an AI Engineer, Platform Infrastructure you will build the tooling, and work with our cleared... 
    Suggested
    Permanent employment
    Temporary work
    Immediate start
    Weekend work

    SpaceX

    Washington DC
    3 days ago
  • $114.6k - $252.1k

    Job Title: AI Cloud Platform EngineerJob Category: Information TechnologyTime Type:...  ...Opportunity:We are seeking an AI and Cloud Engineer to design, build, and scale our next-...  ...artificial intelligence and robust cloud infrastructure. You will be part of a team responsible... 
    Suggested
    Contract work
    Work experience placement
    Flexible hours

    CACI International

    Washington DC
    1 day ago
  • $107.9k - $195.05k

    Leidos is seeking a Senior AI Platform Engineer to join our DCSB Artificial Intelligence & Agent Development team supporting the U.S. Army...  ...failure recovery.Build and maintain CI/CD pipelines and Infrastructure as Code (IaC) using Platform One and technologies such as... 
    Suggested
    Full time
    Remote work

    Leidos

    Adelphi, MD
    18 hours ago
  • $107.9k - $195.05k

    Leidos is seeking an AI & Security Infrastructure Integration Engineer to join our team in Alexandria, VA. This is a hybrid position allowing partial telework, but the majority of the time is spent on-site and candidates must be within commutable distance.Position OverviewAs... 
    Full time
    Work experience placement
    Remote work

    Leidos

    Alexandria, VA
    23 hours ago
  •  ...Analytica is seeking a  Senior AI-ML Engineer (Azure) with deep Microsoft Azure ecosystem experience combining a blend of high-level architectural design skills, deep proficiency in Azure’s specialized AI toolset, and a mastery of the end-to-end Machine Learning Lifecycle... 
    Full time
    For contractors
    Work at office
    Local area

    Analytica

    Bethesda, MD
    23 hours ago
  • $85k

     ...our team at APL!   We are seeking a highly motivated AI/ML platform engineer who will contribute to solving cutting edge challenges that...  ...). Prepare training data, run training jobs on shared infrastructure, evaluate results against task-specific benchmarks, and hand... 
    Temporary work
    Work experience placement
    Interim role
    Relocation package
    Flexible hours

    Johns Hopkins Applied Physics Laboratory (APL)

    Laurel, MD
    -48
  •  ...Architect high-throughput, low-latency model-serving infrastructure for cloud and air-gapped tactical edge...  ...DPO. Set unified infrastructure standards with AI researchers, computer vision teams, and platform engineers. Lead technical direction and complex migrations... 
    Full time

    Anduril Industries

    Washington DC
    13 days ago
  •  ...~5+ years of Software or Platform Engineering experience ~ Startup experience (post-...  ...building and maintaining production platform infrastructure ~ Strong ownership and ability to work...  ...migrations Production incident response AI-assisted developer tooling AI-first... 

    Saxon Global

    Washington DC
    2 days ago
  • $84.4k - $156.8k

     ...Design, deploy, configure, secure, and maintain AI application environments within Oracle Cloud Infrastructure (OCI). Adapt existing containerized applications...  ...applications using Docker, Kubernetes/Oracle Kubernetes Engine (OKE), OCI Container Registry (OCIR), or... 
    Minimum wage
    Full time
    Contract work
    Flexible hours

    DXC Technology

    Arlington, VA
    1 day ago
  • Accenture Google Business Group (AGBG) seeks a Google Cloud Platform Agentic AI Delivery Engineer to design, build and demonstrate Agentic AI solutions on Google Cloud for client outcomes. You will partner with global delivery teams, leveraging Vertex AI, Gemini/Agentic... 

    Accenture

    Arlington, VA
    23 hours ago
  • $85k - $195k

     ...mathematics, computer science, electrical engineering, or a closely related discipline. We...  ...experience designing and implementing AI/ML methods across diverse datasets. Preferred...  ..., execute training jobs on shared infrastructure, evaluate outcomes against benchmarks,... 
    Full time
    Interim role

    Johns Hopkins Applied Physics Laboratory (APL)

    Laurel, MD
    1 day ago
  • CoStar Group in Arlington, VA is seeking a Senior Software Engineer to help build a greenfield, enterprise-scale web application infused with AI, shaping AI-first engineering workflows. You will drive AI-powered product experiences and contribute to an innovative engineering... 

    your Jared

    Arlington, VA
    4 days ago
  • $86.8k - $198k

    AWS AI Cloud EngineerThe Opportunity: As an AWS AI Cloud Engineer, you can resolve a problem with a complete end-to-end GenAI solution in a fast, agile environment. If you’re looking for the chance to not just develop software, but to create a system that will make a difference... 
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    1 day ago
  • Venture Global LNG in Arlington, VA seeks a Director of AI Engineering to define and execute the enterprise AI strategy, architecture, and operating model. You will build a cross-functional team of senior AI and ML engineers, drive platform capabilities, and ensure security... 

    Venture Global LNG

    Arlington, VA
    3 days ago
  • $86.8k - $198k

     ...Job Number: R0243693 AWS AI Cloud Engineer The Opportunity: As an AWS AI Cloud Engineer, you can resolve a problem with a complete end-to-end GenAI solution in a fast, agile environment. If you're looking for the chance to not just develop software, but to create... 
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    23 hours ago
  • $140k - $180k

     ...experiences. Their innovative strategies and solutions securely and rapidly transform the way their clients do business.  As a Senior AI Engineer, you will understand how AI is positioned to meet business objectives and then deliver projects for customers as part of a team.... 
    Full time

    Reply

    Washington DC
    23 hours ago
  •  ...We build AI agents that actually work in enterprise environments — not prototypes, not demos. We need engineer's who can own the entire agent stack: a production frontend, a robust...  ...working systems, and leave behind infrastructure clients can operate and extend. You'll... 
    Full time
    Temporary work

    Trilagen

    Bethesda, MD
    23 hours ago
  •  ...Description The work AI Engineers build and operate systems that turn data, documents, models, and AI services into useful applications and workflows. The work runs from understanding the problem and preparing inputs through model or service selection, system design... 
    Full time

    Opendatajobs

    Washington DC
    23 hours ago
  •  ...Description The work Generative AI Engineers build production applications around foundation models and large language models. They turn model capabilities into tools for search, drafting, summarization, information extraction, multimodal work, and guided action... 
    Full time

    Opendatajobs

    Washington DC
    23 hours ago
  •  ...Title: Senior Embodied AI Engineer About Us: UnitX builds the world's leading physical AI systems to automate repetitive visual tasks in factories. UnitX is a fast-moving startup with a team from Stanford, MIT, Google, and beyond. Since inception, UnitX has deployed... 
    Full time

    Unitx

    Washington DC
    23 hours ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,... 
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    23 hours ago
  • $197.3k - $225.1k

     ...Overview Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services) At Capital One, we are creating responsible and reliable...  ...personalized customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in... 
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    4 days ago
  • $229.9k - $262.4k

    Sr. Lead AI Engineer (GenAI Platform) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    2 days ago
  • $229.9k - $262.4k

    Senior Lead AI Engineer (GenAI Platform Services) Overview At Capital One, we are creating responsible and reliable AI systems, changing...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    3 days ago
  • $197k - $278k

    About the teamThe AI Deployment Engineering team is responsible for ensuring the safe and effective deployment of Generative AI applications. We act as a trusted advisor and thought partner for our customers, working to build an effective backlog of GenAI use cases for... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    OpenAI

    Washington DC
    4 days ago
  •  ...Technologies (IDT), a leading defense technology company, is seeking an AI Solutions Developer to be part of our Missile Defense team and...  ...improve productivity, decision-making, and automation across engineering and business functionsResearch, evaluate, and prototype AI... 
    Work at office
    Immediate start

    Innovative Defense Technologies

    Arlington, VA
    4 days ago
  • ID.me is seeking a Threat Detection Engineer to join our security engineering and operations team. You will develop high-fidelity detections...  ...security data platforms, focusing on analytics, automation, and AI-enabled threat detection at scale. You will build AI-enhanced... 

    Socket

    Mc Lean, VA
    3 days ago
  • $150k - $210k

     ...Enterprise Knowledge (EK) is hiring for a full-time Semantic Data and AI Engineer to join our growing Knowledge and Data Services Sector. In this role, you will be responsible for designing and deploying cutting-edge data discovery, integration, and governance solutions... 
    Remote job
    Full time
    For contractors
    H1b
    Work at office
    Local area

    Enterprise Knowledge

    Arlington, VA
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!