Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior GPU Systems Engineer for AI Clusters & Linux

Base-2 Solutions, LLC.

Position Summary

Support enterprise AI mission systems by designing, developing, and optimizing GPU clusters, with deep focus on operating systems, hardware, GPU platforms, and high-speed networking in a secure customer environment.

Essential Duties and Responsibilities

  • Design, configure, and maintain GPU clusters.
  • Collaborate with a multidisciplinary team to define and optimize architectures for performance, power efficiency, and required features.
  • Work closely with AI/ML engineers to integrate GPUs with Linux-based systems.
  • Optimize GPU drivers for compatibility, reliability, and performance.
  • Analyze GPU performance, identify bottlenecks, and develop strategies to improve efficiency across hardware and software layers.
  • Build and maintain debugging tools, profiling utilities, and performance analysis software for Linux environments.
  • Leverage Bash, Python, Ansible, Puppet, and Salt for tooling and automation.
  • Maintain technical documentation, architectural specifications, and Linux best practices.
  • Support ATO activities and ensure compliance with federal security standards.

Required Qualifications

  • Active TS/SCI with ability to obtain a CI Polygraph.
  • Bachelor's degree with a minimum of ten years of experience in the category field.
  • Experience managing NVIDIA GPU data center platforms, including DGX, HGX, H200, H100, and L4s.
  • Knowledge of enterprise server components, including storage/network controllers, HBAs, and SSDs.
  • Strong expertise with Linux distributions, including RHEL, Ubuntu, Oracle, and Rocky.
  • Excellent problem-solving skills and the ability to collaborate within a team.
  • Meet DoD 8570.11 IAT Level II certification requirements at a minimum; IAT Level III is also acceptable.
  • U.S. citizenship is required due to the nature of the government contracts supported.

Preferred Qualifications

  • Experience with Kubernetes cluster management and AI/ML workflow orchestration, including Argo, Airflow, and Kubeflow.
  • Familiarity with GPU virtualization and cloud computing.
  • Experience with Prometheus and Grafana for monitoring.
  • Knowledge of distributed resource scheduling systems such as Slurm, LSF, or similar tools.

Required Education and Experience Equivalency

  • Bachelors' Degree with 10 years of experience.
  • Masters' Degree with 10 years of experience.
  • PhD with 10 years of experience.

RequiredCertifications

  • DoD 8570.11 IAT Level II certification: Security+ CE, CCNA-Security, GICSP, GSEC, or SSCP.

Required Security Clearance

  • Active TS/SCI with ability to obtain a CI Polygraph.

Equal Employment Opportunity

Base-2 Solutions is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy), national origin, age, sexual orientation, gender identity, genetic information, protected veteran status, or any other characteristic protected by law, and will not be discriminated against on the basis of disability. Learn more: base-2solutions.com/eeo

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior GPU Systems Engineer for AI Clusters & Linux in Bethesda, MD vacancy
  • $152k - $241.5k

    Sr Software Engineer - Distributed Systems Engineer, EDA InfrastructureNVIDIA...  ...large fleets of GPU-based and CPU-based compute...  ..., operating systems, cluster schedulers,...  ...and large fleets of Linux-based compute nodes.Understanding...  ...vacancy. NVIDIA uses AI tools in its... 
    Senior
    Linux
    Full time
    Remote work

    Nvidia

    Washington DC
    2 days ago
  • $184k - $287.5k

    We are seeking a Linux Systems Engineer to join our Infrastructure Engineering team, dedicated to supporting...  ...Cadence) and high-performance compute clusters (e.g. exposure to LSF and Slurm...  ...is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA... 
    Senior
    Linux
    Full time
    Work experience placement
    Remote work

    Nvidia

    Washington DC
    5 days ago
  • $131.3k - $237.35k

    Leidos is looking for a senior Systems Engineer - HPC & GPU Infrastructure with a deep understanding of operating...  ..., developing, and optimizing GPU clusters for the IC community customers.This...  ...across various applications in Linux, addressing both hardware and software... 
    Linux
    Full time

    Leidos

    Bethesda, MD
    6 days ago
  • DescriptionSystems Engineer - HPC & GPU Infrastructure - TS/SCI Xcelerate Solution...  ...is looking for a mid-career Systems Engineer (Mid-Career) - HPC...  ..., and optimizing GPU clusters for the IC community customers...  ...across various applications in Linux, addressing both hardware... 
    Linux

    Xcelerate Solutions

    Bethesda, MD
    2 days ago
  • DescriptionSystems and Platform Engineer - TS/SCI Xcelerate...  ...expertise in operating systems, hardware, GPU, and high-speed...  ...and optimize Kubernetes clusters that power enterprise AI for the mission customers...  ...architectural specifications, and Linux best practices. Support... 
    Linux

    Xcelerate Solutions

    Bethesda, MD
    2 days ago
  • $166k - $220k

     ...changing how military systems are designed, built and...  ...powered by Lattice OS, an AI-powered operating...  ...Our systems integration engineers internalize the nuances...  ...with managing Kubernetes clusters of hundreds of nodesKnowledge...  ...low-level frameworks, Linux and databasesExcellent... 
    Senior
    Linux
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Washington DC
    4 days ago
  • $131.3k - $237.35k

     ...Senior Systems Engineer - TS/SCI Bethesda, Maryland $131,300.00 - $237,350.00 Clearance: TS/SCI...  ...Polygraph Broad understanding of GPU-enabled systems architecture and engineering...  ...in a Red Hat, Centos or Oracle Linux Familiarity DGX (Deep GPU Xceleration... 
    Senior
    Linux
    Remote work
    Flexible hours

    California Creative Solutions Inc.

    Bethesda, MD
    1 day ago
  • $165k - $265k

     ...SITE RELIABILITY ENGINEER (STARSHIELD) At SpaceX...  ...all parts of the system - receivers that...  ...Starshield's software and GPU infrastructure,...  ...solutions for AI clusters (100k+ GPU scale)...  ...junior engineersAs a senior engineer you must...  ...experience with Linux operating systems;... 
    Senior
    Linux
    Permanent employment
    Temporary work
    Immediate start
    Weekend work

    SpaceX

    Washington DC
    3 days ago
  • $146k - $234k

    ResponsibilitiesThe Senior AI Platform Engineer will stand up and operate...  ..., throughput, and GPU/memory utilization while...  ...with platform/systems/integration engineering...  ...CNI), storage (CSI), cluster security, and lifecycle...  ...considerationsStrong Linux administration skills... 
    Senior
    Linux
    Contract work
    Remote work
    Flexible hours
    Shift work

    Peraton Corporation

    Arlington, VA
    3 days ago
  • $222k - $257k

     ...Senior HPC DevOPS Engineer | TS/SCI w/MD poly required ~ Hanover, MD...  ...lifecycle for an existing HPC/AI compute cluster (Linux). You will work closely with...  .... 7+ years in Linux systems / SRE / DevOps, including...  ...performance troubleshooting, and GPU node health validation.... 
    Senior
    Linux
    Immediate start

    Power3

    College Park, MD
    1 day ago
  • $184k - $287.5k

    NVIDIA is looking for an AI Solutions Architect...  ...experience in large-scale GPU systems. This role involves...  ...large-scale AI clusters across GPU compute, high...  ...Partnering with NVIDIA’s engineering, product, and sales teams...  ...Deep understanding of Linux systems, distributed... 
    Senior
    Linux
    Full time
    Local area
    Remote work

    Nvidia

    Washington DC
    4 days ago
  •  ...Enterprise Data Storage Systems (EDSS) Senior Storage Systems Engineer to support a government customer...  ...array snapshots, active clusters, metro clusters,...  ...administration tasks and jobs using AI, PowerShell, Ansible,...  ...to SAN storage, Red Hat Linux, and Windows Server... 
    Senior
    Linux
    Full time
    Contract work
    For contractors
    Work at office
    Local area
    Shift work
    Weekend work

    Computer Technologies Consultants (CTC)

    Washington DC
    1 day ago
  • $107.9k - $195.05k

     ...SCI cleared Software Engineer supporting a long-...  ...work closely with Systems Engineers, Software...  ...them in Kubernetes clusters Participate in...  ...development experience in a Linux environment...  ...Familiarity DGX (Deep GPU Xceleration)...  ...Language Models, Agentic AI #NMECDTP-Leidos... 
    Senior
    Linux
    Contract work
    Local area
    Immediate start
    Remote work
    Flexible hours

    Leidos

    Bethesda, MD
    2 days ago
  • $77.6k - $176k

    DevOps Engineer and System Administrator, SeniorThe Opportunity:Are you looking for an opportunity to...  ...of experience with Windows Server, Linux, Domain Controllers, SQL Server, and IIS...  ...your identity and prevent fraud.Candidate AI Usage PolicyAI is a part of our daily work... 
    Senior
    Linux
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    4 days ago
  •  ...are seeking a highly skilled Senior Security Engineer to join a multi-...  ...supporting mission-critical systems in a regulated federal environment...  ...application security, and emerging AI-driven security technologies...  ...). ~ Strong background in Linux and Windows administration... 
    Senior
    Linux
    Full time

    Peyton Resource Group

    Bethesda, MD
    3 days ago
  • $100k - $150k

     ...Vision insurance WHO WE ARE US AI stands as a forward-thinking digital...  ...for a motivated and enthusiastic Senior System Engineer to join our IT Infrastructure team. The...  ...MongoDB) ~ Extensive experience with Linux/Unix system administration. ~ Strong... 
    Senior
    Linux
    Live in
    Work at office

    US AI

    Rockville, MD
    28 days ago
  • $128.5k - $190k

     ...The Site Reliability Engineering organization at Medallia...  ...SaaS platform. As a Senior Site Reliability...  ...platform solutions, and AI-assisted workflows that...  ...supporting production systems and services. Engineering...  ...GCP. ~ Demonstrated Linux systems administration... 
    Senior
    Linux
    Temporary work
    Work experience placement
    Local area

    Medallia

    McLean, VA
    1 day ago
  •  ...Position Title: Senior Principal Field Programmable...  ...Signal Processing Engineer Location: Hybrid...  ...RF sensing, GPU-accelerated processing...  ..., software, AI, and RF engineering...  ...testing of Dragonfly systems. Serve as the technical...  ...C++ development in Linux environments. ~... 
    Senior
    Linux
    Full time
    Work at office
    Flexible hours

    Research Innovations Inc

    Alexandria, VA
    1 day ago
  • $184k - $287.5k

    NVIDIA is looking for a Systems & Software Engineer interested in building and running...  ...to produce code without AI assistance during the interview...  ...depth knowledge of Linux systems and ContainersA track...  ...Experience working with Nvidia GPU-based systemsNVIDIA is leading... 
    Senior
    Linux
    Full time
    Remote work

    Nvidia

    Washington DC
    1 day ago
  •  ...technology. Job Title: Senior Cloud Engineer Summary The Cloud...  ...~ Elasticsearch, Kubernetes clusters, and Docker ~ Scripting and...  ...strong understanding of use of AI in development workflows ~...  ...and EC2 ~ Solid command of Linux administration ~ Strong... 
    Senior
    Linux
    Full time
    Shift work

    Volant Media UK Ltd

    Washington DC
    2 days ago
  • $77.6k - $176k

    Electronic Health Record Data Engineer, SeniorThe Opportunity: Ever-expanding technology like...  ...degreeNice If You Have:   Experience with UNIX and Linux, including basic commands and Shell...  ...your identity and prevent fraud.Candidate AI Usage PolicyAI is a part of our daily work... 
    Senior
    Linux
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    Bethesda, MD
    1 day ago
  •  ...Senior Infrastructure/ Platform Engineer (TS/SCI): Hybrid, Suitland, MD A fast-growing, profitable...  ...build data management and AI platforms for maritime...  ...Docker . Standing up a cluster from scratch is a big plus...  ...GitHub Actions . Strong Linux and networking... 
    Senior
    Linux
    Full time
    Contract work
    Home office

    Landshark Recruiting

    Washington DC
    3 days ago
  • $180k - $255k

     ...architecture, operations, and hands‑on engineering depending on project demands....  ...boredom. Ownership of systems and projects from planning...  ...on specializations: Linux systems, containerized workloads...  ...performance issues. Mentor less‑senior engineers and technicians.... 
    Senior
    Linux
    Full time
    Work experience placement

    99999 Consulting LLC

    Washington DC
    1 day ago
  • $160k - $210k

    MTSI is seeking a Senior Cybersecurity Systems Engineer whose primary function will be to work with Special Access Programs (SAPs) supporting Department...  ...(e.g. OSCP, GPEN), operating systems (Microsoft/Linux administration), etc.Education Requirements:Masters Degree... 
    Senior
    Linux
    Contract work
    For contractors

    Modern Technology Solutions

    Washington DC
    1 day ago
  • $99k - $225k

     ...development of algorithms and systems. You’ll use the right...  ...with data cleaning, feature engineering, clustering, data manipulation techniques...  ...2+ years of experience with AI/ML2+ years of experience with...  ...modelsAbility to work in Windows and Linux OS environmentsBachelor's... 
    Senior
    Linux
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    Arlington, VA
    3 days ago
  • $182.75k - $247.25k

     ...AWS), Cloud Computing, Complex Systems Design Certifications:...  ...differentiator. As a Cloud Systems Engineer, you will help ensure today is...  ...system Experience with Linux/Unix systems administration...  ...mission-ready capabilities in AI, cloud, cyber and software development... 
    Linux
    Temporary work
    Work at office
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Devopsroles

    Bethesda, MD
    1 day ago
  •  ...intelligence platform. Our SmartMast™ system transforms commercial and civilian...  ...network—combining HD video, AI, radar, RF sensing, and AIS to deliver...  ...operational pressure. We need a Senior Embedded Linux / Platform Software Engineer who can own the software that runs... 
    Senior
    Linux
    Remote work

    Quartermaster

    Arlington, VA
    3 days ago
  • $140k - $190k

     ...Research and Development Engineers at Kitware also have...  ...environments, from embedded systems and mobile platforms to...  ...Experience with GPU-based developmentKnowledge...  ...develop software for Unix, Linux, MacOS and/or Windows...  ...Experience with AI tools, frameworks, and... 
    Senior
    Linux
    Full time
    Contract work
    Temporary work
    Worldwide
    Flexible hours

    Kitware

    Arlington, VA
    4 days ago
  • $182.75k - $247.25k

     ...AWS), Cloud Computing, Complex Systems Design Certifications: None...  ...differentiator. As a Cloud Systems Engineer, you will help ensure today is...  ...system Experience with Linux/Unix systems administration Review...  ...mission-ready capabilities in AI, cloud, cyber and software... 
    Linux
    Temporary work
    Work at office
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    General Dynamics Information Technology, Inc.

    Bethesda, MD
    10 hours ago
  •  ...technology. Job Title: Senior Cloud Engineer Summary The Cloud...  ...~ Elasticsearch, Kubernetes clusters, and Docker ~ Scripting and...  ...strong understanding of use of AI in development workflows ~...  ...and EC2 ~ Solid command of Linux administration ~ Strong... 
    Senior
    Linux
    Shift work

    Volant Media UK Ltd

    Washington DC
    13 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior GPU Systems Engineer for AI Clusters & Linux. Be the first to apply!