Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI, HPC & GPU Infrastructure Support Engineer

$90k - $160k
Full-time

vastai

About Us

Vast.ai 's cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing — reshaping our future for the benefit of humanity. Our mission is to organize, optimize, and orient the world's computation.

We value elegance, ownership, integrity, and continuous learning. You'll have the opportunity to dive into state-of-the-art AI systems while collaborating with a globally distributed team.

About the Role

This role focuses on troubleshooting complex Linux and GPU infrastructure issues across NVIDIA drivers, CUDA, GPU workloads, Ubuntu, Docker, KVM based virtual machines, networking, hardware, BIOS, and firmware. You’ll investigate failures, reproduce issues, identify root causes, and propose practical solutions across the full infrastructure stack.

You’ll also serve as the engineering resource our L1 support team relies on when tickets go beyond frontline triage. You’ll own complex escalations end-to-end, gather technical evidence, coordinate with the appropriate teams, and communicate findings clearly to clients, infrastructure suppliers, and internal teams.

The best engineers in this role don’t just resolve individual issues—they recognize recurring patterns, improve diagnostic tooling, and build runbooks that prevent future incidents. You’ll collaborate directly with the engineering and host support teams on systemic Linux, GPU, and infrastructure problems.

Strong GPU troubleshooting experience, Linux systems knowledge, and technical support skills are the primary requirements. You should be comfortable working autonomously in Ubuntu environments and troubleshooting NVIDIA drivers, CUDA, containers, virtual machines, networking, hardware, and GPU workloads.

Vast.ai users or hosts strongly preferred.

Location and Schedule

This is a full-time position based in our Westwood, Los Angeles office.

Available schedules:

  • Monday–Friday: Fully on-site

  • Sunday–Thursday: Four days on-site and one day working from home

Key Responsibilities

  • Diagnose and resolve issues across NVIDIA CUDA/GPU drivers, Docker, and KVM virtualization environments

  • Investigate GPU utilization, container resource constraints, thermal throttling, driver conflicts, and disk I/O bottlenecks

  • Assist clients and infrastructure suppliers working with TensorFlow, PyTorch, and other GPU-accelerated workloads

  • Troubleshoot network-layer issues, including VLAN, DNS, DHCP, VPN, NAT, firewall rules, and connectivity failures on host machines

  • Handle escalated support tickets involving GPU workload failures, container issues, networking problems, account infrastructure, and host-side configuration

  • Provide managed support for supplier onboarding and ongoing machine management, including installation, configuration, and post setup troubleshooting

  • Advise suppliers on hardware setup, driver configuration, BIOS and firmware settings, and network configuration for optimal performance

  • Provide coverage for L1 support overflow during peak periods or incidents

  • Write and maintain internal runbooks, escalation guides, and knowledge base articles to reduce repeat escalations

  • Build diagnostic and automation tooling in Python and Bash to reduce manual triage overhead

  • Collaborate with the engineering and support teams to flag and document systemic or recurring platform issues

You Are

  • Experienced with Linux, especially Ubuntu, and comfortable troubleshooting from the command line

  • Someone who enjoys debugging difficult problems and fixing broken systems

  • Methodical and focused on finding root causes, not just temporary fixes

  • Able to manage complex tickets independently

  • A clear written communicator with an interest in AI infrastructure and GPU computing

Must-Haves

  • Strong Linux systems operations experience with Ubuntu, RHEL/CentOS, or Debian, including networking, storage, services, and permissions

  • Proficiency with Docker, including container debugging, Docker Compose, image management, cgroup limits, and Docker storage and filesystem troubleshooting

  • Experience with virtualization platforms such as Proxmox VE, VMware, or similar hypervisors, including VM provisioning and troubleshooting

  • Strong networking fundamentals, including VLANs, DNS, DHCP, NAT, VPNs, firewall rules, and L2/L3 troubleshooting

  • Hands-on experience with NVIDIA GPU drivers, CUDA, and GPU workload troubleshooting

  • Python and Bash scripting skills for automation and diagnostic tooling

  • Strong written English communication that is clear, professional, and technically precise

  • Experience providing technical support in a customer-facing or internal help desk environment

  • Ability to prioritize across a concurrent queue of escalated tickets, triaging by severity and customer impact, balancing reactive resolution against proactive documentation and tooling work, and making clear judgment calls on when to escalate versus own resolution end-to-end

Nice-to-Haves

  • Familiarity with AI/ML frameworks (TensorFlow, PyTorch) and running GPU-accelerated containers

  • Monitoring and observability experience (Prometheus, Grafana)

  • Relevant certifications: RHCSA, CompTIA Linux+, or similar

  • Knowledge of the Vast.ai platform as a client or infrastructure supplier

Interview Process (~1 week)

After you submit your application, our technical team will review your experience and qualifications. Selected candidates will proceed through the following stages:

  • 15 minutes — Initial Screening (Virtual): A brief conversation about your background, availability, and interest in the role

  • 45 minutes — Experience Interview (Virtual): An introduction to Vast.ai and a deeper discussion of your technical and support experience

  • 2 hours — Meet and Greet and Technical Assessment (On-site): Meet the team and complete an LLM-assisted Linux systems operations assessment

Annual Salary Range

$90,000 – $160,000 + equity + benefits

Vast.ai is hiring across all experience levels with compensation commensurate with background, experience and potential.

Benefits

  • Comprehensive health, dental, vision, and life insurance

  • 401(k) with company match

  • Meaningful early-stage equity

  • Onsite meals, snacks, and close collaboration with founders/tech leaders

  • Ambitious, fast-paced startup culture where initiative is rewarded

 

Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the AI, HPC & GPU Infrastructure Support Engineer in Los Angeles, CA vacancy
  • $180k - $205k

     ...at the forefront of AI systems within the legal...  ...professional in a supportive culture. If you aspire...  ...Role The Manager of Infrastructure - Platform Engineering is an integral part...  ...platform architecture, GPU scheduling and...  ...VAST Data or comparable HPC/AI storage, preferablyExperience... 
    Suggested
    Work experience placement
    Work at office
    Flexible hours

    Latham&Watkins

    Los Angeles, CA
    1 day ago
  • $155k - $175k

     ...Are Liqid is doing for AI infrastructure what VMware did for x86...  ...the adoption of AI, HPC and VDI by unlocking the bottleneck of GPU utilization and availability...  ...of Worldwide Solutions Engineering and working directly...  ...• Working closely with support, marketing and our OEM... 
    Suggested
    Full time
    Casual work
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours

    Liqid

    Los Angeles, CA
    1 day ago
  • $125k - $160k

     ...enabling human life on Mars. NETWORK ENGINEER, AI INFRASTRUCTURE (STARSHIELD) Starshield leverages...  ...Starlink technology and launch capability to support national security efforts. While...  ...solutions for AI clusters (100k+ GPU scale) Collaborate with ML training... 
    Suggested
    Temporary work
    Internship
    Immediate start
    Weekend work

    SpaceX

    Hawthorne, CA
    3 days ago
  • $90k - $150k

     ...About Us Vast.ai 's cloud powers AI projects and...  ...Role This is a technical support role focused on escalated infrastructure issues that go beyond...  ...frontline triage. You'll be the engineering resource our L1 support...  ..., Docker, NVIDIA CUDA/GPU, and virtualization (KVM)... 
    Suggested
    Full time
    Work at office

    vastai

    Los Angeles, CA
    6 days ago
  •  ...applications powered by our cutting-edge AI research. As a Data Infrastructure Engineer, you will lead the development of...  ...and systems needed to support our AI applications. Examples includeLarge...  ...Preferred Qualifications:Experience with GPU computingExperience with... 
    Suggested

    HeyGen

    Los Angeles, CA
    2 days ago
  •  ...Orbital Technical Support EngineerOrbital is the AI platform for real estate legal work. Real estate shapes...  ...our cultural landmarks. It's the infrastructure that powers everyday life and is...  ...re looking for a Technical Support Engineer to join our Los Angeles team and help... 
    Immediate start

    Orbital LLC

    Los Angeles, CA
    5 days ago
  •  ...About the role We're looking for a Support Engineer to be the first line of help when something...  ...pressure matters. We're also an AI-first team. Our senior engineers use AI...  ...running an application locally, or reading infrastructure-as-code. Setting up monitoring,... 
    Work at office
    Shift work

    Tax App LLC

    Los Angeles, CA
    5 days ago
  • $24.75 per hour

     ...IT Support Engineer The IT Support Engineer plays a critical role in supporting all team members across the organization, providing timely...  ...glove service when warranted. WME Enterprise IT operates as an AI-augmented function — every role, including this one, is... 
    Hourly pay
    Minimum wage
    Temporary work
    Work at office
    Local area
    Immediate start
    Flexible hours
    Rotating shift

    Endeavor

    Beverly Hills, CA
    2 days ago
  • $75 - $85 per hour

    TEKsystems is seeking Infrastructure Engineers with experience supporting enterprise environments across cloud, systems administration, virtualization, network...  ...and civil liability.Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support... 
    Contract work
    Temporary work

    TEKsystems

    Los Angeles, CA
    2 hours ago
  •  ...Our platform gives hardware engineering teams a single place to ingest...  ...like Anduril and Shield AI to next-generation aerospace...  ...'re looking for a Baremetal Infrastructure Engineer to join our team building...  ...modernization, all while supporting deployments in highly... 
    Permanent employment
    Work at office

    Nominal

    Los Angeles, CA
    2 days ago
  • $175k - $285k

     ...reindustrialize America. By combining AI, advanced software, robotics,...  ...technical direction for the infrastructure platform powering automated...  ...the standards, patterns, and engineering culture that the entire...  ...for employees 401k Relocation support may be provided for certain... 
    Permanent employment
    Full time
    Relocation package
    Flexible hours

    Hadrian

    Los Angeles, CA
    4 days ago
  •  ...About Us Vast.ai ’s cloud powers AI projects and businesses...  ...excellence. We seek engineers with strong intrinsic drive,...  ...About the Role As a Senior Infrastructure Engineer, you will help design...  ...that power Vast.ai’s global GPU marketplace. You’ll work closely... 
    Full time
    Work at office

    vastai

    Los Angeles, CA
    6 days ago
  • $129.3k - $173.3k

     ...Technology is a global organization of engineers, product developers, designers, technologists...  ...is passionate about large-scale network infrastructure. This is a technical leadership role...  ...about Disney's guidelines on the use of AI for candidates, click here.Disney Entertainment... 
    Worldwide

    The Walt Disney Studios

    Glendale, CA
    5 days ago
  • $114.75k - $140.25k

     ...Operations - Information / Software Engineering /Full-time /On-siteHermeus is...  ...Hermeus networks as well as support cross-org needs for network...  ...other IT teams to support infrastructure projects and resolve complex...  ...use artificial intelligence (AI) tools to support parts of the... 
    Weekly pay
    Permanent employment
    Full time
    For contractors
    Work at office
    Local area

    Hermeus

    Los Angeles, CA
    1 day ago
  • $123k - $220k

     ...reindustrialize America. By combining AI, advanced software, robotics,...  ...looking for a Senior Network Engineer to own the design,...  ..., and reliability of network infrastructure across our data center, campus...  ...for employees 401k Relocation support may be provided for certain situations... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Relocation package
    Flexible hours

    Hadrian

    Los Angeles, CA
    4 days ago
  • $155k - $215k

     ...human life on Mars. SR. IT NETWORK ENGINEER SpaceX is looking for an experienced...  ...expertise in networking technologies that support routing, switching, dynamic multicast,...  ...expanding our campus and data center infrastructure as well as our expansive wireless network... 
    Temporary work
    Weekend work

    SpaceX

    Hawthorne, CA
    1 day ago
  • $155k - $215k

     ...life on Mars. SR. IT WIRELESS NETWORK ENGINEER SpaceX is looking for an experienced...  ...across all sites. This network supports the designing, manufacturing and launching...  ...deployments. Work closely with the network infrastructure team to ensure access points are... 
    Temporary work
    Night shift
    Weekend work

    SpaceX

    Hawthorne, CA
    10 hours ago
  •  ...weaving together advances in cloud infrastructure, automation and analytics,...  ...at AHEAD. Associate Network Engineer (Internally known as an...  ...CCA-V Willingness to travel to support client projects and shadowing...  ...for additional details. Use of AI: We may use artificial intelligence... 
    Internship
    Work at office
    Visa sponsorship

    AHEAD Inc

    Los Angeles, CA
    15 hours ago
  • $292.3k

    ML engineers at Riot own the full lifecycle of machine learning in production...  ...games.The RoleAs a Principal AI/ML Platform Engineer for...  ...scale system design (Kubernetes, GPU scheduling, container...  ...player-facing experience or you’re supporting the company as a whole, everyone... 
    Temporary work
    Local area
    Flexible hours

    Riot Games

    Los Angeles, CA
    1 day ago
  • $125k - $160k

     ...enabling human life on Mars. SOFTWARE ENGINEER, AI INFRASTRUCTURE (STARSHIELD) At SpaceX we're...  ...focused on Starshield's software and GPU infrastructure, you will design, operate and scale the infrastructure that supports critical national security missions. These... 
    Temporary work
    Immediate start
    Weekend work

    SpaceX

    Hawthorne, CA
    2 days ago
  • $15k

     ...has ever seen. They should have AI that’s purpose-built for them.Nominal...  ...Platform that gives engineers increased visibility into complex...  ...triage cloud security findings and support incident response and recovery.Implement infrastructure-as-code guardrails, policy-as-code... 
    Permanent employment
    Work at office

    Nominal

    Los Angeles, CA
    2 days ago
  • $120.9k - $184.5k

    Job Type: RegularClassified IT Network Engineer The Classified IT Network Engineer works...  ...team to engineer networks and infrastructure services in the RAND classified environments...  ...with S&CO and IS technical personnel. SME support, troubleshoot network issues, lead small... 
    Full time
    Work experience placement
    Monday to Friday

    RAND Corporation

    Santa Monica, CA
    1 day ago
  •  ...weaving together advances in cloud infrastructure, automation and analytics,...  ..., and shadowing, all supported by an ecosystem of AHEADians...  ...be!  Associate Network Engineer (Internally known as an Associate...  ...details.  Use of AI: We may use artificial intelligence... 
    Internship
    Work at office
    Visa sponsorship

    AHEAD

    Los Angeles, CA
    1 day ago
  •  ...Internet Data Center Engineer/Technician Zenlayer Inc. is looking for...  .../components, copper and fiber infrastructure installations and testing, data center product support applications, software (Windows...  ...and improve their digital and AI experience. Zenlayer offers edge... 
    Full time
    Shift work
    Night shift
    Rotating shift
    Weekend work

    Zenlayer

    Los Angeles, CA
    2 days ago
  • $180k - $240k

     ...doc here. Position SummaryAs a Backend Engineer (Infrastructure) at HeyGen, you'll spearhead the development...  ...Infrastructure: Multi-vendor GPU capacity management and schedulingML Infrastructure...  ...training infrastructure to enhance our AI researchers’ productivity, and... 
    Work experience placement

    HeyGen

    Los Angeles, CA
    2 days ago
  • $65.18 per hour

     ...Angeles) provides professional targeted engineering and support to production, postproduction and...  ..., and resolve complex signal flow and infrastructure issues across traditional SDI and IP-based...  ...Disney's guidelines on the use of AI for candidates, click here. American Broadcasting... 
    Hourly pay
    Daily paid
    Full time
    For contractors
    Work experience placement
    Immediate start
    Remote work
    Worldwide
    Flexible hours
    Shift work
    Night shift

    The Walt Disney Company

    Los Angeles, CA
    14 days ago
  • $150k - $175k

     ...About Us UJET leads the way in AI-powered contact center innovation, delivering...  ...are seeking a highly experienced Cloud Infrastructure Engineer in Austin, TX, Los Angeles, CA, or...  ...for the foundational infrastructure that supports our engineering organization, including... 
    Work experience placement
    Work at office
    Local area
    Remote work
    Visa sponsorship
    Work visa

    UJET

    Los Angeles, CA
    2 days ago
  • $131.75k - $178.25k

     ...achievement and career growth. The Senior Infrastructure DevOps Engineer, under the direction of the Senior...  ...Infrastructure as Code (Terraform) practices in support of various workflows and services...  ...O365 services.Experience with AI technologies such as Copilot or Claude... 
    Full time
    Work experience placement
    Remote work
    Worldwide

    Wilson Sonsini Goodrich & Rosati

    Los Angeles, CA
    1 day ago
  • $130k - $175k

     ...of enabling human life on Mars. IT INFRASTRUCTURE ENGINEER, VIRTUALIZATION & STORAGE As an IT...  ...software lifecycle while scaling and supporting data center infrastructure, virtualization...  ...and multi-tier storage (enterprise + HPC) and be ready to build the next... 
    Temporary work
    Weekend work

    SpaceX

    Hawthorne, CA
    1 day ago
  •  ...DevOps EngineerTala is the AI-native credit infrastructure that connects global capital to the global majority. We combine proprietary risk intelligence...  ...hear from you!The RoleWe are currently seeking a DevOps Engineer to design, implement and maintain suitable infrastructure... 
    Work at office
    Remote work
    Shift work

    IVP

    Santa Monica, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI, HPC & GPU Infrastructure Support Engineer. Be the first to apply!