AI, HPC & GPU Infrastructure Support Engineer
$90k - $160kvastai
About Us
Vast.ai 's cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing — reshaping our future for the benefit of humanity. Our mission is to organize, optimize, and orient the world's computation.
We value elegance, ownership, integrity, and continuous learning. You'll have the opportunity to dive into state-of-the-art AI systems while collaborating with a globally distributed team.
About the Role
This role focuses on troubleshooting complex Linux and GPU infrastructure issues across NVIDIA drivers, CUDA, GPU workloads, Ubuntu, Docker, KVM based virtual machines, networking, hardware, BIOS, and firmware. You’ll investigate failures, reproduce issues, identify root causes, and propose practical solutions across the full infrastructure stack.
You’ll also serve as the engineering resource our L1 support team relies on when tickets go beyond frontline triage. You’ll own complex escalations end-to-end, gather technical evidence, coordinate with the appropriate teams, and communicate findings clearly to clients, infrastructure suppliers, and internal teams.
The best engineers in this role don’t just resolve individual issues—they recognize recurring patterns, improve diagnostic tooling, and build runbooks that prevent future incidents. You’ll collaborate directly with the engineering and host support teams on systemic Linux, GPU, and infrastructure problems.
Strong GPU troubleshooting experience, Linux systems knowledge, and technical support skills are the primary requirements. You should be comfortable working autonomously in Ubuntu environments and troubleshooting NVIDIA drivers, CUDA, containers, virtual machines, networking, hardware, and GPU workloads.
Vast.ai users or hosts strongly preferred.
Location and Schedule
This is a full-time position based in our Westwood, Los Angeles office.
Available schedules:
Monday–Friday: Fully on-site
Sunday–Thursday: Four days on-site and one day working from home
Key Responsibilities
Diagnose and resolve issues across NVIDIA CUDA/GPU drivers, Docker, and KVM virtualization environments
Investigate GPU utilization, container resource constraints, thermal throttling, driver conflicts, and disk I/O bottlenecks
Assist clients and infrastructure suppliers working with TensorFlow, PyTorch, and other GPU-accelerated workloads
Troubleshoot network-layer issues, including VLAN, DNS, DHCP, VPN, NAT, firewall rules, and connectivity failures on host machines
Handle escalated support tickets involving GPU workload failures, container issues, networking problems, account infrastructure, and host-side configuration
Provide managed support for supplier onboarding and ongoing machine management, including installation, configuration, and post setup troubleshooting
Advise suppliers on hardware setup, driver configuration, BIOS and firmware settings, and network configuration for optimal performance
Provide coverage for L1 support overflow during peak periods or incidents
Write and maintain internal runbooks, escalation guides, and knowledge base articles to reduce repeat escalations
Build diagnostic and automation tooling in Python and Bash to reduce manual triage overhead
Collaborate with the engineering and support teams to flag and document systemic or recurring platform issues
You Are
Experienced with Linux, especially Ubuntu, and comfortable troubleshooting from the command line
Someone who enjoys debugging difficult problems and fixing broken systems
Methodical and focused on finding root causes, not just temporary fixes
Able to manage complex tickets independently
A clear written communicator with an interest in AI infrastructure and GPU computing
Must-Haves
Strong Linux systems operations experience with Ubuntu, RHEL/CentOS, or Debian, including networking, storage, services, and permissions
Proficiency with Docker, including container debugging, Docker Compose, image management, cgroup limits, and Docker storage and filesystem troubleshooting
Experience with virtualization platforms such as Proxmox VE, VMware, or similar hypervisors, including VM provisioning and troubleshooting
Strong networking fundamentals, including VLANs, DNS, DHCP, NAT, VPNs, firewall rules, and L2/L3 troubleshooting
Hands-on experience with NVIDIA GPU drivers, CUDA, and GPU workload troubleshooting
Python and Bash scripting skills for automation and diagnostic tooling
Strong written English communication that is clear, professional, and technically precise
Experience providing technical support in a customer-facing or internal help desk environment
Ability to prioritize across a concurrent queue of escalated tickets, triaging by severity and customer impact, balancing reactive resolution against proactive documentation and tooling work, and making clear judgment calls on when to escalate versus own resolution end-to-end
Nice-to-Haves
Familiarity with AI/ML frameworks (TensorFlow, PyTorch) and running GPU-accelerated containers
Monitoring and observability experience (Prometheus, Grafana)
Relevant certifications: RHCSA, CompTIA Linux+, or similar
Knowledge of the Vast.ai platform as a client or infrastructure supplier
Interview Process (~1 week)
After you submit your application, our technical team will review your experience and qualifications. Selected candidates will proceed through the following stages:
15 minutes — Initial Screening (Virtual): A brief conversation about your background, availability, and interest in the role
45 minutes — Experience Interview (Virtual): An introduction to Vast.ai and a deeper discussion of your technical and support experience
2 hours — Meet and Greet and Technical Assessment (On-site): Meet the team and complete an LLM-assisted Linux systems operations assessment
Annual Salary Range
$90,000 – $160,000 + equity + benefits
Vast.ai is hiring across all experience levels with compensation commensurate with background, experience and potential.
Benefits
Comprehensive health, dental, vision, and life insurance
401(k) with company match
Meaningful early-stage equity
Onsite meals, snacks, and close collaboration with founders/tech leaders
Ambitious, fast-paced startup culture where initiative is rewarded
$180k - $205k
...at the forefront of AI systems within the legal... ...professional in a supportive culture. If you aspire... ...Role The Manager of Infrastructure - Platform Engineering is an integral part... ...platform architecture, GPU scheduling and... ...VAST Data or comparable HPC/AI storage, preferablyExperience...SuggestedWork experience placementWork at officeFlexible hours$155k - $175k
...Are Liqid is doing for AI infrastructure what VMware did for x86... ...the adoption of AI, HPC and VDI by unlocking the bottleneck of GPU utilization and availability... ...of Worldwide Solutions Engineering and working directly... ...• Working closely with support, marketing and our OEM...SuggestedFull timeCasual workWork at officeLocal areaRemote workWorldwideFlexible hours$125k - $160k
...enabling human life on Mars. NETWORK ENGINEER, AI INFRASTRUCTURE (STARSHIELD) Starshield leverages... ...Starlink technology and launch capability to support national security efforts. While... ...solutions for AI clusters (100k+ GPU scale) Collaborate with ML training...SuggestedTemporary workInternshipImmediate startWeekend work$90k - $150k
...About Us Vast.ai 's cloud powers AI projects and... ...Role This is a technical support role focused on escalated infrastructure issues that go beyond... ...frontline triage. You'll be the engineering resource our L1 support... ..., Docker, NVIDIA CUDA/GPU, and virtualization (KVM)...SuggestedFull timeWork at office- ...applications powered by our cutting-edge AI research. As a Data Infrastructure Engineer, you will lead the development of... ...and systems needed to support our AI applications. Examples includeLarge... ...Preferred Qualifications:Experience with GPU computingExperience with...Suggested
- ...Orbital Technical Support EngineerOrbital is the AI platform for real estate legal work. Real estate shapes... ...our cultural landmarks. It's the infrastructure that powers everyday life and is... ...re looking for a Technical Support Engineer to join our Los Angeles team and help...Immediate start
- ...About the role We're looking for a Support Engineer to be the first line of help when something... ...pressure matters. We're also an AI-first team. Our senior engineers use AI... ...running an application locally, or reading infrastructure-as-code. Setting up monitoring,...Work at officeShift work
$24.75 per hour
...IT Support Engineer The IT Support Engineer plays a critical role in supporting all team members across the organization, providing timely... ...glove service when warranted. WME Enterprise IT operates as an AI-augmented function — every role, including this one, is...Hourly payMinimum wageTemporary workWork at officeLocal areaImmediate startFlexible hoursRotating shift$75 - $85 per hour
TEKsystems is seeking Infrastructure Engineers with experience supporting enterprise environments across cloud, systems administration, virtualization, network... ...and civil liability.Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support...Contract workTemporary work- ...Our platform gives hardware engineering teams a single place to ingest... ...like Anduril and Shield AI to next-generation aerospace... ...'re looking for a Baremetal Infrastructure Engineer to join our team building... ...modernization, all while supporting deployments in highly...Permanent employmentWork at office
$175k - $285k
...reindustrialize America. By combining AI, advanced software, robotics,... ...technical direction for the infrastructure platform powering automated... ...the standards, patterns, and engineering culture that the entire... ...for employees 401k Relocation support may be provided for certain...Permanent employmentFull timeRelocation packageFlexible hours- ...About Us Vast.ai ’s cloud powers AI projects and businesses... ...excellence. We seek engineers with strong intrinsic drive,... ...About the Role As a Senior Infrastructure Engineer, you will help design... ...that power Vast.ai’s global GPU marketplace. You’ll work closely...Full timeWork at office
$129.3k - $173.3k
...Technology is a global organization of engineers, product developers, designers, technologists... ...is passionate about large-scale network infrastructure. This is a technical leadership role... ...about Disney's guidelines on the use of AI for candidates, click here.Disney Entertainment...Worldwide$114.75k - $140.25k
...Operations - Information / Software Engineering /Full-time /On-siteHermeus is... ...Hermeus networks as well as support cross-org needs for network... ...other IT teams to support infrastructure projects and resolve complex... ...use artificial intelligence (AI) tools to support parts of the...Weekly payPermanent employmentFull timeFor contractorsWork at officeLocal area$123k - $220k
...reindustrialize America. By combining AI, advanced software, robotics,... ...looking for a Senior Network Engineer to own the design,... ..., and reliability of network infrastructure across our data center, campus... ...for employees 401k Relocation support may be provided for certain situations...Permanent employmentFull timeWork at officeRemote workRelocation packageFlexible hours$155k - $215k
...human life on Mars. SR. IT NETWORK ENGINEER SpaceX is looking for an experienced... ...expertise in networking technologies that support routing, switching, dynamic multicast,... ...expanding our campus and data center infrastructure as well as our expansive wireless network...Temporary workWeekend work$155k - $215k
...life on Mars. SR. IT WIRELESS NETWORK ENGINEER SpaceX is looking for an experienced... ...across all sites. This network supports the designing, manufacturing and launching... ...deployments. Work closely with the network infrastructure team to ensure access points are...Temporary workNight shiftWeekend work- ...weaving together advances in cloud infrastructure, automation and analytics,... ...at AHEAD. Associate Network Engineer (Internally known as an... ...CCA-V Willingness to travel to support client projects and shadowing... ...for additional details. Use of AI: We may use artificial intelligence...InternshipWork at officeVisa sponsorship
$292.3k
ML engineers at Riot own the full lifecycle of machine learning in production... ...games.The RoleAs a Principal AI/ML Platform Engineer for... ...scale system design (Kubernetes, GPU scheduling, container... ...player-facing experience or you’re supporting the company as a whole, everyone...Temporary workLocal areaFlexible hours$125k - $160k
...enabling human life on Mars. SOFTWARE ENGINEER, AI INFRASTRUCTURE (STARSHIELD) At SpaceX we're... ...focused on Starshield's software and GPU infrastructure, you will design, operate and scale the infrastructure that supports critical national security missions. These...Temporary workImmediate startWeekend work$15k
...has ever seen. They should have AI that’s purpose-built for them.Nominal... ...Platform that gives engineers increased visibility into complex... ...triage cloud security findings and support incident response and recovery.Implement infrastructure-as-code guardrails, policy-as-code...Permanent employmentWork at office$120.9k - $184.5k
Job Type: RegularClassified IT Network Engineer The Classified IT Network Engineer works... ...team to engineer networks and infrastructure services in the RAND classified environments... ...with S&CO and IS technical personnel. SME support, troubleshoot network issues, lead small...Full timeWork experience placementMonday to Friday- ...weaving together advances in cloud infrastructure, automation and analytics,... ..., and shadowing, all supported by an ecosystem of AHEADians... ...be! Associate Network Engineer (Internally known as an Associate... ...details. Use of AI: We may use artificial intelligence...InternshipWork at officeVisa sponsorship
- ...Internet Data Center Engineer/Technician Zenlayer Inc. is looking for... .../components, copper and fiber infrastructure installations and testing, data center product support applications, software (Windows... ...and improve their digital and AI experience. Zenlayer offers edge...Full timeShift workNight shiftRotating shiftWeekend work
$180k - $240k
...doc here. Position SummaryAs a Backend Engineer (Infrastructure) at HeyGen, you'll spearhead the development... ...Infrastructure: Multi-vendor GPU capacity management and schedulingML Infrastructure... ...training infrastructure to enhance our AI researchers’ productivity, and...Work experience placement$65.18 per hour
...Angeles) provides professional targeted engineering and support to production, postproduction and... ..., and resolve complex signal flow and infrastructure issues across traditional SDI and IP-based... ...Disney's guidelines on the use of AI for candidates, click here. American Broadcasting...Hourly payDaily paidFull timeFor contractorsWork experience placementImmediate startRemote workWorldwideFlexible hoursShift workNight shift$150k - $175k
...About Us UJET leads the way in AI-powered contact center innovation, delivering... ...are seeking a highly experienced Cloud Infrastructure Engineer in Austin, TX, Los Angeles, CA, or... ...for the foundational infrastructure that supports our engineering organization, including...Work experience placementWork at officeLocal areaRemote workVisa sponsorshipWork visa$131.75k - $178.25k
...achievement and career growth. The Senior Infrastructure DevOps Engineer, under the direction of the Senior... ...Infrastructure as Code (Terraform) practices in support of various workflows and services... ...O365 services.Experience with AI technologies such as Copilot or Claude...Full timeWork experience placementRemote workWorldwide$130k - $175k
...of enabling human life on Mars. IT INFRASTRUCTURE ENGINEER, VIRTUALIZATION & STORAGE As an IT... ...software lifecycle while scaling and supporting data center infrastructure, virtualization... ...and multi-tier storage (enterprise + HPC) and be ready to build the next...Temporary workWeekend work- ...DevOps EngineerTala is the AI-native credit infrastructure that connects global capital to the global majority. We combine proprietary risk intelligence... ...hear from you!The RoleWe are currently seeking a DevOps Engineer to design, implement and maintain suitable infrastructure...Work at officeRemote workShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI, HPC & GPU Infrastructure Support Engineer. Be the first to apply!
- entry level infrastructure engineer Los Angeles, CA
- principal infrastructure engineer Los Angeles, CA
- infrastructure engineering manager Los Angeles, CA
- infrastructure developer Los Angeles, CA
- security infrastructure engineer Los Angeles, CA
- infrastructure engineer Los Angeles, CA
- remote infrastructure engineer Los Angeles, CA
- senior infrastructure engineer Los Angeles, CA
- senior application support engineer Los Angeles, CA
- IT engineer Los Angeles, CA




