GPU Infrastructure Architect - GPU Cluster Stand-up, Configuration & Operations
United IT
GPU Infrastructure Architect The GPU Cluster Architect is responsible for designing, provisioning, and operating AMD MI350–based GPU clusters on a cloud platform. The role ensures scalable, secure, and reproducible GPU infrastructure to support distributed training and high-performance workloads. Key Responsibilities Design end-to-end GPU cluster architecture covering compute, networking, storage, and control services. Provision and operationalize up to 9 AMD MI350 GPU clusters based on confirmed cloud SKU availability. Configure GPU compute nodes including base OS images, GPU drivers, runtime libraries, and distributed training dependencies. Implement automation for node imaging, bootstrapping, lifecycle management, patching, and upgrades. Standardize environments using reproducible builds and Infrastructure-as-Code (IaC). Enable workload portability through containerized environments and documented deployment patterns. Implement OS baseline hardening, restricted administrative access, and secure cluster access controls. Establish monitoring, logging, and operational runbooks to ensure reliability and performance. United IT
$224k - $356.5k
...era in which our GPU acts as the brains... ...! As a Principal Architect on our powerful... ...vision for our modern infrastructure while working... ...editing and bulk operations. Driving platform... ...solutions. Ways to stand out from the... ...release engineering or configuration management...OperationsFull time- ...that builds and operates its own infrastructure, end to end. One... ...of liquid-cooled GPU compute in a 20-... ...how fast we can stand up a new site,... ...Role As Network Architect, you'll own the... ...Runware: the GPU cluster fabric inside our... .... Treat network configuration as code: IaC,...OperationsRemote workFlexible hours
- ...seeking a Lead HPC & AI Infrastructure Architect to own the... ...large-scale CPU and GPU platforms across on-... ...across engineering, operations, security, and research... ...standards for CPU/GPU clusters. Define workload placement... ...provisioning, configuration, and fleet upgrades...Operations
- ...Sciforium is an AI infrastructure company developing next-generation... ...looking for a dedicated Hardware Operations Engineer to own the... ...foundational infrastructure of our GPU clusters. You will be the primary... .... Security & Access: Configure and maintain edge and internal...OperationsFull timeWork at officeFlexible hours
- GPU Network Engineer An innovative technology organization... ...the forefront of AI infrastructure is seeking a GPU... ...to help design and operate the high-performance networking... ...next generation GPU clusters. What You Will Do... ...infrastructure. Configure and maintain Arista, Juniper...Operations
$184k - $287.5k
...Inference Engineer, for GPU Kernel Optimization!... ...push every LLM inference operation to its performance... ...measured kernel benchmarking infrastructure, model-level... ...fidelity across the full configuration space that production... ...or SASS output.Ways to stand out from the crowdDeep...OperationsFull time$184k - $287.5k
...computing. An era in which our GPU acts as the brains of... ...techniques that explore large configuration spaces and identify viable product... ...performance, design, silicon, Operations, and software to move... ...implementation, and product teams.Ways to Stand Out From the Crowd:Hands-on...OperationsFull time- ...networking software for GPU scale-up... ...for next-generation AI infrastructure.THE PERSON:The ideal... ...Ethernet MAC/PCS/FEC configuration, topology discovery and... ...features for large-scale clusters• Support performance... ...characterization of collective operations and distributed...Operations
$272k - $431.25k
...seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will have a pivotal role... ...tasks and systems.Hands-on experience in using or operating High Performance Computing (HPC) grade...OperationsFull time$250k
...Join a fast-growing infrastructure software company backed... ..., with 35+ live GPU cluster deployments globally... ...flow You will be architecting and validating high-... ...hardware and reviewing configurations with a strong... ...engineering, automation, and operations teams to build...OperationsPermanent employmentFlexible hours- ...ROLE:We are seeking a self-motivated GPU Hardware Security Architect to join our growing GPU... ...register access, firmware interfaces, configuration controls, and sensitive customer data... ...configuration, disrupt correct GPU operation, impact performance, or circumvent...OperationsWork experience placement
$152k - $241.5k
...next generation of GPU systems programming.... ...Parallel Abstractions: Architect innovative compiler-... ...(TMA), and warp/cluster-level operations.Build the future: Supporting... ...with compiler infrastructures, intermediate representations... ...production.Ways to stand out from the crowd:A...OperationsFull timeRemote work$184k - $287.5k
...Network Solutions Architect Engineer to help... ...data center GPU and networking deployments... ..., network, and cluster infrastructure in customer data... ...and debug configuration and performance... ...summaries.Ways to stand out from the... ...bringing up and operating large clusters or...Full timeRemote work- Job Title: GPU Network Engineer Job Location: Sunnyvale, CA (hybrid... ..., we are an innovative energy infrastructure company that develops cutting-edge... ...Engineer to design, build, and operate the high-speed fabrics that connect our GPU clusters. Must be local to Sunnyvale, CA...OperationsLocal areaRelocation
$250k - $330k
...leader in next-generation AI infrastructure, delivering a full-stack... ...than the traditional GPU model. Its decode... ...global-scale AI compute clusters. We're looking for a Network Architect join us on this exciting... ...engineering, supply chain, operations, and customer-facing teams...OperationsFull timeTemporary workLocal areaWorldwideFlexible hours$168k - $258.75k
...Product Manager - Data Center GPU. NVIDIA is the engine behind... ..., AI/ML, developer tools, or infrastructure productsGreat knowledge in CPU... ...across engineering, operations, and customer teamsPassion for... ...products/technologiesWays to stand out from the crowd:Advanced knowledge...OperationsFull timeLocal area$184k - $287.5k
We are looking for a Senior GPU PCIe and Boot architect. NVIDIA is seeking outstanding... ...design the architecture and infrastructure for boot, PCIe/CXL... ...experience in Computer Architecture, Operation systems, and/or system architectureWays to stand out from the crowd:Knowledge...OperationsFull time$152k - $241.5k
We are now looking for a Senior GPU system and process scheduling architect! NVIDIA is seeking outstanding system architects to... ...experience in Computer Architecture, Operation systems, and/or system architectureWays to stand out from the crowd:Knowledge of memory isolation...OperationsFull time$152k - $241.5k
...next era of computing. An era in which our GPU acts as the brains of computers, robots,... ...within the Boot stack, ensuring detailed operation.Collaborate closely with architecture,... ...abilities, both verbal and written.Ways to stand out from the crowd:Familiarity with Boot...OperationsFull time$168k - $258.75k
...computing. An era in which our GPU acts as the brains of... ...with our partners, engineering, operations & field teams to develop comprehensive... ...with cloud partnersWays to stand out from the crowd: Strong... ...or leading cloud computing infrastructure and technologiesExposure to bringing...OperationsFull time- ...AI and Bitcoin mining infrastructure. Bitdeer is committed... ...management, and daily operations. Bitdeer also offers... ...Be Responsible For GPU as a Service (GPUaaS)... ...metal, and dedicated GPU clusters. Develop AI labs,... .... How You Will Stand Out ~5+ years of...OperationsFull timeContract workLocal area
- ...over 10 times faster than GPU-based hyperscale cloud inference... ...Principal Network Security Architect to lead the design and... ...Reliability, Security, and Infrastructure to operate at the scale and speed our... ...Terraform), version-controlled configuration, and CI/CD for network...Operations
$196k - $310.5k
.... An era in which our GPU acts as the brains of... ...along with a passion for configuration standards will set you... ...languages used in infrastructure automation.Advanced knowledge... ...solutions.Comfort operating in ambiguity on... ...being written.Ways To Stand Out From The Crowd:Experience...Full timeWork at office$154.68k - $231.7k
...building blocks of the data infrastructure that connects our world.... ...real customer workloads, operates GPU/HPC lab clusters, validates Marvell's... ...Own Teralynx-based switch configuration, SONiC deployment, and lab... ...and scale-out workloads.• Architect rail-optimized, leaf-spine...Permanent employmentInternshipWork from home- ...and Bitcoin mining infrastructure. Bitdeer is... ...management, and daily operations. Bitdeer also... ...seeking a Senior GPU Systems & Fabric... ...Responsibilities Architect and maintain... ...control plane. Configure and optimize high... ...workloads and maximize cluster utilization....OperationsFull timeLocal area
$124k - $195.5k
.... An era in which our GPU acts as the brains of... ...System and Scheduling Architect - New College Graduate... ...Computer Architecture, Operation systems, and/or System... ...validation activities Ways to stand out from the crowd:... .... Today, our AI infrastructure powers global intelligence...OperationsFull time$263.93k - $341.55k
Infrastructure Solutions Group (ISG) builds the products that... ...Technical Staff-Network Architect From applied research... ...Graphics Processing Unit (GPU)-GPU, server-storage,... ...network topology and configuration to maximize performance of AI clusters • Work closely with key...Full time- Network Architect / Senior Network Engineer We are seeking a highly experienced Network... ...Engineer to lead planning, design refinement, configuration development, deployment readiness, and... ...communicate clearly with engineering, operations, project, and stakeholder teams during...OperationsH1bWork at officeWork visa
$142.8k - $274.8k
Principal AI Network Architect Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is... ...security and compliance, operations, globalization, and... ...architectures for AI clusters, racks, pods, and multi... ...experience delivering AI and GPU-based systems to...OperationsPermanent employmentWork at officeWorldwide- ...modeling for effective coverage and density planning. Configure and deploy access points (Client), controllers, and related infrastructure components to ensure seamless connectivity across campus facilities. Operations & Maintenance: Perform regular system checks...OperationsFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU Infrastructure Architect - GPU Cluster Stand-up, Configuration & Operations. Be the first to apply!
- infrastructure architect San Jose, CA
- network architect San Jose, CA
- veterinary operations San Jose, CA
- import export operations San Jose, CA
- franchise operations San Jose, CA
- nonprofit operations San Jose, CA
- data center operations technician San Jose, CA
- operation strategy cost manager San Jose, CA
- gas operations San Jose, CA
- vice president clinical operations San Jose, CA



