Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

GPU Infrastructure Architect - GPU Cluster Stand-up, Configuration & Operations

United IT

GPU Infrastructure Architect The GPU Cluster Architect is responsible for designing, provisioning, and operating AMD MI350–based GPU clusters on a cloud platform. The role ensures scalable, secure, and reproducible GPU infrastructure to support distributed training and high-performance workloads. Key Responsibilities Design end-to-end GPU cluster architecture covering compute, networking, storage, and control services. Provision and operationalize up to 9 AMD MI350 GPU clusters based on confirmed cloud SKU availability. Configure GPU compute nodes including base OS images, GPU drivers, runtime libraries, and distributed training dependencies. Implement automation for node imaging, bootstrapping, lifecycle management, patching, and upgrades. Standardize environments using reproducible builds and Infrastructure-as-Code (IaC). Enable workload portability through containerized environments and documented deployment patterns. Implement OS baseline hardening, restricted administrative access, and secure cluster access controls. Establish monitoring, logging, and operational runbooks to ensure reliability and performance. United IT

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the GPU Infrastructure Architect - GPU Cluster Stand-up, Configuration & Operations in San Jose, CA vacancy
  • $224k - $356.5k

     ...era in which our GPU acts as the brains...  ...! As a Principal Architect on our powerful...  ...vision for our modern infrastructure while working...  ...editing and bulk operations. Driving platform...  ...solutions. Ways to stand out from the...  ...release engineering or configuration management... 
    Operations
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...that builds and operates its own infrastructure, end to end. One...  ...of liquid-cooled GPU compute in a 20-...  ...how fast we can stand up a new site,...  ...Role As Network Architect, you'll own the...  ...Runware: the GPU cluster fabric inside our...  .... Treat network configuration as code: IaC,... 
    Operations
    Remote work
    Flexible hours

    Runware

    San Jose, CA
    3 days ago
  •  ...seeking a Lead HPC & AI Infrastructure Architect to own the...  ...large-scale CPU and GPU platforms across on-...  ...across engineering, operations, security, and research...  ...standards for CPU/GPU clusters. Define workload placement...  ...provisioning, configuration, and fleet upgrades... 
    Operations

    AMD

    San Jose, CA
    4 days ago
  •  ...Sciforium is an AI infrastructure company developing next-generation...  ...looking for a dedicated Hardware Operations Engineer to own the...  ...foundational infrastructure of our GPU clusters. You will be the primary...  .... Security & Access: Configure and maintain edge and internal... 
    Operations
    Full time
    Work at office
    Flexible hours

    Sciforium

    San Jose, CA
    9 days ago
  • GPU Network Engineer An innovative technology organization...  ...the forefront of AI infrastructure is seeking a GPU...  ...to help design and operate the high-performance networking...  ...next generation GPU clusters. What You Will Do...  ...infrastructure. Configure and maintain Arista, Juniper... 
    Operations

    Blue Signal Search

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...Inference Engineer, for GPU Kernel Optimization!...  ...push every LLM inference operation to its performance...  ...measured kernel benchmarking infrastructure, model-level...  ...fidelity across the full configuration space that production...  ...or SASS output.Ways to stand out from the crowdDeep... 
    Operations
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...computing. An era in which our GPU acts as the brains of...  ...techniques that explore large configuration spaces and identify viable product...  ...performance, design, silicon, Operations, and software to move...  ...implementation, and product teams.Ways to Stand Out From the Crowd:Hands-on... 
    Operations
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...networking software for GPU scale-up...  ...for next-generation AI infrastructure.THE PERSON:The ideal...  ...Ethernet MAC/PCS/FEC configuration, topology discovery and...  ...features for large-scale clusters• Support performance...  ...characterization of collective operations and distributed... 
    Operations

    AMD

    Santa Clara, CA
    2 days ago
  • $272k - $431.25k

     ...seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you will have a pivotal role...  ...tasks and systems.Hands-on experience in using or operating High Performance Computing (HPC) grade... 
    Operations
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $250k

     ...Join a fast-growing infrastructure software company backed...  ..., with 35+ live GPU cluster deployments globally...  ...flow You will be architecting and validating high-...  ...hardware and reviewing configurations with a strong...  ...engineering, automation, and operations teams to build... 
    Operations
    Permanent employment
    Flexible hours
    Santa Clara, CA
    more than 2 months ago
  •  ...ROLE:We are seeking a self-motivated GPU Hardware Security Architect to join our growing GPU...  ...register access, firmware interfaces, configuration controls, and sensitive customer data...  ...configuration, disrupt correct GPU operation, impact performance, or circumvent... 
    Operations
    Work experience placement

    AMD

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

     ...next generation of GPU systems programming....  ...Parallel Abstractions: Architect innovative compiler-...  ...(TMA), and warp/cluster-level operations.Build the future: Supporting...  ...with compiler infrastructures, intermediate representations...  ...production.Ways to stand out from the crowd:A... 
    Operations
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...Network Solutions Architect Engineer to help...  ...data center GPU and networking deployments...  ..., network, and cluster infrastructure in customer data...  ...and debug configuration and performance...  ...summaries.Ways to stand out from the...  ...bringing up and operating large clusters or... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    4 days ago
  • Job Title: GPU Network Engineer Job Location: Sunnyvale, CA (hybrid...  ..., we are an innovative energy infrastructure company that develops cutting-edge...  ...Engineer to design, build, and operate the high-speed fabrics that connect our GPU clusters. Must be local to Sunnyvale, CA... 
    Operations
    Local area
    Relocation

    CyberCoders

    San Jose, CA
    3 days ago
  • $250k - $330k

     ...leader in next-generation AI infrastructure, delivering a full-stack...  ...than the traditional GPU model. Its decode...  ...global-scale AI compute clusters. We're looking for a Network Architect join us on this exciting...  ...engineering, supply chain, operations, and customer-facing teams... 
    Operations
    Full time
    Temporary work
    Local area
    Worldwide
    Flexible hours

    SambaNova

    San Jose, CA
    6 days ago
  • $168k - $258.75k

     ...Product Manager - Data Center GPU. NVIDIA is the engine behind...  ..., AI/ML, developer tools, or infrastructure productsGreat knowledge in CPU...  ...across engineering, operations, and customer teamsPassion for...  ...products/technologiesWays to stand out from the crowd:Advanced knowledge... 
    Operations
    Full time
    Local area

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

    We are looking for a Senior GPU PCIe and Boot architect. NVIDIA is seeking outstanding...  ...design the architecture and infrastructure for boot, PCIe/CXL...  ...experience in Computer Architecture, Operation systems, and/or system architectureWays to stand out from the crowd:Knowledge... 
    Operations
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $152k - $241.5k

    We are now looking for a Senior GPU system and process scheduling architect! NVIDIA is seeking outstanding system architects to...  ...experience in Computer Architecture, Operation systems, and/or system architectureWays to stand out from the crowd:Knowledge of memory isolation... 
    Operations
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

     ...next era of computing. An era in which our GPU acts as the brains of computers, robots,...  ...within the Boot stack, ensuring detailed operation.Collaborate closely with architecture,...  ...abilities, both verbal and written.Ways to stand out from the crowd:Familiarity with Boot... 
    Operations
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $168k - $258.75k

     ...computing. An era in which our GPU acts as the brains of...  ...with our partners, engineering, operations & field teams to develop comprehensive...  ...with cloud partnersWays to stand out from the crowd: Strong...  ...or leading cloud computing infrastructure and technologiesExposure to bringing... 
    Operations
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...AI and Bitcoin mining infrastructure. Bitdeer is committed...  ...management, and daily operations. Bitdeer also offers...  ...Be Responsible For GPU as a Service (GPUaaS)...  ...metal, and dedicated GPU clusters. Develop AI labs,...  .... How You Will Stand Out ~5+ years of... 
    Operations
    Full time
    Contract work
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    21 days ago
  •  ...over 10 times faster than GPU-based hyperscale cloud inference...  ...Principal Network Security Architect to lead the design and...  ...Reliability, Security, and Infrastructure to operate at the scale and speed our...  ...Terraform), version-controlled configuration, and CI/CD for network... 
    Operations

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $196k - $310.5k

     .... An era in which our GPU acts as the brains of...  ...along with a passion for configuration standards will set you...  ...languages used in infrastructure automation.Advanced knowledge...  ...solutions.Comfort operating in ambiguity on...  ...being written.Ways To Stand Out From The Crowd:Experience... 
    Full time
    Work at office

    Nvidia

    Santa Clara, CA
    3 days ago
  • $154.68k - $231.7k

     ...building blocks of the data infrastructure that connects our world....  ...real customer workloads, operates GPU/HPC lab clusters, validates Marvell's...  ...Own Teralynx-based switch configuration, SONiC deployment, and lab...  ...and scale-out workloads.• Architect rail-optimized, leaf-spine... 
    Permanent employment
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    5 days ago
  •  ...and Bitcoin mining infrastructure. Bitdeer is...  ...management, and daily operations. Bitdeer also...  ...seeking a Senior GPU Systems & Fabric...  ...Responsibilities Architect and maintain...  ...control plane. Configure and optimize high...  ...workloads and maximize cluster utilization.... 
    Operations
    Full time
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    5 days ago
  • $124k - $195.5k

     .... An era in which our GPU acts as the brains of...  ...System and Scheduling Architect - New College Graduate...  ...Computer Architecture, Operation systems, and/or System...  ...validation activities Ways to stand out from the crowd:...  .... Today, our AI infrastructure powers global intelligence... 
    Operations
    Full time

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $263.93k - $341.55k

    Infrastructure Solutions Group (ISG) builds the products that...  ...Technical Staff-Network Architect From applied research...  ...Graphics Processing Unit (GPU)-GPU, server-storage,...  ...network topology and configuration to maximize performance of AI clusters • Work closely with key... 
    Full time

    Dell Technologies

    Santa Clara, CA
    3 days ago
  • Network Architect / Senior Network Engineer We are seeking a highly experienced Network...  ...Engineer to lead planning, design refinement, configuration development, deployment readiness, and...  ...communicate clearly with engineering, operations, project, and stakeholder teams during... 
    Operations
    H1b
    Work at office
    Work visa

    Abstra

    Cupertino, CA
    21 hours ago
  • $142.8k - $274.8k

    Principal AI Network Architect Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is...  ...security and compliance, operations, globalization, and...  ...architectures for AI clusters, racks, pods, and multi...  ...experience delivering AI and GPU-based systems to... 
    Operations
    Permanent employment
    Work at office
    Worldwide

    Microsoft Corporation

    Mountain View, CA
    3 days ago
  •  ...modeling for effective coverage and density planning. Configure and deploy access points (Client), controllers, and related infrastructure components to ensure seamless connectivity across campus facilities. Operations & Maintenance: Perform regular system checks... 
    Operations
    For contractors
    Remote work

    Macpower Digital Assets Edge Private Limited

    Santa Clara, CA
    26 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to GPU Infrastructure Architect - GPU Cluster Stand-up, Configuration & Operations. Be the first to apply!