Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior GPU Fabric Architect for AI Cloud

Bitdeer

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.

To learn more, visit

Position Overview

We are seeking a Senior GPU Systems & Fabric Engineer to serve as the critical bridge between our physical GPU/network infrastructure and the Kubernetes abstraction layer. You will be responsible for creating the high-performance 'hardware foundation' that makes AI-native cloud computing possible. This role requires deep expertise in Linux kernel internals, GPU architectures, and high-speed interconnects, as you will be tasked with transforming raw, bare-metal compute resources into scalable, resilient, and multi-tenant cloud primitives. You will drive the design of our fabric layer, ensuring that our AI workloads have the low-latency, high-bandwidth environment they require to perform at industry-leading speeds.

Key Responsibilities

  • Architect and maintain integrations for NVIDIA/AMD GPU device plugins and Kubernetes Operators to expose hardware capabilities to the control plane.
  • Configure and optimize high-performance host networking stacks, including RDMA, SR-IOV, RoCEv2, and InfiniBand, ensuring line-rate throughput for distributed AI training.
  • Build and manage automated hardware remediation pipelines using DCGM telemetry to proactively identify, isolate, and reset degraded GPU/NIC components before they impact production jobs.
  • Implement and manage sophisticated GPU slicing technologies (MIG, vGPU) to enable efficient multi-tenant inference workloads and maximize cluster utilization.
  • Profile and tune kernel-level parameters, device drivers, and runtime libraries (CUDA, NCCL) to resolve bottlenecks and optimize containerized AI workloads.
  • Collaborate with the Scheduling and Storage engineering teams to ensure topology-aware placement and efficient data movement across the fabric.
  • Define and enforce operational standards for bare-metal provisioning, BIOS/firmware updates, and OS hardening within the containerized environment.
  • Lead technical investigations into complex performance issues spanning hardware, fabric, and software, providing actionable architectural insights.
  • Mentor team members and drive documentation standards for our evolving AI hardware stack.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or related field.
  • 5+ years of systems engineering experience, with strong proficiency in Linux kernel internals, C, or Go.
  • Hands-on experience with GPU architectures (NVIDIA H100/A100), CUDA runtimes, and distributed networking (RDMA, InfiniBand).
  • Deep understanding of containerized environments and Kubernetes device plugin architecture.
  • Proven track record of operating, debugging, and scaling bare-metal systems in large-scale production or HPC environments.
  • Familiarity with infrastructure automation (e.g., Terraform, Ansible, CI/CD pipelines) for managing hardware lifecycles.
  • Strong problem-solving skills, with the ability to navigate ambiguous performance challenges at the intersection of hardware and software.
  • Excellent communication skills, with a collaborative approach to working across infrastructure, scheduling, and reliability teams.
  • Experience working in high-velocity, high-growth engineering environments is strongly preferred

--------------------------------------------------------------------

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.

#J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior GPU Fabric Architect for AI Cloud in San Jose, CA vacancy
  •  ...leading technology company for AI and Bitcoin mining infrastructure...  .... Bitdeer also offers advanced cloud capabilities to customers with...  ...both bare-metal and VM-based GPU nodes, and will lead our adoption...  ...-aware scheduling for GPU fabrics — Model the physical fabric in... 
    Cloud
    Senior
    Local area
    Shift work

    Bitdeer

    San Jose, CA
    2 days ago
  •  ...generation computing experiences—from AI and data centers, to PCs,...  ...We are seeking a Robotics AI Architect to define and scale next-...  ...software co-design across CPU, GPU, and acceleratorsLighthouse Customer...  ..., RL work, Sim-to-real, cloud-to-sim, real-to-sim/cloud from... 
    Cloud
    Senior

    AMD

    San Jose, CA
    2 days ago
  • KLA is seeking a Senior HPC Platform Architect in Milpitas, CA to design and lead next-generation...  ...for semiconductor manufacturing and AI workloads. You will define...  ...software, hardware, networking, storage, GPU acceleration, and cloud integration. You will drive technology... 
    Cloud
    Senior

    KLA

    Milpitas, CA
    4 days ago
  • $180k - $320k

     ...leading technology company for AI and Bitcoin mining...  ...Bitdeer also offers advanced cloud capabilities to customers with...  ...Overview We are seeking a Senior GPU Systems & Fabric Engineer to serve as the...  ...Responsibilities Architect and maintain integrations for... 
    Cloud
    Senior
    Remote job
    Full time
    Local area

    Bitdeer

    San Jose, CA
    a month ago
  • $212.8k

     ..., platform tooling, as well as cloud services and server system services. We are looking for an architect-level contributor to lead the design...  ..., and adoption of enterprise AI agent capabilities, AI harness...  ...both domestic and non-domestic GPU hardware architectures,... 
    Cloud
    Senior
    Temporary work
    Local area
    Overseas

    ByteDance (old)

    San Jose, CA
    2 days ago
  •  ...Principal AI Platform Architect (GCP GKE | TPU/GPU Infrastructure) Location: Milpitas, CA (Onsite) Work Authorization: USC/GC only (W2/C2C) Experience...  ...with 5+ Years in AI/ML Platform Architecture on Google Cloud Platform (GCP) Position Summary Customer is... 
    Cloud

    ReqRoute,Inc

    Milpitas, CA
    4 days ago
  • NVIDIA is hiring software engineers with Kubernetes expertise to help scale its DGX Cloud GPU infrastructure for AI workloads. You will work on production systems, GPU resource scheduling, and cluster health monitoring. We seek 5+ years in a software engineering role, strong... 
    Cloud

    NVIDIA Corporation

    Santa Clara, CA
    5 days ago
  • NVIDIA is seeking a Senior Applied Power Architect - GPU to lead power/energy-efficiency efforts for next-generation AI architectures in Santa Clara. You will invent methodologies, drive PDN and power integrity work, and collaborate with ASIC, packaging, and product teams... 
    Senior

    NVIDIA

    Santa Clara, CA
    3 days ago
  • NVIDIA's Applied Power Architecture team seeks a Senior Applied Power Architect - GPU to drive energy-efficient GPU/SoC designs for AI, automotive, and mobile products. You will lead power integrity initiatives, PDN design efforts, and cross-disciplinary collaboration to... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...architectures used for artificial intelligence (AI) / deep learning (DL), high-performance computing (HPC), cloud service providers (CSP), gaming,...  ...-core and multi-socket CPU and CPU/GPU systems.Work with CPU and interconnect architects to improve future CPU and system... 
    Cloud
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • NVIDIA DGX Cloud builds and operates large-scale GPU infrastructure for AI workloads. We seek Software Engineers with SRE/Production Engineering experience who have hands-on experience with bare-metal NVIDIA systems and who can develop tooling to move GPU capacity into... 
    Cloud
    Senior

    Devopsroles

    Santa Clara, CA
    2 days ago
  • Amazon Data Services, Inc. seeks a Senior Accelerator Engineer to own the GPU component lifecycle across AI accelerator platforms, from defining hardware, firmware, and diagnostics to qualification and field deployment. You will lead fleet-scale failure analysis, set health... 
    Cloud
    Senior

    Amazon Inc.

    Cupertino, CA
    3 days ago
  • NVIDIA AI in Santa Clara seeks an experienced software engineer to design and build distributed services and data pipelines for GPU capacity, reservations, and utilization across DGX Cloud environments. Responsibilities include automating capacity-management workflows and... 
    Cloud
    Senior

    NVIDIA AI

    Santa Clara, CA
    2 days ago
  • NVIDIA Corporation is seeking a Senior Cloud Software Engineer in Santa Clara, CA to design and deliver SDKs/CLIs for Cloud GPU Services. Lead cross-functional efforts, drive architecture, and ensure robust software with CI/CD and tests. Ideal candidates have 8+ years in... 
    Cloud
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

     ...Performance Computing and Visualization. The GPU, our invention, serves as the visual...  ...preferably PythonFamiliar with containers, cloud provisioning and scheduling tools (Kubernetes...  ...is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is... 
    Cloud
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    6 days ago
  • $175k - $275k

     ...builds the world's largest AI chip, 56 times larger than...  ...over 10 times faster than GPU-based hyperscale cloud inference services. This order...  ...ultra high-speed inference.Senior Staff AI Accelerator...  ...looking for a performance architect to guide the evolution of our... 
    Cloud
    Senior

    Cerebras Systems

    Sunnyvale, CA
    5 days ago
  • $208k - $327.75k

     ...has transformed industries from AI and HPC to Autonomous Driving...  ...computational demands rise, GPU-accelerated storage solutions...  ...Definition: Collaborate closely with architects, engineers, and researchers to...  ...strategies or requirements in cloud-based or HPC environments.... 
    Cloud
    Senior
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    6 days ago
  •  ...next-generation computing experiences—from AI and data centers, to PCs, gaming and...  ...your career. THE ROLE:Join AMD’s Datacenter GPU Product Application Engineering team to lead...  ...engineering roles within data center, GPU, cloud, or HPC environments. You are equally comfortable... 
    Cloud
    Senior
    For contractors

    AMD

    Santa Clara, CA
    5 days ago
  •  ...Senior Systems Software Engineer – GPU Performance at Scale We are looking for a dedicated engineer for the Senior...  ...position will drive innovation in AI and GPU computing. What You’ll Be...  ...stacks (CUDA). Experience with modern cloud and container‑based enterprise... 
    Cloud
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  • $144k - $270.25k

    We are now looking for Software Engineers who see the big picture of Cloud Computing and AI. This essential role will give you a rare opportunity to craft and deliver a new class of GPU services for Cloud Computing in the fields of Deep Learning and AI. Your work will... 
    Cloud
    Senior

    NVIDIA

    Santa Clara, CA
    2 days ago
  •  ...Netris, Inc. is shaping the AI buildout by building a leading network automation platform for demanding AI clouds. The Product Architect will sit at the intersection of deep network engineering and product thinking, translating how networks are built and operated into... 
    Cloud
    Senior

    Jobleads-US

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...unlimited potential of AI to define the next era of...  ...computing. An era in which our GPU acts as the brains of...  ...engineer for the Senior Systems Software Engineer...  ...systems specialists to architect, build, and optimize large...  ....Experience with modern cloud and container-based enterprise... 
    Cloud
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    6 days ago
  • General Motors LLC in Sunnyvale is seeking a Senior Performance Engineer to join the AV Capacity and...  ...optimize large-scale ML infrastructure, drive GPU system strategy, and help manage cloud budgets while enabling faster AI development for autonomous vehicles. You will... 
    Cloud
    Senior

    General Motors LLC

    Sunnyvale, CA
    5 days ago
  •  ...technology company for AI and Bitcoin mining infrastructure...  ...also offers advanced cloud capabilities to...  ...) working system and re-architect it into a commercial, globally...  ...token throughput per GPU, and invoice-grade accounting...  ...customers. Act as a senior technical voice who can... 
    Cloud
    Senior
    Contract work
    Local area
    Remote work

    Bitdeer

    San Jose, CA
    2 days ago
  • $184k - $287.5k

     ...team at NVIDIA and help bring AI solutions to our largest customers...  ...seeking an expert Solutions Architect to assist customers in...  ...critical business needs and support cloud service integration for NVIDIA...  ...diagnostics.Hands-on experience with GPU systems in general including... 
    Cloud
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • Palo Alto Networks is hiring for a senior DevOps/Cloud Platform Engineer to advance Prisma AIRS, a cloud-native security platform. The role emphasizes building scalable, secure infrastructure, driving GitOps adoption, and mentoring engineers across teams. The team leverages... 
    Cloud
    Senior

    Devopsroles

    Santa Clara, CA
    2 days ago
  • NVIDIA Gruppe is looking for a senior test development engineer in Santa Clara, California....  ...involves driving quality and automation for AI microservices, leading testing strategies,...  ...in Python, and familiarity with cloud-native platforms such as Docker and Kubernetes... 
    Cloud
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

    Senior Software Engineer, Agent Policy Fabric# CAREERS AT NVIDIA## Senior Software Engineer, Agent Policy FabricApply...  ...an enterprise governance layer for AI agents. APF combines signed policy,...  ...evolution, backward-compatible APIs, or cloud and enterprise deployment... 
    Cloud
    Senior
    Full time
    Remote work

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...tapping into the unlimited potential of AI to define the next era of computing. An...  ...building reliable systems software for cloud-scale GPU infrastructure, we encourage you to contribute...  ...to our team. We are looking for a Senior Software Engineer to join our DGX Cloud... 
    Cloud
    Senior
    Full time
    Local area
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • NVIDIA in Santa Clara is seeking an experienced Solutions Architect to help customers adopt GPU hardware and software while building ML/DL, data analytics, and related topics on cloud platforms. You will engage researchers and data scientists and work with NVIDIA’s full... 
    Cloud
    Senior
    Remote job

    NVIDIA

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior GPU Fabric Architect for AI Cloud. Be the first to apply!