Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr GPU Cloud K8S Expert (SRE SME)

Bitdeer Technologies Group

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.
To learn more, visit

Position Overview

You run the control plane where AIOps meets tenants — where topology-aware scheduling, self-healing, and agent-driven remediation actually execute.

NeoCloud is building an AI-operated GPU cloud. Kubernetes is where all of that lands on real customer workloads: the topology-aware scheduler places jobs on the right NVLink domain, the operator drains and reschedules around predicted faults, and the tenant boundary is enforced against a Bare-Metal-as-a-Service backend. In this role you design, deploy, and operate that control plane — and you make sure the AIOps substrate can reach in and remediate without a human on the pager.

What you'll own

  • Production Kubernetes clusters optimized for GPU workloads at scale (100–10,000 GPUs).
  • Nvidia GPU operator, device plugin, MIG configuration, and GPU time-slicing policies.
  • Topology-aware scheduling: GPU locality, NVLink domain awareness, network rail affinity.
  • Custom Resource Definitions (CRDs) for GPU workload lifecycle management.
  • AI framework integrations: Slurm on K8S, Ray on K8S, Kubeflow.
  • Multi-tenant isolation: namespaces, network policies, resource quotas, RBAC, pod security standards.
  • Bare-Metal as a Service (BMaaS): automated provisioning, tenant onboarding, lifecycle, reclamation.
  • Terraform providers and modules for infrastructure-as-code across GPU clusters.
  • SLIs/SLOs for cluster availability, job completion rates, and provisioning latency.
  • Incident management: runbook automation, escalation, post-incident reviews.
  • Monitoring stack: Prometheus, Grafana, Alertmanager, PagerDuty.
  • GPU node failure handling: automated detection, drain/cordon/taint, workload rescheduling.

Feed the AIOps substrate

  • The remediation-actuator and workflow engine land here — you make the control plane safe for automated action.
  • Your CRDs are the schema the platform's predictors and remediators write against.
  • Every human intervention you do this quarter becomes an autonomous workflow next quarter.

What success looks like in year 1

  • Automated drain/reschedule around predicted GPU faults, at scale, without customer impact.
  • BMaaS live for external tenants with self-service onboarding.
  • Cluster availability and job-completion SLOs published and met.

Job Requirement:

  • 5+ years in Kubernetes operations, with at least 2 years managing GPU workloads on K8S
  • Deep understanding of Nvidia GPU operator, device plugin, and GPU scheduling in K8S
  • Experience with topology-aware scheduling and GPU-specific resource management
  • Hands-on experience building multi-tenant K8S platforms with strong isolation guarantees
  • Experience with bare-metal server provisioning and lifecycle automation (Ironic, MAAS, or custom)
  • Proficiency in Terraform, Helm, and GitOps workflows (ArgoCD/Flux)
  • Strong SRE background: SLI/SLO frameworks, incident management, capacity planning
  • Experience with Prometheus, Grafana, and alerting at scale
  • Strong programming skills in Go or Python for operator/CRD development
  • AIOps aptitude — you think of the K8S control plane as an execution surface for automated remediation, not just a scheduler. You've either wired an autoscaler/remediator loop into K8S or you can design one.
  • Runbook-as-code mindset — every SRE playbook you write should be executable by the platform.

--------------------------------------------------------------------

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Sr GPU Cloud K8S Expert (SRE SME) in San Jose, CA vacancy
  •  ...equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial...  ...stalls a $50M training run. Bitdeer is building an AI-operated GPU cloud. Storage is where AI workloads either fly or fall over: a... 
    Cloud
    Senior
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    1 day ago
  •  ...equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial...  ...from tickets into policy. NeoCloud is building an AI-operated GPU cloud spanning 4 US DCs, APAC sites, and Iceland. In this role you... 
    Cloud
    Senior
    Remote job
    Full time
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    22 days ago
  • NVIDIA DGX Cloud builds and operates large-scale GPU infrastructure for AI workloads. We seek Software Engineers with SRE/Production Engineering experience who have hands-on experience with bare-metal NVIDIA systems and who can develop tooling to move GPU capacity into... 
    Cloud
    Senior

    Devopsroles

    Santa Clara, CA
    1 day ago
  • NVIDIA's Digital Marketing Organization seeks a senior Site Reliability Engineer (SRE) to join the Santa Clara, CA team. You will build and deploy large-scale redirects, manage Akamai Cloudlets, provide on-call support, and ensure reliable, fast delivery of AI-powered marketing... 
    Cloud
    Senior

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $180k - $260k

    ~ Full-Time ~ AI Cloud ~$180,000 – $260,000 / year ~ San Jose, CA / Austin, TX - Remote...  .... NeoCloud is building an AI-operated GPU cloud — and because it is a customer-...  ..., and post-incident recovery. You are the SRE who stands between raw infrastructure and... 
    Cloud
    Senior
    Full time
    Local area
    Remote work

    Bitdeer Technologies Group

    San Jose, CA
    1 day ago
  • NVIDIA seeks Software Engineers with SRE/Production Engineering experience to build and operate production-grade, bare-metal GPU infrastructure for AI workloads. You will craft automation...  ...across NVL72 systems and DPUs in cloud and on-prem environments. #J-18808-Ljbffr... 
    Cloud
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago
  •  ..., together, we’ll advance your career.THE TEAM:AMD's Data Center GPU organization is transforming the AI and HPC landscape. Our mission...  ...the next generation of computing in enterprise data centers, cloud, and supercomputing environments. If you’re excited by AI disruption... 
    Cloud
    Senior

    AMD

    San Jose, CA
    4 days ago
  • $152k - $241.5k

    NVIDIA DGX Cloud builds and operates large-scale GPU infrastructure for AI workloads. We are looking for Software Engineers with SRE or Production Engineering experience who have worked hands-on with bare-metal NVIDIA systems. This team builds the software and operational... 
    Cloud
    Senior
    Permanent employment
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...together, we’ll advance your career.THE ROLE:The Sr. Director, Pre-Si System Validation leads...  ...and pre-silicon validation for Data Center GPU platforms. This role ensures early, system-accurate insights across AI, HPC, and cloud-scale environments, accelerating software... 
    Cloud
    Senior
    Shift work

    AMD

    San Jose, CA
    1 day ago
  • $152k - $241.5k

     ...you're passionate about building reliable systems software for cloud-scale GPU infrastructure, we encourage you to contribute to our team. We...  ...semantics.Collaborate with backend, infrastructure, SRE, security, and datacenter operations teams to deliver reliable... 
    Cloud
    Senior
    Full time
    Local area
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...the global product marketing organization for AMD’s Data Center GPU portfolio, connecting market insight, product and software value...  ...strategy into an integrated marketing agenda across AI, HPC, OEM/ODM, cloud and ecosystem motions, while building a scalable, high-performing... 
    Cloud
    Senior

    AMD

    Santa Clara, CA
    6 days ago
  • $148.75k - $361k

     ...infrastructure. The ideal candidate has a strong background in DevOps/SRE practices, cloud infrastructure management, and MLOps tooling — with a passion...  ...for ML workloads across AWS and GCP, including GPU/TPU-based training and inference environmentsArchitect and improve... 
    Cloud
    Senior
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    San Jose, CA
    5 days ago
  •  ...seeking a Senior Director, Customer Program Management — Data Center GPU to lead end-to-end program execution and customer success for AMD...  ...will own program strategy and delivery across OEM/ODM partners, Cloud service providers (CSPs), and end clients to drive platform... 
    Cloud
    Senior

    Jobleads-US

    Santa Clara, CA
    3 days ago
  •  ...operations. Bitdeer also offers advanced cloud capabilities to customers with high demand...  ...Position Overview We are seeking a Senior GPU Systems & Fabric Engineer to serve as the...  ...host networking stacks, including RDMA, SR-IOV, RoCEv2, and InfiniBand, ensuring line... 
    Cloud
    Senior
    Local area

    Bitdeer

    San Jose, CA
    1 day ago
  • $101k - $161k

     ...DescriptionArista Networks is an industry leader in data-driven, client-to-cloud networking for large data center, campus and routing environments...  ...our growing Arista’s CloudVision-as-a-Service (CVaaS) global SRE team. SREs at Arista combine strong software engineering... 
    Cloud
    Senior

    Arista Networks

    Santa Clara, CA
    3 days ago
  •  ...container orchestration, cloud-native technologies,...  ...teams, security teams, and SRE teams to deliver a robust...  ...subject matter expert.Provide technical leadership...  ...SkillsKubernetes EcosystemKubernetes (K8s)...  ...environments.Experience with GPU-based Kubernetes workloads... 
    Cloud
    Senior

    Apptad

    Milpitas, CA
    1 day ago
  •  ...ensuring the reliability, scalability, and performance of a large-scale cloud infrastructure. This leadership role combines technical expertise...  ...of experience managing technical operations, infrastructure, or SRE teams. ~ Strong leadership, mentoring, and people management... 
    Cloud
    Senior

    GCS Recruitment

    Campbell, CA
    10 hours ago
  •  ...customer-facing services and systems across iCloud. You will apply SRE best practices to ensure availability, reliability, and...  ...role includes on-call duty, incident response, and evolving with microservices and Kubernetes in a cloud environment. #J-18808-Ljbffr null
    Cloud
    Senior

    null

    Cupertino, CA
    1 day ago
  • ServiceNow is seeking a Staff Voice AI Engineer - SRE/DevOps in Santa Clara. You will design and deliver cloud-native solutions for Voice AI, ensuring high availability and observability, and integrate LLMs into real-time voice platforms. You will mentor teammates, enforce... 
    Cloud
    Senior

    ServiceNow

    Santa Clara, CA
    4 days ago
  •  ...Inc. in Cupertino, California, seeks experienced Media Platforms SRE engineers to design, build and run services powering App Store, Apple...  ...with cross‑functional teams, with transition from bare metal to cloud and Kubernetes in a fast-paced environment. #J-18808-Ljbffr... 
    Cloud
    Senior

    Apple Inc.

    Cupertino, CA
    9 hours ago
  • Amazon Data Services, Inc. seeks a Senior Accelerator Engineer to own the GPU component lifecycle across AI accelerator platforms, from defining hardware, firmware, and diagnostics to qualification and field deployment. You will lead fleet-scale failure analysis, set health... 
    Cloud
    Senior

    Amazon Inc.

    Cupertino, CA
    2 days ago
  • NVIDIA is seeking software engineers with SRE or Production Engineering experience to help operate and scale our BMaaS/IaaS infrastructure for GPU systems. You will build automation for bare-metal provisioning, hardware validation, firmware upgrades, and cluster lifecycle... 
    Senior

    Devopsroles

    Santa Clara, CA
    2 days ago
  • NVIDIA Corporation is seeking a Senior Cloud Software Engineer in Santa Clara, CA to design and deliver SDKs/CLIs for Cloud GPU Services. Lead cross-functional efforts, drive architecture, and ensure robust software with CI/CD and tests. Ideal candidates have 8+ years... 
    Cloud
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  •  ...seeks an experienced software engineer to design and build distributed services and data pipelines for GPU capacity, reservations, and utilization across DGX Cloud environments. Responsibilities include automating capacity-management workflows and developing models to... 
    Cloud
    Senior

    NVIDIA AI

    Santa Clara, CA
    1 day ago
  • NVIDIA in Santa Clara, CA is seeking a Software Engineer with SRE/Production Engineering experience to help build and operate large-scale GPU infrastructure for AI workloads. You will automate bare-metal provisioning, work with BMC/Redfish, manage NVL72 systems and BlueField... 
    Senior

    Devopsroles

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and...  ...a scripting language, preferably PythonFamiliar with containers, cloud provisioning and scheduling tools (Kubernetes, SLURM, Ansible,... 
    Cloud
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $208k - $327.75k

     ...worldwide. As data volumes explode and computational demands rise, GPU-accelerated storage solutions like GPUDirect Storage and cuFile...  ...management.Previous roles defining product strategies or requirements in cloud-based or HPC environments.NVIDIA is renowned globally as a top-... 
    Cloud
    Senior
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...Together, we advance your career. THE ROLE:Join AMD’s Datacenter GPU Product Application Engineering team to lead a high-performing group...  ...in customer-facing engineering roles within data center, GPU, cloud, or HPC environments. You are equally comfortable leading teams,... 
    Cloud
    Senior
    For contractors

    AMD

    Santa Clara, CA
    4 days ago
  •  ...Senior Systems Software Engineer – GPU Performance at Scale We are looking for a dedicated engineer for the Senior Systems Software...  ...accelerated computing software stacks (CUDA). Experience with modern cloud and container‑based enterprise computing architectures, with... 
    Cloud
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars...  ...computing software stacks (CUDA).Experience with modern cloud and container-based enterprise computing architectures, with Slurm... 
    Cloud
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr GPU Cloud K8S Expert (SRE SME). Be the first to apply!