Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr GPU Cloud K8S Expert (SRE SME) [Remote]

$180k - $260k
Full-time

Bitdeer

San Jose, CA
  • Remote job

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.

To learn more, visit [ Position Overview

You run the control plane where AIOps meets tenants — where topology-aware scheduling, self-healing, and agent-driven remediation actually execute.

NeoCloud is building an AI-operated GPU cloud. Kubernetes is where all of that lands on real customer workloads: the topology-aware scheduler places jobs on the right NVLink domain, the operator drains and reschedules around predicted faults, and the tenant boundary is enforced against a Bare-Metal-as-a-Service backend. In this role you design, deploy, and operate that control plane — and you make sure the AIOps substrate can reach in and remediate without a human on the pager.

What you'll own
  • Production Kubernetes clusters optimized for GPU workloads at scale (100–10,000 GPUs).
  • Nvidia GPU operator, device plugin, MIG configuration, and GPU time-slicing policies.
  • Topology-aware scheduling: GPU locality, NVLink domain awareness, network rail affinity.
  • Custom Resource Definitions (CRDs) for GPU workload lifecycle management.
  • AI framework integrations: Slurm on K8S, Ray on K8S, Kubeflow.
  • Multi-tenant isolation: namespaces, network policies, resource quotas, RBAC, pod security standards.
  • Bare-Metal as a Service (BMaaS): automated provisioning, tenant onboarding, lifecycle, reclamation.
  • Terraform providers and modules for infrastructure-as-code across GPU clusters.
  • SLIs/SLOs for cluster availability, job completion rates, and provisioning latency.
  • Incident management: runbook automation, escalation, post-incident reviews.
  • Monitoring stack: Prometheus, Grafana, Alertmanager, PagerDuty.
  • GPU node failure handling: automated detection, drain/cordon/taint, workload rescheduling.
Feed the AIOps substrate
  • The remediation-actuator and workflow engine land here — you make the control plane safe for automated action.
  • Your CRDs are the schema the platform's predictors and remediators write against.
  • Every human intervention you do this quarter becomes an autonomous workflow next quarter.
What success looks like in year 1
  • Automated drain/reschedule around predicted GPU faults, at scale, without customer impact.
  • BMaaS live for external tenants with self-service onboarding.
  • Cluster availability and job-completion SLOs published and met.
Job Requirement:
  • 5+ years in Kubernetes operations, with at least 2 years managing GPU workloads on K8S
  • Deep understanding of Nvidia GPU operator, device plugin, and GPU scheduling in K8S
  • Experience with topology-aware scheduling and GPU-specific resource management
  • Hands-on experience building multi-tenant K8S platforms with strong isolation guarantees
  • Experience with bare-metal server provisioning and lifecycle automation (Ironic, MAAS, or custom)
  • Proficiency in Terraform, Helm, and GitOps workflows (ArgoCD/Flux)
  • Strong SRE background: SLI/SLO frameworks, incident management, capacity planning
  • Experience with Prometheus, Grafana, and alerting at scale
  • Strong programming skills in Go or Python for operator/CRD development
  • AIOps aptitude — you think of the K8S control plane as an execution surface for automated remediation, not just a scheduler. You've either wired an autoscaler/remediator loop into K8S or you can design one.
  • Runbook-as-code mindset — every SRE playbook you write should be executable by the platform.
-------------------------------------------------------------------- Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Sr GPU Cloud K8S Expert (SRE SME) [Remote] in San Jose, CA vacancy
  •  .... Bitdeer also offers advanced cloud capabilities to customers with...  ...NeoCloud is building an AI-operated GPU cloud. Kubernetes is where all...  ...integrations: Slurm on K8S, Ray on K8S, Kubeflow. Multi...  ...workflows (ArgoCD/Flux) ~ Strong SRE background: SLI/SLO frameworks,... 
    Cloud
    Senior
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    23 hours ago
  •  ...equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial...  ...stalls a $50M training run. Bitdeer is building an AI-operated GPU cloud. Storage is where AI workloads either fly or fall over: a... 
    Cloud
    Senior
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    23 hours ago
  •  ...equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial...  ...from tickets into policy. NeoCloud is building an AI-operated GPU cloud spanning 4 US DCs, APAC sites, and Iceland. In this role you... 
    Cloud
    Senior
    Remote job
    Full time
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    22 days ago
  • $180k - $260k

    ~ Full-Time ~ AI Cloud ~$180,000 – $260,000 / year ~ San Jose, CA / Austin, TX - Remote...  .... NeoCloud is building an AI-operated GPU cloud — and because it is a customer-...  ..., and post-incident recovery. You are the SRE who stands between raw infrastructure and... 
    Cloud
    Senior
    Full time
    Local area
    Remote work

    Bitdeer Technologies Group

    San Jose, CA
    23 hours ago
  •  ..., together, we’ll advance your career.THE TEAM:AMD's Data Center GPU organization is transforming the AI and HPC landscape. Our mission...  ...the next generation of computing in enterprise data centers, cloud, and supercomputing environments. If you’re excited by AI disruption... 
    Cloud
    Senior

    AMD

    San Jose, CA
    3 days ago
  • $152k - $241.5k

    NVIDIA DGX Cloud builds and operates large-scale GPU infrastructure for AI workloads. We are looking for Software Engineers with SRE or Production Engineering experience who have worked hands-on with bare-metal NVIDIA systems. This team builds the software and operational... 
    Cloud
    Senior
    Permanent employment
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...together, we’ll advance your career.THE ROLE:The Sr. Director, Pre-Si System Validation leads...  ...and pre-silicon validation for Data Center GPU platforms. This role ensures early, system-accurate insights across AI, HPC, and cloud-scale environments, accelerating software... 
    Cloud
    Senior
    Shift work

    AMD

    San Jose, CA
    1 day ago
  •  ...seeking a Senior Director, Customer Program Management — Data Center GPU to lead end-to-end program execution and customer success for AMD...  ...will own program strategy and delivery across OEM/ODM partners, Cloud service providers (CSPs), and end clients to drive platform... 
    Cloud
    Senior

    Advanced Micro Devices, Inc.

    Santa Clara, CA
    3 days ago
  • $152k - $241.5k

     ...you're passionate about building reliable systems software for cloud-scale GPU infrastructure, we encourage you to contribute to our team. We...  ...semantics.Collaborate with backend, infrastructure, SRE, security, and datacenter operations teams to deliver reliable... 
    Cloud
    Senior
    Full time
    Local area
    Remote work

    Nvidia

    Santa Clara, CA
    20 hours ago
  •  ...the global product marketing organization for AMD’s Data Center GPU portfolio, connecting market insight, product and software value...  ...strategy into an integrated marketing agenda across AI, HPC, OEM/ODM, cloud and ecosystem motions, while building a scalable, high-performing... 
    Cloud
    Senior

    AMD

    Santa Clara, CA
    5 days ago
  • $148.75k - $361k

     ...infrastructure. The ideal candidate has a strong background in DevOps/SRE practices, cloud infrastructure management, and MLOps tooling — with a passion...  ...for ML workloads across AWS and GCP, including GPU/TPU-based training and inference environmentsArchitect and improve... 
    Cloud
    Senior
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    San Jose, CA
    5 days ago
  •  ...career. THE TEAM: AMD's Data Center GPU organization is transforming the industry...  ...driving our business success with North America cloud service providers. The role requires deep...  ...- customers, media, analysts, technical experts and senior executives Possess a network... 
    Cloud
    Senior
    Work experience placement

    Advanced Micro Devices, Inc.

    Santa Clara, CA
    7 hours ago
  •  ...operations. Bitdeer also offers advanced cloud capabilities to customers with high demand...  ...Position Overview We are seeking a Senior GPU Systems & Fabric Engineer to serve as the...  ...host networking stacks, including RDMA, SR-IOV, RoCEv2, and InfiniBand, ensuring line... 
    Cloud
    Senior
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    23 hours ago
  • $101k - $161k

     ...DescriptionArista Networks is an industry leader in data-driven, client-to-cloud networking for large data center, campus and routing environments...  ...our growing Arista’s CloudVision-as-a-Service (CVaaS) global SRE team. SREs at Arista combine strong software engineering... 
    Cloud
    Senior

    Arista Networks

    Santa Clara, CA
    3 days ago
  •  ...container orchestration, cloud-native technologies,...  ...teams, security teams, and SRE teams to deliver a robust...  ...subject matter expert.Provide technical leadership...  ...SkillsKubernetes EcosystemKubernetes (K8s)...  ...environments.Experience with GPU-based Kubernetes workloads... 
    Cloud
    Senior

    Apptad

    Milpitas, CA
    1 day ago
  • $152k - $241.5k

     ...Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and...  ...a scripting language, preferably PythonFamiliar with containers, cloud provisioning and scheduling tools (Kubernetes, SLURM, Ansible,... 
    Cloud
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $208k - $327.75k

     ...worldwide. As data volumes explode and computational demands rise, GPU-accelerated storage solutions like GPUDirect Storage and cuFile...  ...management.Previous roles defining product strategies or requirements in cloud-based or HPC environments.NVIDIA is renowned globally as a top-... 
    Cloud
    Senior
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...Together, we advance your career. THE ROLE:Join AMD’s Datacenter GPU Product Application Engineering team to lead a high-performing group...  ...in customer-facing engineering roles within data center, GPU, cloud, or HPC environments. You are equally comfortable leading teams,... 
    Cloud
    Senior
    For contractors

    AMD

    Santa Clara, CA
    4 days ago
  •  ...Senior Systems Software Engineer – GPU Performance at Scale We are looking for a dedicated engineer for the Senior Systems Software...  ...accelerated computing software stacks (CUDA). Experience with modern cloud and container‑based enterprise computing architectures, with... 
    Cloud
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    23 hours ago
  • $184k - $287.5k

     ...potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars...  ...computing software stacks (CUDA).Experience with modern cloud and container-based enterprise computing architectures, with Slurm... 
    Cloud
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...our largest customers. We are seeking an expert Solutions Architect to assist customers in...  ...address critical business needs and support cloud service integration for NVIDIA technology...  ...error diagnostics.Hands-on experience with GPU systems in general including but not... 
    Cloud
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...Principal AI Platform Architect (GCP GKE | TPU/GPU Infrastructure) Location: Milpitas, CA...  ...in AI/ML Platform Architecture on Google Cloud Platform (GCP) Position Summary...  ...infrastructure best practices. Act as the primary SME for AI platform architecture and... 
    Cloud

    ReqRoute,Inc

    Milpitas, CA
    3 days ago
  • $177.5k - $287.1k

     ...platform is built on a modern, cloud‑native foundation centered around...  ...the clock. Manage expensive GPU/TPU resource allocation, spot‑...  ...Site Reliability Engineering (SRE), or Cloud Platform Engineering...  ...infrastructure declaratively. You are an expert in modern IaC tools (Terraform,... 
    Cloud
    Senior
    Full time
    Work at office

    Devopsroles

    Santa Clara, CA
    23 hours ago
  • $200k - $230k

     ...fast in many key markets such as AI, HPC, Cloud Computing, Storage, etc. To meet the market...  ...integrated and tested.Job Summary:The Sr. Manager, Solution Management collaborates...  ...infrastructuresHands-on experience with Nvidia and AMD GPU based deployments are desirableSolid... 
    Cloud
    Senior

    Supermicro

    San Jose, CA
    3 days ago
  •  ...Bitdeer also offers advanced cloud capabilities to...  ...infrastructure using Kubernetes (K8s) and Docker. Manage and...  ...resources (e.g., GPU clusters) to support high...  ...Reliability Engineering (SRE), or Cloud Infrastructure...  ...roles. Networking & OS: Expert-level knowledge of Linux... 
    Cloud
    Senior
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    23 hours ago
  •  ...equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial...  ...policy, and cluster reliability on both bare-metal and VM-based GPU nodes, and will lead our adoption of the Slinky operator stack (slurm... 
    Cloud
    Senior
    Local area
    Shift work

    Bitdeer

    San Jose, CA
    23 hours ago
  • $175k - $265k

     ...shape the endless possibilities of AI. Role Overviewd-Matrix's SRE team owns the infrastructure layer that every engineering...  ...and customer depends on — colocation facilities, on-premises GPU clusters, cloud environments, and the platform services used to deploy and validate... 
    Cloud
    Senior

    d-Matrix

    Santa Clara, CA
    2 days ago
  • $150.4k - $277.6k

     ...Cupertino, California, United States Software and Services Apple Cloud infrastructure is BIG. The storage SRE teams of Apple Cloud are building and running the next generation distributed storage systems to support Apple’s most critical services. Operating at our scale... 
    Cloud
    Senior
    Relocation
    Rotating shift

    Apple Inc.

    Cupertino, CA
    23 hours ago
  • $168k - $258.75k

     ...potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars...  ...to make sophisticated trade-offsAbility to work closely with cloud partnersWays to stand out from the crowd: Strong background in... 
    Cloud
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $162k - $182k

     ...and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data...  ...join us.Job Summary:Supermicro is seeking a Sr. Product Manager who can lead the...  ...and lead the development and integration of GPU server/workstation system products• Develop... 
    Cloud
    Senior
    Remote work
    Worldwide

    Super Micro Computer

    San Jose, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr GPU Cloud K8S Expert (SRE SME) [Remote]. Be the first to apply!