Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff MaaS Backend Engineer

Bitdeer Technologies Group

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia. To learn more, visit

Position Overview

We are seeking a Staff Backend Engineer to take our Model-as-a-Service (MaaS) working system and re-architect it into a commercial, globally distributed, multi-tenant token service - one that sustains at least millions of monthly active users, high sustained token throughput per GPU, and invoice-grade accounting, with scalability, reliability, and observability engineered in deliberately rather than absorbed under load. This role works directly with the principal architect: co-owning the MaaS system design as the deepest backend voice in that conversation, and owning the implementation end to end - the code that ships, the migrations that land, and the service that stays up. Design authority is shared; delivery accountability is not. The mandate is explicit: measure what exists, find where it breaks before it breaks in front of a paying customer, and carry the platform there incrementally - with each step independently shippable, reversible, and non-disruptive to the tenants already on it. The role is deeply hands-on: it reads and rewrites the existing Go services, owns SLOs and on-call for a revenue-bearing service, and sets the backend engineering standard for the MaaS team.

Key Responsibilities

  • Architecture, Strategy, and Leadership: Co-own the end-to-end MaaS system design with the Principal Architect, authoring decision records and defending technical trade-offs. Drive the platform through its maturity roadmap by delivering operable, measurable capabilities rather than mere demos. Lead technical execution by setting stringent Go and API standards, mentoring engineers, and aligning cross-functional teams.
  • Inference Gateway and API Surface: Own the wire compatibility contract for major formats (OpenAI, Anthropic), supporting advanced features like streaming, tool calling, and structured output. Evolve the routing tier to handle load-aware, model-aware, and prefix-cache-aware endpoint selection with robust circuit breaking and fallback mechanisms. Run versioning and deprecation as a published contract to guarantee external customer code stability across underlying changes.
  • Performance Optimization and Model Lifecycle: Maximize platform economics and performance by optimizing token throughput, KV cache tiering, and time-to-first-token (TTFT) latency at the p95/p99 levels. Mature the model serving control plane by integrating deployment tooling, LoRA multiplexing, and cold-start-aware autoscaling directly with the Kubernetes fleet. Treat regressions in cost-per-million-tokens or latency metrics as critical system incidents.
  • Global Topology and Reliability (SLOs): Scale the platform to a globally distributed architecture featuring regional inference pools, capacity-aware failovers, and an active-active control plane. Define, publish, and rigorously defend strict Service Level Objectives (SLOs) baselined against actual system performance rather than aspirations. Ensure operational resilience through peak-concurrency load testing, robust on-call runbooks, and predictable load-shedding during overloads.
  • Security, Identity, and Multi-tenant Isolation: Enforce fail-closed authorization, robust multi-tenant isolation, and zero-retention data paths across the network, cache, and storage layers. Manage the complete lifecycle of API keys and OAuth credentials while distributedly enforcing rate limits and quotas without relying on client-supplied identifiers. Design strict abuse, rate, and prompt-injection controls, treating all user and model-generated content as untrusted data.
  • Token Metering and Billing Correctness: Build an idempotent, exactly-once metering system to capture uncached, cached, output, and reasoning tokens accurately across all requests. Maintain a high-volume usage ledger that enforces prepaid spend caps asynchronously and reconciles perfectly with the invoicing system. Safeguard business integrity by treating any metering or billing defect as a critical revenue and trust incident.
  • Safe Migrations and Observability: Execute zero-regression, incremental platform upgrades using strangler-style replacements, shadow traffic, and stateful dual-writes. Deliver end-to-end request tracing and cost telemetry, defining internal schemas for token and quality attributes. Enforce absolute log hygiene by ensuring prompts, completions, and PII are never retained outside of explicit, consented policies.

Qualifications

  • Bring 8+ years of backend engineering experience, including 3+ years owning a high-traffic, multi-tenant API platform for paying customers. Act as a senior technical voice who can collaborate closely with architects, write rigorous design documents, and commit to executing architectural decisions effectively.
  • Demonstrate expertise in scaling distributed systems through multi-region active-active deployments, caching, backpressure, and targeted performance engineering that measurably lowers unit costs. You must have a proven track record of safely executing zero-downtime brownfield migrations for stateful subsystems - like metering or ledgers - without regressions or accounting gaps.
  • Possess deep hands-on proficiency with Go-based services, production Kubernetes (including Envoy and GPU-aware scheduling), and the architectural trade-offs of datastores like PostgreSQL, Redis, and Kafka. Additionally, you will drive operational visibility by owning end-to-end observability strategies using OpenTelemetry and high-cardinality analytics stores.
  • Apply a systems-level understanding of LLM serving to manage complexities like server-sent-event streaming, KV/prefix caching, and the trade-offs between time-to-first-token (TTFT) and throughput. Leverage this foundation to build highly reliable, exactly-once metering and billing systems that accurately reconcile billions of events under partial failure conditions.
  • Enforce strict multi-tenant security disciplines by designing fail-closed authorization, mandating verified identities, and guaranteeing absolute cross-tenant isolation. Bring operational maturity to a revenue-bearing platform by carrying on-call responsibilities, running blameless incident reviews, and translating outages into structural improvements.

--------------------------------------------------------------------

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff MaaS Backend Engineer in San Jose, CA vacancy
  •  ..., including the United States, Norway, Bhutan, and Ethiopia. To learn more, visit We are seeking a Staff Backend Engineer to take our Model-as-a-Service (MaaS) working system and re-architect it into a commercial, globally distributed, multi-tenant token service —... 
    Suggested
    Contract work
    Local area
    Remote work

    Bitdeer

    San Jose, CA
    1 day ago
  •  ..., Norway, Bhutan, and Ethiopia. To learn more, visit Position Overview We are seeking a Staff Backend Engineer to take our Model-as-a-Service (MaaS) working system and re-architect it into a commercial, globally distributed, multi-tenant token service —... 
    Suggested
    Remote job
    Full time
    Contract work
    Local area

    Bitdeer Technologies Group

    San Jose, CA
    22 days ago
  • $152k - $241.5k

    We are searching for a Backend Compiler Engineer for an exciting and fun role in our GPU Software organization. Our Compiler team is responsible for constructing and emitting the highest performance GPU machine instructions for Graphics (OpenGL, Vulkan, DX) and Compute... 
    Suggested
    Full time
    Remote work
    Worldwide

    Nvidia

    Santa Clara, CA
    4 days ago
  • $170k - $400k

     ...of intelligent systems. About the Role You’ll build the backend systems that make Hark’s AI agent actually work — reliable, fast...  ...team. You’ll work directly with model researchers and platform engineers, and the systems you build will determine whether Hark feels like... 
    Suggested
    Full time

    Hark, Inc.

    San Jose, CA
    1 day ago
  • $150.4k - $277.6k

     ...and Services What happens when the world's most innovative engineers collaborate with the world's most creative storytellers? TV gets...  ...Video Services engineering team is responsible for building the backend services critical to the Apple TV app, which is the central hub... 
    Suggested
    Relocation

    Apple Inc.

    Cupertino, CA
    2 days ago
  • $184.7k - $324.8k

     ...Cupertino, California, United States Software and Services The growing Apple Services group is seeking a Senior Backend Engineer to join the InfoApps org to help shape what comes next for one of Apple's flagship content experiences. You'll join a close-knit, highly... 
    Relocation

    Apple Inc.

    Cupertino, CA
    2 days ago
  •  ...Backend Software EngineerImmediate need for a talented Backend Software Engineer. This is a six-month contract opportunity with long-term potential and is located in San Jose, CA (Hybrid).Job ID: 26-30071 Pay Range: $80 - $85/hour. Employee benefits include, but are not... 
    Contract work
    Local area

    Pyramid Consulting

    San Jose, CA
    1 day ago
  • $150.4k - $277.6k

     ...accomplish.Apple's Camera & Photos Tools & AI team is a tight-knit engineering team building the internal tools that power how the Camera,...  ...problems into reliable, well-designed systems. You'll own backend services and data infrastructure end to end, from Python REST... 
    Relocation
    Shift work

    Apple Inc.

    Cupertino, CA
    1 day ago
  • $80 - $85 per hour

     ...Immediate need for a talented Backend Software Engineer . This is a 06 months contract opportunity with long-term potential and is located in San Jose, CA (Hybrid) . Please review the job description below and contact me ASAP if you are interested. Job ID:26-300... 
    Contract work
    Local area
    Immediate start

    Pyramid Consulting

    San Jose, CA
    4 days ago
  •  ...SYMVIONICS, Inc. has an Immediate Opening Job Description : Full Stack Software Engineer LOCATION: NASA Ames Research Center, Moffett Field, CA (* immediate opening*) Job Description: ATM-X Freddie As an agile team, we commit code and perform code reviews... 
    Full time
    For contractors
    Immediate start

    Symvionics

    San Jose, CA
    4 days ago
  • $122.57k - $316.8k

     ...Discover a career that energizes and excites you every day. @2026 TikTok Backend Software Engineer, Asset Services Location: San Jose Employment Type: Regular Job Code: A87385 Share this listing: Responsibilities The Creation team is an international... 
    Temporary work
    Local area

    TikTok

    San Jose, CA
    1 day ago
  •  ...SYMVIONICS, Inc. has an Immediate Opening Job Description : Backend Software Engineer LOCATION: NASA Ames Research Center, Moffett Field, CA (* immediate opening*) - On Site - this is not a remote position Job Description: Asan agile team, we commit... 
    Full time
    For contractors
    Immediate start

    Symvionics

    Santa Clara, CA
    3 days ago
  • $196.5k - $291.5k

     ...this position will take primary accountability for the domain's backend platform features, capabilities and quality. As a strong...  ...field of study, or equivalent experience12+ years of software engineering experience, with significant time spent on backend platforms,... 
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    PayPal

    San Jose, CA
    1 day ago
  •  ...effodio Senior Backend Software Engineer (Tech Lead) Full-Time | Remote - United States About effodio Founded by industry veterans from Google, Arista, and other leading tech companies, effodio is revolutionizing cloud application and infrastructure analytics. Our advanced... 
    Full time
    Remote work
    Visa sponsorship
    Work visa

    Effodio, Inc.

    Santa Clara, CA
    3 days ago
  • Eightfold's Analytics Product Engineering team builds the native reporting experiences that turn raw data into actionable insights. We’re looking for a Senior Full Stack Engineer (Backend-Heavy) who thrives on backend systems but is comfortable across the stack when needed... 

    Eightfold

    Santa Clara, CA
    1 day ago
  • Amazon.com Services LLC is seeking a Software Development Engineer III for AWS SageMaker Unified Studio. You will contribute to a new product...  ...managers, and other engineers to deliver scalable, reliable backend services and interactive experiences within the AWS ecosystem.... 

    Jobleads-US

    Santa Clara, CA
    1 day ago
  • $167.7k - $245.2k

     ...Senior Software Engineer -Backend EngineerJoin the Splunk Enterprise Security team as we reimagine Threat Detection for the cloud era. We are rebuilding our legacy system into a modern, cloud-native security analytics platform, deploying across AWS, Azure, GCP, and on-... 
    Full time
    Temporary work
    Flexible hours

    Cisco

    San Jose, CA
    20 hours ago
  •  ...who are completing or have recently completed a Bachelor's/ Master's degree in Software Development, Computer Science, Computer Engineering, or a related technical discipline, or a related discipline.- Familiar with mainstream model compilation stacks (such as TVM, MLIR... 

    ByteDance (old)

    San Jose, CA
    1 day ago
  • $150.4k - $277.6k

     ...Backend System Engineer, Insights & Release Technologies Cupertino, California, United States Software and Services Do you want to help define the future of delivering Apple software to customers? Join the Insights & Release Technologies team to develop storage solutions... 
    Relocation

    Apple Inc.

    Cupertino, CA
    2 days ago
  • Apple Inc. in Cupertino, CA seeks a backend software engineer for the Apple Video Services team. You will work on the Apple TV app backend, contributing to scalable Java services and data pipelines, ensuring high-quality, well-tested code while collaborating with product... 

    Apple

    Cupertino, CA
    2 days ago
  • $156k - $316.8k

     ...Solution Backend Software Engineer - Local Service Location: San Jose Employment Type: Regular Job Code: A28605 Responsibilities Collaborate with the TikTok product engineering team to build new products and enhance existing ones to meet business needs.... 
    Temporary work
    Local area

    Ellis Technologies, Inc.

    San Jose, CA
    1 day ago
  • $180k - $240k

     ...conversation to real-world action. Built on the open-source Conductor engine, our platform empowers developers to orchestrate complex...  ...AI to drive actual business value. The Opportunity As a Senior Backend Engineer at Orkes, you will work at the frontier of agentic workflow... 
    Full time
    Work at office
    Flexible hours

    Orkes

    Santa Clara, CA
    1 day ago
  • Apple Inc. is seeking a versatile Backend Software Engineer to design, build, and own backend infrastructure for imaging engineering and quality workflows across Camera, Photos, and Image Quality, building and operating Python REST API services and data models for large... 

    Apple Inc.

    Cupertino, CA
    2 days ago
  • Netris, Inc. is seeking a Senior / Staff Backend Engineer to design and own the distributed control‑plane services behind the platform. You’ll translate requirements into scalable, production‑grade architectures and take ownership of reliability, observability, and long... 
    Remote job

    Netris, Inc.

    Santa Clara, CA
    1 day ago
  • $162k - $387.6k

     ...Senior AI Backend Software Engineer, TikTok - Asset Services Location: San Jose Employment Type: Regular Job Code: A72224B Responsibilities Work closely with cross functional teams like product managers, designers, and Frontend engineers to deliver... 
    Temporary work
    Local area

    TikTok

    San Jose, CA
    1 day ago
  • Palo Alto Networks is building a brand-new AIRS initiative focused on AI/ML infrastructure and high-performance distributed backends. You will lead architecture from the ground up as a senior technical leader, shaping scalable control planes and microservices in a hybrid... 

    Palo Alto Networks, Inc.

    Santa Clara, CA
    1 day ago
  • Veza is seeking a Staff Software Engineer, Backend to design and scale an identity security solution for AI agents. You will drive architecture, collaborate across teams, and own features end-to-end in a fast-paced security startup environment. The role emphasizes building... 
    Flexible hours

    Servicenow

    Santa Clara, CA
    1 day ago
  • Apple Inc. in Cupertino, California, seeks a Software Development Engineer for the System Analytics & Intelligence (SAIL) team. You will design and build backend data pipelines and services that turn raw signals from the development lifecycle into insights used across Core... 

    Apple Inc.

    Cupertino, CA
    1 day ago
  • $160k - $320k

    The OpportunityWe are looking for a Senior Member of Technical Staff (SMTS) to join our Nutanix Kubernetes Platform (NKP) team in...  ...multi-tenant security infrastructure.You will combine strong backend engineering skills with deep Kubernetes operational expertise to solve... 
    Work at office
    Local area
    Remote work
    Relocation package
    3 days per week

    Nutanix

    San Jose, CA
    4 days ago
  • Akraya, Inc. is seeking a backend-focused developer to design and implement scalable microservices and APIs in an AWS environment. The role emphasizes building robust data stores and services to support a critical marketplace platform. You will collaborate across teams... 
    Remote job

    Akraya

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff MaaS Backend Engineer. Be the first to apply!