Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff MaaS Backend Engineer [Remote]

$180k - $260k
Full-time

Bitdeer

San Jose, CA
  • Remote job

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.

To learn more, visit [ Position Overview

We are seeking a Staff Backend Engineer to take our Model-as-a-Service (MaaS) working system and re-architect it into a commercial, globally distributed, multi-tenant token service — one that sustains at least millions of monthly active users, high sustained token throughput per GPU, and invoice-grade accounting, with scalability, reliability, and observability engineered in deliberately rather than absorbed under load. This role works directly with the principal architect: co-owning the MaaS system design as the deepest backend voice in that conversation, and owning the implementation end to end — the code that ships, the migrations that land, and the service that stays up. Design authority is shared; delivery accountability is not. The mandate is explicit: measure what exists, find where it breaks before it breaks in front of a paying customer, and carry the platform there incrementally — with each step independently shippable, reversible, and non-disruptive to the tenants already on it. The role is deeply hands-on: it reads and rewrites the existing Go services, owns SLOs and on-call for a revenue-bearing service, and sets the backend engineering standard for the MaaS team.

Key Responsibilities
  • Architecture, Strategy, and Leadership: Co-own the end-to-end MaaS system design with the Principal Architect, authoring decision records and defending technical trade-offs. Drive the platform through its maturity roadmap by delivering operable, measurable capabilities rather than mere demos. Lead technical execution by setting stringent Go and API standards, mentoring engineers, and aligning cross-functional teams.
  • Inference Gateway and API Surface: Own the wire compatibility contract for major formats (OpenAI, Anthropic), supporting advanced features like streaming, tool calling, and structured output. Evolve the routing tier to handle load-aware, model-aware, and prefix-cache-aware endpoint selection with robust circuit breaking and fallback mechanisms. Run versioning and deprecation as a published contract to guarantee external customer code stability across underlying changes.
  • Performance Optimization and Model Lifecycle: Maximize platform economics and performance by optimizing token throughput, KV cache tiering, and time-to-first-token (TTFT) latency at the p95/p99 levels. Mature the model serving control plane by integrating deployment tooling, LoRA multiplexing, and cold-start-aware autoscaling directly with the Kubernetes fleet. Treat regressions in cost-per-million-tokens or latency metrics as critical system incidents.
  • Global Topology and Reliability (SLOs): Scale the platform to a globally distributed architecture featuring regional inference pools, capacity-aware failovers, and an active-active control plane. Define, publish, and rigorously defend strict Service Level Objectives (SLOs) baselined against actual system performance rather than aspirations. Ensure operational resilience through peak-concurrency load testing, robust on-call runbooks, and predictable load-shedding during overloads.
  • Security, Identity, and Multi-Tenant Isolation: Enforce fail-closed authorization, robust multi-tenant isolation, and zero-retention data paths across the network, cache, and storage layers. Manage the complete lifecycle of API keys and OAuth credentials while distributedly enforcing rate limits and quotas without relying on client-supplied identifiers. Design strict abuse, rate, and prompt-injection controls, treating all user and model-generated content as untrusted data.
  • Token Metering and Billing Cor
  • rectness: Build an idempotent, exactly-once metering system to capture uncached, cached, output, and reasoning tokens accurately across all requests. Maintain a high-volume usage ledger that enforces prepaid spend caps asynchronously and reconciles perfectly with the invoicing system. Safeguard business integrity by treating any metering or billing defect as a critical revenue and trust incident.
  • Safe Migrations and Observability: Execute zero-regression, incremental platform upgrades using strangler-style replacements, shadow traffic, and stateful dual-writes. Deliver end-to-end request tracing and cost telemetry, defining internal schemas for token and quality attributes. Enforce absolute log hygiene by ensuring prompts, completions, and PII are never retained outside of explicit, consented policies.
Qualifications
  • Bring 8+ years of backend engineering experience, including 3+ years owning a high-traffic, multi-tenant API platform for paying customers. Act as a senior technical voice who can collaborate closely with architects, write rigorous design documents, and commit to executing architectural decisions effectively.
  • Demonstrate expertise in scaling distributed systems through multi-region active-active deployments, caching, backpressure, and targeted performance engineering that measurably lowers unit costs. You must have a proven track record of safely executing zero-downtime brownfield migrations for stateful subsystems—like metering or ledgers—without regressions or accounting gaps.
  • Possess deep hands-on proficiency with Go-based services, production Kubernetes (including Envoy and GPU-aware scheduling), and the architectural trade-offs of datastores like PostgreSQL, Redis, and Kafka. Additionally, you will drive operational visibility by owning end-to-end observability strategies using OpenTelemetry and high-cardinality analytics stores.
  • Apply a systems-level understanding of LLM serving to manage complexities like server-sent-event streaming, KV/prefix caching, and the trade-offs between time-to-first-token (TTFT) and throughput. Leverage this foundation to build highly reliable, exactly-once metering and billing systems that accurately reconcile billions of events under partial failure conditions.
  • Enforce strict multi-tenant security disciplines by designing fail-closed authorization, mandating verified identities, and guaranteeing absolute cross-tenant isolation. Bring operational maturity to a revenue-bearing platform by carrying on-call responsibilities, running blameless incident reviews, and translating outages into structural improvements.
-------------------------------------------------------------------- Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Staff MaaS Backend Engineer [Remote] in San Jose, CA vacancy
  • $152k - $241.5k

    We are searching for a Backend Compiler Engineer for an exciting and fun role in our GPU Software organization. Our Compiler team is responsible for constructing and emitting the highest performance GPU machine instructions for Graphics (OpenGL, Vulkan, DX) and Compute... 
    Suggested
    Full time
    Remote work
    Worldwide

    Nvidia

    Santa Clara, CA
    3 days ago
  •  ...distributed systems. Depth in the fundamentals. Generalists who move across the system rather than staying in one lane. Engineers who operate what they build and treat reliability as part of the job. Comfort owning ambiguous problems end to end, from design... 
    Suggested

    Kloudfuse

    Cupertino, CA
    3 days ago
  • $167.7k - $245.2k

     ...world deployments. Technical Challenge and Scale: Solve complex engineering problems in distributed systems, real-time data processing,...  ...full ownership of the design, development, and delivery of core backend features within the Splunk Enterprise Security ecosystem,... 
    Suggested
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Jose, CA
    1 day ago
  •  ...Backend Software Engineer Immediate need for a talented Backend Software Engineer. This is a six-month contract opportunity with long-term potential and is located in San Jose, CA (Hybrid). Job ID: 26-30071 Pay Range: $80 - $85/hour. Employee benefits include, but... 
    Suggested
    Contract work
    Immediate start

    Pyramid Corporation

    San Jose, CA
    4 days ago
  •  ...reliability — and grow the team that runs it. This is a high-impact engineering role with meaningful equity, real ownership, and direct...  ...scales. What you'll do Set the architecture. Own how our backend fleet and data pipeline fit together, and where they go next.... 
    Suggested

    Lawfully

    San Jose, CA
    2 days ago
  • $184k - $287.5k

    NVIDIA is a global leader in high-speed computer vision, artificial intelligence (AI), and deep learning. Our team develops data engineering solutions that empower AI developers in autonomous vehicle (AV) domains to innovate quickly and effectively at scale. Are you ready... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $155k - $225k

     ...Staff Back-End Developer – Milpitas, CA (Hybrid) The digital landscape continues to...  ...skilled Staff Back-End Developer to join our engineering team and help build mission-critical...  ..., and optimizing secure, scalable backend systems. This role will have a direct impact... 

    Arlo Technologies, Inc.

    Milpitas, CA
    3 days ago
  • $170k - $200k

     ...whether an agent gets to make a call — and prove it later A policy engine is only as good as the world model it reasons over, so we`re...  ...to paying customers, not a demo. You Have built and operated backend systems that real customers depended on Strong in Go or Python... 

    MetAntz

    San Jose, CA
    3 days ago
  • $75k - $300k

     ...Work with brilliant minds on technology transforming automotive industry and make a lasting impact. We're seeking motivated backend engineers to join our infra team. In this role, you'll design and optimize cloud computing platforms and resource management systems to... 

    Tensor

    San Jose, CA
    4 days ago
  •  ...Job Title Java Backend Engineer Duration 6+ Months Location like San Jose, CA (Hybrid - 3 days onsite required). I need some expertise in Java and python. Remember they typically like ex-paypal/ebay folks Key Skills Strong expertise... 

    Amtex Enterprises

    San Jose, CA
    5 days ago
  • $160k - $320k

    The OpportunityWe are looking for a Senior Member of Technical Staff (SMTS) to join our Nutanix Kubernetes Platform (NKP) team in...  ...multi-tenant security infrastructure.You will combine strong backend engineering skills with deep Kubernetes operational expertise to solve... 
    Work at office
    Local area
    Remote work
    Relocation package
    3 days per week

    Nutanix

    San Jose, CA
    3 days ago
  •  ...BoxGroup, YC and a group of strategic angels that will push us to be at the forefront of the industry. We're seeking a Full Stack Engineer to build diverse, production-quality applications that will serve as training examples for AI models. You'll create complete,... 

    Jobleads-US

    Milpitas, CA
    2 days ago
  • $165k - $265k

     ...possibilities of AI. Role Overviewd-Matrix is looking for a Senior Staff Power Performance Architect to own pre-silicon power...  ...workloads. You will partner closely with front-end architects, DV engineers, and backend design teams to identify power activity windows, define... 

    d-Matrix

    Santa Clara, CA
    1 day ago
  • $154k - $220k

     ...the AI era? Join us at Zscaler.We are looking for a Sr. Staff Software Development Engineer, Provisioning Platform to join our Zero Trust Exchange department...  ...-service experiences across Zscaler products. This is a backend-focused platform role requiring strong Java/Spring Boot... 
    Full time
    Work at office
    Local area

    Zscaler

    San Jose, CA
    5 days ago
  • $161k - $194k

     ...factory, Tapestry brings together experts in energy, AI, software engineering, and products to build tools that help the electricity...  ...or equivalent practical experience.5+ years of experience in backend programming languages such as Python, Go, Java.3+ years of extensive... 
    Full time
    Work at office
    Local area
    Flexible hours

    X Company

    Mountain View, CA
    3 days ago
  • $174k - $255k

     ...factory, Tapestry brings together experts in energy, AI, software engineering, and products to build tools that help the electricity...  ...about our team and our mission here.About the roleAs a senior backend software engineer you will work across the entire Tapestry platform... 
    Full time
    Flexible hours

    X Company

    Mountain View, CA
    1 day ago
  •  ...Back-End Developer Location: San Jose, CA Type: Contract to Hire Job Description: ~ Develop backend eCommerce web applications in cloud platform technologies ~ Collaborate with designers & product managers to iterate on the design & implementation of our... 
    Contract work

    InterSources

    San Jose, CA
    4 days ago
  •  ...Summary of Role: This role focuses on transforming higher-level MLIR-based large language models by applying sophisticated mid- and backend compiler techniques to target Persimmons.ai's custom accelerator hardware. You will help design and optimize the Persimmons... 
    Work experience placement
    Flexible hours

    Persimmons

    San Jose, CA
    4 days ago
  • $164k

     ...connected world.Role OverviewCoupang’s platform engineers play a critical role in driving our...  ...that powers our services. As a Staff Engineer, you will lead the evolution of...  ...in C++/Java or GolangProven expertise in backend development and distributed systemsPreferred... 
    Temporary work

    Coupang

    Mountain View, CA
    2 days ago
  •  ...Metis Technology Solutions is seeking an experienced Backend Software Engineer to join our team and help us reimagine air traffic management for the 21 st century! You will be working within the realm of integrated airspace management on services that support the Extensible... 
    Permanent employment

    Metis Technology Solutions, Inc.

    Mountain View, CA
    5 days ago
  • $145k - $180k

     ...posting stays vague on purpose. What we can say: the products are real, they ship, and people use them every day.As a Senior Backend Engineer, you'll build and maintain systems that servie as a critical link between physical hardware and backend services. You may write... 
    Local area
    Worldwide
    Visa sponsorship
    Night shift

    Archer Aviation

    San Jose, CA
    3 days ago
  • $98.5k - $200k

     ...the Fortune 100, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network to gain full visibility and...  ...be responsible for designing, implementing, and enhancing cloud backend software for Netskope Cloud Security solutions, and solving... 

    Netskope

    Santa Clara, CA
    2 days ago
  •  ...Job Description Job Description About the Role Join a team building AI-powered software for marketing teams. As a Backend Software Engineer, you will help develop the server-side capabilities behind tools that analyze marketing data, provide insights, and support... 

    Wintermeyer Ventures

    Mountain View, CA
    5 days ago
  • $207k - $290k

     ...energy infrastructure and advanced AI. Born at X (the innovation engine behind Waymo, Verily, and Google Brain), Tapestry builds...  ...New Zealand, Australia, and Brazil.About the RoleWe are seeking a Staff Software Engineer / Technical Lead to co-anchor the technical direction... 
    Full time
    Flexible hours

    X Company

    Mountain View, CA
    1 day ago
  • $129.4k - $198.4k

    Job DescriptionThe Role:As a Senior Software Engineer focused on backend platform and API ownership, you will design, build, and operate scalable backend services that power critical product and business capabilities. You will be responsible for developing secure, reliable... 
    Full time
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    2 days ago
  • $153.2k - $269.1k

     ...driving safer, smarter, and more connected, shaping the future of transportation on a global scale.The RoleIn this Senior Backend Software Engineer role, you will lead and develop high performance backend services and systems for GM Commercial Services' new software solution... 
    Full time
    Local area
    Work from home
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $174k - $299k

     ...high-tech, and hyper-connected world.Role OverviewAs a Senior Staff Engineer on the Security Infrastructure team, you will build the...  ...Engineering, Math, or a closely related field8 years of experience in backend software developmentExperience working in cloud environments,... 
    Temporary work
    Immediate start
    Flexible hours

    Coupang

    Mountain View, CA
    3 days ago
  • $125.7k - $203.1k

     ...accepted until further notice.Meet the Team Join Cisco's innovative engineering community, where you'll have the opportunity to collaborate...  .... You will work end-to-end on everything from APIs and backend services to user interfaces and distributed systems. You'll solve... 
    Full time
    Temporary work
    Work experience placement
    Local area
    Flexible hours

    CISCO Systems

    Milpitas, CA
    1 day ago
  •  ...poster from ACL Digital This role involves developing robust backend services and integrating them into a scalable system architecture...  ...learning AI-focused frameworks What We’re Looking For Strong engineering fundamentals and problem-solving skills Experience working in... 
    Contract work

    ACL Digital

    San Jose, CA
    1 day ago
  • $190k - $237k

     ...inclusive environment that embraces our differences, and supports and celebrates all of our team members.What You’ll DoAs a Staff Software Backend Engineer, you will build and scale the core application logic, streaming pipelines, and data layers that power our real-time AI... 
    Local area
    Worldwide
    Visa sponsorship

    Archer Aviation

    San Jose, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff MaaS Backend Engineer [Remote]. Be the first to apply!