Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Inference Runtime Engineer

Full-time

Bitdeer

About Bitdeer:

Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry-leading ASIC chips and manufacturing mining rigs, the Group handles complex processes involved in computing across the value chain. This includes equipment procurement, transport logistics, datacenter design and construction, equipment management, and network and facility operations. Bitdeer also offers advanced cloud capabilities to customers with a high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer operates globally with a diversified 3 GW energy portfolio, and deploys Bitcoin mining and HPC datacenters in the United States, Bhutan, Norway, Canada, Malaysia, and Ethiopia. About the team:

We are seeking a Senior Inference Runtime Engineer to own the performance-critical serving layer of the MaaS platform. This role focuses on making self-hosted LLMs faster, cheaper, and more stable by optimizing the runtime stack behind OpenAI- and Anthropic-compatible APIs.

What you will be responsible for:
  • Optimize prefill/decode scheduling, continuous batching, KV cache behavior, speculative decoding, long-context serving, and streaming smoothness.
  • Tune and operate vLLM/Dynamo/SGLang/TensorRT-LLM-style runtimes for model-specific latency, throughput, GPU utilization, and cost efficiency.
  • Profile bottlenecks across GPU memory, HBM bandwidth, NCCL/network, tokenizer, frontend/proxy, and model worker paths.
  • Lead high-value model onboarding, including runtime selection, tensor/pipeline parallelism, quantization, context length, and rollback strategy.
  • Define runtime playbooks and safe defaults for reasoning, tool calling, multimodal, prompt cache, and provider-specific parameters.
  • Partner with SRE and performance/evaluation engineers to turn benchmark findings into production runtime improvements.
How you will stand out:
  • 6+ years of systems, ML infrastructure, or high-performance backend engineering experience.
  • Hands-on experience with LLM serving runtimes such as vLLM, Dynamo, SGLang, TensorRT-LLM, TGI, or Triton.
  • Strong understanding of GPU memory, CUDA/NCCL basics, KV cache, batching, streaming, and distributed inference tradeoffs.
  • Proficient in Go or Python and comfortable reading runtime source code, profiling traces, and production metrics.
  • Experience operating production inference services with strict latency, availability, and cost targets.
  • Able to translate low-level performance work into customer-visible reliability, latency, and margin improvements.
What you will experience working with us:
  • A culture that values authenticity and diversity of thoughts and backgrounds;
  • An inclusive and respectable environment with open workspaces and exciting start-up spirit;
  • Fast-growing company with the chance to network with industrial pioneers and enthusiasts;
  • Ability to contribute directly and make an impact on the future of the digital asset industry;
  • Involvement in new projects, developing processes/systems;
  • Personal accountability, autonomy, fast growth, and learning opportunities;
  • Attractive welfare benefits and developmental opportunities such as training and mentoring.

--------------------------------------------------------------------

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, colour, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.

#LI-ST1

Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Senior Inference Runtime Engineer in Singapore vacancy
  •  ...patterns for both steady-state and burst scenarios. Compare model/runtime/provider options and publish clear recommendations for routing,...  ...degrade quality, latency, or cost. Work with runtime engineers to identify bottlenecks and verify improvements; work with SRE... 
    Senior
    Full time
    Local area

    Bitdeer

    Singapore
    21 days ago
  •  ...vGPU) to enable efficient multi-tenant inference workloads and maximize cluster utilization...  ...-level parameters, device drivers, and runtime libraries (CUDA, NCCL) to resolve bottlenecks...  ...with the Scheduling and Storage engineering teams to ensure topology-aware placement... 
    Senior
    Full time
    Local area

    Bitdeer

    Singapore
    21 days ago
  •  ...operations for Asian AI data centers (AIDCs), covering detection engineering, incident response, host and network hardening, vulnerability...  ...key injection anomalies, and more. • Operate HIDS and eBPF runtime security tools (Tetragon / Falco) — agent deployment coverage,... 
    Senior
    Full time
    Local area
    Worldwide

    Bitdeer

    Singapore
    21 days ago
  •  ...Knowledge: Familiarity with the principles of AI distributed training communication libraries (e.g., NCCL, MPI) and the ability to diagnose/infer network issues by analyzing application-level training logs. Advanced Infiniband Skills: Proficiency with advanced features of... 
    Senior
    Full time
    Temporary work
    Local area
    Night shift

    Bitdeer

    Singapore
    21 days ago
  •  ...We are looking for a Senior Backend Engineer to join our and support our Trading Desk Team at Coinhako. In this role, you will be responsible for designing, developing, and maintaining high-performance tooling that power our internal Trading team. You’ll also be required... 
    Senior
    Full time
    Work experience placement
    Work at office

    Coinhako

    Singapore
    a month ago
  •  ...Motional is seeking a highly skilled Senior Cybersecurity Engineer to join our Defense Operations team. This operations-focused role puts you on the front lines of our security program, acting as a senior resource for security monitoring, system ownership, and the continuous... 
    Senior
    Full time
    Work experience placement

    Motional

    Singapore
    8 days ago
  •  ...capabilities across compute, storage, network, database, and middleware resources—combined with CMDB, Event Center, orchestration engines, and AI / LLM capabilities—to evolve from manual operations toward intelligent control and automated change, continuously improving... 
    Senior
    Full time

    OKX

    Singapore
    a month ago
  •  ...United States, Bhutan, Norway, Canada, Malaysia, and Ethiopia. Role Overview: We are seeking a talented Design Verification Engineer to join our IC development team and help ensure the functional correctness and robustness of complex digital designs. In this role... 
    Senior
    Full time
    Local area
    Night shift

    Bitdeer

    Singapore
    21 days ago
  •  ...our AI customers. Collaborate with AI Scheduling and Fabric engineering teams to ensure the control plane integrates tightly with GPU...  ...control plane chassis before they impact customer training or inference jobs. How you will stand out: ~ Bachelor’s or Master’s degree... 
    Full time
    Local area

    Bitdeer

    Singapore
    21 days ago
  •  ...external services—all with minimal user input. As a Backend Engineer, you'll build the systems that make those experiences possible...  ...services for AI-powered product features Developing inference pipelines and orchestration layers around LLMs Creating reliable... 
    Senior
    Full time

    OnHires

    Singapore
    a month ago
  •  ...and a preferred NVIDIA Cloud Partner, is engineered to power the AI of tomorrow. With the...  ...training pipelines, high-throughput AI Inference engines, and Model-as-a-Service (MaaS) with...  ..., security, and large-scale Agent runtime infrastructure ~ Advanced AI Systems... 
    Full time
    Traineeship
    Work experience placement

    Bitdeer

    Singapore
    18 days ago
  •  ...product streams related to payments, finance, and loyalty, working closely with engineering, customer success, and commercial teams to deliver exceptional value to our customers. This is a senior-level position that requires a proactive, detail-oriented, and technically... 
    Senior
    Full time

    KodyPay

    Singapore
    7 days ago
  •  ...containerized storage stack, from the storage array to the container runtime. Collaborate with the GPU Systems & Fabric team to ensure...  ...fair resource sharing for customer workloads. Mentor junior engineers and drive architectural design reviews to maintain high... 
    Senior
    Full time
    Local area

    Bitdeer

    Singapore
    21 days ago
  •  ...you will lead the development of the company’s core security engineering and DevSecOps capabilities, with a strong focus on  security product...  ..., covering code, build, artifacts, images, deployment, and runtime security. 2. Own the design and development of RASP / Java... 
    Senior
    Full time

    OKX

    Singapore
    a month ago
  •  ...capacity, and GPU health. Improve rollout safety for model/runtime/platform changes using canaries, fallback, health-aware routing...  ...self-healing workflows. Partner with runtime and performance engineers to debug incidents from public API edge to model worker. How... 
    Senior
    Full time
    Local area

    Bitdeer

    Singapore
    21 days ago
  •  ...Overview Singapore GEO (92701), Singapore, Singapore, Senior Account Executive What You’ll Do Responsible for onboarding...  ...Business Administration and Management, Information Technology, or Engineering or in lieu of a degree: 4 years of experience in payments or... 
    Senior

    Capital One

    Singapore
    a month ago
  • Responsibilities: Corporate Transactions Conducting antitrust due diligence, reviewing transaction documents in VDRs, and coordinating with international and local counsel across relevant jurisdictions on transaction structures Drafting, reviewing, and advising...
    Senior
    Full time
    Local area

    Axiom

    Singapore
    27 days ago
  •  ...Canada, Malaysia, and Ethiopia. About the team: GPU training and inference at 10,000+ GPU, multi-region scale depend on high-throughput,...  ...that can sustain massive parallel I/O. We are looking for an engineer who deeply understands distributed file systems and can... 
    Full time
    Local area

    Bitdeer

    Singapore
    21 days ago
  •  ...including on-site assessments where required. Clearly articulate identified risks and recommended controls to stakeholders, including senior management. Lead and drive the implementation of approved information security solutions. Evaluate and promote the adoption... 
    Full time
    Work experience placement

    DBS Bank Ltd

    Singapore
    14 days ago
  •  ...inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Routing & Switching - Network Engineering Advisor to join our team in Singapore, Central Singapore (SG-01), Singapore (SG). Role Responsibilities: •    Must have great... 
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Singapore
    4 days ago
  •  ...(LOBOs) and Operations COO functions. About the role The Senior Delivery Lead will be responsible for the end-to-end delivery...  ...Qualifications ~ Bachelor's or Master's degree in Computer Science, Engineering, Data Science, Artificial Intelligence, or a related... 
    Senior
    Full time

    DBS Bank Ltd

    Singapore
    7 days ago
  •  ...experiencing rapid growth in the region with new store openings and business channels (i.e., Click and collect and marketplace).   Senior Executive, Sephora Collection Demand Planner   The Senior Executive, Sephora Collection Demand Planner is responsible for... 
    Senior
    Local area

    Sephora

    Singapore
    13 days ago
  •  ...Mission Summary: We are looking for a Machine Learning Systems Engineer to join our ML Acceleration team. In this role, you will be...  ...machine learning model execution during training and inference, alongside a strong understanding of fundamental machine learning... 
    Full time

    Motional

    Singapore
    28 days ago
  •  ...business channels (i.e., Click and collect and marketplace).   Senior Executive, Data Excellence   The Data Excellence team is...  ...to work collaboratively across business, analytics, and data engineering teams while independently driving deliverables   Here,... 
    Senior

    Sephora

    Singapore
    a month ago
  •  ...functioning and strategic Finance function, you will have the opportunity to develop financial services expertise and learn directly from senior tax specialists. Key Accountabilities Support seniors in the Group Tax team with the following matters: Perform Transfer... 
    Senior
    Full time
    Local area

    DBS Bank Ltd

    Singapore
    7 days ago
  •  ...adapting the product to their distinct preferences and requirements. Cross-functional Collaboration Work closely with Design, Engineering, Data, and Marketing to translate user insights into shipped product features and iterative improvements. Partner with... 
    Senior
    Full time
    Local area

    OKX

    Singapore
    a month ago
  • Responsibilities 1. KYC and Compliance: • Facilitate the end-to-end client onboarding process, from prospect onboarding advisory to account opening • Assess client / case profile and guide Front Office to obtain the required corroboration and information • Partner...
    Senior
    Full time
    Local area

    DBS Bank Ltd

    Singapore
    14 days ago
  •  ...recognised for the quality of its medical expertise, facilities and teaching. We are looking for a highly motivated and competent Senior Assistant Manager to join the Centre for Geroscience and Geromedicine at LKCMedicine to support the delivery of high‑impact... 
    Senior
    Local area

    Nanyang Technological University Singapore

    Singapore
    more than 2 months ago
  •  ...from MSCI. For more information, please visit:  Job Title: Senior/Lead Character Concept Artist (Stylized) Responsibilities:...  ...successful implementation of designs into the game. Utilize the game engine editor (e.g., Unreal Engine, Unity) to adjust and finalize the... 
    Senior
    Full time
    Worldwide

    NetEase Games

    Singapore
    27 days ago
  •  ...requirements within onboarding processes. Required Qualifications Bachelor's Degree in Computer Science, Information Technology, Engineering, Business Information Systems, or a related discipline. Minimum 4+ years of experience as a Business Analyst or Technical... 
    Senior
    Full time

    DBS Bank Ltd

    Singapore
    19 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Inference Runtime Engineer. Be the first to apply!