Senior Inference Runtime Engineer
Full-time
Bitdeer
About Bitdeer:
Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud.
Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry-leading ASIC chips and manufacturing mining rigs, the Group handles complex processes involved in computing across the value chain. This includes equipment procurement, transport logistics, datacenter design and construction, equipment management, and network and facility operations. Bitdeer also offers advanced cloud capabilities to customers with a high demand for artificial intelligence. Headquartered in Singapore, Bitdeer operates globally with a diversified 3 GW energy portfolio, and deploys Bitcoin mining and HPC datacenters in the United States, Bhutan, Norway, Canada, Malaysia, and Ethiopia. About the team:We are seeking a Senior Inference Runtime Engineer to own the performance-critical serving layer of the MaaS platform. This role focuses on making self-hosted LLMs faster, cheaper, and more stable by optimizing the runtime stack behind OpenAI- and Anthropic-compatible APIs.
What you will be responsible for:- Optimize prefill/decode scheduling, continuous batching, KV cache behavior, speculative decoding, long-context serving, and streaming smoothness.
- Tune and operate vLLM/Dynamo/SGLang/TensorRT-LLM-style runtimes for model-specific latency, throughput, GPU utilization, and cost efficiency.
- Profile bottlenecks across GPU memory, HBM bandwidth, NCCL/network, tokenizer, frontend/proxy, and model worker paths.
- Lead high-value model onboarding, including runtime selection, tensor/pipeline parallelism, quantization, context length, and rollback strategy.
- Define runtime playbooks and safe defaults for reasoning, tool calling, multimodal, prompt cache, and provider-specific parameters.
- Partner with SRE and performance/evaluation engineers to turn benchmark findings into production runtime improvements.
- 6+ years of systems, ML infrastructure, or high-performance backend engineering experience.
- Hands-on experience with LLM serving runtimes such as vLLM, Dynamo, SGLang, TensorRT-LLM, TGI, or Triton.
- Strong understanding of GPU memory, CUDA/NCCL basics, KV cache, batching, streaming, and distributed inference tradeoffs.
- Proficient in Go or Python and comfortable reading runtime source code, profiling traces, and production metrics.
- Experience operating production inference services with strict latency, availability, and cost targets.
- Able to translate low-level performance work into customer-visible reliability, latency, and margin improvements.
- A culture that values authenticity and diversity of thoughts and backgrounds;
- An inclusive and respectable environment with open workspaces and exciting start-up spirit;
- Fast-growing company with the chance to network with industrial pioneers and enthusiasts;
- Ability to contribute directly and make an impact on the future of the digital asset industry;
- Involvement in new projects, developing processes/systems;
- Personal accountability, autonomy, fast growth, and learning opportunities;
- Attractive welfare benefits and developmental opportunities such as training and mentoring.
--------------------------------------------------------------------
Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, colour, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.#LI-ST1
Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Senior Inference Runtime Engineer in Singapore vacancy
- ...patterns for both steady-state and burst scenarios. Compare model/runtime/provider options and publish clear recommendations for routing,... ...degrade quality, latency, or cost. Work with runtime engineers to identify bottlenecks and verify improvements; work with SRE...SeniorFull timeLocal area
- ...vGPU) to enable efficient multi-tenant inference workloads and maximize cluster utilization... ...-level parameters, device drivers, and runtime libraries (CUDA, NCCL) to resolve bottlenecks... ...with the Scheduling and Storage engineering teams to ensure topology-aware placement...SeniorFull timeLocal area
- ...operations for Asian AI data centers (AIDCs), covering detection engineering, incident response, host and network hardening, vulnerability... ...key injection anomalies, and more. • Operate HIDS and eBPF runtime security tools (Tetragon / Falco) — agent deployment coverage,...SeniorFull timeLocal areaWorldwide
- ...Knowledge: Familiarity with the principles of AI distributed training communication libraries (e.g., NCCL, MPI) and the ability to diagnose/infer network issues by analyzing application-level training logs. Advanced Infiniband Skills: Proficiency with advanced features of...SeniorFull timeTemporary workLocal areaNight shift
- ...capabilities across compute, storage, network, database, and middleware resources—combined with CMDB, Event Center, orchestration engines, and AI / LLM capabilities—to evolve from manual operations toward intelligent control and automated change, continuously improving...SeniorFull time
- ...United States, Bhutan, Norway, Canada, Malaysia, and Ethiopia. Role Overview: We are seeking a talented Design Verification Engineer to join our IC development team and help ensure the functional correctness and robustness of complex digital designs. In this role...SeniorFull timeLocal areaNight shift
- ...We are looking for a Senior Backend Engineer to join our and support our Trading Desk Team at Coinhako. In this role, you will be responsible for designing, developing, and maintaining high-performance tooling that power our internal Trading team. You’ll also be required...SeniorFull timeWork experience placementWork at office
- ...Motional is seeking a highly skilled Senior Cybersecurity Engineer to join our Defense Operations team. This operations-focused role puts you on the front lines of our security program, acting as a senior resource for security monitoring, system ownership, and the continuous...SeniorFull timeWork experience placement
- ...you will lead the development of the company’s core security engineering and DevSecOps capabilities, with a strong focus on security product... ..., covering code, build, artifacts, images, deployment, and runtime security. 2. Own the design and development of RASP / Java...SeniorFull time
- ...capacity, and GPU health. Improve rollout safety for model/runtime/platform changes using canaries, fallback, health-aware routing... ...self-healing workflows. Partner with runtime and performance engineers to debug incidents from public API edge to model worker. How...SeniorFull timeLocal area
- ...Canada, Malaysia, and Ethiopia. About the team: GPU training and inference at 10,000+ GPU, multi-region scale depend on high-throughput,... ...that can sustain massive parallel I/O. We are looking for an engineer who deeply understands distributed file systems and can...Full timeLocal area
- ...adapting the product to their distinct preferences and requirements. Cross-functional Collaboration Work closely with Design, Engineering, Data, and Marketing to translate user insights into shipped product features and iterative improvements. Partner with...SeniorFull timeLocal area
- ...our AI customers. Collaborate with AI Scheduling and Fabric engineering teams to ensure the control plane integrates tightly with GPU... ...control plane chassis before they impact customer training or inference jobs. How you will stand out: ~ Bachelor’s or Master’s degree...Full timeLocal area
- ...Lead to drive the verification strategy and execution for complex IC designs. In this role, you will lead a team of verification engineers to ensure robust functional coverage and high-quality silicon through advanced verification methodologies, automation, and close collaboration...Full timeLocal areaNight shift
- ...backend systems for market analysis in a fast-paced, dynamic environment. Collaborate closely with product managers, frontend engineers, and infrastructure teams to deliver scalable and efficient solutions. Continuously improve system reliability, scalability, and...SeniorFull time
- ...We Look For In You: Proficient in AI-assisted development tools such as Codex and Claude Code — mandatory requirement to boost engineering productivity and iteration speed Minimum 3 years of backend development experience in financial or related industries...SeniorFull time
- ...long-term incentive plan. Comprehensive insurance coverage for employees and their families. An international team, an open engineering culture, and rich opportunities for technical growth. Deep involvement in frontier Web3 × AI work, building next-generation...SeniorFull timeContract workWorldwide
- ...This includes analyzing requirements and creating systematic designs (such as but not limited to structured cabling, data center engineering, security systems, network communications, audio-visual systems, building intelligence applications, etc.) based on technical characteristics...Full timeLocal area
- ...and updating technical documentation and design drawings. How you will stand out: Bachelor’s degree or above in Electrical Engineering and Automation, Power System Automation, Power Distribution Engineering, or related fields. Minimum 5 years of experience in medium...Full timeFor contractorsLocal area
- ...bring-up, rack, capacity, and acceptance standards for new GPU SKUs and data-center regions. How you will stand out: ~3+ years (Senior: 6+ years) in large-scale bare-metal / server-fleet operations, HPC, or cloud infrastructure. ~ Hands-on experience operating GPU...Local area
- ...and more. About the Team The Exchange Middle Platform team develops the core modules of the exchange, including the matching engine, real-time market data streaming, and market data analysis. It is the backbone of our industry-leading trading product, used by millions...SeniorFull time
- ...Staff/Senior Java Engineer, OKX Wallet (Web3) Who We Are OKX Wallet is OKX's self-custody wallet, built for users worldwide to securely and conveniently store, manage, and use their on-chain assets. The wallet backend operates in a multi-chain, multi-asset, high-concurrency...SeniorFull timeContract workWorldwide
- ..., Canada, Malaysia, and Ethiopia. About the team A security engineer role on the AI Cloud business line, covering four areas: security... ...issues — model output liability, training data residency, inference data retention, IP indemnity. Work with Legal and Sales to negotiate...SeniorFull timeContract workLocal area
- ...and a preferred NVIDIA Cloud Partner, is engineered to power the AI of tomorrow. With the... ...training pipelines, high-throughput AI Inference engines, and Model-as-a-Service (MaaS) with... ..., security, and large-scale Agent runtime infrastructure ~ Advanced AI Systems...Full timeTraineeshipWork experience placement
- ...processing and pipelines for model training data and feature engineering; partner with Product, Risk, and Growth teams on data needs for... ...Experience connecting big data platforms with AI/ML training and inference pipelines (e.g. feature platforms, real-time feature serving)....SeniorFull timeContract workOverseas
- ...external services—all with minimal user input. As a Backend Engineer, you'll build the systems that make those experiences possible... ...services for AI-powered product features Developing inference pipelines and orchestration layers around LLMs Creating reliable...SeniorFull time
- ...product streams related to payments, finance, and loyalty, working closely with engineering, customer success, and commercial teams to deliver exceptional value to our customers. This is a senior-level position that requires a proactive, detail-oriented, and technically...SeniorFull time
- ...competitive bids and offers in over 19,000 securities, at over 235 venues, in 36 countries worldwide THE ROLE Virtu’s Core Operations Engineers form a small, fast-paced global team dedicated to managing the deployment, maintenance, and enhancement of a sophisticated...Full timeWorldwide
- About Bitdeer: Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud. Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry-leading ASIC chips and manufacturing mining rigs,...Full timeLocal areaNight shift
- ...hard and strive to be virtuous in all we do. * Core Operations Engineer Internship (Singapore) Virtu's internship program offers... ...program. Interns will work from a list of projects and have several senior mentors throughout the summer program. Perks : Daily...Full timeSummer workInternship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Inference Runtime Engineer. Be the first to apply!
Related searches
- senior network engineer remote Singapore
- senior manager legal Singapore
- senior staff systems engineer Singapore
- senior commercial counsel Singapore
- senior manager tax Singapore
- senior implementation project manager Singapore
- senior level Singapore
- senior cloud data engineer Singapore
- senior principal cloud computing engineer Singapore
- senior cloud network engineer Singapore


