Senior Backend Engineer, ML Inference Systems
$135.8k - $237.05kUnity Technologies
Mountain View, CA, USA
Senior Backend Engineer, ML Inference Systems
Location
Mountain View, CA, USA
Department
AI & Machine Learning
Requisition ID
JOBREQ-2616050
Role description
The opportunity
Every day, we connect billions of players with the games and experiences they love.
Our Vector ( Gamer AI team sits at the heart of that mission, governing ad ranking and bidding decisions across billions of daily impressions, where large-scale machine learning and real-world impact converge at scale.
We're hiring a Senior Backend Engineer to build and operate the infrastructure those models depend on. You'll design and operate the distributed systems that power billions of daily decisions, with a focus on the performance, reliability, and scalability of inference systems.
Join us and help influence how billions of gaming experiences are discovered, monetized, and how creators are rewarded.
What you'll be doing
Design, develop, and deploy production-grade backend services and distributed systems powering large-scale online model inference at billions of daily requests
Drive technical direction of our inference platform, with a focus on low-latency, high-throughput serving infrastructure
Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput
Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana
Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high-scale production environment
Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE)
What we're looking for
Experience designing, deploying, and maintaining distributed systems at scale
Expertise in Golang for building high-performance, low-latency backend infrastructure
Hands-on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes
Strong grounding in monitoring and observability tooling, including Prometheus and Grafana
Experience in ad tech, recommender systems, real-time personalization, or other performance-critical domains
Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices
Familiarity with machine learning platforms, workflows, and serving infrastructure
You might also have
Experience with ML inference servers like NVIDIA Triton Inference Server
Familiarity with auction mechanics or bidding systems in an ad tech context
Experience embracing AI as a strategic advantage in engineering, following established best practices for code quality and security
Additional information
- Relocation support is not available for this position
Benefits
At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well-being and work-life balance.
Please note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status.
While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally: Comprehensive health, life, and disability insurance | Commute subsidy | Employee stock ownership | Competitive retirement/pension plans | Generous vacation and personal days | Support for new parents through leave and family-care programs | Office food snacks | Mental Health and Wellbeing programs and support | Employee Resource Groups | Global Employee Assistance Program | Training and development programs | Volunteering and donation matching program
Life at Unity
Unity [NYSE: U] is the world's leading game engine, powering play for more than 3 billion consumers each month. The top mobile games in the world, the most played PC indie titles, the most innovative console games, and virtually all of the top XR and Web Games are developed, deployed, and grown in Unity. Unity also enables teams across industries like automotive, manufacturing, and healthcare to design, simulate, and collaborate in 3D - closing the gap between ideas and reality. For more information, please visit
Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form ( to let us know.
This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English.
Headhunters and recruitment agencies may not submit resumes/CVs through this website or directly to managers. Unity does not accept unsolicited headhunter and agency resumes. Unity will not pay fees to any third-party agency or company that does not have a signed agreement with Unity.
Your privacy is important to us. Please take a moment to review our Prospect Privacy Policy ( and Applicant Privacy Policy ( . Should you have any concerns about your privacy, please contact us at View email address on click.appcast.io.
#SEN #LI-AR1
*Note: This range reflects the anticipated base salary for this position. Beyond base salary, this role may be eligible for equity awards and participation in our company incentive plans (such as annual discretionary bonuses or sales commissions). The final offer amount will depend on several factors, including geographic location and the candidate's relevant experience, professional background, and skill set.
Gross pay salary
$135,800-$237,050 USD
- Job type: Full Time · Department: Backend Engineer · Work type: On-Site About A... ...scalable, and resilient distributed systems. You’ll work closely with researchers, ML engineers, and product teams to... ..., low-latency AI model inference and data services. Partner with...SeniorFull time
- ...for the AI-first world. Why this role exists We need a Backend Engineer to build the systems that orchestrate GPU clusters for AI workloads. You'll create... ...or HPC cluster management experience Understanding of ML,AI workload patterns and requirements Experience with...SeniorHourly payFull timeWork at officeWork from homeVisa sponsorship
$248.71k - $292.6k
...Groq Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses... ...possible. Build fast. Sr. Staff Software Engineer - High Performance GPU Inference... ...Collaboration : Work closely with teams across ML compilers, orchestration, cloud...Senior- ...platform company in Palo Alto seeks a Senior Engineer to develop a cutting-edge inference platform supporting semantic... ...over five years of experience in backend systems and proficiency in languages like... ...or Python. You'll work alongside ML researchers to enhance infrastructure...Senior
- Israelvcforum is looking for a Senior ML Infrastructure Engineer in Mountain View,... ...scale robust platforms for ML inference workflows supporting GM’s... ...serving strategies and handle backend software components. The... ...in machine learning systems, proficiency in Python or...SeniorRemote job
- General Motors is seeking a Senior ML Infrastructure Engineer to build and scale a robust platform for machine learning inference workflows. You will design backend software components, collaborate with... ...experience in machine learning systems, proficiency in Python and C++,...SeniorRemote job
- A leader in AI technology in Palo Alto is seeking a Senior AI Systems Performance Engineer to optimize the latest foundation models on their innovative platform... ...in deep learning, performance optimization, and major ML frameworks. This position offers competitive salary and...Senior
- 247Hire is looking for a Backend Engineer to design and develop sophisticated multi-layered permission role integrations and automated solutions... ...will have over 6 years of experience with distributed systems and lead small to medium engineering teams. This role emphasizes...Senior
$130k - $180k
...healthcare, AI, and scalable cloud systems. About the Role We are looking for a high-impact engineer to join a small, fast-moving... .... This is not a typical backend role. You will work across backend... ...closely with product, ML, and leadership to prioritize...SeniorWork at officeFlexible hours$190k - $240k
A financial technology company is seeking an experienced backend software engineer to enhance their lifecycle-orchestrator service. The successful... ..., proficiency in API design, and knowledge of distributed systems. The position supports remote work, ensuring flexibility...SeniorRemote work- ...Join OPPO US Research Center’s core team to develop and optimize backend services for high-traffic products (App Store, Global Search, Game Center). You’ll build scalable, reliable systems that serve millions of daily users. Key Responsibilities: Design and...SeniorFor contractors
- ...Overview FlexAI is looking for a Senior Backend Engineer (Infrastructure & AI... ...and build the core backend systems powering our next-generation... ...large-scale model training, inference, and orchestration across heterogeneous... ...: Collaborate with AI/ML and Runtime teams to...SeniorWork at office
- ...company is seeking passionate developers to join their dynamic Engineering teams. In this role, you will design and implement... ...world-class APIs and contributing to large-scale distributed systems. If you are eager to make a difference and thrive in a collaborative...Senior
- We’re looking for a Senior Engineer to help build the next-generation inference platform that supports embedding... ...and collaborate with ML researchers and... ...focus on building core systems and services that power... ...of experience building backend or infrastructure systems...SeniorLocal areaWorldwide
$152k - $241.5k
...We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server ( . NVIDIA is hiring software engineers for its GPU-accelerated deep learning... ...with high-scale distributed systems and ML systems. ~ Strong communication skills and ability...Senior$150k - $175k
...AI. What you will do As part of the engineering team, you'll work alongside industry-leading cryptographers, AI/ML innovators, cloud infrastructure experts, and... ...Design and own a cryptographically secure identity system that serves as the "source of truth" for all...SeniorFlexible hours- ...technology company focused on AI and simulation is seeking a Backend Engineer to build and maintain data systems and APIs. The ideal candidate will have experience in... ...role offers the opportunity to work closely with ML engineers and researchers, with a focus on building...
$160k - $240k
...monitoring—working alongside leading health systems to drive real change. This is more than... ...Job Summary We're looking for a skilled Backend Engineer to contribute to the development of our... ...industry experience Experience with AI/ML platforms and frameworks (TensorFlow,...SeniorLive inFlexible hours3 days per week$184k - $287.5k
...We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency... ...research that pushes the pareto frontier for the field of ML Systems; survey recent publications and find a way to...Senior$174k - $299k
...impact complex Coupang workflow systems. We need to create a set of... ...looking for a visionary Senior Staff Software Engineer to lead the architectural... ...Driven Automation: Integrate AI/ML models to automate system... ...8 years of experience in backend software development...SeniorTemporary workFlexible hours$140k - $215k
CrowdStrike Holdings, Inc. is looking for a backend software engineer to join their Ingestion group in Sunnyvale, California. This position involves... ...development, preferably with experience in distributed systems and cloud technologies. The role offers high autonomy and the...Senior$155.42k - $395.9k
...Description About the Team: The ML Inference Platform is part of the... ...Role: We are seeking a Senior ML Infrastructure engineer to help build and scale... ...in designing distributed systems for ML, strong problem-... ...implement core platform backend software components. Collaborate...SeniorLocal areaRemote workRelocationRelocation packageFlexible hours- ...infrastructure company in California is seeking a Member of Technical Staff — Inference to design and optimize large-scale AI inference systems. The role demands 5+ years in systems engineering and expertise in large-scale inference systems. Successful candidates will...SeniorFlexible hours
- Acceler8 Talent is seeking a Senior / Principal Machine Learning Engineer specializing in inference serving frameworks. This role involves designing and optimizing multi-node inference systems, enhancing resource scheduling capabilities, and engaging with the open-source...Senior
- Member of Technical Staff - Backend Engineer - Data Systems and APIs About Vinci We’re building a copilot for hardware. Software engineers have powerful... ...of the platform You’ll work across the stack with ML engineers, physics researchers, and product engineers. What...
- ...to PCs, gaming and embedded systems. Grounded in a culture of... ...AMD is looking for a Senior Staff AI Infra Engineer who is passionate about improving... ...with a special focus on AI/ML workloads and GPU-accelerated... ...LLM training and inference on AMD GPUs, improving kernel...
$152k - $287.5k
NVIDIA Gruppe is seeking a Senior Machine Learning Applications and Compiler Engineer in Santa Clara, California. This role involves developing algorithms for their LPX inference and compiler stack, optimizing the performance of neural network workloads on NVIDIA platforms...Senior$180k
Pantera Capital is seeking a candidate to develop backend infrastructure primarily in Rust. Responsibilities include building the xAI API for global developers and ensuring high-throughput inference systems. Ideal candidates will have expert knowledge in Rust or C++, experience...$180k - $240k
...Backend Engineer - Infrastructure Los Angeles, San Francisco, Palo Alto... ...spearhead the development of core systems and infrastructure crucial to... ...management and scheduling ML Infrastructure: Construct the... ...' productivity, and inference systems to optimize the scalability...Work experience placement$166k - $220k
A leading technology company in Mountain View is seeking an experienced backend or infrastructure engineer to join their ML/AI Environments team. The ideal candidate will have 5+ years of experience and strong programming skills in Python, Scala, or Java. You will be responsible...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer, ML Inference Systems. Be the first to apply!
- back-end developer Mountain View, CA
- senior backend developer Mountain View, CA
- backend software engineer Mountain View, CA
- healthcare systems engineer Mountain View, CA
- system test engineer Mountain View, CA
- electronic systems engineer Mountain View, CA
- systems engineer Mountain View, CA
- system safety engineer Mountain View, CA
- ground systems engineer Mountain View, CA
- operations support system engineer Mountain View, CA

