Senior Backend Engineer, ML Inference Systems
$178.7k - $268.1kUnity Technologies
The opportunity Every day, we connect billions of players with the games and experiences they love. Our Vector Gamer AI team sits at the heart of that mission, governing ad ranking and bidding decisions across billions of daily impressions, where large-scale machine learning and real-world impact converge at scale. We're hiring a Senior Backend Engineer to build and operate the infrastructure those models depend on. You'll design and operate the distributed systems that power billions of daily decisions, with a focus on the performance, reliability, and scalability of inference systems. Join us and help influence how billions of gaming experiences are discovered, monetized, and how creators are rewarded. What you'll be doing Design, develop, and deploy production-grade backend services and distributed systems powering large-scale online model inference at billions of daily requests Drive technical direction of our inference platform, with a focus on low-latency, high-throughput serving infrastructure Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high-scale production environment Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE) What we're looking for Experience designing, deploying, and maintaining distributed systems at scale Expertise in Golang for building high-performance, low-latency backend infrastructure Hands-on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes Strong grounding in monitoring and observability tooling, including Prometheus and Grafana Experience in ad tech, recommender systems, real-time personalization, or other performance-critical domains Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices Familiarity with machine learning platforms, workflows, and serving infrastructure You might also have Experience with ML inference servers like NVIDIA Triton Inference Server Familiarity with auction mechanics or bidding systems in an ad tech context Experience embracing AI as a strategic advantage in engineering, following established best practices for code quality and security Additional information Relocation support is not available for this position Annual Gross Pay: USD $178,700 - $268,100 This range reflects the anticipated base salary for this position. Beyond base salary, this role may be eligible for equity awards and participation in our company incentive plans (such as annual discretionary bonuses or sales commissions). The final offer amount will depend on several factors, including geographic location and the candidate’s relevant experience, professional background, and skill set. Benefits At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well-being and work-life balance. Please note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status. While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally: Comprehensive health, life, and disability insurance | Commute subsidy | Employee stock ownership | Competitive retirement/pension plans | Generous vacation and personal days | Support for new parents through leave and family-care programs | Office food snacks | Mental Health and Wellbeing programs and support | Employee Resource Groups | Global Employee Assistance Program | Training and development programs | Volunteering and donation matching program Life at Unity Unity [NYSE: U] is the world’s leading game engine, powering play for more than 3 billion consumers each month. The top mobile games in the world, the most played PC indie titles, the most innovative console games, and virtually all of the top XR and Web Games are developed, deployed, and grown in Unity. Unity also enables teams across industries like automotive, manufacturing, and healthcare to design, simulate, and collaborate in 3D — closing the gap between ideas and reality. For more information, please visit Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form to let us know. This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English. This posting is intended to fill an existing vacancy, and we are committed to providing applicants with updates throughout the hiring process in accordance with applicable law. Headhunters and recruitment agencies may not submit resumes/CVs through this website or directly to managers. Unity does not accept unsolicited headhunter and agency resumes. Unity will not pay fees to any third-party agency or company that does not have a signed agreement with Unity. Your privacy is important to us. Please take a moment to review our Prospect and Applicant Privacy Policies. Should you have any concerns about your privacy, please contact us at View email address on click.appcast.io. Unity [NYSE: U] is the world’s leading game engine, powering play for more than 3 billion consumers each month. The top mobile games in the world, the most played PC indie titles, the most innovative console games, and virtually all of the top XR and Web Games are developed, deployed, and grown in Unity. Unity also enables teams across industries like automotive, manufacturing, and healthcare to design, simulate, and collaborate in 3D — closing the gap between ideas and reality. At Unity, we're committed to creating a workplace that fosters collaboration and teamwork that allows you to harness your unique skills. Join us in creating industry tools to help creators of all levels bring their projects to reality. Learn more about our culture and values, and get a head start by reading about how our hiring process works.
- ...Overview FlexAI is looking for a Senior Backend Engineer (Infrastructure & AI... ...and build the core backend systems powering our next-generation... ...large-scale model training, inference, and orchestration across heterogeneous... ...: Collaborate with AI/ML and Runtime teams to...SeniorWork at office
$160k - $240k
...monitoring—working alongside leading health systems to drive real change. This is more than... ...Job Summary We're looking for a skilled Backend Engineer to contribute to the development of our... ...industry experience Experience with AI/ML platforms and frameworks (TensorFlow,...SeniorLive inFlexible hours3 days per week- ...company is seeking passionate developers to join their dynamic Engineering teams. In this role, you will design and implement... ...world-class APIs and contributing to large-scale distributed systems. If you are eager to make a difference and thrive in a collaborative...Senior
$126k - $248k
...Role We’re looking for a Senior Engineer to help build the next-generation inference platform that supports... ...and collaborate with ML researchers and engineers... ...focus on building core systems and services that power... ...of experience building backend or infrastructure...SeniorLocal areaFlexible hours- ...is hiring a Member of Technical Staff — Inference to push the limits of large-scale AI... ...inference. You will design and optimize core systems that serve frontier models across thousands of GPUs. The role blends systems engineering, ML infrastructure, and performance...SeniorWorldwide
- A leading voice automation startup in Redwood City is seeking a Senior Backend Engineer to shape core systems for AI-driven conversations. This role involves building scalable architecture, collaborating with teams, and driving product delivery. The ideal candidate has...Senior
- ...services and internal tools. The ideal candidate will have strong backend development experience and proficiency in languages such as... ...production services while collaborating closely with product engineering teams. The role requires a bachelor’s degree in a related field...
- Cerebras Systems builds the world’s largest AI chip with... ...-leading training and inference speeds and allows users to run large-scale ML applications with less... ...applications. About The Role Senior Director of Technical... ...of product, engineering, sales, and marketing to...Senior
- Cerebras Systems builds the world's largest AI chip, 56 times larger... ...industry-leading training and inference speeds; over 10 times faster than... ...are paying attention. As Senior Product Marketing Manager, you... ...product marketing experience in AI, ML infrastructure, or developer...SeniorShift workNight shift
- ...Description Join OPPO US Research Center’s core team to develop and optimize backend services for high-traffic products (App Store, Global Search, Game Center). You’ll build scalable, reliable systems that serve millions of daily users. Key Responsibilities: Design...SeniorFor contractors
$190k - $220k
AI Chopping Block, Inc. is seeking a software engineer with a strong backend and ML engineering background in Mountain View, California. This role involves designing and maintaining AI-powered applications, mentoring engineers, and improving internal ML processes. Candidates...Senior- ...leading AI solutions provider in Palo Alto is looking for a Senior ML Engineer to take ownership of the entire machine learning lifecycle.... ...background in Python, and significant expertise with production systems using PyTorch. You will work closely with product and data...Senior
- ...LLC in Palo Alto is looking for a Senior Engineer to develop a next-generation inference platform integrated with Atlas.... ...have over 5 years of experience in backend development, strong programming... ...solid understanding of distributed systems. The position offers a hybrid...Senior
- Rhoda AI in Mountain View is seeking a Staff / Principal ML Training Systems Engineer to lead the performance of large-scale multimodal training systems. This role involves improving training efficiency and collaborating closely with research teams to accelerate model...Senior
$230k - $250k
Cerebras Systems in Sunnyvale, CA, seeks a Sr. Member of Technical Staff to develop resilient software for their AI chip. Responsibilities include designing robust software features, maintaining deployment workflows using AWS, and debugging software issues. Candidates should...SeniorRemote job$192k - $278k
...projects, ensuring alignment with strategic objectives. You will work closely with engineering teams and collaborate with stakeholders to drive the development of innovative ML systems. This position offers a competitive salary range of $192,000 to $278,000 annually, in...Senior$184k - $287.5k
NVIDIA Gruppe is seeking talented AI systems engineers to advance innovative technologies in AI inference systems software. This role involves developing cutting-edge libraries, code generators, and kernel technologies for NVIDIA's architecture, emphasizing high-impact...Senior$174k - $253k
Google Inc. is seeking a Senior Software Engineer to work on Generative AI technologies in Sunnyvale, CA. You will design, develop, and maintain large software systems, managing project priorities and collaborating closely with teams across the organization. With a focus...Senior- ...seeking an experienced Senior Architect to lead the design... ...‑scale distributed systems supporting 50M+... ...operating mission‑critical backend platforms that process... ...optimization Data Platform Engineering Architect real‑time and... ..., GDPR) Exposure to AI/ML data pipelines and large...SeniorFlexible hours
$135k - $200k
...allocation planning tools driven by rich‑ML models. Our customers use our defense... ...of militaries across the world. Backend Software Engineers at Palantir build software at scale to... ...with other engineers to architect a new system that enables a novel workflow, the next...Work experience placementRelocation package- ...model teams. 3+ yrs distributed systems / ML infra. About Orbifold AI... ...hiring a Machine Learning Engineer to scale and optimize the ML... ...distributed training jobs and inference deployments to maximize GPU/... ...with a strong focus on backend, distributed systems, or ML...
- ...self‑service claim‑filing software to backend fraud detection, we’re the engine that powers claims processing for... ...vulnerable to orchestrating large‑scale ML‑driven decision‑making on billions... ...to help define and scale the core systems powering our rapidly growing B2B SaaS...Temporary workRemote workWork from homeHome office
$140k - $200k
A healthcare technology company is looking for a Backend Engineer to join the Ambient AI team in Mountain View, CA. The role involves developing... ...AI solutions and scaling infrastructure for large health systems. Candidates should have strong programming skills in Python...Senior- ...skilled and experienced Senior AI Architect to... ...with product and engineering leaders to... ...practices for AI system design on AWS, including... ...including model hosting, inference patterns, data... ...-based services, ML models, and... ...Python for AI/ML and backend systems; solid experience...Senior
$120k - $180k
CrowdStrike Holdings, Inc. is looking for a Software Engineer III - Asset Management in Sunnyvale, CA. The successful candidate will write... ...for millions of users. Expertise in Golang and distributed systems is required. This hybrid role involves 2-3 days per week in the...SeniorWork at office2 days per week3 days per week$160k - $200k
General Motors is seeking a Senior Software Engineer to design and develop middleware and application software for next-generation infotainment... ...platforms. This role focuses on building scalable, reliable systems for advanced user experiences. The ideal candidate has...Senior- ...A technology solutions company in Sunnyvale is seeking a Senior Backend Developer to design and develop scalable backend systems using Java and Spring Boot. The ideal candidate will have strong expertise in microservices architecture and AWS services. Responsibilities...Senior
$185k - $250k
...Knightscope is seeking a Senior Full Stack Engineer to design, build, and own the... ...role is the bridge between backend services and the operator-facing... ...with robotics, AI/ML, audio/video, DevOps, and UI... ...with component-based design systems and WCAG AA accessibility standards...SeniorFull timeRelocation$121.5k - $150k
...diseases. The Opportunity We are looking for a hands-on Senior Backend Software Engineer to join our lean, high-impact engineering team as a core... ...ecosystem. This is an opportunity for a purist backend systems engineer. You will own the deterministic state machine that...SeniorFull timeTemporary workFlexible hours- ...0 billion flows through our systems and we support over 100 million... .... About the Role As a Senior Fullstack Engineer , you'll be critical to designing... ..., and supporting both backend and frontend logic for our innovative... ...FHIR. Experience with AI/ML concepts and frameworks....SeniorFull timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer, ML Inference Systems. Be the first to apply!
- back-end developer Mountain View, CA
- backend software engineer Mountain View, CA
- system engineer remote Mountain View, CA
- senior staff systems engineer Mountain View, CA
- mission system engineer Mountain View, CA
- senior windows systems engineer Mountain View, CA
- operations support system engineer Mountain View, CA
- distributed systems engineer Mountain View, CA
- computer system validation engineer Mountain View, CA
- operating system engineer Mountain View, CA

