Senior Backend Engineer, ML Inference Systems
$178.7k - $268.1kUnity
Opportunity Every day, we connect billions of players with the games and experiences they love. Our Vector Gamer AI team sits at the heart of that mission, governing ad ranking and bidding decisions across billions of daily impressions, where large-scale machine learning and real-world impact converge at scale. We’re hiring a Senior Backend Engineer to build and operate the infrastructure those models depend on. You’ll design and operate the distributed systems that power billions of daily decisions, with a focus on the performance, reliability, and scalability of inference systems. What You’ll Be Doing Design, develop, and deploy production‑grade backend services and distributed systems powering large‑scale online model inference at billions of daily requests. Drive technical direction of our inference platform, with a focus on low‑latency, high‑throughput serving infrastructure. Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput. Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana. Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high‑scale production environment. Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE). What We’re Looking For Experience designing, deploying, and maintaining distributed systems at scale. Expertise in Golang for building high‑performance, low‑latency backend infrastructure. Hands‑on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes. Strong grounding in monitoring and observability tooling, including Prometheus and Grafana. Experience in ad tech, recommender systems, real‑time personalization, or other performance‑critical domains. Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices. Familiarity with machine learning platforms, workflows, and serving infrastructure. You Might Also Have Experience with ML inference servers like NVIDIA Triton Inference Server. Familiarity with auction mechanics or bidding systems in an ad tech context. Experience embracing AI as a strategic advantage in engineering, following established best practices for code quality and security. Additional Information Relocation support is not available for this position. Annual Gross Pay: USD $178,700 – $268,100. This range reflects the anticipated base salary for this position. Beyond base salary, this role may be eligible for equity awards and participation in our company incentive plans (such as annual discretionary bonuses or sales commissions). The final offer amount will depend on several factors, including geographic location and the candidate’s relevant experience, professional background, and skill set. Benefits Comprehensive health, life, and disability insurance. Commute subsidy. Employee stock ownership. Competitive retirement/pension plans. Generous vacation and personal days. Support for new parents through leave and family‑care programs. Office food snacks. Mental Health and Wellbeing programs and support. Employee Resource Groups. Global Employee Assistance Program. Training and development programs. Volunteering and donation matching program. Equal Opportunity Employer Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form to let us know. #J-18808-Ljbffr Unity
- Unity is seeking a Senior Backend Engineer to design and operate the infrastructure powering large‑scale model inference. You will build distributed systems, optimize low‑latency serving, and ensure reliability... ...observability. Collaborate with ML teams to scale online serving...Senior
$135.8k - $237.05k
...converge at scale. We're hiring a Senior Backend Engineer to build and operate the... ...and operate the distributed systems that power billions of daily... ..., and scalability of inference systems. Join us and help influence... ...Partner with ML engineers to ensure online serving...SeniorWork at officeWorldwideRelocation package- Unity in Mountain View is hiring a Senior Backend Engineer to design and operate distributed systems that power large-scale online model inference. You will work on performance, reliability, and scalability of these critical systems. The position requires expertise in Golang...SuggestedWorldwide
- ...is hiring a Member of Technical Staff — Inference to push the limits of large-scale AI... ...inference. You will design and optimize core systems that serve frontier models across thousands of GPUs. The role blends systems engineering, ML infrastructure, and performance...SeniorWorldwide
$198k - $326k
...Mountain View is looking for a Sr. Staff Software Engineer in Systems Infrastructure to lead optimizations across AI inference systems. Candidates should have 8+ years of... ...in software engineering, extensive knowledge of ML systems, and proficiency in Python or C++. The...Senior$255k - $405k
...technology company based in California is seeking candidates to build backend systems for AI-powered features. The role involves optimizing service... ...with high-throughput services, be familiar with AI inference patterns, and have proficiency in Python and NodeJs among other...$184k - $287.5k
NVIDIA is seeking AI systems engineers to innovate in the inference systems software stack. The role involves designing and optimizing libraries and kernel technologies... ...(PhD preferred) and over 6 years of experience in ML/DL systems development, with strong skills in Python...Senior- ...Role We’re looking for a Senior Engineer to help build the next-generation inference platform that supports... ...and collaborate with ML researchers and engineers... ...focus on building core systems and services that power... ...of experience building backend or infrastructure...Senior
$192.6k - $271.9k
Unity is hiring a Staff Backend Engineer in Mountain View, California. This role involves designing and operating distributed systems that support billions of daily decisions in gaming experiences. The successful candidate will have 5+ years of experience with distributed...- MongoDB is seeking a Software Engineer 3 for the Voyage Control Plane... ...resources, collaborating closely with ML researchers and platform teams... ...on building robust and secure systems for identity and billing, you’... ...of experience in distributed backend systems and strong skills in...Senior
- ...Lyric’s environment. We are looking for a Senior Backend Engineer to lead the design and development of... ...deeply with Lyric’s data and ML workflows. You will design APIs and services... ...cancellation, logging, and reporting. Ensure the system is resilient and scales horizontally to...Senior
- ...infrastructure team lays the foundation for everything we build — providing reliable, secure, and scalable systems to our engineering and ML teams. We’re looking for a Senior Backend Engineer - Infrastructure to design and build core platform components, including Kubernetes...Senior
- ...architect a cryptographically secure identity system for AI workloads, and develop high-performance... ...across multi-cloud environments, and help shape engineering standards and culture. Join a team of cryptographers, AI/ML experts, and cloud engineers to define the stack...Senior
$204k - $259k
Waymo is seeking a skilled Backend Engineer in Mountain View, California. In this role, you will be responsible for owning crucial systems and developing algorithms to keep our mapping infrastructure updated. The ideal candidate will have over 4 years of experience, solid...Senior- ...company is seeking passionate developers to join their dynamic Engineering teams. In this role, you will design and implement... ...world-class APIs and contributing to large-scale distributed systems. If you are eager to make a difference and thrive in a collaborative...Senior
$180k - $275k
Samayaai is looking for a Backend Engineer in Mountain View, California, to design and lead the development of critical systems supporting AI products. The role requires developing fast, reliable, and scalable core components while ensuring high engineering standards. Candidates...Senior- Wand AI is seeking a highly experienced Senior Backend Engineer to design, build, and operate scalable backend systems. You will be responsible for developing reliable services and APIs that support complex product capabilities. The ideal candidate will have strong experience...Senior
- Articul8 is seeking a Product/Software Engineer-Backend to architect scalable and secure backend systems for our GenAI-powered solutions. In this role, you'll work alongside cross-functional teams to drive innovation and ensure optimal system performance. You should have...Senior
$126k - $248k
...Role We’re looking for a Senior Engineer to help build the next-generation inference platform that supports... ...and collaborate with ML researchers and engineers... ...focus on building core systems and services that power... ...of experience building backend or infrastructure...SeniorLocal areaFlexible hours$224k - $284k
ATOMS Careers page is looking for an experienced Software Engineer for their Mountain View office. The role involves building data-driven... ...features, collaborating with teams, and architecting scalable systems. With a starting salary of $224,000 - $284,000 per year, the...SeniorWork at office- ...Palo Alto, California, is in search of a skilled Product/Software Engineer-Backend to shape the future of Generative AI. You will have a pivotal role in developing scalable, high-performance backend systems while collaborating with diverse teams to drive innovations. The...Senior
- A tech company specializing in computer vision is seeking a skilled software engineer to architect and develop backend systems. You will work with modern technologies, contribute to a collaborative team, and handle real-world applications. The ideal candidate has strong...Senior
- Gravity Engineering Services Pvt Ltd. is seeking an experienced Backend Engineer in Mountain View, California. Join our high-visibility ML/AI Environments team to build systems for AI researchers and engineers. This role involves developing infrastructure that allows seamless...Senior
$150k - $175k
...enterprise AI. What you will do As part of the engineering team, you’ll work alongside industry-leading cryptographers, AI/ML innovators, cloud infrastructure experts, and... ...and own a cryptographically secure identity system that serves as the "source of truth" for all AI...SeniorFlexible hours- Yahoo Holdings Inc. is seeking experienced engineers to design, build and operate highly scalable backend systems powering the Search platform. You will work on edge infrastructure, request validation, traffic routing, bot detection, and platform security within AWS/Kubernetes...Senior
$152k - $241.5k
We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software engineers for its GPU-accelerated deep learning... ...with high-scale distributed systems and ML systems. Strong communication skills and ability...Senior- ...Description Join OPPO US Research Center’s core team to develop and optimize backend services for high-traffic products (App Store, Global Search, Game Center). You’ll build scalable, reliable systems that serve millions of daily users. Key Responsibilities: Design...SeniorFor contractors
- Success Matcher Recruitment is seeking a senior ML systems engineer to translate cutting-edge research into an enterprise-grade platform. You will work directly with the Chief Architect and CEO to design, implement, and scale multi-agent workflow orchestration. The role...Senior
- ...technology firm in Sunnyvale, California, is hiring a Senior Performance Analyst. You will focus on performance benchmarking and competitive pricing for their inference product. The role requires deep knowledge of ML systems and open-source frameworks, with at least 5 years...Senior
$227.87k
...developing and executing solutions that enhance the Pinterest marketplace, primarily focusing on backend systems and statistical models. Candidates need strong software engineering skills and a graduate degree in a related field. The position is unique, allowing...SeniorWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer, ML Inference Systems. Be the first to apply!
- back-end developer Mountain View, CA
- senior backend developer Mountain View, CA
- java developer backend Mountain View, CA
- backend software engineer Mountain View, CA
- ground systems engineer Mountain View, CA
- advanced systems engineer Mountain View, CA
- distributed systems engineer Mountain View, CA
- computer systems engineer Mountain View, CA
- computer system validation engineer Mountain View, CA
- mission system engineer Mountain View, CA

