Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Backend Engineer, ML Inference Systems

$178.7k - $268.1k

Unity

Opportunity Every day, we connect billions of players with the games and experiences they love. Our Vector Gamer AI team sits at the heart of that mission, governing ad ranking and bidding decisions across billions of daily impressions, where large-scale machine learning and real-world impact converge at scale. We’re hiring a Senior Backend Engineer to build and operate the infrastructure those models depend on. You’ll design and operate the distributed systems that power billions of daily decisions, with a focus on the performance, reliability, and scalability of inference systems. What You’ll Be Doing Design, develop, and deploy production‑grade backend services and distributed systems powering large‑scale online model inference at billions of daily requests. Drive technical direction of our inference platform, with a focus on low‑latency, high‑throughput serving infrastructure. Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput. Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana. Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high‑scale production environment. Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE). What We’re Looking For Experience designing, deploying, and maintaining distributed systems at scale. Expertise in Golang for building high‑performance, low‑latency backend infrastructure. Hands‑on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes. Strong grounding in monitoring and observability tooling, including Prometheus and Grafana. Experience in ad tech, recommender systems, real‑time personalization, or other performance‑critical domains. Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices. Familiarity with machine learning platforms, workflows, and serving infrastructure. You Might Also Have Experience with ML inference servers like NVIDIA Triton Inference Server. Familiarity with auction mechanics or bidding systems in an ad tech context. Experience embracing AI as a strategic advantage in engineering, following established best practices for code quality and security. Additional Information Relocation support is not available for this position. Annual Gross Pay: USD $178,700 – $268,100. This range reflects the anticipated base salary for this position. Beyond base salary, this role may be eligible for equity awards and participation in our company incentive plans (such as annual discretionary bonuses or sales commissions). The final offer amount will depend on several factors, including geographic location and the candidate’s relevant experience, professional background, and skill set. Benefits Comprehensive health, life, and disability insurance. Commute subsidy. Employee stock ownership. Competitive retirement/pension plans. Generous vacation and personal days. Support for new parents through leave and family‑care programs. Office food snacks. Mental Health and Wellbeing programs and support. Employee Resource Groups. Global Employee Assistance Program. Training and development programs. Volunteering and donation matching program. Equal Opportunity Employer Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form to let us know. #J-18808-Ljbffr Unity

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer, ML Inference Systems in Mountain View, CA vacancy
  • Unity is seeking a Senior Backend Engineer to design and operate the infrastructure powering large‑scale model inference. You will build distributed systems, optimize low‑latency serving, and ensure reliability...  ...observability. Collaborate with ML teams to scale online serving... 
    Senior

    Unity

    Mountain View, CA
    1 day ago
  • $135.8k - $237.05k

     ...converge at scale. We're hiring a Senior Backend Engineer to build and operate the...  ...and operate the distributed systems that power billions of daily...  ..., and scalability of inference systems. Join us and help influence...  ...Partner with ML engineers to ensure online serving... 
    Senior
    Work at office
    Worldwide
    Relocation package

    Unity

    Mountain View, CA
    1 day ago
  • Unity in Mountain View is hiring a Senior Backend Engineer to design and operate distributed systems that power large-scale online model inference. You will work on performance, reliability, and scalability of these critical systems. The position requires expertise in Golang... 
    Suggested
    Worldwide

    Unity

    Mountain View, CA
    1 day ago
  •  ...is hiring a Member of Technical Staff — Inference to push the limits of large-scale AI...  ...inference. You will design and optimize core systems that serve frontier models across thousands of GPUs. The role blends systems engineering, ML infrastructure, and performance... 
    Senior
    Worldwide

    RadixArk

    Palo Alto, CA
    13 hours ago
  • $198k - $326k

     ...Mountain View is looking for a Sr. Staff Software Engineer in Systems Infrastructure to lead optimizations across AI inference systems. Candidates should have 8+ years of...  ...in software engineering, extensive knowledge of ML systems, and proficiency in Python or C++. The... 
    Senior

    LinkedIn

    Mountain View, CA
    1 day ago
  • $255k - $405k

     ...technology company based in California is seeking candidates to build backend systems for AI-powered features. The role involves optimizing service...  ...with high-throughput services, be familiar with AI inference patterns, and have proficiency in Python and NodeJs among other... 

    A1

    Palo Alto, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA is seeking AI systems engineers to innovate in the inference systems software stack. The role involves designing and optimizing libraries and kernel technologies...  ...(PhD preferred) and over 6 years of experience in ML/DL systems development, with strong skills in Python... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...Role We’re looking for a Senior Engineer to help build the next-generation inference platform that supports...  ...and collaborate with ML researchers and engineers...  ...focus on building core systems and services that power...  ...of experience building backend or infrastructure... 
    Senior

    Gravity Engineering Services Pvt Ltd.

    Palo Alto, CA
    1 day ago
  • $192.6k - $271.9k

    Unity is hiring a Staff Backend Engineer in Mountain View, California. This role involves designing and operating distributed systems that support billions of daily decisions in gaming experiences. The successful candidate will have 5+ years of experience with distributed... 

    Unity

    Mountain View, CA
    1 day ago
  • MongoDB is seeking a Software Engineer 3 for the Voyage Control Plane...  ...resources, collaborating closely with ML researchers and platform teams...  ...on building robust and secure systems for identity and billing, you’...  ...of experience in distributed backend systems and strong skills in... 
    Senior

    MongoDB

    Palo Alto, CA
    1 day ago
  •  ...Lyric’s environment. We are looking for a Senior Backend Engineer to lead the design and development of...  ...deeply with Lyric’s data and ML workflows. You will design APIs and services...  ...cancellation, logging, and reporting. Ensure the system is resilient and scales horizontally to... 
    Senior

    Lyric

    Sunnyvale, CA
    1 day ago
  •  ...infrastructure team lays the foundation for everything we build — providing reliable, secure, and scalable systems to our engineering and ML teams. We’re looking for a Senior Backend Engineer - Infrastructure to design and build core platform components, including Kubernetes... 
    Senior

    Lyric

    Sunnyvale, CA
    1 day ago
  •  ...architect a cryptographically secure identity system for AI workloads, and develop high-performance...  ...across multi-cloud environments, and help shape engineering standards and culture. Join a team of cryptographers, AI/ML experts, and cloud engineers to define the stack... 
    Senior

    DigiCert

    Sunnyvale, CA
    1 day ago
  • $204k - $259k

    Waymo is seeking a skilled Backend Engineer in Mountain View, California. In this role, you will be responsible for owning crucial systems and developing algorithms to keep our mapping infrastructure updated. The ideal candidate will have over 4 years of experience, solid... 
    Senior

    Waymo

    Mountain View, CA
    1 day ago
  •  ...company is seeking passionate developers to join their dynamic Engineering teams. In this role, you will design and implement...  ...world-class APIs and contributing to large-scale distributed systems. If you are eager to make a difference and thrive in a collaborative... 
    Senior

    TechDigital Group

    Sunnyvale, CA
    4 days ago
  • $180k - $275k

    Samayaai is looking for a Backend Engineer in Mountain View, California, to design and lead the development of critical systems supporting AI products. The role requires developing fast, reliable, and scalable core components while ensuring high engineering standards. Candidates... 
    Senior

    Samayaai

    Mountain View, CA
    1 day ago
  • Wand AI is seeking a highly experienced Senior Backend Engineer to design, build, and operate scalable backend systems. You will be responsible for developing reliable services and APIs that support complex product capabilities. The ideal candidate will have strong experience... 
    Senior

    Wand AI

    Palo Alto, CA
    1 day ago
  • Articul8 is seeking a Product/Software Engineer-Backend to architect scalable and secure backend systems for our GenAI-powered solutions. In this role, you'll work alongside cross-functional teams to drive innovation and ensure optimal system performance. You should have... 
    Senior

    Articul8

    Palo Alto, CA
    1 day ago
  • $126k - $248k

     ...Role We’re looking for a Senior Engineer to help build the next-generation inference platform that supports...  ...and collaborate with ML researchers and engineers...  ...focus on building core systems and services that power...  ...of experience building backend or infrastructure... 
    Senior
    Local area
    Flexible hours

    United States Digital Space LLC

    Palo Alto, CA
    2 days ago
  • $224k - $284k

    ATOMS Careers page is looking for an experienced Software Engineer for their Mountain View office. The role involves building data-driven...  ...features, collaborating with teams, and architecting scalable systems. With a starting salary of $224,000 - $284,000 per year, the... 
    Senior
    Work at office

    ATOMS Careers page

    Mountain View, CA
    1 day ago
  •  ...Palo Alto, California, is in search of a skilled Product/Software Engineer-Backend to shape the future of Generative AI. You will have a pivotal role in developing scalable, high-performance backend systems while collaborating with diverse teams to drive innovations. The... 
    Senior

    Articul8

    Palo Alto, CA
    1 day ago
  • A tech company specializing in computer vision is seeking a skilled software engineer to architect and develop backend systems. You will work with modern technologies, contribute to a collaborative team, and handle real-world applications. The ideal candidate has strong... 
    Senior

    Matroid

    Palo Alto, CA
    1 day ago
  • Gravity Engineering Services Pvt Ltd. is seeking an experienced Backend Engineer in Mountain View, California. Join our high-visibility ML/AI Environments team to build systems for AI researchers and engineers. This role involves developing infrastructure that allows seamless... 
    Senior

    Gravity Engineering Services Pvt Ltd.

    Mountain View, CA
    1 day ago
  • $150k - $175k

     ...enterprise AI. What you will do As part of the engineering team, you’ll work alongside industry-leading cryptographers, AI/ML innovators, cloud infrastructure experts, and...  ...and own a cryptographically secure identity system that serves as the "source of truth" for all AI... 
    Senior
    Flexible hours

    DigiCert

    Sunnyvale, CA
    1 day ago
  • Yahoo Holdings Inc. is seeking experienced engineers to design, build and operate highly scalable backend systems powering the Search platform. You will work on edge infrastructure, request validation, traffic routing, bot detection, and platform security within AWS/Kubernetes... 
    Senior

    Yahoo Holdings Inc.

    Mountain View, CA
    1 day ago
  • $152k - $241.5k

    We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software engineers for its GPU-accelerated deep learning...  ...with high-scale distributed systems and ML systems. Strong communication skills and ability... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...Description Join OPPO US Research Center’s core team to develop and optimize backend services for high-traffic products (App Store, Global Search, Game Center). You’ll build scalable, reliable systems that serve millions of daily users. Key Responsibilities: Design... 
    Senior
    For contractors

    OPPO US Research Center

    Palo Alto, CA
    5 days ago
  • Success Matcher Recruitment is seeking a senior ML systems engineer to translate cutting-edge research into an enterprise-grade platform. You will work directly with the Chief Architect and CEO to design, implement, and scale multi-agent workflow orchestration. The role... 
    Senior

    Success Matcher Recruitment

    Sunnyvale, CA
    1 day ago
  •  ...technology firm in Sunnyvale, California, is hiring a Senior Performance Analyst. You will focus on performance benchmarking and competitive pricing for their inference product. The role requires deep knowledge of ML systems and open-source frameworks, with at least 5 years... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $227.87k

     ...developing and executing solutions that enhance the Pinterest marketplace, primarily focusing on backend systems and statistical models. Candidates need strong software engineering skills and a graduate degree in a related field. The position is unique, allowing... 
    Senior
    Work at office
    Flexible hours

    Pinterest

    Palo Alto, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Backend Engineer, ML Inference Systems. Be the first to apply!