Senior Backend Engineer, ML Inference Systems
$135.8k - $237.05kDormont Manufacturing Co
The opportunity Every day, we connect billions of players with the games and experiences they love. Our Vector Gamer AI team sits at the heart of that mission, governing ad ranking and bidding decisions across billions of daily impressions, where large‑scale machine learning and real‑world impact converge at scale. We’re hiring a Senior Backend Engineer to build and operate the infrastructure those models depend on. You’ll design and operate the distributed systems that power billions of daily decisions, with a focus on the performance, reliability, and scalability of inference systems. Join us and help influence how billions of gaming experiences are discovered, monetized, and how creators are rewarded. What you’ll be doing Design, develop, and deploy production-grade backend services and distributed systems powering large-scale online model inference at billions of daily requests Drive technical direction of our inference platform, with a focus on low-latency, high-throughput serving infrastructure Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high-scale production environment Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE) What we’re looking for Experience designing, deploying, and maintaining distributed systems at scale Expertise in Golang for building high-performance, low-latency backend infrastructure Hands‑on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes Strong grounding in monitoring and observability tooling, including Prometheus and Grafana Experience in ad tech, recommender systems, real-time personalization, or other performance‑critical domains Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices Familiarity with machine learning platforms, workflows, and serving infrastructure You might also have Experience with ML inference servers like NVIDIA Triton Inference Server Familiarity with auction mechanics or bidding systems in an ad tech context Experience embracing AI as a strategic advantage in engineering, following established best practices for code quality and security Additional information Relocation support is not available for this position Benefits At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well‑being and work‑life balance. Please note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status. While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally: Comprehensive health, life, and disability insurance, Commute subsidy, Employee stock ownership, Competitive retirement/pension plans, Generous vacation and personal days, Support for new parents through leave and family‑care programs, Office food snacks, Mental Health and Wellbeing programs and support, Employee Resource Groups, Global Employee Assistance Program, Training and development programs, Volunteering and donation matching program. Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English. Gross pay salary
$135,800—$237,050 USD
*Note: Certain locations require a good faith disclosure of the base salary range for the role. The actual salary for the successful candidate may differ based on location, experience, and other job-related factors. #J-18808-Ljbffr Dormont Manufacturing Co$126k - $248k
...Solutions is seeking a Senior Engineer in Palo Alto to build the next-generation inference platform integrated... ...involves designing core systems, enhancing performance... ...and collaborating with ML researchers.... ...years of experience in backend engineering and strong...Senior- Dormont Manufacturing Co in Mountain View, California seeks a Staff Backend Engineer to design and operate infrastructure for AI-driven ad ranking and bidding systems. The successful candidate will work on backend services ensuring high-performance, reliability, and scalability...Suggested
- ...for the AI-first world. Why this role exists We need a Backend Engineer to build the systems that orchestrate GPU clusters for AI workloads. You'll create... ...or HPC cluster management experience Understanding of ML,AI workload patterns and requirements Experience with...SeniorHourly payFull timeWork at officeWork from homeVisa sponsorship
$165k - $242k
Dormont Manufacturing Co is seeking a Senior Engineer to lead designs and improve engineering... ...focuses on evolving our Kubernetes-native inference platform and ensuring reliability... ...5-8 years experience with distributed systems, cloud services, and strong coding skills...Senior- Job type: Full Time · Department: Backend Engineer · Work type: On-Site About A... ...scalable, and resilient distributed systems. You’ll work closely with researchers, ML engineers, and product teams to... ..., low-latency AI model inference and data services. Partner with...SuggestedFull time
- ...from cost centers into engines of customer intelligence... ..., agent-assist, and backend automation—along with deep... ...the scalable backend systems that power Level AI’s next... ...Architect low-latency inference pipelines integrating... ...closely with Applied AI / ML teams to productionize...SeniorRemote jobFlexible hours
- ...Manufacturing Co is looking for a Senior ML Infrastructure Engineer to help build and scale robust platforms for ML inference workflows. You will... ...experience in designing distributed systems for ML and possess strong... ...in ML inference and backend services, with several attractive...SeniorRemote job
- ...platform company in Palo Alto seeks a Senior Engineer to develop a cutting-edge inference platform supporting semantic... ...over five years of experience in backend systems and proficiency in languages like... ...or Python. You'll work alongside ML researchers to enhance infrastructure...Senior
- Israelvcforum is looking for a Senior ML Infrastructure Engineer in Mountain View,... ...scale robust platforms for ML inference workflows supporting GM’s... ...serving strategies and handle backend software components. The... ...in machine learning systems, proficiency in Python or...SeniorRemote job
- Cerebras is seeking a Software Engineer to join our Inference Platform team in Sunnyvale,... ...that integrate cloud and ML components. You will... ...technical direction and improve system performance. The ideal candidate... ...systems, security, and backend languages like Go or C++....Senior
- A leader in AI technology in Palo Alto is seeking a Senior AI Systems Performance Engineer to optimize the latest foundation models on their innovative platform... ...in deep learning, performance optimization, and major ML frameworks. This position offers competitive salary and...Senior
$160k - $240k
...monitoring—working alongside leading health systems to drive real change. This is more than... ...Job Summary We're looking for a skilled Backend Engineer to contribute to the development of our... ...industry experience Experience with AI/ML platforms and frameworks (TensorFlow,...SeniorLive inFlexible hours3 days per week$126k - $248k
...Role We’re looking for a Senior Engineer to help build the next‑generation inference platform that supports... ...and collaborate with ML researchers and engineers... ...focus on building core systems and services that power... ...of experience building backend or infrastructure...SeniorLocal area- ...Overview FlexAI is looking for a Senior Backend Engineer (Infrastructure & AI... ...and build the core backend systems powering our next-generation... ...large-scale model training, inference, and orchestration across heterogeneous... ...: Collaborate with AI/ML and Runtime teams to...SeniorWork at office
- We’re looking for a Senior Engineer to help build the next-generation inference platform that supports embedding... ...and collaborate with ML researchers and... ...focus on building core systems and services that power... ...of experience building backend or infrastructure systems...SeniorLocal areaWorldwide
- ...technology company focused on AI and simulation is seeking a Backend Engineer to build and maintain data systems and APIs. The ideal candidate will have experience in... ...role offers the opportunity to work closely with ML engineers and researchers, with a focus on building...
$174k - $299k
...impact complex Coupang workflow systems. We need to create a set of... ...looking for a visionary Senior Staff Software Engineer to lead the architectural... ...Driven Automation: Integrate AI/ML models to automate system... ...8 years of experience in backend software development...SeniorTemporary workFlexible hours$152k - $241.5k
We are looking for a Senior System Software Engineer to work on. NVIDIA is hiring software engineers for its... ...team building a highly-performant AI inference platform to make design and... ...with high-scale distributed systems and ML systems.* Strong communication skills...Senior$155.42k - $205.9k
Job Description Senior ML Infrastructure Engineer (ML Inference Platform). About the Team The ML Inference Platform... ...experience in designing distributed systems for ML, strong problem‑solving... ...Design and implement core platform backend software components. Collaborate...SeniorLocal areaRemote workRelocationRelocation packageFlexible hours$184k - $287.5k
...We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency... ...research that pushes the Pareto frontier for the field of ML Systems; survey recent publications and find a way to...Senior- Cerebras Systems, Inc. is looking for a Senior Performance Engineer to enhance the performance benchmarking and competitive pricing models... ...have extensive experience with open-source inference frameworks and an understanding of ML systems. This role critically combines...Senior
- Member of Technical Staff - Backend Engineer - Data Systems and APIs About Vinci We’re building a copilot for hardware. Software engineers have powerful... ...of the platform You’ll work across the stack with ML engineers, physics researchers, and product engineers. What...
- ...infrastructure company in California is seeking a Member of Technical Staff — Inference to design and optimize large-scale AI inference systems. The role demands 5+ years in systems engineering and expertise in large-scale inference systems. Successful candidates will...SeniorFlexible hours
$152k - $287.5k
NVIDIA Gruppe is seeking a Senior Machine Learning Applications and Compiler Engineer in Santa Clara, California. This role involves developing algorithms for their LPX inference and compiler stack, optimizing the performance of neural network workloads on NVIDIA platforms...Senior- ...The Role Cerebras Systems builds the world's... ...leading training and inference speeds; over 10... ...hiring a Principal Engineer for our Inference... ...is one of the most senior IC roles on the... ...partner closely with ML, Product, and... ...Strong proficiency in backend or systems languages...
$166k - $220k
A leading technology company in Mountain View is seeking an experienced backend or infrastructure engineer to join their ML/AI Environments team. The ideal candidate will have 5+ years of experience and strong programming skills in Python, Scala, or Java. You will be responsible...Senior- ...Cerebras Systems builds the world's largest AI chip, 56 times larger... ...industry‑leading training and inference speeds and empowers machine learning... ...effortlessly run large‑scale ML applications, without the... ...seeking a versatile and experienced engineer to join our SOTA Training...SeniorInternship
- ...services and internal tools. The ideal candidate will have strong backend development experience and proficiency in languages such as... ...production services while collaborating closely with product engineering teams. The role requires a bachelor’s degree in a related field...
- A leading voice automation startup in Redwood City is seeking a Senior Backend Engineer to shape core systems for AI-driven conversations. This role involves building scalable architecture, collaborating with teams, and driving product delivery. The ideal candidate has...Senior
- Dormont Manufacturing Co is looking for a Software Engineer based in Mountain View, California, to develop and maintain AI-powered... ...over 5 years of software development experience, with strong backend and ML engineering skills, along with fluency in cloud technologies...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer, ML Inference Systems. Be the first to apply!
- backend software engineer Mountain View, CA
- back-end developer Mountain View, CA
- senior backend developer Mountain View, CA
- systems engineer Mountain View, CA
- advanced systems engineer Mountain View, CA
- senior linux systems engineer Mountain View, CA
- mission system engineer Mountain View, CA
- director systems engineering Mountain View, CA
- operating system engineer Mountain View, CA
- software system engineer Mountain View, CA

