Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Backend Engineer - High-Scale ML Inference Systems

Unity

Unity is seeking a Senior Backend Engineer to design and operate the infrastructure powering large‑scale model inference. You will build distributed systems, optimize low‑latency serving, and ensure reliability with comprehensive observability. Collaborate with ML teams to scale online serving infrastructure on GCP and Kubernetes, while promoting DevOps/SRE best practices across the stack. #J-18808-Ljbffr Unity

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer - High-Scale ML Inference Systems in Mountain View, CA vacancy
  • $135.8k - $237.05k

     ...impressions, where large-scale machine learning...  ...We're hiring a Senior Backend Engineer to build and...  ...the distributed systems that power billions...  ...scalability of inference systems. Join us...  ...on low-latency, high-throughput serving...  ...infrastructure Partner with ML engineers to... 
    Senior
    Work at office
    Worldwide
    Relocation package

    Unity

    Mountain View, CA
    1 day ago
  • Unity in Mountain View is hiring a Senior Backend Engineer to design and operate distributed systems that power large-scale online model inference. You will work on performance, reliability, and scalability of these critical systems. The position requires expertise in Golang... 
    Suggested
    Worldwide

    Unity

    Mountain View, CA
    1 day ago
  •  ...Member of Technical Staff — Inference to push the limits of large-scale AI inference. You will design and optimize core systems that serve frontier...  ...The role blends systems engineering, ML infrastructure, and performance...  ...This deeply technical, high‑impact position sits... 
    Senior
    Worldwide

    RadixArk

    Palo Alto, CA
    16 hours ago
  • Wand AI is seeking a highly experienced Senior Backend Engineer to design, build, and operate scalable backend systems. You will be responsible for developing reliable services and APIs that support complex product capabilities. The ideal candidate will have strong experience... 
    Senior

    Wand AI

    Palo Alto, CA
    1 day ago
  • $180k - $275k

    Samayaai is looking for a Backend Engineer in Mountain View, California, to design and lead the development of critical systems supporting AI products. The role requires developing fast...  ...scalable core components while ensuring high engineering standards. Candidates should... 
    Senior

    Samayaai

    Mountain View, CA
    1 day ago
  • $140k - $215k

    CrowdStrike is looking for a Senior-to-Sr Staff Backend ('Cloud') Software Engineer who will manage high-volume services for our Falcon Platform. This role requires strong skills in cloud protocols and distributed systems, with responsibilities including system design... 
    Senior

    CrowdStrike

    Sunnyvale, CA
    1 day ago
  •  ...infrastructure company in California is seeking a Member of Technical Staff — Inference to design and optimize large-scale AI inference systems. The role demands 5+ years in systems engineering and expertise in large-scale inference systems. Successful candidates will... 
    Senior
    Flexible hours

    RadixArk

    Palo Alto, CA
    4 days ago
  •  ...company in California seeks a skilled engineer to develop foundational infrastructure for large-scale multimodal AI models. You will...  ...pipelines, manage scheduling systems for GPU resources, and own CI/CD...  .... Opportunities include high-ownership responsibilities in a... 
    Senior

    Luma AI

    Palo Alto, CA
    1 day ago
  •  ...’re looking for a Senior Engineer to help build the next-generation inference platform that supports...  ...collaborate with ML researchers and...  ...low-latency, and high-scale inference — fully...  ...on building core systems and services that...  ...experience building backend or infrastructure... 
    Senior

    Gravity Engineering Services Pvt Ltd.

    Palo Alto, CA
    1 day ago
  • $192.6k - $271.9k

    Unity is hiring a Staff Backend Engineer in Mountain View, California. This role involves designing and operating distributed systems that support billions of daily decisions in gaming experiences. The successful candidate will have 5+ years of experience with distributed... 

    Unity

    Mountain View, CA
    1 day ago
  • Crusoe Energy Systems seeks a Senior Software Engineer to join their Cloud Managed AI team in California. This on-site role involves...  ...leading the design and implementation of AI inference platform infrastructure, ensuring high performance and availability. The ideal candidate... 
    Senior

    Crusoe Energy Systems

    Sunnyvale, CA
    1 day ago
  •  ...leading fintech startup is seeking an experienced backend engineer to develop and maintain core payment services....  ...building reliable transaction processing systems that integrate with external partners, ensuring a high level of security and performance. The ideal candidate... 
    Senior
    Remote job

    Vantaca, LLC

    Redwood City, CA
    1 day ago
  •  ...cryptographically secure identity system for AI workloads, and develop high-performance runtime...  ...governance logic, scale the secure platform across...  ...environments, and help shape engineering standards and culture....  ...team of cryptographers, AI/ML experts, and cloud engineers... 
    Senior

    DigiCert

    Sunnyvale, CA
    1 day ago
  •  ...leverage supply chain AI at scale. The current SCM...  ...We are looking for a Senior Backend Engineer to lead the design and...  ...with Lyric’s data and ML workflows. You will design...  .... This is a high-impact, foundational role...  ...reporting. Ensure the system is resilient and scales... 
    Senior

    Lyric

    Sunnyvale, CA
    1 day ago
  • $126k - $248k

     ...’re looking for a Senior Engineer to help build the next-generation inference platform that supports...  ...collaborate with ML researchers and...  ...low-latency, and high-scale inference - fully...  ...on building core systems and services that...  ...experience building backend or infrastructure... 
    Senior
    Local area
    Flexible hours

    United States Digital Space LLC

    Palo Alto, CA
    2 days ago
  • $255k - $405k

     ...based in California is seeking candidates to build backend systems for AI-powered features. The role involves...  ...operations. Ideal candidates will have experience with high-throughput services, be familiar with AI inference patterns, and have proficiency in Python and... 

    A1

    Palo Alto, CA
    1 day ago
  • $150k - $175k

     ...selecting our stack, and scaling a platform that will...  ...will do As part of the engineering team, you’ll work alongside...  ...cryptographers, AI/ML innovators, cloud infrastructure...  ...secure identity system that serves as the "...  ...Runtime Enforcement: Develop high-performance systems to... 
    Senior
    Flexible hours

    DigiCert

    Sunnyvale, CA
    1 day ago
  • Yahoo Holdings Inc. is seeking experienced engineers to design, build and operate highly scalable backend systems powering the Search platform. You will work on edge infrastructure...  ..., observability, and automation across large-scale distributed services while collaborating with... 
    Senior

    Yahoo Holdings Inc.

    Mountain View, CA
    1 day ago
  •  ...looking for a skilled Java Developer with at least 5 years of experience in Java and Java EE environments. The ideal candidate will build high-performance applications and work closely with a team to deliver high-quality products. Required skills include proficiency in MySQL... 
    Senior

    Jobsbridge

    Sunnyvale, CA
    1 day ago
  • $152k - $241.5k

    We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server. NVIDIA is hiring software...  ...fast-paced team building a highly-performant AI inference platform...  .... Experience with high-scale distributed systems and ML systems. Strong... 
    Senior

    NVIDIA

    Santa Clara, CA
    1 day ago
  • A1 is looking for a Senior Member of Technical Staff, Machine Learning...  ...the development of critical ML subsystems for their AI...  ...end, collaborating closely with engineers and product teams to deliver high reliability in production systems. The ideal candidate has experience... 
    Senior

    A1

    Palo Alto, CA
    1 day ago
  • $176k - $242k

    Otter is seeking a Senior Software Engineer for its Menu Platform in Mountain View, CA. This role requires building scalable, data-driven features...  ...engineering, particularly with Java and distributed systems. The position offers a base salary between $176,000 and $24... 
    Senior

    Otter

    Mountain View, CA
    1 day ago
  • Rhoda AI in Mountain View is seeking a Staff / Principal ML Training Systems Engineer to lead the performance of large-scale multimodal training systems. This role involves improving training efficiency and collaborating closely with research teams to accelerate model iteration... 
    Senior

    Rhoda AI

    Mountain View, CA
    19 days ago
  • $161k - $239k

    Google is seeking a Software Engineer in New York, NY to develop next-generation technologies for millions of users. The role encompasses...  ...Machine Learning, Natural Language Processing, and large-scale systems. Applicants should possess a Bachelor’s degree with 6 years... 
    Senior

    Google

    Mountain View, CA
    1 day ago
  • $198k - $326k

     ...Mountain View is looking for a Sr. Staff Software Engineer in Systems Infrastructure to lead optimizations across AI inference systems. Candidates should have 8+ years of...  ...in software engineering, extensive knowledge of ML systems, and proficiency in Python or C++. The... 
    Senior

    LinkedIn

    Mountain View, CA
    1 day ago
  •  ...Motors, Inc. is seeking strong software engineers in Palo Alto to help scale next-gen AI models for Autopilot and...  ...of large-scale distributed training systems on thousands of GPUs, developing...  ...implementing performance improvements in ML frameworks. The ideal candidate will... 
    Senior

    Tesla Motors, Inc.

    Palo Alto, CA
    1 day ago
  • $272k - $425.5k

    Principal Software Engineer - Large-Scale LLM Memory and Storage Systems page is loaded## Principal...  ...1NVIDIA Dynamo is a high-throughput, low-latency inference framework for...  ...memory pools.* Mentor senior and junior engineers...  ...performance storage, or ML systems... 
    Local area
    Remote work

    NVIDIA

    Santa Clara, CA
    16 hours ago
  • $155.9k - $233.86k

     ...projects on one of our backend infrastructure teams Help scale our products as we...  ...? 8+ years software engineering experience using one...  .../infrastructure systems. Bachelor Degree or...  ...technical degree (Master's highly preferred)...  ...SRE, Data Science, ML engineering, etc); or... 
    Senior

    MOLOCO

    Redwood City, CA
    1 day ago
  • $176k - $242k

    ATOMS Careers page is seeking a Senior Backend Engineer based in Mountain View, CA. The role involves architecting and scaling real-time food ordering platforms using high-quality code in Java and Go. You'll lead backend initiatives ensuring reliability and mentor team... 
    Senior
    Flexible hours

    ATOMS Careers page

    Mountain View, CA
    1 day ago
  •  ...powers intelligent supply chain automation at scale. Our infrastructure team lays the foundation for...  ...build — providing reliable, secure, and scalable systems to our engineering and ML teams. We’re looking for a Senior Backend Engineer - Infrastructure to design and build... 
    Senior

    Lyric

    Sunnyvale, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Backend Engineer - High-Scale ML Inference Systems. Be the first to apply!