Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Backend Engineer, Scalable ML Inference Platform

$126k - $248k

The Consulting Solutions

The Consulting Solutions is seeking a Senior Engineer in Palo Alto to build the next-generation inference platform integrated with MongoDB Atlas. The role involves designing core systems, enhancing performance and collaborating with ML researchers. Applicants should have over 5 years of experience in backend engineering and strong skills in relevant programming languages. The position offers an attractive salary range of $126,000 to $248,000 USD, with a hybrid work model. #J-18808-Ljbffr The Consulting Solutions

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer, Scalable ML Inference Platform in Palo Alto, CA vacancy
  •  ...advantage. Our AI-native platform helps enterprises...  ...cost centers into engines of customer...  ...agent-assist, and backend automation—along with...  ...in building the scalable backend systems that...  ...low-latency inference pipelines integrating...  ...with Applied AI / ML teams to productionize... 
    Platform
    Senior
    Remote job
    Flexible hours

    StartX

    Mountain View, CA
    5 days ago
  • $126k - $248k

     ...Role We’re looking for a Senior Engineer to help build the next‑generation inference platform that supports...  ...and collaborate with ML researchers and engineers...  ...of experience building backend or infrastructure systems...  ...bring novel ideas into scalable systems. Tackle... 
    Platform
    Senior
    Local area

    The Consulting Solutions

    Palo Alto, CA
    1 day ago
  • $150k - $172k

     ...not pedigree. Our platform is trusted by...  ...to build strong engineering teams ready for what...  ...re looking for a Senior Backend Software Development...  ..., reliable, and scalable as we grow our...  ...understanding of AI/ML fundamentals:...  ...embedding models, inference optimization, RAG... 
    Platform
    Senior
    Immediate start
    Shift work

    HackerRank

    Santa Clara, CA
    5 days ago
  •  ...Compute Infrastructure Platform provides an "end-to-...  ...is looking for a Senior Backend Engineer (Infrastructure & AI...  ...scale model training, inference, and orchestration across...  ...Systems & Scalability: Design and scale microservices...  ...Collaborate with AI/ML and Runtime teams to... 
    Platform
    Senior
    Work at office

    FlexAI

    Santa Clara, CA
    1 day ago
  • Level AI in Mountain View, California, is seeking a Senior Engineer - AI Agents to design scalable backend systems for real-time environments. You'll work at the...  ...address performance optimization, and collaborate with AI/ML teams. A flexible vacation policy, competitive... 
    Senior
    Flexible hours

    Level AI

    Mountain View, CA
    5 days ago
  • 慨正橡扯 is looking for a Backend Java Software Engineer III to enhance technology products at JPMorgan Chase...  ...designing and delivering secure and scalable solutions as part of the Digital...  ...experience, proficiency in Java and cloud platforms, and a strong foundation in software... 
    Platform
    Senior

    慨正橡扯

    Palo Alto, CA
    2 days ago
  • We’re looking for a Senior Engineer to help build the next-generation inference platform that supports embedding...  ...and collaborate with ML researchers and engineers...  ...experience building backend or infrastructure systems...  ...novel ideas into scalable systems Tackle challenging... 
    Platform
    Senior
    Local area
    Worldwide

    MongoDB

    Palo Alto, CA
    4 days ago
  •  ...company in data and AI infrastructure is seeking a Software Engineer with a backend focus to work on high-scale service and infrastructure...  ...involves managing resource management infrastructure, developing scalable cloud services, and supporting Databricks engineers across... 
    Platform
    Senior

    Databricks Inc.

    Mountain View, CA
    5 days ago
  • $166k - $225k

    A dynamic technology company in Mountain View is seeking a backend-focused software engineer to build scalable infrastructure and products on the Databricks platform. Ideal candidates will have at least 5 years of experience in languages like Java or Scala and familiarity... 
    Platform
    Senior
    Local area

    Menlo Ventures

    Mountain View, CA
    4 days ago
  • $155.42k - $395.9k

     ...Description About the Team: The ML Inference Platform is part of the AV ML...  ..., concurrency, and scalability. We’re committed to maximizing...  ...Role: We are seeking a Senior ML Infrastructure engineer to help build and scale...  ...implement core platform backend software components.... 
    Platform
    Senior
    Local area
    Remote work
    Relocation
    Relocation package
    Flexible hours

    Israelvcforum

    Mountain View, CA
    5 days ago
  • Israelvcforum is looking for a Senior ML Infrastructure Engineer in Mountain View, California. This...  ...position aims to build and scale robust platforms for ML inference workflows supporting GM’s AI...  ...serving strategies and handle backend software components. The position... 
    Platform
    Senior
    Remote job

    Israelvcforum

    Mountain View, CA
    5 days ago
  • A leading data platform company in Palo Alto seeks a Senior Engineer to develop a cutting-edge inference platform supporting semantic search and AI...  ...five years of experience in backend systems and proficiency in...  ...Python. You'll work alongside ML researchers to enhance... 
    Platform
    Senior

    MongoDB

    Palo Alto, CA
    4 days ago
  • $180k - $250k

     ...develop, and maintain backend processes, including server...  ...on high-quality, scalable code. Requirements...  ...built on top of LLMs/ML. Proficiency with AI coding...  .../Attention/GPU inference. Experience in building...  ...in Computer Science, Engineering, or a related technical... 
    Senior
    Full time
    Work experience placement
    Work at office

    RainesDev

    Palo Alto, CA
    5 days ago
  • Google Inc. is seeking a Senior Engineering Manager for its AI Inference Platform, based in Sunnyvale, CA. This pivotal role involves architecting and optimizing the serving stack for advanced models like Gemini, focusing on enhancing performance and cost-effectiveness... 
    Platform
    Senior

    Google Inc.

    Sunnyvale, CA
    5 days ago
  • $160k - $240k

     ...Summary: We're looking for a skilled Backend Engineer to contribute to the development of our Gen AI for Healthcare SaaS platform. As a key member of our early engineering team...  ...industry experience ~ Experience with AI/ML platforms and frameworks (TensorFlow,... 
    Platform
    Senior
    Live in
    Flexible hours
    3 days per week

    Qualified Health

    Palo Alto, CA
    4 days ago
  •  ...Full Time · Department: Backend Engineer · Work type: On-Site...  ...the world's first AI platform to bring AI into the real...  ...building performant, scalable, and resilient...  ...closely with researchers, ML engineers, and product...  ...low-latency AI model inference and data services. Partner... 
    Platform
    Full time

    Neara

    Palo Alto, CA
    4 days ago
  • $166k - $220k

     ...and AI infrastructure platform so our customers can use...  ...their business. Founded by engineers — and customer obsessed...  .... As part of the ML/AI Environments team you...  ...years of experience in backend or infrastructure engineering...  ...distributed systems, scalable APIs, or cloud‑native... 
    Platform
    Senior
    Local area
    Worldwide

    Cacheflow

    Mountain View, CA
    2 days ago
  •  ...generation of AI inference infrastructure for...  ...enabling a new class of scalable, sustainable AI...  ...Description: - Senior Sales Executive, Hyperscale...  ...enterprise cloud platforms. Company...  ...collaborating with engineering teams on evaluations...  ...or large-scale AI/ML infrastructure environments... 
    Platform
    Senior
    Full time
    Remote work

    Tensordyne

    Sunnyvale, CA
    4 days ago
  • $192k - $260k

    Databricks in Mountain View, California is seeking a Software Engineer with a backend focus. The role will involve writing software in Scala/Java...  ...pipelines, and operating micro-services within our data platform. Ideal candidates will have 10+ years of experience in languages... 
    Platform
    Senior

    Menlo Ventures

    Mountain View, CA
    3 days ago
  • $262k - $365k

    Senior Engineering Manager AI Inference Platform, Distributed Cloud Location: Sunnyvale, CA, USA Pay US: $262,000 -...  ...of experience utilizing deep‑dive ML profiling tools (e.g., Nsight, xprof...  ...stack, focusing on performance, scalability, and resource efficiency. Oversee... 
    Platform
    Senior

    Google Inc.

    Sunnyvale, CA
    4 days ago
  • General Motors is seeking a Senior ML Infrastructure Engineer to build and scale a robust platform for machine learning inference workflows. You will design backend software components, collaborate with ML engineers, and lead initiatives across GM's ML ecosystem. With... 
    Platform
    Senior
    Remote job

    General Motors

    Sunnyvale, CA
    2 days ago
  •  ...industry. Our AI workforce platform integrates machine...  ...and driving scalability. With rapid growth in...  ...data. This role owns the backend systems that make agents...  ...OAuth, webhooks, sync engines, connectors) with strong...  ...caching, storage, and inference/tool‑call costs; build... 
    Platform
    Senior
    Work at office
    Remote work
    Flexible hours

    Vantaca

    Redwood City, CA
    5 days ago
  • Cerebras is seeking a Software Engineer to join our Inference Platform team in Sunnyvale, California. This role...  ...leading projects that integrate cloud and ML components. You will contribute to...  ...distributed systems, security, and backend languages like Go or C++. Join us in... 
    Platform
    Senior

    Cerebras

    Sunnyvale, CA
    5 days ago
  •  ...Senior Backend Software Engineer Step is a next-generation financial services company building a better...  ..., building, and maintaining scalable and reliable distributed systems...  ...next-generation consumer and services platform with global reach and long-term ambition... 
    Platform
    Senior
    Flexible hours

    S.T.E.P.

    Palo Alto, CA
    8 hours ago
  • $128.7k - $261.3k

    About the Team The Model Deployment & Inference Solutions team in GM AV deploys...  .... Our mission is two‑fold: build the ML deployment platform that makes model rollouts fast and predictable...  ...currently performed manually by engineers. Build the developer experience that... 
    Platform
    Senior
    Local area
    Remote work
    Flexible hours
    Shift work

    General Motors

    Mountain View, CA
    4 days ago
  • $213k - $263k

     ...Waymo Ml Ops Engineer Waymo is an autonomous driving technology company...  ...to a range of vehicle platforms and product use cases. The Waymo...  ...Experience with building highly scalable distributed systems...  ...infrastructure and model hosting / inference infrastructure Experience... 
    Platform
    Senior

    Latent Logic

    Mountain View, CA
    2 days ago
  • $150k - $180k

     ...About the role The Senior Backend Engineer role gives the successful candidate the opportunity to...  ...on Cyber-Physical Systems Protection Platforms, Zero Trust Network Access, Remote Privileged...  ...and adopt best practices for highly scalable and distributed and autonomous... 
    Platform
    Senior
    Contract work
    Remote work
    Worldwide

    Xage Security

    Palo Alto, CA
    1 day ago
  •  ...Defense is looking for a Senior Software Development Engineer in Mountain View, California...  ...will design and implement backend APIs for the Shopping Graph of their commerce platform, allowing identity-gated...  ...the platform is reliable, scalable, and secure. This is a full... 
    Platform
    Senior
    Full time
    Work at office

    Front Door Defense

    Mountain View, CA
    4 days ago
  • $100k - $200k

     ...a talented and experienced backend engineer to join our growing team. In...  ...developing, and maintaining scalable and high-performance RESTful...  ...You will work primarily with platforms like Google Cloud or Azure to...  ...closely with Android and ML teams on API contracts and model... 
    Platform
    Full time

    OPPO US Research Center

    Palo Alto, CA
    2 days ago
  • $160k - $200k

    General Motors is seeking a Senior Software Engineer to design and develop middleware and application software for next-generation infotainment platforms. This role focuses on building scalable, reliable systems for advanced user experiences. The ideal candidate has strong... 
    Platform
    Senior

    General Motors

    Mountain View, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Backend Engineer, Scalable ML Inference Platform. Be the first to apply!