Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Backend Infrastructure Engineer — GPU Inference & Cloud SDKs

Spur

NomadicML is seeking a Backend / Infrastructure Engineer to build and scale the video intelligence platform, from secure cloud ingestion to distributed GPU inference. You’ll collaborate with ML researchers to productionize models, automate deployment, and expose capabilities via APIs and SDKs for enterprises worldwide. You’ll work across cloud storage, inference scheduling, GPU clusters, and the NomadicML SDK, tying backend systems to frontend workflows with robust observability and reliability. #J-18808-Ljbffr Spur

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Backend Infrastructure Engineer — GPU Inference & Cloud SDKs in San Francisco, CA vacancy
  • NomadicML in San Francisco is seeking a Backend / Infrastructure Engineer to join our platform that powers video intelligence. You’ll build scalable cloud ingestion, distributed GPU inference pipelines, and robust APIs/SDKs used by enterprises worldwide. You’ll collaborate... 
    Cloud
    Worldwide

    Praxis, Inc.

    San Francisco, CA
    13 hours ago
  •  ...Machines Lab Inc. is seeking a network engineer to own the lowest layers of the...  ...for large-scale training and inference. You will ensure interconnect reliability across GPU fabrics, debugging NICs, and...  ...on and cross-stack, working with cloud providers to drive issues to resolution... 
    Cloud

    Thinking Machines Lab Inc.

    San Francisco, CA
    1 day ago
  •  ...company in San Francisco is seeking a Senior Software Engineer for Backend (Systems / Infrastructure). You will architect and deliver backend systems to maintain...  ...grows. This role involves optimizing APIs, managing GPU workloads, and collaborating with cross-functional... 
    Suggested

    Vizcom

    San Francisco, CA
    1 day ago
  • NomadicML is seeking a Backend / Infrastructure Engineer who thrives at the intersection of cloud systems, SDK design, and large-scale inference infrastructure. You will...  ...to distributed GPU inference pipelines—collaborating...  ...through APIs and SDKs used by enterprises worldwide... 
    Cloud
    Worldwide

    Nomadic AI

    San Francisco, CA
    13 hours ago
  •  ...fans out into multiple AI inference requests running in real time...  .... Behind that sits a large GPU fleet spread across several cloud providers. Today, our inference engineers and researchers build...  ...to take ownership of that infrastructure and hide its complexity behind... 
    Cloud
    Shift work

    Neura Market

    San Francisco, CA
    2 days ago
  • $240k - $280k

     ...looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns...  ...of GPUs into running inference clusters without a human...  ..., inference bring-up to GPU driver/CUDA stack,...  ...work at a hyperscaler, GPU cloud, or datacenter-scale infrastructure... 
    Cloud
    Full time

    Together Ai

    San Francisco, CA
    14 hours ago
  • $250k

     ...Ready to architect AI infrastructure that powers next-generation research and cloud platforms? Join a stealth...  ...building a serverless inference platform, beginning...  ...Senior Inference Platform Engineer at an early stage and...  ...inference systems to maximise GPU utilisation and... 
    Cloud
    Full time
    San Francisco, CA
    more than 2 months ago
  • $350k

    Thinking Machines Lab is seeking a Network Engineer in San Francisco to manage and improve our GPU network fabric. The role requires in-depth knowledge of large...  ..., where initiative and effective communication with cloud providers are key. The position offers a competitive... 
    Cloud
    Visa sponsorship

    Thinking Machines Lab

    San Francisco, CA
    3 days ago
  •  ...We’re a team of engineers, clinicians,...  ...maintain software infrastructure for robotic...  ...line tools, and SDKs for defining and...  ..., cluster, and cloud-based execution...  ...Develop secure, GPU-enabled containerized...  ..., model inference, and experimentation...  ...-quality backend or platform systems... 
    Cloud
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    San Francisco, CA
    1 day ago
  •  ...Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you will own the cloud systems that serve our compression API and build global low-latency, high-throughput GPU ML inference infrastructure. The ideal candidate will have solid... 
    Cloud
    Visa sponsorship

    The Token Company

    San Francisco, CA
    2 days ago
  • $180k - $220k

     ...systems used by millions. Build APIs, core infrastructure, and backend services powering AI-driven...  ...Languages: Go, Python, Rust, or similar Cloud: AWS, GCP, or Azure Systems: Distributed...  ...data Ideal Qualifications: Backend engineer with 7+ years building reliable, scalable... 
    Cloud
    Full time

    Strategic Employment Partners

    San Francisco, CA
    13 hours ago
  • Hyperbolic is seeking a very senior Infrastructure Engineer to scale a GPU cloud marketplace. You will build a multi-tenant provisioning and virtualization layer, turning global GPU inventories into an orchestrated pool for AI developers and researchers. You will own the... 
    Cloud

    Hyperbolic

    San Francisco, CA
    13 hours ago
  • $210k - $240k

     ...picture and our vision at Postman.The OpportunityAs a Senior Backend Engineer on the Cloud Platform team, you will play a key role in building the...  ...that manage how we deploy, scale, and operate our infrastructure and product services, leveraging Java, Spring Boot, and... 
    Cloud
    Work at office
    Flexible hours
    3 days per week

    Postman

    San Francisco, CA
    1 day ago
  • B Capital is seeking a Systems Engineer to join its Compute Platform team in San Francisco. This role involves maintaining...  ...and solving complex systems challenges, focusing on GPU infrastructures and multi-cloud environments. The ideal candidate has extensive experience... 
    Cloud

    B Capital

    San Francisco, CA
    4 days ago
  • Hyperbolic Labs is seeking a Platform Engineer to design and build the control plane powering its GPU marketplace. You will architect the tenant management system, resource lifecycles, IAM and billing, and multi-cloud abstractions to provide a native-feeling experience... 
    Cloud

    Hyperbolic

    San Francisco, CA
    13 hours ago
  • $200k - $400k

     ...Description Machine Learning Infrastructure Engineer San Francisco, CA · On-...  ...the distributed training and inference backbone for a foundation...  ...Profile and debug low-level GPU operations to optimize performance...  .../Docker, and a major cloud platform (GCP, AWS, or Azure... 
    Cloud
    Full time
    Visa sponsorship
    Relocation package

    David Joseph & Company

    San Francisco, CA
    13 days ago
  • $190k - $265k

     ...best data and AI infrastructure platform so our customers...  .... Founded by engineers — and customer-...  ...real-time and batch inference, powering model inference...  ...of experience in backend or infrastructure...  ...scalable APIs, or cloud-native...  ...infrastructure, or GPU orchestrationFamiliarity... 
    Cloud
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    4 days ago
  •  ...Ventures in New York City is seeking a Senior Backend Engineer to design and build scalable backend services in a cloud-native environment, focusing on transaction...  ...supporting trading, lending, settlement, and infrastructure, contributing to high-throughput, low-latency... 
    Cloud

    Next Ventures

    San Francisco, CA
    4 days ago
  • DutyTap is seeking a software engineer to design and build robust backend services in San Francisco. You will focus on performance, scalability, and reliability...  ...experience with microservices; a Master’s degree and cloud-native experience are preferred. Candidates should... 
    Cloud

    DutyTap

    San Francisco, CA
    23 hours ago
  • Hayden AI, located in San Francisco, is looking for a Senior Software Engineer for the Cloud Events team. You will enhance ML operations and work closely with various teams to validate data captured by our devices. Ideal candidates have 7+ years of experience, with expertise... 
    Cloud
    Work at office
    3 days per week

    Hayden AI

    San Francisco, CA
    13 hours ago
  • CHAOS Industries is building the secure cloud platform behind advanced radar systems. You’ll design and operate backend services and Azure infrastructure that ingest, process, and deliver...  ...production systems, and shape the engineering foundations of a rapidly evolving platform... 
    Cloud

    CHAOS Industries

    San Francisco, CA
    2 days ago
  • CHAOS Industries is hiring backend and cloud engineers to design, build, and operate the secure cloud platform behind mission-critical radar...  ...influence, and modern DevOps practices, including automated deployments and scalable Azure infrastructure. #J-18808-Ljbffr Chaos Inc
    Cloud

    Chaos Inc

    San Francisco, CA
    2 days ago
  • $160k - $300k

     ...pioneering AI company in San Francisco seeks a Senior / Staff Backend Engineer to design and build core systems for its intelligence...  ...backend service design using Python and hands-on experience with cloud deployments and container technologies. This position offers... 
    Cloud

    Apiphany Corporation

    San Francisco, CA
    1 day ago
  • Roundtable, located in San Francisco, is seeking an exceptional engineer to work on full-stack web development, emphasizing backend and cloud infrastructure. You will design scalable systems and lead feature development, directly impacting company strategy. The ideal candidate... 
    Cloud

    Roundtable

    San Francisco, CA
    4 days ago
  • $220k - $405k

    Perplexity is looking for experienced backend engineers to join our team specializing in building high-performance APIs. You will be responsible...  ..., Go, or Rust, and a solid understanding of API design and cloud environments. Join us to reshape how people search and... 
    Cloud

    Perplexity

    San Francisco, CA
    2 days ago
  • A leading API platform company is seeking an experienced backend developer. You will design and develop services in Java and Spring Boot, manage service deployment in Kubernetes, and collaborate with Cloud Architects and DevOps teams. Ideal candidates should have over... 
    Cloud

    Postman

    San Francisco, CA
    4 days ago
  •  ...Palo Alto Networks is seeking a Senior Principal Backend Engineer for the Cortex group to lead backend development for Cortex XSOAR, XDR and...  ...collaboration, integrity, and inclusion, with a focus on cloud-native architectures and robust data pipelines that serve thousands... 
    Cloud

    Jobleads-US

    San Francisco, CA
    23 hours ago
  •  ...journey , is looking for an AI Infrastructure Engineer to join us in building out...  ...and run our next-generation inference architecture for running all...  ...on both on-prem and multi-cloud clusters. But most...  ...excellent understanding of GPU’s handling large workloads... 
    Cloud
    Work experience placement
    Work at office
    Visa sponsorship

    Spellbrush

    San Francisco, CA
    29 days ago
  • $350k

     ...Network Engineer The mission of Thinking Machines is...  ...large-scale training and inference depend on. A single...  ...at scale, across large GPU fabrics — both the RDMA...  ...to resolution with our cloud providers' networking teams...  ...in at least one backend language (we use Python... 
    Cloud
    Immediate start
    Visa sponsorship
    Work visa
    Relocation package

    Thinking Machines Lab

    San Francisco, CA
    1 day ago
  • Alterion is seeking a Senior Software Engineer in San Francisco to design and build core backend and distributed systems. This hands-on role involves technical ownership...  ...as Rust or Python, and a strong understanding of cloud-native services. Competitive compensation and... 
    Cloud

    Alterion Inc

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Backend Infrastructure Engineer — GPU Inference & Cloud SDKs. Be the first to apply!