Backend Infrastructure Engineer — GPU Inference & Cloud SDKs
Spur
NomadicML is seeking a Backend / Infrastructure Engineer to build and scale the video intelligence platform, from secure cloud ingestion to distributed GPU inference. You’ll collaborate with ML researchers to productionize models, automate deployment, and expose capabilities via APIs and SDKs for enterprises worldwide. You’ll work across cloud storage, inference scheduling, GPU clusters, and the NomadicML SDK, tying backend systems to frontend workflows with robust observability and reliability. #J-18808-Ljbffr Spur
- NomadicML in San Francisco is seeking a Backend / Infrastructure Engineer to join our platform that powers video intelligence. You’ll build scalable cloud ingestion, distributed GPU inference pipelines, and robust APIs/SDKs used by enterprises worldwide. You’ll collaborate...CloudWorldwide
- ...Machines Lab Inc. is seeking a network engineer to own the lowest layers of the... ...for large-scale training and inference. You will ensure interconnect reliability across GPU fabrics, debugging NICs, and... ...on and cross-stack, working with cloud providers to drive issues to resolution...Cloud
- ...company in San Francisco is seeking a Senior Software Engineer for Backend (Systems / Infrastructure). You will architect and deliver backend systems to maintain... ...grows. This role involves optimizing APIs, managing GPU workloads, and collaborating with cross-functional...Suggested
- NomadicML is seeking a Backend / Infrastructure Engineer who thrives at the intersection of cloud systems, SDK design, and large-scale inference infrastructure. You will... ...to distributed GPU inference pipelines—collaborating... ...through APIs and SDKs used by enterprises worldwide...CloudWorldwide
- ...fans out into multiple AI inference requests running in real time... .... Behind that sits a large GPU fleet spread across several cloud providers. Today, our inference engineers and researchers build... ...to take ownership of that infrastructure and hide its complexity behind...CloudShift work
$240k - $280k
...looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns... ...of GPUs into running inference clusters without a human... ..., inference bring-up to GPU driver/CUDA stack,... ...work at a hyperscaler, GPU cloud, or datacenter-scale infrastructure...CloudFull time$250k
...Ready to architect AI infrastructure that powers next-generation research and cloud platforms? Join a stealth... ...building a serverless inference platform, beginning... ...Senior Inference Platform Engineer at an early stage and... ...inference systems to maximise GPU utilisation and...CloudFull time$350k
Thinking Machines Lab is seeking a Network Engineer in San Francisco to manage and improve our GPU network fabric. The role requires in-depth knowledge of large... ..., where initiative and effective communication with cloud providers are key. The position offers a competitive...CloudVisa sponsorship- ...We’re a team of engineers, clinicians,... ...maintain software infrastructure for robotic... ...line tools, and SDKs for defining and... ..., cluster, and cloud-based execution... ...Develop secure, GPU-enabled containerized... ..., model inference, and experimentation... ...-quality backend or platform systems...CloudLocal areaWorldwideFlexible hours
- ...Francisco is seeking a Member of Technical Staff for their infrastructure team. In this role, you will own the cloud systems that serve our compression API and build global low-latency, high-throughput GPU ML inference infrastructure. The ideal candidate will have solid...CloudVisa sponsorship
$180k - $220k
...systems used by millions. Build APIs, core infrastructure, and backend services powering AI-driven... ...Languages: Go, Python, Rust, or similar Cloud: AWS, GCP, or Azure Systems: Distributed... ...data Ideal Qualifications: Backend engineer with 7+ years building reliable, scalable...CloudFull time- Hyperbolic is seeking a very senior Infrastructure Engineer to scale a GPU cloud marketplace. You will build a multi-tenant provisioning and virtualization layer, turning global GPU inventories into an orchestrated pool for AI developers and researchers. You will own the...Cloud
$210k - $240k
...picture and our vision at Postman.The OpportunityAs a Senior Backend Engineer on the Cloud Platform team, you will play a key role in building the... ...that manage how we deploy, scale, and operate our infrastructure and product services, leveraging Java, Spring Boot, and...CloudWork at officeFlexible hours3 days per week- B Capital is seeking a Systems Engineer to join its Compute Platform team in San Francisco. This role involves maintaining... ...and solving complex systems challenges, focusing on GPU infrastructures and multi-cloud environments. The ideal candidate has extensive experience...Cloud
- Hyperbolic Labs is seeking a Platform Engineer to design and build the control plane powering its GPU marketplace. You will architect the tenant management system, resource lifecycles, IAM and billing, and multi-cloud abstractions to provide a native-feeling experience...Cloud
$200k - $400k
...Description Machine Learning Infrastructure Engineer San Francisco, CA · On-... ...the distributed training and inference backbone for a foundation... ...Profile and debug low-level GPU operations to optimize performance... .../Docker, and a major cloud platform (GCP, AWS, or Azure...CloudFull timeVisa sponsorshipRelocation package$190k - $265k
...best data and AI infrastructure platform so our customers... .... Founded by engineers — and customer-... ...real-time and batch inference, powering model inference... ...of experience in backend or infrastructure... ...scalable APIs, or cloud-native... ...infrastructure, or GPU orchestrationFamiliarity...CloudLocal areaWorldwide- ...Ventures in New York City is seeking a Senior Backend Engineer to design and build scalable backend services in a cloud-native environment, focusing on transaction... ...supporting trading, lending, settlement, and infrastructure, contributing to high-throughput, low-latency...Cloud
- DutyTap is seeking a software engineer to design and build robust backend services in San Francisco. You will focus on performance, scalability, and reliability... ...experience with microservices; a Master’s degree and cloud-native experience are preferred. Candidates should...Cloud
- Hayden AI, located in San Francisco, is looking for a Senior Software Engineer for the Cloud Events team. You will enhance ML operations and work closely with various teams to validate data captured by our devices. Ideal candidates have 7+ years of experience, with expertise...CloudWork at office3 days per week
- CHAOS Industries is building the secure cloud platform behind advanced radar systems. You’ll design and operate backend services and Azure infrastructure that ingest, process, and deliver... ...production systems, and shape the engineering foundations of a rapidly evolving platform...Cloud
- CHAOS Industries is hiring backend and cloud engineers to design, build, and operate the secure cloud platform behind mission-critical radar... ...influence, and modern DevOps practices, including automated deployments and scalable Azure infrastructure. #J-18808-Ljbffr Chaos IncCloud
$160k - $300k
...pioneering AI company in San Francisco seeks a Senior / Staff Backend Engineer to design and build core systems for its intelligence... ...backend service design using Python and hands-on experience with cloud deployments and container technologies. This position offers...Cloud- Roundtable, located in San Francisco, is seeking an exceptional engineer to work on full-stack web development, emphasizing backend and cloud infrastructure. You will design scalable systems and lead feature development, directly impacting company strategy. The ideal candidate...Cloud
$220k - $405k
Perplexity is looking for experienced backend engineers to join our team specializing in building high-performance APIs. You will be responsible... ..., Go, or Rust, and a solid understanding of API design and cloud environments. Join us to reshape how people search and...Cloud- A leading API platform company is seeking an experienced backend developer. You will design and develop services in Java and Spring Boot, manage service deployment in Kubernetes, and collaborate with Cloud Architects and DevOps teams. Ideal candidates should have over...Cloud
- ...Palo Alto Networks is seeking a Senior Principal Backend Engineer for the Cortex group to lead backend development for Cortex XSOAR, XDR and... ...collaboration, integrity, and inclusion, with a focus on cloud-native architectures and robust data pipelines that serve thousands...Cloud
- ...journey , is looking for an AI Infrastructure Engineer to join us in building out... ...and run our next-generation inference architecture for running all... ...on both on-prem and multi-cloud clusters. But most... ...excellent understanding of GPU’s handling large workloads...CloudWork experience placementWork at officeVisa sponsorship
$350k
...Network Engineer The mission of Thinking Machines is... ...large-scale training and inference depend on. A single... ...at scale, across large GPU fabrics — both the RDMA... ...to resolution with our cloud providers' networking teams... ...in at least one backend language (we use Python...CloudImmediate startVisa sponsorshipWork visaRelocation package- Alterion is seeking a Senior Software Engineer in San Francisco to design and build core backend and distributed systems. This hands-on role involves technical ownership... ...as Rust or Python, and a strong understanding of cloud-native services. Competitive compensation and...Cloud
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Infrastructure Engineer — GPU Inference & Cloud SDKs. Be the first to apply!
- back-end developer San Francisco, CA
- senior backend developer San Francisco, CA
- backend software engineer San Francisco, CA
- backend python developer San Francisco, CA
- remote back end developer San Francisco, CA
- senior infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA
- infrastructure developer San Francisco, CA
- entry level infrastructure engineer San Francisco, CA
- security infrastructure engineer San Francisco, CA




