Backend Engineer - Multi-Cloud Inference Platform (Remote)
Modular Inc
- Remote job
Modular is seeking an experienced backend engineer to shape end-to-end distributed inference deployments on a multi-cloud platform. You will build scalable services, improve observability, and drive performance across diverse hardware and cloud providers. The team emphasizes secure multi-tenant infrastructure, Kubernetes-based deployments, and close collaboration with product and ML teams. Remote-friendly role with offices in Los Altos, CA. #J-18808-Ljbffr Modular Inc
$148k - $324k
...States / Canada Remote Full-time... ...role: In the Cloud Inference team, we are focused... ...productive, low toil platform for managing... ...alike. We're seeking engineers who are... ...of experience in backend engineering, AI inference... ...do: Build the multi-cloud, multi-tenant...Remote workPlatformFull timeWork experience placementWork at officeLocal area$200k - $250k
...information. Our platform combines... ...Our team includes engineers, researchers, product... ...through one layer: our inference gateway. It allows... ...budget. This is a remote position open to... ...A strong backend generalist (Python... ...inference provider or GPU cloud, or contributions...Remote workPlatformImmediate startWork from homeFlexible hours$155k - $235k
...AI. Staff Test & Release Engineer, Inference CloudLocation: Santa Clara, Ca / Remote, USRole OverviewThe Inference Cloud Engineering team builds the... ...partner with QE, product, platform, and infrastructure teams... ...including deploying and debugging multi-service workloads, Helm,...Remote workPlatformShift work$160k - $250k
Together AI is building the Inference Platform that brings the most advanced generative AI models to the world. Our platform powers multi‑tenant serverless workloads and dedicated endpoints... ...across data centers and model engine pods. Develop auto‑scaling systems to...PlatformFull timeLocal area$150.4k - $277.6k
...Senior Software Engineer, Private Cloud Compute Inference Routing Cupertino, California, United States Software... ...at scale. You'll join iCloud Platform Engineering team. We build the server... ...preserving system design (e.g., Oblivious remote attestation) Experience leading a...Remote workPlatformWorldwideRelocation$150k - $250k
...You'll be Owning GRVTY is seeking a Multi-Cloud Engineer with a TS/SCI + Poly clearance (... ...updates, troubleshooting within the cloud platform, and providing input on troubleshooting... ...signal devices such as scalable portable remote devices Demonstrated experience...Remote workPlatformContract workFor contractors- d-Matrix is building an internal cloud and customer-facing inference endpoints; this staff role owns end-to-end test automation and release governance... ...components. You will collaborate with QE, product, platform and infrastructure teams to scale testing without slowing...Remote jobPlatform
- ...Systems Administrator / DevOps Engineer, you will maintain and build... ...our model training and our inference cloud. You’ll split your time... ...developer workflows (e.g., VSCode remote development, Docker)... ...reliability of our inference platform. What We’re Looking For /...Remote workPlatformWork at officeRelocation package
$160k - $320k
...our Nutanix Kubernetes Platform (NKP) team in San Jose... ..., enterprise-grade cloud-native solutions at the... ...application mobility, and multi-tenant security... ...You will combine strong backend engineering skills with deep Kubernetes... ...the benefits of remote work with the advantages...Remote workPlatformWork at officeLocal areaRelocation package3 days per week$136.45k - $213.98k
...the connectivity and platforms we provide, to the... ...the office for the remote option.)Job SummaryThis Software Engineer (Engineer 3)... ...building scalable backend microservices, robust API layers, and multi-tenant platform infrastructure... ...applications in cloud or cluster...Remote workPlatformFull timeWork at officeWorldwide$121.5k - $145.5k
This is a remote position; however, the candidate... ...Sr. Software Engineer in the North... ...role will sit in the Platform team that focuses... ...oriented code in our backend services.Develop public... ..., memory, and multi-step decision-... ...paymentsFamiliarity with cloud-native...Remote workPlatformFull timeFlexible hours- ...industry. Our AI workforce platform integrates machine... ...executing complex, multi-step processes with human... ...at scale. The backend powers session orchestration... ...replay. Reliability engineering : SLIs/SLOs, incident... ...with Company Match. ~ Remote Flexible - come to the...Remote workPlatformWork at officeFlexible hours
- ...CA / Austin, TX - Remote (within locations... ...offers advanced cloud capabilities to customers... ...seeking a Staff Backend Engineer to take our Model... ...distributed, multi-tenant token... ...customer, and carry the platform there... ...functional teams. Inference Gateway and API Surface...Remote workPlatformContract workLocal area
$200k - $230k
...Fellow is looking for a Backend Engineer to build, scale, and... ...physical products to the cloud. A successful... ...applications, and backend platforms. Data Management: Own... ...restore testing, and multi-region readiness. Tools... ..., and secure remote device diagnostics when...Remote workPlatformSummer workWork at officeLocal area- ...Francisco is seeking a Senior Software Engineer (Backend) to shape the future of Kubernetes multi-tenancy. You will architect core platform components and drive backend initiatives... ...define scalable isolation models. This remote-friendly role offers startup grit and impact...Remote workPlatform
- affirm is seeking a Senior Software Engineer to architect, build, and scale relational and distributed SQL databases in a remote-first environment. You will automate provisioning, backups, failover, and upgrades across multi-tenant clusters. The role emphasizes zero-downtime...Remote jobPlatform
$175k - $315k
...most advanced AI-native platform. We work on large scale... ...for this Senior Engineer II has deep expertise in... ...system behavior in a large multi-tenant environment. We... ...Communication — As a remote-first company, bring excellent... ...of at least one cloud environment (AWS, Azure...Remote workPlatformHourly payPermanent employmentWork experience placementWork at officeLocal areaShift work- You.com is seeking a backend generalist to own the inference gateway that routes all model calls. You will design and optimize provider/model selection, caching behavior, and metering, ensuring reliable, cost-aware routing at scale. The role emphasizes building aproxy/gateway...Platform
$250k
...orchestration platform designed to unify... ...with a robust backend infrastructure... ...for staff-level engineers to help design,... ...from low-latency inference pipelines to... ..., concurrency (multi-processing, multi... ...with cloud infrastructure... ...This role can be remote or onsite, based...Remote workPlatform$160k - $250k
Together AI is searching for a skilled engineer to join their team, focusing on building and optimizing a large-scale inference platform. This role involves developing low-latency systems and collaborating with research teams to deploy advanced AI models. Candidates should...Platform- ...Orbis is seeking a Senior Backend Engineer to drive the evolution of Catalyst... ...our secure distributed data platform. You will act as an... ...testcontainers) that exercise multi-component systems end to end... ...a hybrid schedule, or fully remote work; our team is spread across...Remote workPlatformFull timeWork at officeShift work
$205k - $242k
...personal phones. This multi-billion dollar market... ...easy-to-use, AI-powered platform. We’re not just... ...then get the rest of engineering to actually use it Own... ...and TypeScript on the backend Event-driven microservices... .... Who We Are We're a remote-first company with a culture...Remote workPlatformFlexible hours$150k - $185k
...Come join our Engineering team! High velocity,... ...work. Our AI-powered platform brings efficiency... ...seeking a Senior Backend Engineer (Integrations... ...configuration, or cloud deployments) ~... ...effectively in a fully remote environment... ...government systems Multi-tenant...Remote workPlatformFull timeWork at officeFlexible hours$140k - $230k
...looking for a Senior Software Engineer (AI Inference & Runtime Platform) based in the United... ...GPU infrastructure, and cloud platforms. Working across... ...infrastructure foundation used by backend engineering teams,... ...work-life balance. Remote work: Fully remote...Remote workPlatformFull timeFlexible hours$116k - $189.75k
...are looking for a Software Engineer focused on bring-up,... ...distributed training and inference workloads across NVIDIA GPU platforms at the largest scales we... ...distributed LLM workloads on multi-GPU and multi-node deployments... ...US, TX, Austin; US, OR, Remote; US, WA, Remote; US, WA,...Remote workPlatformFull time$205k - $242k
...personal phones. This multi-billion dollar market has... ...-to-use, AI-powered platform. We’re not just building... .... As a Staff Software Engineer, you'll be the hands-on... ...and TypeScript on the backend Event-driven microservices... .... Who We Are We're a remote-first company with a...Remote workPlatformFlexible hours$184k - $287.5k
...looking for a Senior Software Engineer to lead the bring-up,... ...distributed training and inference workloads across NVIDIA GPU platforms at the largest scales we... ...reliability investigations on multi-GPU and multi-node... ...US, TX, Austin; US, OR, Remote; US, WA, Remote; US, WA,...Remote workPlatformFull time- ...leading training and inference speeds; over 10... ...GPU-based hyperscale cloud inference services.... ...recently announced a multi-year partnership... ...hiring a Principal Engineer for our Inference Cloud Platform. This team owns the... ...Strong proficiency in backend or systems...Platform
- ...leading training and inference speeds; over 10... ...-based hyperscale cloud inference services... ...recently announced a multi-year partnership... ...re hiring a Staff Engineer to own major areas... ...Inference Cloud Platform. This team owns the... ...Strong proficiency in backend or systems...Platform
- ...are hiring a Senior Backend Engineer to join an early-stage... ...environments. The platform helps monitor... ...distributed systems, cloud infrastructure, and backend... ...infrastructure on AWS * Build multi-region and high-... ...challenges ahead * Remote full-time opportunity...Remote workPlatformFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Engineer - Multi-Cloud Inference Platform (Remote). Be the first to apply!
- cloud Los Altos, CA
- power platform Los Altos, CA
- platform product manager Los Altos, CA
- remote ruby on rails developer Los Altos, CA
- remote customer support Los Altos, CA
- remote web developer part time Los Altos, CA
- entry level data scientist remote Los Altos, CA
- customer service representative (remote from home) Los Altos, CA
- companies hiring remote Los Altos, CA
- entry level javascript developer remote Los Altos, CA





