Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Backend Engineer - Multi-Cloud Inference Platform (Remote)

Modular Inc

Los Altos, CA
  • Remote job

Modular is seeking an experienced backend engineer to shape end-to-end distributed inference deployments on a multi-cloud platform. You will build scalable services, improve observability, and drive performance across diverse hardware and cloud providers. The team emphasizes secure multi-tenant infrastructure, Kubernetes-based deployments, and close collaboration with product and ML teams. Remote-friendly role with offices in Los Altos, CA. #J-18808-Ljbffr Modular Inc

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Backend Engineer - Multi-Cloud Inference Platform (Remote) in Los Altos, CA vacancy
  • $148k - $324k

     ...States / Canada Remote Full-time...  ...role: In the Cloud Inference team, we are focused...  ...productive, low toil platform for managing...  ...alike. We're seeking engineers who are...  ...of experience in backend engineering, AI inference...  ...do: Build the multi-cloud, multi-tenant... 
    Remote work
    Platform
    Full time
    Work experience placement
    Work at office
    Local area

    Modular Inc

    Los Altos, CA
    4 days ago
  • $200k - $250k

     ...information. Our platform combines...  ...Our team includes engineers, researchers, product...  ...through one layer: our inference gateway. It allows...  ...budget. This is a remote position open to...  ...A strong backend generalist (Python...  ...inference provider or GPU cloud, or contributions... 
    Remote work
    Platform
    Immediate start
    Work from home
    Flexible hours

    Mixpeek

    San Francisco, CA
    1 day ago
  • $155k - $235k

     ...AI. Staff Test & Release Engineer, Inference CloudLocation: Santa Clara, Ca / Remote, USRole OverviewThe Inference Cloud Engineering team builds the...  ...partner with QE, product, platform, and infrastructure teams...  ...including deploying and debugging multi-service workloads, Helm,... 
    Remote work
    Platform
    Shift work

    d-Matrix

    Santa Clara, CA
    1 day ago
  • $160k - $250k

    Together AI is building the Inference Platform that brings the most advanced generative AI models to the world. Our platform powers multi‑tenant serverless workloads and dedicated endpoints...  ...across data centers and model engine pods. Develop auto‑scaling systems to... 
    Platform
    Full time
    Local area

    Together AI

    San Francisco, CA
    1 day ago
  • $150.4k - $277.6k

     ...Senior Software Engineer, Private Cloud Compute Inference Routing Cupertino, California, United States Software...  ...at scale. You'll join iCloud Platform Engineering team. We build the server...  ...preserving system design (e.g., Oblivious remote attestation) Experience leading a... 
    Remote work
    Platform
    Worldwide
    Relocation

    Apple Inc.

    Seattle, WA
    1 day ago
  • $150k - $250k

     ...You'll be Owning GRVTY is seeking a Multi-Cloud Engineer with a TS/SCI + Poly clearance (...  ...updates, troubleshooting within the cloud platform, and providing input on troubleshooting...  ...signal devices such as scalable portable remote devices Demonstrated experience... 
    Remote work
    Platform
    Contract work
    For contractors

    Devopsroles

    Chantilly, Loudoun County, VA
    21 hours ago
  • d-Matrix is building an internal cloud and customer-facing inference endpoints; this staff role owns end-to-end test automation and release governance...  ...components. You will collaborate with QE, product, platform and infrastructure teams to scale testing without slowing... 
    Remote job
    Platform

    Devopsroles

    Santa Clara, CA
    1 day ago
  •  ...Systems Administrator / DevOps Engineer, you will maintain and build...  ...our model training and our inference cloud. You’ll split your time...  ...developer workflows (e.g., VSCode remote development, Docker)...  ...reliability of our inference platform. What We’re Looking For /... 
    Remote work
    Platform
    Work at office
    Relocation package

    Linuxconfig

    San Francisco, CA
    21 hours ago
  • $160k - $320k

     ...our Nutanix Kubernetes Platform (NKP) team in San Jose...  ..., enterprise-grade cloud-native solutions at the...  ...application mobility, and multi-tenant security...  ...You will combine strong backend engineering skills with deep Kubernetes...  ...the benefits of remote work with the advantages... 
    Remote work
    Platform
    Work at office
    Local area
    Relocation package
    3 days per week

    Nutanix

    San Jose, CA
    4 days ago
  • $136.45k - $213.98k

     ...the connectivity and platforms we provide, to the...  ...the office for the remote option.)Job SummaryThis Software Engineer (Engineer 3)...  ...building scalable backend microservices, robust API layers, and multi-tenant platform infrastructure...  ...applications in cloud or cluster... 
    Remote work
    Platform
    Full time
    Work at office
    Worldwide

    Comcast

    Philadelphia, PA
    1 day ago
  • $121.5k - $145.5k

    This is a remote position; however, the candidate...  ...Sr. Software Engineer in the North...  ...role will sit in the Platform team that focuses...  ...oriented code in our backend services.Develop public...  ..., memory, and multi-step decision-...  ...paymentsFamiliarity with cloud-native... 
    Remote work
    Platform
    Full time
    Flexible hours

    WEX

    Dallas, TX
    5 days ago
  •  ...industry. Our AI workforce platform integrates machine...  ...executing complex, multi-step processes with human...  ...at scale. The backend powers session orchestration...  ...replay. Reliability engineering : SLIs/SLOs, incident...  ...with Company Match. ~ Remote Flexible - come to the... 
    Remote work
    Platform
    Work at office
    Flexible hours

    Vantaca

    Redwood City, CA
    1 day ago
  •  ...CA / Austin, TX - Remote (within locations...  ...offers advanced cloud capabilities to customers...  ...seeking a Staff Backend Engineer to take our Model...  ...distributed, multi-tenant token...  ...customer, and carry the platform there...  ...functional teams. Inference Gateway and API Surface... 
    Remote work
    Platform
    Contract work
    Local area

    Bitdeer

    San Jose, CA
    1 day ago
  • $200k - $230k

     ...Fellow is looking for a Backend Engineer to build, scale, and...  ...physical products to the cloud. A successful...  ...applications, and backend platforms. Data Management: Own...  ...restore testing, and multi-region readiness. Tools...  ..., and secure remote device diagnostics when... 
    Remote work
    Platform
    Summer work
    Work at office
    Local area

    Fellow

    San Francisco, CA
    1 day ago
  •  ...Francisco is seeking a Senior Software Engineer (Backend) to shape the future of Kubernetes multi-tenancy. You will architect core platform components and drive backend initiatives...  ...define scalable isolation models. This remote-friendly role offers startup grit and impact... 
    Remote work
    Platform

    Vcluster

    San Francisco, CA
    1 day ago
  • affirm is seeking a Senior Software Engineer to architect, build, and scale relational and distributed SQL databases in a remote-first environment. You will automate provisioning, backups, failover, and upgrades across multi-tenant clusters. The role emphasizes zero-downtime... 
    Remote job
    Platform

    Affirm

    Chicago, IL
    3 days ago
  • $175k - $315k

     ...most advanced AI-native platform. We work on large scale...  ...for this Senior Engineer II has deep expertise in...  ...system behavior in a large multi-tenant environment. We...  ...Communication — As a remote-first company, bring excellent...  ...of at least one cloud environment (AWS, Azure... 
    Remote work
    Platform
    Hourly pay
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Shift work
    Austin, TX
    8 days ago
  • You.com is seeking a backend generalist to own the inference gateway that routes all model calls. You will design and optimize provider/model selection, caching behavior, and metering, ensuring reliable, cost-aware routing at scale. The role emphasizes building aproxy/gateway... 
    Platform

    Mixpeek

    San Francisco, CA
    21 hours ago
  • $250k

     ...orchestration platform designed to unify...  ...with a robust backend infrastructure...  ...for staff-level engineers to help design,...  ...from low-latency inference pipelines to...  ..., concurrency (multi-processing, multi...  ...with cloud infrastructure...  ...This role can be remote or onsite, based... 
    Remote work
    Platform

    ByteHire Limited.

    New York, NY
    21 hours ago
  • $160k - $250k

    Together AI is searching for a skilled engineer to join their team, focusing on building and optimizing a large-scale inference platform. This role involves developing low-latency systems and collaborating with research teams to deploy advanced AI models. Candidates should... 
    Platform

    Together AI

    San Francisco, CA
    1 day ago
  •  ...Orbis is seeking a Senior Backend Engineer to drive the evolution of Catalyst...  ...our secure distributed data platform. You will act as an...  ...testcontainers) that exercise multi-component systems end to end...  ...a hybrid schedule, or fully remote work; our team is spread across... 
    Remote work
    Platform
    Full time
    Work at office
    Shift work

    Orbis

    McLean, VA
    1 day ago
  • $205k - $242k

     ...personal phones. This multi-billion dollar market...  ...easy-to-use, AI-powered platform. We’re not just...  ...then get the rest of engineering to actually use it Own...  ...and TypeScript on the backend Event-driven microservices...  .... Who We Are We're a remote-first company with a culture... 
    Remote work
    Platform
    Flexible hours

    Quo

    Sacramento, CA
    1 day ago
  • $150k - $185k

     ...Come join our Engineering team! High velocity,...  ...work. Our AI-powered platform brings efficiency...  ...seeking a Senior Backend Engineer (Integrations...  ...configuration, or cloud deployments) ~...  ...effectively in a fully remote environment...  ...government systems Multi-tenant... 
    Remote work
    Platform
    Full time
    Work at office
    Flexible hours

    FutureFit AI

    Remote
    1 day ago
  • $140k - $230k

     ...looking for a Senior Software Engineer (AI Inference & Runtime Platform) based in the United...  ...GPU infrastructure, and cloud platforms. Working across...  ...infrastructure foundation used by backend engineering teams,...  ...work-life balance. Remote work: Fully remote... 
    Remote work
    Platform
    Full time
    Flexible hours

    Jobgether

    Remote
    2 days ago
  • $116k - $189.75k

     ...are looking for a Software Engineer focused on bring-up,...  ...distributed training and inference workloads across NVIDIA GPU platforms at the largest scales we...  ...distributed LLM workloads on multi-GPU and multi-node deployments...  ...US, TX, Austin; US, OR, Remote; US, WA, Remote; US, WA,... 
    Remote work
    Platform
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $205k - $242k

     ...personal phones. This multi-billion dollar market has...  ...-to-use, AI-powered platform. We’re not just building...  .... As a Staff Software Engineer, you'll be the hands-on...  ...and TypeScript on the backend Event-driven microservices...  .... Who We Are We're a remote-first company with a... 
    Remote work
    Platform
    Flexible hours

    Quo

    Sacramento, CA
    4 days ago
  • $184k - $287.5k

     ...looking for a Senior Software Engineer to lead the bring-up,...  ...distributed training and inference workloads across NVIDIA GPU platforms at the largest scales we...  ...reliability investigations on multi-GPU and multi-node...  ...US, TX, Austin; US, OR, Remote; US, WA, Remote; US, WA,... 
    Remote work
    Platform
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...leading training and inference speeds; over 10...  ...GPU-based hyperscale cloud inference services....  ...recently announced a multi-year partnership...  ...hiring a Principal Engineer for our Inference Cloud Platform. This team owns the...  ...Strong proficiency in backend or systems... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    5 days ago
  •  ...leading training and inference speeds; over 10...  ...-based hyperscale cloud inference services...  ...recently announced a multi-year partnership...  ...re hiring a Staff Engineer to own major areas...  ...Inference Cloud Platform. This team owns the...  ...Strong proficiency in backend or systems... 
    Platform

    Cerebras Systems

    Sunnyvale, CA
    5 days ago
  •  ...are hiring a Senior Backend Engineer to join an early-stage...  ...environments. The platform helps monitor...  ...distributed systems, cloud infrastructure, and backend...  ...infrastructure on AWS * Build multi-region and high-...  ...challenges ahead * Remote full-time opportunity... 
    Remote work
    Platform
    Full time

    RediRecruit Hiring Solutions

    United States
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Backend Engineer - Multi-Cloud Inference Platform (Remote). Be the first to apply!