Lead Cloud Inference Engineer - Multi-Cloud Scale
EngineersOfAI
Anthropic is seeking backend engineers to scale Claude across AWS, GCP, Azure, and future CSPs. You will design, build, and own services and infrastructure for cross-cloud inference, balancing performance, cost, and reliability. Ideal candidates have deep distributed-systems experience, strong Python or Rust skills, and a proven ability to work across autonomous, cross-functional teams. This role emphasizes security, safety, and scalable operations across multiple cloud providers. #J-18808-Ljbffr EngineersOfAI
- ...powers mission-critical inference for the world's most... ...help build the platform engineers turn to ship AI... ...runtime that powers large-scale LLM inference on Baseten... ...models with industry-leading performance, scalability... ...~ How Baseten multi-cloud capacity management (MCM...SuggestedFlexible hours
$180k - $220k
...cost-efficient, large-scale compute. Teams get the... ...training, and production inference, with security, observability... ...Build Great Teams: We lead by example, empower... ...model across the multi-entity group Establish... ...experience at a high-growth AI, cloud, infrastructure, or...SuggestedTemporary workWork at officeWork from homeFlexible hours2 days per week- Cline is seeking a Senior Infrastructure Engineer to build and scale infrastructure supporting AI inference pipelines, backend APIs, and enterprise integrations. You... ...low‑latency systems, define SLAs/SLIs/SLOs, and lead cloud strategy across AWS/GCP/Azure while driving CI/...Suggested
- ...growing group of committed researchers, engineers, policy experts, and business leaders... ...AI systems. About the role The Cloud Inference team scales and optimizes Claude to serve the massive... ...Solid understanding of multi-region deployments, request routing,...Suggested
$192k - $264k
...offering, that let us scale the business into new conditions... ...members. As a Staff Engineer, you'll help take new... ...the primary technical lead for the team, setting... ...of experience with cloud platforms (AWS preferred... ...Native or otherwise). Multi-team delivery:...SuggestedFull timeWork at officeLocal areaRemote workWorldwide3 days per week$160k - $250k
Together AI is building the Inference Platform that brings... .... Our platform powers multi‑tenant serverless... ..., and speech models at scale. If you get a thrill from... ...data centers and model engine pods. Develop auto‑scaling... ...We have contributed to leading open‑source research,...Full timeLocal area- Kubestrive is seeking a world-class Cloud Solutions Architect to lead multi-cloud initiatives across AWS, Google Cloud, and Azure. You will design enterprise-grade cloud architectures and guide transformations for strategic clients. You will act as the technical authority...
- Catalyst Labs in San Francisco seeks a Tech Lead, Data & Inference Engineer to own the design, development and scaling of a data platform spanning ingestion to insights, with a focus on speed, reliability and business usability. You will build batch and streaming pipelines...
$200k - $250k
...large language models, and large-scale infrastructure to make AI... ...useful. Our team includes engineers, researchers, product builders... ...through one layer: our inference gateway. It allows users to select... ...an inference provider or GPU cloud, or contributions to an open-...Immediate startRemote workWork from homeFlexible hours- ...ideal candidate has deep hands-on experience in AI chip design (GPUs, TPUs, XPUs, ASICs) and strong knowledge of memory subsystems in multi-die configurations, with an emphasis on LLM inference workloads from software to hardware implications. #J-18808-Ljbffr Conductor
- Anthropic in San Francisco is seeking a Cloud Inference Engineer to scale and optimize Claude across AWS, GCP, and Azure. You will own validation, deployment, and performance of inference servers and load balancers on multiple CSPs, ensuring correctness and reliability....
- General Compute is building the inference cloud—control plane, API, and serving layer that turn racks into a sellable product. You will own... ...with data center deployment and model bring-up teams, shaping reliability and scale from day one. #J-18808-Ljbffr General ComputeWork at office
- ...growing group of committed researchers, engineers, policy experts, and business leaders... ...AI systems. About the role The Cloud Inference team scales and optimizes Claude to serve the massive... ...environments Solid understanding of multi‑region deployments, geographic routing...
- Rippling is seeking a Staff Software Engineer for the Cloud Infrastructure team to architect and scale our infrastructure as we expand globally. You will lead design initiatives across Kubernetes fleets, multi-region disaster recovery, and AI-driven workflows, driving...
- Scale AI, based in San Francisco, seeks an experienced US Payroll Specialist to guide end-to-end multi-state payroll for 1,000+ exempt and non-exempt employees. You will ensure accurate processing, timely delivery, and strict compliance with federal, state, and local tax...Local area
- ...Solutions Partners is seeking a software engineer to join our platform team focused... ...systems. You will help build and scale reliable services for an enterprise-grade, multi-tenant security platform, while... ...systems, backend Go, and cloud production experience with AWS or...Visa sponsorship
- Adaption Labs is building a multi-tenant platform that makes our inference infrastructure a trusted product for enterprises and sovereign customers. You will own the systems between customers and the inference stack, including authentication, tenant isolation, quotas,...
$164.7k - $266k
...foundation that lets every engineering team at Docusign... ...safely and at scale. This isn't a... ...As the AI Platform Lead, you own the architecture... ..., and the inference and GPU serving infrastructure... ...Sr. Director of Cloud Services.... ...build, and operate a multi-provider LLM...Permanent employmentFull timeContract workWork at officeLocal areaRemote work2 days per week$155.6k - $307.4k
...infrastructure authority to lead the development of our AI Inference Platform! You will lead... ...ML model serving at scale, with high cost efficiency... ...platforms, across multiple clouds. If you enjoy having many... ...optimizes COGs. Drive the engineering aspects of the AI...Temporary work$200k - $240k
...is a scalable risk engine, our Stand World Model... ...in building and scaling high‑growth companies... ...Science Platform Lead, you’ll lead the platform... ...AI training and inference, simulation... ..., and articulate a multi‑year vision for how... ...on experience with cloud infrastructure and...Full timeTemporary workH1bRemote workVisa sponsorshipWork visaFlexible hours- ...their investment over time. Working closely with Product, Ads Engineering, Data Science, and Sales, we combine customer insight,... ...scalable growth. About the Role We are looking for a Scaled Programs Lead to build and scale global programs that engage SMB-focused...Work at officeLocal area
$255k - $320k
...committed researchers, engineers, policy experts, and business... ...Insights, Measurement Lead at Anthropic, you will... ...media mix modeling, multi-touch attribution and... ...segmentation or other causal‑inference methods to a real... ...team on just a few large‑scale research efforts. And...Work at officeVisa sponsorshipFlexible hoursShift work- ..., helping accelerate schedules for large-scale commercial projects while improving safety... .... The Role Our system runs a Multi Agent Action Expert architecture: classical... ..., control, and safety stack. Optimize inference for deployment on edge GPUs using TensorRT...Shift work
$190k - $235k
...vertically integrated AI Cloud provider, delivering large-scale data centers and GPU clusters for AI training and inference. IREN's platform is underpinned... ...in. The Azure DevOps Lead Engineer will own the technical... ...a NASDAQ-listed, multi-country business spanning...Temporary workFlexible hours$160k - $250k
Together AI is searching for a skilled engineer to join their team, focusing on building and optimizing a large-scale inference platform. This role involves developing low-latency systems and collaborating with research teams to deploy advanced AI models. Candidates should...- Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build and operate infrastructure that enables serving, scaling, and optimizing frontier models with enterprise reliability. You will collaborate across platform, infra, and...
- You.com is seeking a backend generalist to own the inference gateway that routes all model calls. You will design and optimize provider/... ...behavior, and metering, ensuring reliable, cost-aware routing at scale. The role emphasizes building aproxy/gateway on the critical...
- Baseten powers mission-critical AI inference at scale. We seek distributed systems engineers to own the runtimes and APIs that run large-scale LLM inference and hosted endpoints. You’ll work across the stack from developer tooling to orchestration on Kubernetes, driving...
- ...seeking a seasoned Staff DevOps and Platform Engineer to own the infrastructure powering our real-time... ...or SF (remote within the U.S.), you will lead AWS-based platform design, CI/CD, security, and reliability for multi-agent runtimes, mentoring engineers and shaping...Remote work
- Astreya is seeking an Expert Cloud Architect in San Francisco to lead and deliver enterprise-scale cloud platform initiatives. You will architect... ...automation at scale. You will mentor engineers, define standards, and guide multi-team delivery with a focus on observability...Local area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Cloud Inference Engineer - Multi-Cloud Scale. Be the first to apply!
- lead infrastructure engineer San Francisco, CA
- lead operating engineer San Francisco, CA
- lead backend developer San Francisco, CA
- lead algorithm engineer San Francisco, CA
- lead web developer San Francisco, CA
- lead security engineer San Francisco, CA
- lead product engineer San Francisco, CA
- lead network engineer San Francisco, CA
- lead engineer San Francisco, CA
- lead system engineer San Francisco, CA


