Senior Cloud Inference Engineer: Scale & Optimize CSPs
Anthropic
Anthropic is seeking product-minded backend engineers to design, build, and own backend services for Claude across AWS, GCP, and Azure. You will navigate provider differences, optimize cost, and ensure reliability at massive scale while supporting multiple CSP platforms. You will collaborate across inference, product API, systems, and security teams, implementing CI/CD pipelines and scalable deployment of new model versions to millions of users with robust safety and performance. #J-18808-Ljbffr Anthropic
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Cloud Inference Engineer: Scale & Optimize CSPs in Seattle, WA vacancy
- Anthropic’s Cloud Inference team in Seattle builds and operates the Claude inference stack across CSPs. You will own validation, deployment, and performance optimizations for inference servers and load balancers, ensuring correctness at scale. Join a high-leverage infrastructure...Senior
$500 per month
The Cloud Inference team scales and optimizes Claude to serve the massive audiences of developers and enterprise... ...and future cloud service providers (CSPs) We own the end-to-end product of... ...reliability Have significant software engineering experience, with a strong...SeniorWork at officeHome officeRelocation packageFlexible hours- ...technology products. As a Senior Lead Software Engineer at JPMorgan Chase within... ...deploy secure, scalable cloud platforms optimized for AI/ML workloads.... ...by automation at scale. Required qualifications... ...architecture, ML training, and inference. Experience with...SeniorFor contractors
JPMorgan Chase & Co.
Seattle, WA1 day ago $500 per month
The Cloud Inference team scales and optimizes Claude to serve the massive audiences of developers and enterprise... ...and future cloud service providers (CSPs) We own the end-to-end product of... ...management, and day-to-day operations Our engineers are extremely high leverage: we...SeniorWork at officeHome officeRelocation packageFlexible hours$236k - $330k
...advance the state of the art in LLM inference systems and optimization.Our mission is to build the next generation... ...manual tuning. We embrace AI-native engineering, using AI not only as the workload... ...-edge research into production-scale AI.ResponsibilitiesDesign and develop...SeniorSnowflake
Bellevue, WA3 days ago$150.4k - $277.6k
...Senior Software Engineer, Private Cloud Compute Inference Routing Cupertino, California, United States Software and Services... ...delivers cloud inference at scale. You'll join iCloud Platform... ...disaggregation and cache locality optimizations within PCC’s privacy architecture...SeniorRemote workWorldwideRelocationApple Inc.
Seattle, WA1 day ago- Expedia Group is seeking a Senior Software Development Engineer for the ML Platform to design, build, and scale our machine learning infrastructure. You will create reliable... ...for feature engineering, model inference, and monitoring, collaborating with engineers...Senior
- Apple seeks an engineer to build tooling, automation, and analysis capabilities for the AI inference platform, focusing on benchmarking, capacity projection models, and data... ...advance, and help accelerate data-driven decisions for scaling AI workloads. #J-18808-Ljbffr AppleSenior
$175k - $308.5k
We are looking for an engineer to build tooling, automation, and analysis capabilities that strengthen our AI inference platform. This role will focus on developing sophisticated... ...make data-driven decisions about scaling and optimizing our inference platform. Description...SeniorWorldwide- NVIDIA is seeking a Sr. Inference Engineer to push GPU kernel optimization for LLM inference. The role focuses on silicon-measured kernel benchmarking, model-level performance projection, and agentic optimization systems that improve kernels at the assembly level. You...Senior
- DigitalOcean is seeking a Senior Engineer 2 to lead architectural decisions for inference performance and to optimize GPU kernel and inference engine performance. You will solve memory bandwidth bottlenecks and guide the technical roadmap for a high-performance inference...Senior
- AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into products our customers rely... ...-documented APIs serving production traffic at scale. You’ll design and ship customer-facing APIs, scale inference infrastructure for 1M+ users, and collaborate with...Senior
- Anthropic is seeking an experienced engineer to design, build, and operate the high-performance inference infrastructure that serves... ...across multiple accelerators and cloud platforms, implementing... ...boundaries of model architectures at scale in #J-18808-Ljbffr AnthropicSenior
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference Performance Analysis and Optimization team builds the answer from the ground up. We develop...SeniorFull timeNvidia
Seattle, WA3 days ago$184.5k
...traveler satisfaction.The Senior Software Development Engineer - ML Platform role is a... ...and training to real-time inference, monitoring, and cost transparency... ...safely, fast, and at scale.In this role, you will:... ..., and performance optimization.Experience working with machine...SeniorFull timeExpedia
Seattle, WA1 day ago- OpenAI is seeking a software engineer to build the platform that qualifies and optimizes inference workloads across heterogeneous compute environments. You will develop OpenAI-hosted services and partner-side software for long‑lived optimization workflows, generating kernels...
$207.48k - $368.22k
...Senior Cloud Acceleration Engineer - DPU & AI Infrastructure (Multiple Positions) Location... ...GPUs, and custom hardware to optimize distributed training and inference. Drive end-to-end performance... ...challenges. It’s working fast, at scale, and we’re making a difference...SeniorFull timeTemporary workWork experience placementLocal areaByteDance (old)
Seattle, WA2 days ago- Apple Inc. in Seattle, Washington, is seeking an experienced Senior Platform Engineer to help build privacy-preserving measurement and machine... ...products. You will collaborate with cross-functional teams to scale data-intensive systems while upholding Apple’s strict...Senior
- Uber's Compute team in Seattle is seeking a senior engineer to design and scale a cloud-native compute platform used across Uber's product teams. You will own end-to-end systems for orchestration, monitoring, and frameworks, driving reliability at global scale. You will...Senior
- Arm seeks an engineer for its AI Inference Cloud team to define the technical direction and develop highly available, scalable services for running AI inference workloads. You will guide architecture and actively contribute across Kubernetes orchestration, workload management...Senior
- A leading technology company is seeking a Sr. Staff Software Engineer in Seattle to build and maintain observability solutions. This role... ...5+ years of experience in observability solutions within large-scale environments and is proficient in relevant technologies such as...Senior
$184.7k - $324.8k
...Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference Santa Clara, California, United... ...the hardware beneath them. We optimize language, vision, and speech models... ...techniques and ship them at Apple scale.This is a rare opportunity to directly...SeniorWorldwideRelocationApple Inc.
Seattle, WA1 day ago- Carta is building a high-scale KYC platform and seeks an experienced software engineer to drive critical projects from concept to production. You will simplify architecture, raise the technical bar, and collaborate with product, design, and cross-functional teams to deliver...Senior
- Robinhood in Bellevue, WA is seeking a Senior Software Engineer for the Storage Platform. You will build and improve core infrastructure, focusing on reliability, performance, and automation to scale database access and storage systems across teams. The role offers challenging...Senior
- ...technology products. As a Senior Lead Software Engineer at JPMorgan Chase within... ...deploy secure, scalable cloud platforms optimized for AI/ML workloads.... ...by automation at scale. Required qualifications... ...architecture, ML training, and inference. Experience with...SeniorFor contractors
JPMorgan Chase & Co.
Seattle, WA1 day ago - Gusto is seeking seasoned engineers to join our teams working on core platform capabilities, scaling our Ruby on Rails and TypeScript/React applications, and advancing the Tax platform. You will guide projects end-to-end by influencing feature specs, extending existing...Senior
- Rippling in Seattle, WA is seeking a Senior Software Engineer, Backend for the HR Product team. You will own design and implementation of core... ...mentor engineers, and elevate technical standards while solving scale and data integrity challenges. #J-18808-Ljbffr RipplingSenior
$175k - $308.5k
...Staff/Senior Machine Learning Engineer, Search & Knowledge Platform Seattle, Washington, United States... ...Search and AI engineers on large scale machine learning to improve Query... ...the latest advances for online inference optimization. Following is the primary list of...SeniorWork experience placementRelocationApple Inc.
Seattle, WA1 day ago- ...AI lifecycle platform to ingest, transform, and analyze data at scale. The role focuses on designing scalable data systems,... ...across production services. Ideal candidates have 5+ years in data engineering, strong Python/SQL skills, and experience with dbt, Dagster, or...Senior
- Rippling is seeking a Senior Software Engineer, Backend for the Platform team in Seattle. You will own design and implementation of core backend... ...capabilities, focusing on reliability and security at scale. You will collaborate with product, frontend, and platform...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Cloud Inference Engineer: Scale & Optimize CSPs. Be the first to apply!
Related searches
- senior devops cloud engineer Seattle, WA
- senior aws cloud engineer Seattle, WA
- cloud network engineer Seattle, WA
- google cloud architect Seattle, WA
- senior cloud network engineer Seattle, WA
- principal cloud computing engineer Seattle, WA
- cloud solutions architect Seattle, WA
- cloud engineer Seattle, WA
- lead cloud architect Seattle, WA
- google cloud engineer Seattle, WA