Senior Inference Platform Engineer — Kubernetes & Latency
$165k - $242kCoreWeave
A cloud service provider is seeking a Senior Software Engineer II for their Inference team in Sunnyvale, California. In this role, you'll lead design reviews, implement optimizations, and improve service reliability. The ideal candidate has extensive experience with distributed systems, strong Python/Go skills, and Kubernetes expertise. This position offers a competitive salary between $165,000 to $242,000, plus generous benefits and a hybrid working environment. #J-18808-Ljbffr CoreWeave
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Inference Platform Engineer — Kubernetes & Latency in Sunnyvale, CA vacancy
$139k - $204k
CoreWeave is seeking a Senior Engineer to lead designs and enhance engineering standards within their Kubernetes-native inference platform. Responsibilities include driving architecture, defining SLIs/SLOs, and mentoring engineers, with 3-8 years of experience preferred...SeniorRemote jobFlexible hours- Apple is seeking a Senior Software Engineer for the Data Platform to design, develop, and deploy scalable data processing... ...orchestration with Docker and Kubernetes. You will collaborate with cross-functional teams to ensure low latency, fault tolerance, and high availability...Senior
- A leading cloud service provider in California is seeking a Senior Platform Engineer II to champion reliability and administer multi-tenant Kubernetes platforms. The ideal candidate will have over 5 years of experience in Kubernetes, a strong background in resilient application...Senior
- ...-leading training and inference speeds; over 10 times... ...'re hiring a Software Engineer to help contribute to... ...projects on our Inference Platform team. Our team... ...leading solutions across Kubernetes operators, service security... ...level improvements in latency, throughput, capacity...SuggestedFull time
Cerebras Systems
Sunnyvale, CA14 hours ago $152k - $241.5k
...computing company”.We are looking for an AI & Deep Learning Compiler Engineer. NVIDIA is hiring software engineers for its Deep Learning &... ...advancement of AI, our DLC has been the backbone of NVIDIA’s inference engine, spanning across data centers, personal devices,...SeniorFull timeRemote work- DDN is seeking a Senior Software Engineering Manager to lead the engineering... ...for our KV Cache Platform—a distributed memory... ...large-scale LLM inference across GPU clusters.... ...scalable, low-latency distributed systems... ...Storage, BlueField DPUs, Kubernetes, or related AI infrastructure...Senior
$193.93k - $352.29k
...world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides.Founded in 2016,... ...data generation to on-road validation.Maintain an in-house ML inference platform to serve large language models efficiently.Maintain an...SeniorImmediate startFlexible hours$184k - $287.5k
...Silicon Co-Design Group (SCG) is seeking Senior AI Platform Engineers. They will set the technical... ...ownership of a model serving platform or latency-sensitive backend service from initial... ...with job queues + sandboxed execution (Kubernetes Jobs, Celery/Sidekiq/Temporal,...SeniorFull time$201k - $402k
...HonestThe OpportunityWe are looking for a Senior Engineering Manager to lead the design,... ...development, and scaling of a next-generation Kubernetes platform powering enterprise environments.... ...of GPU scheduling, training, and inference systemsExecution & Operational...SeniorWork at officeLocal areaRemote workRelocation package3 days per week- ...career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance... ..., INT4) effects on throughput and latency.Competitive performance analysis:... ...end inference SLAs.GPU operator and Kubernetes stack: Profile the overhead introduced...Senior
$182.5k - $260.5k
...0, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge... ...Positions are available at Senior Staff and above. Candidates... ...Scientist, you own the inference and optimization layer that... ...and evaluate models, push latency and throughput on real hardware...Senior- NVIDIA seeks a Senior Product Manager for AI Platform Inference (Finance) in Santa Clara to lead tooling, SDKs, and libraries enabling GPU-based inference deployments. You will craft strategy, roadmaps, and market plans, collaborating with developers to optimize models...Senior
$184k - $287.5k
...forward‑thinking engineers tackling some of the... ...searching for a Senior Systems Software Engineer... ...systems, Kubernetes, containers, and systems... ..., distributed inference serving, and major cloud platforms. You’ll own hard technical... ...and cold‑start latency to enable smooth,...SeniorFull timeRemote work- Apple Services Engineering (ASE) Data Platform team is seeking engineers who can design, develop, and deploy... ...of events daily, delivering low-latency insights and reliable storage, caching... ..., IaC, and experience with Docker/Kubernetes, plus a degree in CS/CE. #J-18808-Ljbffr...Senior
$193.93k - $352.29k
...world around us, that's why we're building a universal autonomy platform: self-driving for all roads and all rides. Founded in 2016,... ...generation to on-road validation. Maintain an in-house ML inference platform to serve large language models efficiently....SeniorImmediate startFlexible hoursNuro
Mountain View, CA7 days ago- Apple Inc. is seeking a Sr. Machine Learning Engineer for the Foundation Models Inference team in Santa Clara, CA. You will collaborate with research and... ...privacy-preserving PCC/CloudOS infrastructure, ensuring low latency and high reliability across billions of queries. #J-1...Senior
$230k - $250k
...involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a... ...and experience with containerization tools like Docker and Kubernetes. A competitive salary between $230,000 and $250,000 is offered...Senior$168k - $264.5k
...Digital Marketing Organization seeks a senior Site Reliability Engineer (SRE) to join our Santa Clara, CA... ...tracking model drift and inference latency.What we need to see:MS or BS in Computer... ....Strong knowledge of the Kubernetes Platform, deployments, and cloud-native automation...SeniorFull time$176k - $276k
...exciting time to join us!NVIDIA invites applications for a Senior DevOps Platform Engineer skilled in Platform and Release Engineering to join the... ...for Metropolis software products.Develop and manage Kubernetes-based platform infrastructure supporting AI/ML workloads...SeniorFull time$157.2k - $254.1k
...comprehensive AI security platform. Organizations are... ...Machine Learning Inference Engineer, you will serve as a... ...technical projects, mentor senior engineers, and set... ...highly scalable, low-latency, and resilient ML inference... ...technologies like Kubernetes and Docker.Mastery of...Full timeWork at office- Cerebras Systems is seeking a Software Engineer to build and maintain high-performance, low-latency inference infrastructure. You will deploy scalable inference services... ...auto-scaling, and integrate with Docker/Kubernetes in production environments. You will collaborate...
$224k - $356.5k
...best experience. We own the platform — performance, CI/CD pipelines... ...in leading open-source LLM inference frameworks — identify... ...observed inference throughput, latency, and utilizationOwn the model... ...Computer Science, Computer Engineering, Electrical Engineering, or...SeniorFull timeLocal area$152k - $241.5k
...coordinated access control platform. Our UAM platform is a cutting... ...Science, Electrical Engineering, Computer Engineering, or a... ...millions of transactions, low latency, high availabilityVerifiable... ...level knowledge of AWS Cloud, Kubernetes (k8s), and the GitOps model....SeniorFull time$200k - $322k
...technical, creative, and hands-on Senior full-stack developer to build the next generation AI platforms and products that improve... ...efficiency and productivity. This engineer is expected to be familiar... ...experience deploying applications in Kubernetes environments. Experience...SeniorFull timeImmediate start$152k - $241.5k
...massive superchip. We are looking for expert engineers to come and help design rack level... ...next generation scaling AI supercomputing platforms.Join us at the forefront of... ...architecture, optimize firmware for low latency APIs. Strong knowledge of analyzing algorithms...SeniorFull time$176k - $276k
...GNI) organization. We deploy, integrate, and operate the Kubernetes-based platform and shared services used to provision, monitor, and operate... ...across environments.We are looking for a hands-on senior engineer to own the lifecycle and automation of the Kubernetes platform...SeniorFull timeRemote workWeekend work- CoreWeave is seeking a Senior Engineer for its Benchmarking & Performance team to own kernel-level optimization for LLM inference and end-to-end model serving, focusing on CUDA kernels and throughput/latency improvements. You will lead kernel design reviews, mentor engineers...Senior
$224k - $356.5k
...definition resolution at low latency and smooth frame-rates. Just... ...highly skilled and motivated engineers who bring GeForce NOW to life... ...a member of the GeForce Now Platform Engineering team, you will help... ...experience with tools like GPUView, Kubernetes, Nvidia Nsight, Kernel shark,...SeniorFull time$144k - $236k
...model training, feature engineering and serving with... ...state-of-the-art Feature Platform, which empowers AI Users... ...this team builds low latency high performance applications... ..., enable GPU based inference for a large variety of... ...possible.As a Senior Software Engineer, you...SeniorFor contractorsWork experience placementWork at officeFlexible hours$262k - $364k
...Lead and coach a distributed engineering team, fostering innovation... ...transport across various NICs and platforms, tuning the communication... ...ahead of training and inference advancements.Collaborative System... ...Storage (GDS).As a Senior Staff Software Engineer, you...SeniorRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Inference Platform Engineer — Kubernetes & Latency. Be the first to apply!
Related searches
- platform engineer Sunnyvale, CA
- platform engineering manager Sunnyvale, CA
- platform developer Sunnyvale, CA
- senior platform engineer Sunnyvale, CA
- senior lead project manager Sunnyvale, CA
- senior robotics software engineer Sunnyvale, CA
- senior devops engineer remote Sunnyvale, CA
- senior sas administrator Sunnyvale, CA
- senior IT manager Sunnyvale, CA
- sr project manager Sunnyvale, CA