Senior Inference Platform Engineer — Kubernetes & Latency
$165k - $242kCoreWeave
A cloud service provider is seeking a Senior Software Engineer II for their Inference team in Sunnyvale, California. In this role, you'll lead design reviews, implement optimizations, and improve service reliability. The ideal candidate has extensive experience with distributed systems, strong Python/Go skills, and Kubernetes expertise. This position offers a competitive salary between $165,000 to $242,000, plus generous benefits and a hybrid working environment. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Inference Platform Engineer — Kubernetes & Latency in Sunnyvale, CA vacancy
- DDN is seeking a Senior Software Engineering Manager to lead the engineering... ...for our KV Cache Platform—a distributed memory... ...large-scale LLM inference across GPU clusters.... ...scalable, low-latency distributed systems... ...Storage, BlueField DPUs, Kubernetes, or related AI infrastructure...Senior
- ...-leading training and inference speeds; over 10 times... ...'re hiring a Software Engineer to help contribute to... ...projects on our Inference Platform team. Our team... ...leading solutions across Kubernetes operators, service security... ...level improvements in latency, throughput, capacity...SuggestedFull time
Cerebras Systems
Sunnyvale, CA10 hours ago $152k - $241.5k
...computing company”.We are looking for an AI & Deep Learning Compiler Engineer. NVIDIA is hiring software engineers for its Deep Learning &... ...advancement of AI, our DLC has been the backbone of NVIDIA’s inference engine, spanning across data centers, personal devices,...SeniorFull timeRemote work$184k - $287.5k
...Silicon Co-Design Group (SCG) is seeking Senior AI Platform Engineers. They will set the technical... ...ownership of a model serving platform or latency-sensitive backend service from initial... ...with job queues + sandboxed execution (Kubernetes Jobs, Celery/Sidekiq/Temporal,...SeniorFull time- ...career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance... ..., INT4) effects on throughput and latency.Competitive performance analysis:... ...end inference SLAs.GPU operator and Kubernetes stack: Profile the overhead introduced...Senior
$182.5k - $260.5k
...0, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge... ...Positions are available at Senior Staff and above. Candidates... ...Scientist, you own the inference and optimization layer that... ...and evaluate models, push latency and throughput on real hardware...Senior$201k - $402k
...HonestThe OpportunityWe are looking for a Senior Engineering Manager to lead the design,... ...development, and scaling of a next-generation Kubernetes platform powering enterprise environments.... ...of GPU scheduling, training, and inference systemsExecution & Operational...SeniorWork at officeLocal areaRemote workRelocation package3 days per week$184k - $287.5k
...forward‑thinking engineers tackling some of the... ...searching for a Senior Systems Software Engineer... ...systems, Kubernetes, containers, and systems... ..., distributed inference serving, and major cloud platforms. You’ll own hard technical... ...and cold‑start latency to enable smooth,...SeniorFull timeRemote work$168k - $264.5k
...Digital Marketing Organization seeks a senior Site Reliability Engineer (SRE) to join our Santa Clara, CA... ...tracking model drift and inference latency.What we need to see:MS or BS in Computer... ....Strong knowledge of the Kubernetes Platform, deployments, and cloud-native automation...SeniorFull time$157.2k - $254.1k
...comprehensive AI security platform. Organizations are... ...Machine Learning Inference Engineer, you will serve as a... ...technical projects, mentor senior engineers, and set... ...highly scalable, low-latency, and resilient ML inference... ...technologies like Kubernetes and Docker.Mastery of...Full timeWork at office$139k - $204k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...at What You'll Do: Senior engineers are area owners who lead... ...measurable improvements to latency, throughput, and reliability... ...teams to evolve our Kubernetes-native inference platform and meet strict P...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursShift workCoreWeave
Sunnyvale, CA17 days ago$224k - $356.5k
...best experience. We own the platform — performance, CI/CD pipelines... ...in leading open-source LLM inference frameworks — identify... ...observed inference throughput, latency, and utilizationOwn the model... ...Computer Science, Computer Engineering, Electrical Engineering, or...SeniorFull timeLocal area$152k - $241.5k
...coordinated access control platform. Our UAM platform is a cutting... ...Science, Electrical Engineering, Computer Engineering, or a... ...millions of transactions, low latency, high availabilityVerifiable... ...level knowledge of AWS Cloud, Kubernetes (k8s), and the GitOps model....SeniorFull time$152k - $241.5k
...massive superchip. We are looking for expert engineers to come and help design rack level... ...next generation scaling AI supercomputing platforms.Join us at the forefront of... ...architecture, optimize firmware for low latency APIs. Strong knowledge of analyzing algorithms...SeniorFull time$176k - $276k
...GNI) organization. We deploy, integrate, and operate the Kubernetes-based platform and shared services used to provision, monitor, and operate... ...across environments.We are looking for a hands-on senior engineer to own the lifecycle and automation of the Kubernetes platform...SeniorFull timeRemote workWeekend work$148k - $224.25k
...depend on to operate inference and agentic workloads.... ...Manager to drive NVCF platform features and developer... ...roadmap.Collaborate with engineering on feature design,... ...container orchestration (Kubernetes / serverless),... ...capability to connect with senior technical customers and...SeniorFull time$262k - $364k
...Lead and coach a distributed engineering team, fostering innovation... ...transport across various NICs and platforms, tuning the communication... ...ahead of training and inference advancements.Collaborative System... ...Storage (GDS).As a Senior Staff Software Engineer, you...SeniorRemote workWorldwide$144k - $236k
...model training, feature engineering and serving with... ...state-of-the-art Feature Platform, which empowers AI Users... ...this team builds low latency high performance applications... ..., enable GPU based inference for a large variety of... ...possible.As a Senior Software Engineer, you...SeniorFor contractorsWork experience placementWork at officeFlexible hours$184k - $287.5k
...forefront of technological advancement. We’re hiring a Senior Backend/Platform Engineer to build and maintain the core infrastructure behind NVIDIA... ..., and infrastructure automationWork deeply with Linux, Kubernetes, containers, networking, and public cloud...SeniorFull timeRemote work$152k - $241.5k
We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate the discovery and deployment... ...precision or sparsified variants — unlocking throughput and latency gains without regressing accuracy or verbosity....SeniorFull time$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its... ...understanding of how kernel selection drives model-level throughput and latency.Working knowledge of GPU kernel optimization — CUDA, CUTLASS...SeniorFull time$245k - $350k
...native Zero Trust Exchange platform. This innovation... ....We are looking for a Senior Architect to join our... ...,Software Development Engineering ZIdentity team. You will... ...technical roadmap for the Kubernetes platform, architecting... ...throughput and low latency, multi-cloud & DRBasic...SeniorFull timeWork at officeLocal area3 days per week- ...Role Overview: This role is for a Senior Platform Software Engineer with a focus on Java, responsible for developing and maintaining distributed... ...containerization and orchestration tools such as Kubernetes and Docker. Implement infrastructure as code using Terraform...Senior
Prophecy Technologies
Sunnyvale, CA1 day ago - ...industry-leading training and inference speeds; over 10 times... ...About The RoleWe are hiring a Senior Performance Engineer to join our Product team.... ..., time to first token, latency under concurrency, and total... ..., and inference API platforms. You will work directly with...SeniorContract workShift work
- ...industry-leading training and inference speeds; over 10 times... ...'re hiring a Principal Engineer for our Inference Cloud Platform. This team owns the cloud... ...including availability, latency, reliability, and multi-region... ...This is one of the most senior IC roles on the team, for...
$151.8k - $265.35k
...effortlessly. The AI for Engineering team builds a scalable, production-grade AI platform that powers creativity... ..., memory systems, inference services, data flows,... ...strong guarantees around latency, reliability,... ...adaptive AI systems.Mentor senior engineers in modern AI...SeniorFull timeTemporary workLocal areaWorldwide$224k - $356.5k
We are now looking for a Senior System Software Engineer to work on Dynamo. NVIDIA is hiring software... ...-paced team building Generative AI inference platform to make design and deployment of new... ...repeated prompt processing, improve latency and token throughput, maximize GPU...SeniorFull time- ...of what’s possible with LLM inference on heterogeneous hardware. Our... ...are an applied research and engineering team that moves fast, ships real... ...throughput and minimize latency.• Drive quantization, sparsity... ...work and real hardware.• Small, senior team with high autonomy and...Senior
- ...Job Title: Senior Platform Software Engineer (Java) - Ex-Apple Preferred Experience Required 8+ Years Mandatory Requirement: Candidate... ...7, Spring Boot, Spring Cloud, Microservices, AWS Cloud, Kubernetes, and Event-Driven Architecture . This role...Senior
Purple Drive
Sunnyvale, CA24 days ago - ...Senior SAP Hybris / Commerce Cloud Developer E-commerce Platform Location: Mountain View, CA (Onsite... ...of overall software engineering experience. ~5+ years... ...per minute with low latency. Key Responsibilities... ...experience. Kubernetes experience....SeniorContract work
Stellent IT LLC
Mountain View, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Inference Platform Engineer — Kubernetes & Latency. Be the first to apply!
Related searches
- platform developer Sunnyvale, CA
- senior platform engineer Sunnyvale, CA
- platform engineer Sunnyvale, CA
- senior technology project manager Sunnyvale, CA
- remote senior business analyst Sunnyvale, CA
- senior manager clinical operations Sunnyvale, CA
- senior leadership Sunnyvale, CA
- senior director engineering Sunnyvale, CA
- senior grant accountant Sunnyvale, CA
- senior storage engineer Sunnyvale, CA