Senior Inference Platform Engineer Kubernetes & Latency
$165k - $242kCoreWeave
A cloud service provider is seeking a Senior Software Engineer II for their Inference team in Sunnyvale, California. In this role, you'll lead design reviews, implement optimizations, and improve service reliability. The ideal candidate has extensive experience with distributed systems, strong Python/Go skills, and Kubernetes expertise. This position offers a competitive salary between $165,000 to $242,000, plus generous benefits and a hybrid working environment. #J-18808-Ljbffr CoreWeave
- Cerebras is seeking a Software Engineer to join our Inference Platform team in Sunnyvale, California. This role involves developing and leading projects that integrate cloud and ML components. You will contribute to shaping the technical direction and improve system performance...Senior
- A leading data platform company in Palo Alto seeks a Senior Engineer to develop a cutting-edge inference platform supporting semantic search and AI-native experiences. The ideal candidate will have over five years of experience in backend systems and proficiency in languages...Senior
$126k - $248k
...the Role We’re looking for a Senior Engineer to help build the next‑generation inference platform that supports embedding models... ...infrastructure for real‑time, low‑latency, and high‑scale inference —... ...container orchestration with Kubernetes Who You Are 5+ years of experience...SeniorLocal area- A leading technology company is looking for a Java SRE Engineer to support large-scale cloud migrations and production systems on AWS and Kubernetes. You will lead migrations, design robust AWS EKS platforms, and implement deployment strategies. The ideal candidate has...Senior
- ...technology company in Mountain View is seeking a candidate with hands-on experience in building multi-tenant SaaS platforms. The role requires knowledge of Kubernetes, cloud services (AWS/GCP/Azure), and the ability to integrate AI tools for enhancing productivity....Senior
- A tech company is seeking a Senior DevOps Engineer to enhance and automate its infrastructure for a site-builder platform. This position focuses on creating robust CI/CD pipelines and production-ready Kubernetes environments. The ideal candidate will have substantial experience...Senior
$126k - $203.5k
Palo Alto Networks, Inc. is seeking a Senior Staff Production Engineer to design and build foundational cloud platform capabilities. This role involves working with infrastructure... ...as AWS, Azure, or GCP, and expertise in Kubernetes management. Compensation ranges from $126,00...Senior- Israelvcforum is looking for a Senior ML Infrastructure Engineer in Mountain View, California. This position aims to build and scale robust platforms for ML inference workflows supporting GM’s AI efforts. You will collaborate with ML engineers and researchers to implement...SeniorRemote job
- CoreWeave is looking for a Senior Engineer specializing in database and stream processing to enhance its data platform. This position offers the opportunity to work with a skilled... ...in Go or Python, and knowledge of Kubernetes. Embrace collaboration and innovation within...Senior
- We’re looking for a Senior Engineer to help build the next-generation inference platform that supports embedding models used for... ...infrastructure for real-time, low-latency, and high-scale inference —... ...container orchestration with Kubernetes Who You Are 5+ years of experience...SeniorLocal areaWorldwide
- General Motors is seeking a Senior ML Infrastructure Engineer to build and scale a robust platform for machine learning inference workflows. You will design backend software components, collaborate with ML engineers, and lead initiatives across GM's ML ecosystem. With over...SeniorRemote job
$262k - $365k
Senior Engineering Manager AI Inference Platform, Distributed Cloud Location: Sunnyvale, CA, USA Pay US: $262,000 - $365,000 (USD) + 25% bonus target + equity... ..., maximize resource utilization, and minimize latency. Google is proud to be an equal opportunity and affirmative...Senior$128.7k - $261.3k
...Team The Model Deployment & Inference Solutions team in GM AV deploys... ...: build the ML deployment platform that makes model rollouts fast... ...models so they meet the real‑time latency and memory budgets required... ...performed manually by engineers. Build the developer experience...SeniorLocal areaRemote workFlexible hoursShift work- ...Senior Cloud Platform Engineer Own the production inferencing service reliability and... ...focus will be ensuring our inference endpoints have exceptional uptime, low-latency response times, and efficient... ...orchestration technologies (Docker, Kubernetes). Deep understanding of...SeniorImmediate startFlexible hoursShift work
$235k - $250k
...maintain critical shared services for our mission-critical SaaS platform. You will be instrumental in enabling teams to deliver... ...The ideal candidate has 9+ years of relevant experience, deep Kubernetes knowledge, and strong programming skills in Go (Golang). This...Senior$184k - $356.5k
NVIDIA Gruppe is seeking a Senior Engineer to lead the evolution of the core NIM Platform SDK and microservice framework in Santa Clara, California. This hands-on role involves architecting significant new features and solving complex engineering challenges. The ideal...Senior- ...Sunnyvale We're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns... ...system-level improvements in latency, throughput, capacity... ...distributed systems ideally with Kubernetes. Experience building highly available...
$230k - $250k
...involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a... ...and experience with containerization tools like Docker and Kubernetes. A competitive salary between $230,000 and $250,000 is offered...Senior$155.42k - $395.9k
Job Description About the Team: The ML Inference Platform is part of the AV ML Infrastructure organization. Our team owns the cloud... ...cost efficiency. About the Role: We are seeking a Senior ML Infrastructure engineer to help build and scale robust platforms for ML...SeniorLocal areaRemote workRelocationRelocation packageFlexible hours$245k - $295k
...Senior Manager, Infrastructure Platform Engineering Crusoe is on a mission to accelerate the abundance of energy... ...instrumented platform systems from Kubernetes-based orchestration and... ...GPU clusters, AI training, and inference workloads Working knowledge of...SeniorTemporary workImmediate start$184k - $287.5k
Senior Systems Software Engineer - DGX Cloud, NVIDIA NVIDIA is a leader in... ...analysis across the Kubernetes‑based accelerated runtime... ...and cold‑start latency to enable smooth, low‑latency inference scaling on Kubernetes... ...Kubernetes an outstanding platform for AI workloads (e.g...Senior$128k - $176k
A leading technology firm in Santa Clara seeks a DevOps Engineer with a strong background in CI/CD systems and cloud environments. The... ...of experience in DevOps, proficient in tools like Jenkins and Kubernetes, and will play a key role in developing infrastructure and...SeniorFull time- ...recruiting firm is seeking a Site Reliability Engineer to manage and optimize cloud... ...involves maintaining high availability through Kubernetes clusters and improving CI/CD pipelines... ...customer interaction and focuses on improving platform architecture and reliability. #J-18808-...Senior
$172.5k - $306.63k
...effortlessly. The AI for Engineering team builds a scalable, production‑grade AI platform that powers creativity... ..., memory systems, inference services, data flows,... ...strong guarantees around latency, reliability,... ...adaptive AI systems. Mentor senior engineers in modern AI...SeniorLocal area- ...effortlessly. The AI for Engineering team builds a scalable, production‑grade AI platform that powers creativity... ...high‑performance inference and runtime systems with... ...strong guarantees around latency, reliability,... ...adaptive AI systems. Mentor senior engineers in modern AI...Senior
- United States Digital Space LLC in Palo Alto is looking for a Senior Engineer to develop a next-generation inference platform integrated with Atlas. This role involves building scalable infrastructure and collaborating with teams to enhance AI capabilities. Ideal candidates...Senior
$224k - $431.25k
NVIDIA Gruppe is looking for a Senior System Software Engineer for Cloud in Santa Clara, California. You will design, build, and deploy cloud-based... ...with Golang and C++, and a strong background in Kubernetes and cloud infrastructure. NVIDIA offers a competitive salary...Senior$170k - $230k
General Motors is hiring a Senior Platform Engineer to enhance the Autonomous Vehicle (AV) Cloud Engineering team. The role involves building... ...development. Ideal candidates will have a strong background in Kubernetes, Google Cloud, and software engineering principles. The...Senior$152k - $222k
Google is hiring a Platform Customer Engineer in Sunnyvale, CA to help customers leverage the Google Cloud Platform. The ideal candidate will engage... ...account plans, conducting workshops, and optimizing Kubernetes deployments. An attractive compensation package includes a...Senior- ...seeking a world‑class Principal Engineer (Sr Manager‑equivalent) to... ...our Cloud Infrastructure and Platform Engineering (CIPE) organization... ...cloud platforms, mentoring senior engineers and infusing industry... ...technologies (e.g Kubernetes) and CI/CD. Deep proficiency...SeniorFull timeWork at office3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Inference Platform Engineer Kubernetes & Latency. Be the first to apply!
- senior platform engineer Sunnyvale, CA
- platform engineering manager Sunnyvale, CA
- platform developer Sunnyvale, CA
- data platform engineer Sunnyvale, CA
- platform engineer Sunnyvale, CA
- senior cloud service delivery manager Sunnyvale, CA
- senior business analyst contract Sunnyvale, CA
- senior product design engineer Sunnyvale, CA
- senior game producer Sunnyvale, CA
- senior software manager Sunnyvale, CA

