Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Inference Platform Engineer Kubernetes & Latency

$165k - $242k

CoreWeave

A cloud service provider is seeking a Senior Software Engineer II for their Inference team in Sunnyvale, California. In this role, you'll lead design reviews, implement optimizations, and improve service reliability. The ideal candidate has extensive experience with distributed systems, strong Python/Go skills, and Kubernetes expertise. This position offers a competitive salary between $165,000 to $242,000, plus generous benefits and a hybrid working environment. #J-18808-Ljbffr CoreWeave

Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Senior Inference Platform Engineer Kubernetes & Latency in Sunnyvale, CA vacancy
  • Cerebras is seeking a Software Engineer to join our Inference Platform team in Sunnyvale, California. This role involves developing and leading projects that integrate cloud and ML components. You will contribute to shaping the technical direction and improve system performance... 
    Senior

    Cerebras

    Sunnyvale, CA
    1 day ago
  • A leading data platform company in Palo Alto seeks a Senior Engineer to develop a cutting-edge inference platform supporting semantic search and AI-native experiences. The ideal candidate will have over five years of experience in backend systems and proficiency in languages... 
    Senior

    MongoDB

    Palo Alto, CA
    14 hours ago
  • $126k - $248k

     ...the Role We’re looking for a Senior Engineer to help build the next‑generation inference platform that supports embedding models...  ...infrastructure for real‑time, low‑latency, and high‑scale inference —...  ...container orchestration with Kubernetes Who You Are 5+ years of experience... 
    Senior
    Local area

    The Consulting Solutions

    Palo Alto, CA
    2 days ago
  • A leading technology company is looking for a Java SRE Engineer to support large-scale cloud migrations and production systems on AWS and Kubernetes. You will lead migrations, design robust AWS EKS platforms, and implement deployment strategies. The ideal candidate has... 
    Senior

    EITACIES Inc.

    Santa Clara, CA
    3 days ago
  •  ...technology company in Mountain View is seeking a candidate with hands-on experience in building multi-tenant SaaS platforms. The role requires knowledge of Kubernetes, cloud services (AWS/GCP/Azure), and the ability to integrate AI tools for enhancing productivity.... 
    Senior

    ThoughtSpot

    Mountain View, CA
    3 days ago
  • A tech company is seeking a Senior DevOps Engineer to enhance and automate its infrastructure for a site-builder platform. This position focuses on creating robust CI/CD pipelines and production-ready Kubernetes environments. The ideal candidate will have substantial experience... 
    Senior

    TechDigital Group

    Santa Clara, CA
    4 days ago
  • $126k - $203.5k

    Palo Alto Networks, Inc. is seeking a Senior Staff Production Engineer to design and build foundational cloud platform capabilities. This role involves working with infrastructure...  ...as AWS, Azure, or GCP, and expertise in Kubernetes management. Compensation ranges from $126,00... 
    Senior

    Palo Alto Networks, Inc.

    Santa Clara, CA
    1 day ago
  • Israelvcforum is looking for a Senior ML Infrastructure Engineer in Mountain View, California. This position aims to build and scale robust platforms for ML inference workflows supporting GM’s AI efforts. You will collaborate with ML engineers and researchers to implement... 
    Senior
    Remote job

    Israelvcforum

    Mountain View, CA
    1 day ago
  • CoreWeave is looking for a Senior Engineer specializing in database and stream processing to enhance its data platform. This position offers the opportunity to work with a skilled...  ...in Go or Python, and knowledge of Kubernetes. Embrace collaboration and innovation within... 
    Senior

    Dormont Manufacturing Company

    Sunnyvale, CA
    2 days ago
  • We’re looking for a Senior Engineer to help build the next-generation inference platform that supports embedding models used for...  ...infrastructure for real-time, low-latency, and high-scale inference —...  ...container orchestration with Kubernetes Who You Are 5+ years of experience... 
    Senior
    Local area
    Worldwide

    MongoDB

    Palo Alto, CA
    14 hours ago
  • General Motors is seeking a Senior ML Infrastructure Engineer to build and scale a robust platform for machine learning inference workflows. You will design backend software components, collaborate with ML engineers, and lead initiatives across GM's ML ecosystem. With over... 
    Senior
    Remote job

    General Motors

    Sunnyvale, CA
    3 days ago
  • $262k - $365k

    Senior Engineering Manager AI Inference Platform, Distributed Cloud Location: Sunnyvale, CA, USA Pay US: $262,000 - $365,000 (USD) + 25% bonus target + equity...  ..., maximize resource utilization, and minimize latency. Google is proud to be an equal opportunity and affirmative... 
    Senior

    Google Inc.

    Sunnyvale, CA
    14 hours ago
  • $128.7k - $261.3k

     ...Team The Model Deployment & Inference Solutions team in GM AV deploys...  ...: build the ML deployment platform that makes model rollouts fast...  ...models so they meet the real‑time latency and memory budgets required...  ...performed manually by engineers. Build the developer experience... 
    Senior
    Local area
    Remote work
    Flexible hours
    Shift work

    General Motors

    Mountain View, CA
    14 hours ago
  •  ...Senior Cloud Platform Engineer Own the production inferencing service reliability and...  ...focus will be ensuring our inference endpoints have exceptional uptime, low-latency response times, and efficient...  ...orchestration technologies (Docker, Kubernetes). Deep understanding of... 
    Senior
    Immediate start
    Flexible hours
    Shift work

    jobs.frontdoordefense.com - Jobboard

    Palo Alto, CA
    2 days ago
  • $235k - $250k

     ...maintain critical shared services for our mission-critical SaaS platform. You will be instrumental in enabling teams to deliver...  ...The ideal candidate has 9+ years of relevant experience, deep Kubernetes knowledge, and strong programming skills in Go (Golang). This... 
    Senior

    Medium

    Milpitas, CA
    3 days ago
  • $184k - $356.5k

    NVIDIA Gruppe is seeking a Senior Engineer to lead the evolution of the core NIM Platform SDK and microservice framework in Santa Clara, California. This hands-on role involves architecting significant new features and solving complex engineering challenges. The ideal... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  •  ...Sunnyvale We're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns...  ...system-level improvements in latency, throughput, capacity...  ...distributed systems ideally with Kubernetes. Experience building highly available... 

    Cerebras

    Sunnyvale, CA
    1 day ago
  • $230k - $250k

     ...involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a...  ...and experience with containerization tools like Docker and Kubernetes. A competitive salary between $230,000 and $250,000 is offered... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    14 hours ago
  • $155.42k - $395.9k

    Job Description About the Team: The ML Inference Platform is part of the AV ML Infrastructure organization. Our team owns the cloud...  ...cost efficiency. About the Role: We are seeking a Senior ML Infrastructure engineer to help build and scale robust platforms for ML... 
    Senior
    Local area
    Remote work
    Relocation
    Relocation package
    Flexible hours

    Israelvcforum

    Mountain View, CA
    1 day ago
  • $245k - $295k

     ...Senior Manager, Infrastructure Platform Engineering Crusoe is on a mission to accelerate the abundance of energy...  ...instrumented platform systems from Kubernetes-based orchestration and...  ...GPU clusters, AI training, and inference workloads Working knowledge of... 
    Senior
    Temporary work
    Immediate start

    Crusoe

    Sunnyvale, CA
    2 days ago
  • $184k - $287.5k

    Senior Systems Software Engineer - DGX Cloud, NVIDIA NVIDIA is a leader in...  ...analysis across the Kubernetes‑based accelerated runtime...  ...and cold‑start latency to enable smooth, low‑latency inference scaling on Kubernetes...  ...Kubernetes an outstanding platform for AI workloads (e.g... 
    Senior

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • $128k - $176k

    A leading technology firm in Santa Clara seeks a DevOps Engineer with a strong background in CI/CD systems and cloud environments. The...  ...of experience in DevOps, proficient in tools like Jenkins and Kubernetes, and will play a key role in developing infrastructure and... 
    Senior
    Full time

    Victrays

    Santa Clara, CA
    3 days ago
  •  ...recruiting firm is seeking a Site Reliability Engineer to manage and optimize cloud...  ...involves maintaining high availability through Kubernetes clusters and improving CI/CD pipelines...  ...customer interaction and focuses on improving platform architecture and reliability. #J-18808-... 
    Senior

    Amiri Recruiting

    Mountain View, CA
    3 days ago
  • $172.5k - $306.63k

     ...effortlessly. The AI for Engineering team builds a scalable, production‑grade AI platform that powers creativity...  ..., memory systems, inference services, data flows,...  ...strong guarantees around latency, reliability,...  ...adaptive AI systems. Mentor senior engineers in modern AI... 
    Senior
    Local area

    Dormont Manufacturing Company

    San Jose, CA
    2 days ago
  •  ...effortlessly. The AI for Engineering team builds a scalable, production‑grade AI platform that powers creativity...  ...high‑performance inference and runtime systems with...  ...strong guarantees around latency, reliability,...  ...adaptive AI systems. Mentor senior engineers in modern AI... 
    Senior

    Adobe

    San Jose, CA
    1 day ago
  • United States Digital Space LLC in Palo Alto is looking for a Senior Engineer to develop a next-generation inference platform integrated with Atlas. This role involves building scalable infrastructure and collaborating with teams to enhance AI capabilities. Ideal candidates... 
    Senior

    United States Digital Space LLC

    Palo Alto, CA
    1 day ago
  • $224k - $431.25k

    NVIDIA Gruppe is looking for a Senior System Software Engineer for Cloud in Santa Clara, California. You will design, build, and deploy cloud-based...  ...with Golang and C++, and a strong background in Kubernetes and cloud infrastructure. NVIDIA offers a competitive salary... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  • $170k - $230k

    General Motors is hiring a Senior Platform Engineer to enhance the Autonomous Vehicle (AV) Cloud Engineering team. The role involves building...  ...development. Ideal candidates will have a strong background in Kubernetes, Google Cloud, and software engineering principles. The... 
    Senior

    General Motors

    Sunnyvale, CA
    1 day ago
  • $152k - $222k

    Google is hiring a Platform Customer Engineer in Sunnyvale, CA to help customers leverage the Google Cloud Platform. The ideal candidate will engage...  ...account plans, conducting workshops, and optimizing Kubernetes deployments. An attractive compensation package includes a... 
    Senior

    Google

    Sunnyvale, CA
    1 day ago
  •  ...seeking a world‑class Principal Engineer (Sr Manager‑equivalent) to...  ...our Cloud Infrastructure and Platform Engineering (CIPE) organization...  ...cloud platforms, mentoring senior engineers and infusing industry...  ...technologies (e.g Kubernetes) and CI/CD. Deep proficiency... 
    Senior
    Full time
    Work at office
    3 days per week

    Palo Alto Networks

    Santa Clara, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Inference Platform Engineer Kubernetes & Latency. Be the first to apply!