Senior Kubernetes Inference Platform Engineer
Jobleads-US
Together AI, the AI Native Cloud, is seeking a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You design a manifest-driven API where the inference team declares needs like clusters, model deployments, or capacity changes, and our controllers handle reconciliation, provider/runtime selection, and lifecycle management underneath.
The role focuses on decoupling operators from runtime complexity, building self-service surfaces, and
#J-18808-Ljbffr Jobleads-US$300k
...startup building an AI and cloud platform, powered by thousands of H100... ...-scale model training, or inference. Our client operates high-... ...tune, and operate inference engines such as vLLM, SGLang, and TensorRT... ...(CUDA, Triton, NCCL) and Kubernetes orchestration. ~ Practical...SeniorPermanent employmentWorldwide$200k - $330k
...Decagon is the leading conversational AI platform empowering every brand to deliver... ...team. About the Team The Security Engineering team at Decagon protects the platform that... ...container deployment, service mesh, and Kubernetes security best practices ~...SeniorFull timeWork at officeLocal area$160k - $280k
...the Role We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API... ...the people building on top of the platform from the operational and runtime complexity...SeniorFull time- ...Leadout Capital in San Francisco is seeking a Cloud & DevOps Engineer, Senior Member of Technical Staff (SMTS), to design, build, automate... ...secure, scalable cloud infrastructure and production platforms. You will work with software engineers, infrastructure teams...Senior
- ...Cloud Platform Engineer Opportunity At Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies. By uniting applied AI research, flexible... ...field. Extensive experience with Kubernetes. Experience in building and maintaining...SuggestedFlexible hours
- ...Job Description Job Description Senior Veritas eDiscovery Platform (eDP) Engineer Employment Type: Full-Time, Executive-Level Department: Legal CGS is seeking a dedicated Senior Veritas eDiscovery Platform (eDP) Engineer to join a fast-paced and hard-...SeniorFull timeFor contractorsRemote workFlexible hours
$181.2k
...Description It all started when engineer Fred Luddy wrote code that... ...reinvention. Our ServiceNow AI platform brings together any AI, any... ...considered. About the team As a Senior Staff Software Engineer with... ...and operating workloads on Kubernetes. ~ Working experience with...SeniorPermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week- ...Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San Francisco ·... ...and where it’s needed most. Our platform routes training and inference jobs across global supply, unlocking... ...syscall and hardware level. Kubernetes & Orchestration: Strong...SeniorFull timeRemote work
$182k - $242k
...pioneers, CoreWeave delivers a platform of technology, tools, and... ...of the largest GPU-based Kubernetes clusters, for the most... ..., in the world. As a Senior Specialist Field Engineer for Kubernetes, you'll help... ...run training and inference on those clusters, and get...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$160k - $250k
...Deploy is an intelligence infrastructure platform that gives developers and enterprises... ..., Deploy operates an optimized model inference engine that keeps costs and latency low while... ...Container Orchestrators - Mesosphere/Kubernetes Scripting Languages - Python/Ruby/Node...Senior$145k - $170k
...cost GPU compute power. As a Cloud Support Engineer, you'll play a crucial role in... ...Experience with container orchestration (e.g., Kubernetes), workload management (e.g., Slurm, Terraform... ...: Familiarity with other public cloud platforms (e.g., AWS, Azure, GCP)....SeniorFull timeTemporary work$250k - $300k
...Crusoe. About the Role: As a Senior Engineering Manager, you will lead an engineering... ...deeply technical and hands-on with the inference stack end to end: profiling performance... ...systems. Experience with Docker and Kubernetes. Prior work building or tuning AI/...SeniorTemporary work$185.5k - $232k
...Inc., has built technology platforms, processes, and... ...About The Position As a Senior Site Reliability Engineer at Formation Bio, you will... ...data systems, ML pipelines, inference, and agentic software.... ...experience with Docker, GitHub, Kubernetes, Python, Terraform or...SeniorWork experience placementWork at officeLocal area3 days per week- Block, Inc. in San Francisco is seeking a skilled Machine Learning Engineer to join our Risk and Trust team. This role focuses on creating and maintaining model development infrastructure to support a decentralized financial ecosystem. The ideal candidate will have substantial...Senior
$194k - $266k
...Cloudflare’s critical internal services run on Kubernetes. These services include those... ...manage our global network. These Kubernetes platforms are purpose-built from the ground up and... ...run parts of the global Internet. As an engineer on the Kubernetes platform team, you'll...SeniorFull timeTemporary workLocal areaFlexible hours- .... Work directly with Kubernetes APIs, GitOps controllers... ...with backend and platform teams for use in the frontend... ...practices as an early engineering team member. What We'... ...We're looking for a Senior Infrastructure/SRE... ...Background working with AI inference or training companies...
- ...Systems Administrator / DevOps Engineer, you will maintain and build... ...our model training and our inference cloud. You’ll split your... ...reliability of our inference platform. What We’re Looking For... ...orchestration systems (Slurm, Kubernetes) Experience running...Work at officeRemote workRelocation package
- ...Job Description Job Description JOB DESCRIPTION The Job As a Senior Platform Engineer at Panther Labs, you will be part of a team designing and delivering Panther’s core platform and infrastructure for our product, which includes areas like automation, CI/CD...Senior
$208k - $260k
...institutions Work together with engineers, scientists, operators, and more... ...The Role Handshake is hiring a Senior Software Engineer to join Backend Platform, with an initial focus on supporting... ...uses technologies including GCP, Kubernetes, Terraform, and Docker. ~...SeniorFull timeWork at officeRemote workFlexible hours$149.8k - $262.2k
...Description It all started when engineer Fred Luddy wrote code that... ...reinvention. Our ServiceNow AI platform brings together any AI, any... ...the team: We are seeking a Senior Staff Software Engineer (IC5... ...streaming, and key-value stores — on Kubernetes, and serves as the technical...SeniorPermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week- ...Passionate Engineer Opportunity Passionate engineer who is interested to work in an early-stage startup building innovative cloud... ...Experience in container and clustering technologies like ECS, Docker, Kubernetes and Helm Experience in version control systems like GitHub,...Senior
- ...Cloud Network & Reliability Engineer to lead the architecture, reliability... ...organization. This is a senior hands-on technical role... ...infrastructure automation, and platform architecture across AWS, GCP,... .... Experience operating Kubernetes or adjacent cloud-platform infrastructure...Permanent employmentImmediate start
- ...infrastructure behind some of the most impactful research in the country. About the Role We are looking for a skilled Kubernetes Platform Engineer to join our Platform Engineering team. In this hands-on individual contributor role, you will be at the heart of our...Contract work
- ...About the role Rippling AI is becoming a foundational platform across the company, powering everything from intelligent agents... ...experiences. As we rapidly scale adoption, we\'re looking for an Engineering Manager to lead a critical AI Platform Infrastructure team...SeniorWork at office3 days per week
$180k - $230k
...Senior DevOps Engineer We're seeking a Senior DevOps Engineer to design, build, and operate the... ...operational tooling that support our platform. In this role, you will own critical... ...repeatable deployment Manage and optimize Kubernetes clusters to ensure high availability,...Senior- ...Senior DevOps Engineer Skyfire empowers AI to present verified identities, access essential services... ...of all kinds including LLMs, data platforms, websites, and API services, we're... ...grade resilience : Have you managed Kubernetes clusters in production? How do you handle...SeniorWork at officeShift work
$213k - $229k
...As a Site Reliability Engineer at Material Security, you'll own the reliability of the infrastructure every product team builds on, including GCP, Kubernetes, and Postgres across hundreds of GCP projects. This is a software engineering role, where you’ll be building systems...SeniorWork at officeRemote work- ...people around the world come to our platform to find creative ideas, dream about... ...Pinterest is seeking a Manager II, Engineering to lead our Kubernetes Platform team. The team builds and operates... ..., and develop engineers; empower senior technical leaders; and sustain an...Full time
$180k - $220k
...Looking For We're looking for a senior infrastructure engineer with real security and compliance depth... ...and own our security and compliance platform as your area of the team's scope.... ...member of the DevOps team on our Cloud, Kubernetes, and Terraform platform, including...Senior$158k - $200k
...is an AI document generation platform for life sciences. We automate... ...Lever. Our AI researchers, engineers, and designers have worked at... ...infrastructure is hosted on AWS with Kubernetes for orchestration and... ...Francisco) SWE: $158-200K; Senior SWE: $188-250K; Staff SWE: $2...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Kubernetes Inference Platform Engineer. Be the first to apply!
- platform engineering manager San Francisco, CA
- platform developer San Francisco, CA
- senior platform engineer San Francisco, CA
- platform engineer San Francisco, CA
- client platform engineer San Francisco, CA
- data platform engineer San Francisco, CA
- senior associate vice president San Francisco, CA
- senior manager accounts payable San Francisco, CA
- senior cloud service delivery manager San Francisco, CA
- senior service engineer San Francisco, CA





