Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Kubernetes Inference Platform Engineer

Jobleads-US

Together AI, the AI Native Cloud, is seeking a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You design a manifest-driven API where the inference team declares needs like clusters, model deployments, or capacity changes, and our controllers handle reconciliation, provider/runtime selection, and lifecycle management underneath.

The role focuses on decoupling operators from runtime complexity, building self-service surfaces, and

#J-18808-Ljbffr Jobleads-US
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Kubernetes Inference Platform Engineer in San Francisco, CA vacancy
  • $300k

     ...startup building an AI and cloud platform, powered by thousands of H100...  ...-scale model training, or inference.  Our client operates high-...  ...tune, and operate inference engines such as vLLM, SGLang, and TensorRT...  ...(CUDA, Triton, NCCL) and Kubernetes orchestration. ~ Practical... 
    Senior
    Permanent employment
    Worldwide
    San Francisco, CA
    more than 2 months ago
  • $200k - $330k

     ...Decagon is the leading conversational AI platform empowering every brand to deliver...  ...team. About the Team The Security Engineering team at Decagon protects the platform that...  ...container deployment, service mesh, and Kubernetes security best practices ~... 
    Senior
    Full time
    Work at office
    Local area

    Decagon AI, Inc.

    San Francisco, CA
    3 days ago
  • $160k - $280k

     ...the Role We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API...  ...the people building on top of the platform from the operational and runtime complexity... 
    Senior
    Full time

    Jobleads-US

    San Francisco, CA
    3 days ago
  •  ...Leadout Capital in San Francisco is seeking a Cloud & DevOps Engineer, Senior Member of Technical Staff (SMTS), to design, build, automate...  ...secure, scalable cloud infrastructure and production platforms. You will work with software engineers, infrastructure teams... 
    Senior

    Jobleads-US

    San Francisco, CA
    5 days ago
  •  ...Cloud Platform Engineer Opportunity At Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies. By uniting applied AI research, flexible...  ...field. Extensive experience with Kubernetes. Experience in building and maintaining... 
    Suggested
    Flexible hours

    CapitalG

    San Francisco, CA
    5 days ago
  •  ...Job Description Job Description Senior Veritas eDiscovery Platform (eDP) Engineer Employment Type: Full-Time, Executive-Level Department: Legal      CGS is seeking a dedicated Senior Veritas eDiscovery Platform (eDP) Engineer to join a fast-paced and hard-... 
    Senior
    Full time
    For contractors
    Remote work
    Flexible hours

    Contact Government Services, LLC

    San Francisco, CA
    8 days ago
  • $181.2k

     ...Description It all started when engineer Fred Luddy wrote code that...  ...reinvention. Our ServiceNow AI platform brings together any AI, any...  ...considered. About the team As a Senior Staff Software Engineer with...  ...and operating workloads on Kubernetes. ~ Working experience with... 
    Senior
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    San Francisco, CA
    4 days ago
  •  ...Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San Francisco ·...  ...and where it’s needed most. Our platform routes training and inference jobs across global supply, unlocking...  ...syscall and hardware level. Kubernetes & Orchestration: Strong... 
    Senior
    Full time
    Remote work

    Andromeda

    San Francisco, CA
    2 days ago
  • $182k - $242k

     ...pioneers, CoreWeave delivers a platform of technology, tools, and...  ...of the largest GPU-based Kubernetes clusters, for the most...  ..., in the world. As a Senior Specialist Field Engineer for Kubernetes, you'll help...  ...run training and inference on those clusters, and get... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    San Francisco, CA
    29 days ago
  • $160k - $250k

     ...Deploy is an intelligence infrastructure platform that gives developers and enterprises...  ..., Deploy operates an optimized model inference engine that keeps costs and latency low while...  ...Container Orchestrators - Mesosphere/Kubernetes Scripting Languages - Python/Ruby/Node... 
    Senior

    Hive

    San Francisco, CA
    5 days ago
  • $145k - $170k

     ...cost GPU compute power. As a Cloud Support Engineer, you'll play a crucial role in...  ...Experience with container orchestration (e.g., Kubernetes), workload management (e.g., Slurm, Terraform...  ...: Familiarity with other public cloud platforms (e.g., AWS, Azure, GCP).... 
    Senior
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    26 days ago
  • $250k - $300k

     ...Crusoe. About the Role: As a Senior Engineering Manager, you will lead an engineering...  ...deeply technical and hands-on with the inference stack end to end: profiling performance...  ...systems. Experience with Docker and Kubernetes. Prior work building or tuning AI/... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    17 days ago
  • $185.5k - $232k

     ...Inc., has built technology platforms, processes, and...  ...About The Position As a Senior Site Reliability Engineer at Formation Bio, you will...  ...data systems, ML pipelines, inference, and agentic software....  ...experience with Docker, GitHub, Kubernetes, Python, Terraform or... 
    Senior
    Work experience placement
    Work at office
    Local area
    3 days per week

    Formation Bio

    San Francisco, CA
    5 days ago
  • Block, Inc. in San Francisco is seeking a skilled Machine Learning Engineer to join our Risk and Trust team. This role focuses on creating and maintaining model development infrastructure to support a decentralized financial ecosystem. The ideal candidate will have substantial... 
    Senior

    Block, Inc.

    San Francisco, CA
    3 days ago
  • $194k - $266k

     ...Cloudflare’s critical internal services run on Kubernetes. These services include those...  ...manage our global network. These Kubernetes platforms are purpose-built from the ground up and...  ...run parts of the global Internet. As an engineer on the Kubernetes platform team, you'll... 
    Senior
    Full time
    Temporary work
    Local area
    Flexible hours

    Cloudflare_

    San Francisco, CA
    18 hours ago
  •  .... Work directly with Kubernetes APIs, GitOps controllers...  ...with backend and platform teams for use in the frontend...  ...practices as an early engineering team member. What We'...  ...We're looking for a Senior Infrastructure/SRE...  ...Background working with AI inference or training companies... 

    Aranya Inc.

    San Francisco, CA
    2 days ago
  •  ...Systems Administrator / DevOps Engineer, you will maintain and build...  ...our model training and our inference cloud. You’ll split your...  ...reliability of our inference platform. What We’re Looking For...  ...orchestration systems (Slurm, Kubernetes) Experience running... 
    Work at office
    Remote work
    Relocation package

    Zyphra

    San Francisco, CA
    25 days ago
  •  ...Job Description Job Description JOB DESCRIPTION The Job As a Senior Platform Engineer at Panther Labs, you will be part of a team designing and delivering Panther’s core platform and infrastructure for our product, which includes areas like automation, CI/CD... 
    Senior

    Hired Recruiters

    San Francisco, CA
    more than 2 months ago
  • $208k - $260k

     ...institutions Work together with engineers, scientists, operators, and more...  ...The Role Handshake is hiring a Senior Software Engineer to join Backend Platform, with an initial focus on supporting...  ...uses technologies including GCP, Kubernetes, Terraform, and Docker. ~... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    22 days ago
  • $149.8k - $262.2k

     ...Description It all started when engineer Fred Luddy wrote code that...  ...reinvention. Our ServiceNow AI platform brings together any AI, any...  ...the team: We are seeking a Senior Staff Software Engineer (IC5...  ...streaming, and key-value stores — on Kubernetes, and serves as the technical... 
    Senior
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    San Francisco, CA
    3 days ago
  •  ...Passionate Engineer Opportunity Passionate engineer who is interested to work in an early-stage startup building innovative cloud...  ...Experience in container and clustering technologies like ECS, Docker, Kubernetes and Helm Experience in version control systems like GitHub,... 
    Senior

    Omniwyse Inc

    San Francisco, CA
    5 days ago
  •  ...Cloud Network & Reliability Engineer to lead the architecture, reliability...  ...organization. This is a senior hands-on technical role...  ...infrastructure automation, and platform architecture across AWS, GCP,...  .... Experience operating Kubernetes or adjacent cloud-platform infrastructure... 
    Permanent employment
    Immediate start

    Jobleads-US

    San Francisco, CA
    6 days ago
  •  ...infrastructure behind some of the most impactful research in the country.   About the Role We are looking for a skilled Kubernetes Platform Engineer to join our Platform Engineering team. In this hands-on individual contributor role, you will be at the heart of our... 
    Contract work

    LTD Global

    Berkeley, CA
    more than 2 months ago
  •  ...About the role Rippling AI is becoming a foundational platform across the company, powering everything from intelligent agents...  ...experiences. As we rapidly scale adoption, we\'re looking for an Engineering Manager to lead a critical AI Platform Infrastructure team... 
    Senior
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    3 days ago
  • $180k - $230k

     ...Senior DevOps Engineer We're seeking a Senior DevOps Engineer to design, build, and operate the...  ...operational tooling that support our platform. In this role, you will own critical...  ...repeatable deployment Manage and optimize Kubernetes clusters to ensure high availability,... 
    Senior

    Arena Club

    San Francisco, CA
    2 days ago
  •  ...Senior DevOps Engineer Skyfire empowers AI to present verified identities, access essential services...  ...of all kinds including LLMs, data platforms, websites, and API services, we're...  ...grade resilience : Have you managed Kubernetes clusters in production? How do you handle... 
    Senior
    Work at office
    Shift work

    Skyfire

    San Francisco, CA
    5 days ago
  • $213k - $229k

     ...As a Site Reliability Engineer at Material Security, you'll own the reliability of the infrastructure every product team builds on, including GCP, Kubernetes, and Postgres across hundreds of GCP projects. This is a software engineering role, where you’ll be building systems... 
    Senior
    Work at office
    Remote work

    Material Security, Inc.

    San Francisco, CA
    4 days ago
  •  ...people around the world come to our platform to find creative ideas, dream about...  ...Pinterest is seeking a Manager II, Engineering to lead our Kubernetes Platform team. The team builds and operates...  ..., and develop engineers; empower senior technical leaders; and sustain an... 
    Full time

    Pinterest

    San Francisco, CA
    17 days ago
  • $180k - $220k

     ...Looking For We're looking for a senior infrastructure engineer with real security and compliance depth...  ...and own our security and compliance platform as your area of the team's scope....  ...member of the DevOps team on our Cloud, Kubernetes, and Terraform platform, including... 
    Senior

    Supio

    San Francisco, CA
    5 days ago
  • $158k - $200k

     ...is an AI document generation platform for life sciences. We automate...  ...Lever. Our AI researchers, engineers, and designers have worked at...  ...infrastructure is hosted on AWS with Kubernetes for orchestration and...  ...Francisco) SWE: $158-200K; Senior SWE: $188-250K; Staff SWE: $2... 

    Collate

    San Francisco, CA
    29 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Kubernetes Inference Platform Engineer. Be the first to apply!