Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Kubernetes AI Inference

$161k - $239k

Google

Minimum qualifications: Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages (e.g., Java, C/C++, Python, or Go), and with data structures/algorithms. 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture. 3 years of experience in AI/ML related engineering, developing, deploying, managing, and maintaining Machine Learning infrastructure, or managing and maintaining a production-ready Kubernetes environment. 1 year of experience with developing infrastructure, distributed systems. Preferred qualifications: Master's degree or PhD in Computer Science or related technical field. 3 years of experience working in an organization involving cross-functional or cross-business projects. Experience with open-source development and community engagement. Experience running ML platforms. Knowledge of Kubernetes and AI inference workloads. About the job Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. In this role, you will be working in Google Kubernetes Engine and Kubernetes Open Source community, interacting with customers, and internal and external industry leads. Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. The US base salary range for this full-time position is $161,000-$239,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google. Responsibilities Write and test product or system development code. Lead design reviews with peers and stakeholders to decide on available technologies. Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency). Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality. #J-18808-Ljbffr Google

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Kubernetes AI Inference in Seattle, WA vacancy
  • $177.69k - $341.73k

    Senior Software Engineer - Inference Infrastructure Location: Seattle Team: Infrastructure Employment Type:...  ...open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale...  ...internal and external developers to bring AI workloads from research to... 
    Senior
    Temporary work
    Local area

    ByteDance

    Seattle, WA
    3 days ago
  •  ...edge hardware and software innovation to deliver...  ...most adventurous AI workloads. We’re a...  ...of innovative engineers dedicated to solving...  ...for an outstanding Senior Systems Software...  ...technologies such as Kubernetes and containers,...  ...plugins to distributed inference serving and cloud... 
    Senior
    Worldwide

    NVIDIA

    Seattle, WA
    3 days ago
  • Anthropic is seeking a Software Engineer for their Launch Engineering team...  ...deployment infrastructure for their AI systems. The role involves...  ...the deployment of inference code across multiple hardware...  ...engineering skills, proficiency with Kubernetes, and experience in building... 
    Senior

    Anthropic

    Seattle, WA
    3 days ago
  • $184k - $287.5k

    Join NVIDIA's Accelerated Kubernetes Runtime team and be at the forefront of building the...  ...Kubernetes runtime distributions. As a Software Engineer on the Runtime team, you will design and...  ...runtime packages powering NVIDIA's AI Accelerators. You'll work on innovative... 
    Senior

    NVIDIA

    Seattle, WA
    3 days ago
  • Google is looking for a Software Engineer in Sunnyvale, California, to develop next-generation technologies...  ...billions of users. You’ll engage with Kubernetes and influence large-scale system design...  ...development background, especially in AI/ML engineering, with at least 5 years... 
    Senior

    Google

    Seattle, WA
    3 days ago
  • $320k

     ...interpretable, and steerable AI systems. We want AI to...  ...committed researchers, engineers, policy experts, and...  ...’s mandate is to make inference deployment boring and unattended. As a Software Engineer on Launch...  ...pipelines Proficiency with Kubernetes-based deployments,... 
    Senior
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    Seattle, WA
    3 days ago
  • $152k - $241.5k

     ...unlimited potential of AI to define the next...  ...edge hardware and software innovation to...  ...forward‑thinking engineers tackling some of the...  ...searching for a Senior Systems Software Engineer...  ...systems, Kubernetes, containers, and systems...  ..., distributed inference serving, and major... 
    Senior
    Remote work

    NVIDIA

    Seattle, WA
    3 days ago
  • CoreWeave is looking for a Staff Software Engineer to design and operate critical backend services...  ...candidate will have expertise in Go, Kubernetes, Terraform, and PostgreSQL, primarily focusing...  .... Join us at CoreWeave to help drive AI innovation! #J-18808-Ljbffr CoreWeave
    Senior

    CoreWeave

    Bellevue, WA
    3 days ago
  • $131.4k - $176.4k

    LVT is seeking a Senior Cloud Engineer to architect and implement scalable and secure AWS infrastructure for our innovative AI and IoT ecosystems. This role will involve driving automation...  ...containerized workloads via Kubernetes, and developing CI/CD pipelines to streamline... 
    Senior

    LVT

    Seattle, WA
    3 days ago
  • A leading technology firm in Seattle is seeking a Senior Software Engineer for their Inference Infrastructure team. This role focuses on designing and building large-scale cloud-native GPU and AI systems, requiring expertise in container technologies and distributed systems... 
    Senior

    ByteDance

    Seattle, WA
    3 days ago
  • Compa is seeking a Staff Engineer for their Platform team in San Francisco, California...  ...across cloud, data, and AI/ML systems, driving multi-cloud initiatives...  ...candidate has over 8 years of software engineering experience, strong Kubernetes and Python skills, and a passion... 
    Senior

    Compa

    Seattle, WA
    3 days ago
  • A leading technology company in Seattle is seeking a Senior Software Engineer for the CSP Engagements team. This role focuses on cloud-native stacks for AI/ML datacenters, requiring strong expertise in Kubernetes and Slurm. Responsibilities include deep debugging, gathering... 
    Senior

    NVIDIA

    Seattle, WA
    3 days ago
  • A cloud technology company is looking for a Senior Engineer 2 to enhance their AI Inference Optimization team. In this role, you will drive architectural decisions that improve throughput and reduce latency in large models. Candidates should have over 5 years of experience... 
    Senior
    Remote job

    DigitalOcean

    Seattle, WA
    3 days ago
  •  ...usher in this new era, we seek AI-native thinkers across...  ...future of how work gets done. Senior Software Engineer — Cortex Training The...  ...orchestration, multi-node training and inference, fault tolerance, and...  ...and operating them on Kubernetes in production. Familiarity... 
    Senior

    Snowflake Computing

    Bellevue, WA
    3 days ago
  • NVIDIA AI in Seattle is seeking a Senior Systems Software Engineer to lead innovations in Kubernetes node engineering and cloud infrastructure. This role will focus on managing the node layer within NVIDIA Kubernetes Engine, ensuring reliability at AI scale. The ideal candidate... 
    Senior

    NVIDIA AI

    Seattle, WA
    3 days ago
  • $202.16k - $368.22k

     ...Scheduling team uses Kubernetes and Serverless technologies...  ...jobs daily, including AI and LLM workloads. The...  ...on K8s, and the LLM inference control plan project...  ...Computer Science, Computer Engineering or a related area with...  ...large‑scale software systems. Familiarity... 
    Senior
    Temporary work
    Internship
    Local area

    ByteDance

    Seattle, WA
    3 days ago
  • $320k - $405k

    Anthropic, based in New York, is seeking a Senior Kubernetes Engineer. In this role, you will own, operate, and extend the Kubernetes scheduler for our accelerator fleets, ensuring that the control plane scales efficiently and reliably. Your deep Kubernetes expertise will... 
    Senior
    Flexible hours

    Anthropic

    Seattle, WA
    3 days ago
  • $150k - $220k

    Senior Software Engineer (AI Infra) - Seattle, WA (USA) Location: Seattle, WA (United States) Type: Full...  ...systems that power our causal inference engine and intelligent reliability workflows...  ...services (AWS, Azure, GCP) and Kubernetes Experience operating production systems... 
    Senior
    Full time

    Causal Dynamics Lab

    Seattle, WA
    3 days ago
  • $184k - $287.5k

     ...019395 Job Category Engineering Time Type Full time...  ...merges fresh hardware and software innovations to offer...  ...the most challenging AI workloads worldwide. Our...  ...We are looking for a Senior Systems Software...  ...strong experience in Kubernetes node engineering, OS image... 
    Senior
    Full time
    Worldwide

    NVIDIA AI

    Seattle, WA
    3 days ago
  • $186.07k - $218.9k

    Coinbase is seeking a Senior Software Engineer to own the compute orchestration infrastructure for our products. You will work within the Compute...  .... The ideal candidate has extensive experience with Kubernetes and cloud infrastructure, and will collaborate with various... 
    Senior

    Coinbase

    Seattle, WA
    3 days ago
  • $167.2k - $209k

    A pioneering cloud service provider in Seattle seeks a Senior Engineer 2 for its AI Inference Data Plane team. This role requires designing and delivering...  ...expertise in distributed systems, AI/ML, and strong software engineering skills, particularly in GoLang or Python.... 
    Senior
    Remote job

    DigitalOcean

    Seattle, WA
    1 day ago
  •  ...The Essential Cloud for AI™. Built for pioneers...  ...at . About the role Senior Engineers are area owners who lead...  ...to interact with Kubernetes and other infrastructure...  ...proficiency in Go and/or Python software development. Hands‑on...  ...and training / inference Wondering if you’re a... 
    Senior

    Gravity Engineering Services Pvt Ltd.

    Seattle, WA
    3 days ago
  • $165k - $242k

     ...traffic-shift strategies. Mentor IC1/IC2 engineers; review cross-team designs and elevate...  ...workloads. Hands‑on experience with Kubernetes at production scale, CI/CD, and observability...  ...). Practical knowledge of inference internals: batching, caching, mixed precision... 
    Senior
    Permanent employment
    Temporary work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Bellevue, WA
    3 days ago
  • CoreWeave in Bellevue seeks a Senior Software Engineer II to develop and manage its Kubernetes-native platform for AI workloads. You will be responsible for the design, build, and operation of orchestration services, improving system performance and reliability. The ideal... 
    Senior
    Flexible hours

    CoreWeave

    Bellevue, WA
    3 days ago
  • What You’ll Do As a Senior Software Engineer II (IC4) on the AI Workload Orchestration team, you will help build and operate CoreWeave’s Kubernetes-native platform for admitting, scheduling, and...  ...to support modern AI training and inference workflows. It complements SUNK (... 
    Senior
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Bellevue, WA
    3 days ago
  • ByteDance is seeking a Senior Compute Infrastructure Engineer to design and evolve large-scale Kubernetes-based infrastructure for AI/LLM workloads in Seattle. You will improve control and data-plane performance and lead data-driven optimization initiatives across a global... 
    Senior

    ByteDance

    Seattle, WA
    3 days ago
  • $139k - $204k

    What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements...  ..., orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Bellevue, WA
    3 days ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI. Built for pioneers by...  ...’ll Do Develop and enhance Kubernetes-native benchmarking services...  ...end-to-end MLPerf Training and Inference runs, including workload...  ...within the team. Break down engineering tasks into clear milestones and... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Bellevue, WA
    3 days ago
  • $140.8k - $176k

     ...the world. We are seeking a Senior Software Engineer (IC3) to join our Customer...  ...instrumental in supporting our AI initiatives, building...  ...reliability, from fine-tuning Kubernetes deployments to migrating...  ...collaborate across teams (Inference, Billing, DOKS). Nice to Have... 
    Senior
    Work experience placement
    Local area
    Worldwide
    Flexible hours

    Dormont Manufacturing Company

    Seattle, WA
    5 days ago
  • $152k - $241.5k

    NVIDIA in Seattle is looking for a Senior Systems Software Engineer to enhance AI infrastructure. The role involves performance analysis, development of Kubernetes architectures, and collaboration with AI teams and the open-source community. The ideal candidate should... 
    Senior

    NVIDIA

    Seattle, WA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Kubernetes AI Inference. Be the first to apply!