Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, Kubernetes AI Inference

$161k - $239k

Google

Minimum qualifications: Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages (e.g., Java, C/C++, Python, or Go), and with data structures/algorithms. 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture. 3 years of experience in AI/ML related engineering, developing, deploying, managing, and maintaining Machine Learning infrastructure, or managing and maintaining a production-ready Kubernetes environment. 1 year of experience with developing infrastructure, distributed systems. Preferred qualifications: Master's degree or PhD in Computer Science or related technical field. 3 years of experience working in an organization involving cross-functional or cross-business projects. Experience with open-source development and community engagement. Experience running ML platforms. Knowledge of Kubernetes and AI inference workloads. About the job Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. In this role, you will be working in Google Kubernetes Engine and Kubernetes Open Source community, interacting with customers, and internal and external industry leads. Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. The US base salary range for this full-time position is $161,000-$239,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google. Responsibilities Write and test product or system development code. Lead design reviews with peers and stakeholders to decide on available technologies. Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency). Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality. #J-18808-Ljbffr Google

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, Kubernetes AI Inference in Seattle, WA vacancy
  • $300k

     ...interpretable, and steerable AI systems. We want AI to...  ...researchers, engineers, policy experts, and business...  ...Role The Cloud Inference team scales and...  ...Have significant software engineering experience...  ...Azure), with exposure to Kubernetes, Infrastructure as Code... 
    Senior
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    Seattle, WA
    21 hours ago
  • $168.1k - $227.4k

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium...  ...accelerators. This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is...  ...production on GPUs, Neuron, TPU or other AI acceleration hardware.Amazon is... 
    Senior
    Work experience placement
    Flexible hours

    Amazon

    Seattle, WA
    1 day ago
  • $184k - $287.5k

     ...unlimited potential of AI to define the next...  ...edge hardware and software innovation to...  ...forward‑thinking engineers tackling some of the...  ...searching for a Senior Systems Software Engineer...  ...systems, Kubernetes, containers, and systems...  ..., distributed inference serving, and major... 
    Senior
    Full time
    Remote work

    Nvidia

    Seattle, WA
    4 days ago
  • $92k - $135k

     ...CoreWeave is the AI Hyperscaler™, delivering a cloud platform...  ...What You’ll Do: Join the Inference team to ship production...  ...mentorship from experienced engineers. About the role: Implement...  ...Exposure to containers and Kubernetes (coursework or projects welcome... 
    Suggested
    Permanent employment
    Full time
    Temporary work
    Casual work
    Internship
    Work at office
    Remote work
    Flexible hours

    Coreweave

    Bellevue, WA
    21 hours ago
  • $300k

     ...interpretable, and steerable AI systems. We want AI to...  ...researchers, engineers, policy experts, and business...  ...the role Our Inference team is responsible...  ...Have significant software engineering experience...  ...caching strategies Kubernetes and cloud infrastructure... 
    Suggested
    Full time
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    Anthropic

    Seattle, WA
    21 hours ago
  • $320k

     ...interpretable, and steerable AI systems. We want AI to...  ...researchers, engineers, policy experts, and business...  ...mandate is to make inference deployment boring and...  ...unattended. As a Software Engineer on the Launch...  ...~ Proficiency with Kubernetes-based deployments, rolling... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    Seattle, WA
    21 hours ago
  • $143.7k - $194.4k

     ...forefront of ultra-scale AI/ML infrastructure,...  ...fine-tuning, and agentic inference that's shaping the...  ...backend data store for Kubernetes. EKS etcd team is part...  ...value technically strong engineers who take initiative to...  ...professional software development experience... 
    Internship
    Flexible hours

    Amazon

    Seattle, WA
    4 days ago
  •  ...usher in this new era, we seek AI-native thinkers across...  ...future of how work gets done.Senior Software Engineer — Cortex TrainingThe...  ...orchestration, multi-node training and inference, fault tolerance, and...  ...services and operating them on Kubernetes in production.Familiarity... 
    Senior

    Snowflake

    Bellevue, WA
    3 days ago
  • $184k - $287.5k

     ...merges fresh hardware and software innovations to offer...  ...for the most challenging AI workloads worldwide. Our team of skilled engineers is committed to...  ...world!We are looking for a Senior Systems Software Engineer...  ...with strong experience in Kubernetes node engineering, OS... 
    Senior
    Full time
    Worldwide

    Nvidia

    Seattle, WA
    4 days ago
  • $170k - $253k

    About the RoleNetApp's Cloud AI team is building an...  ...frameworks, and production cloud engineering.We are hiring a Senior Software Engineer to design...  ...building systems that run model inference in production (tool...  ...containerization (Docker, Kubernetes), and infrastructure as... 
    Senior
    Local area

    NetApp

    Bellevue, WA
    21 hours ago
  •  ...-throughput batch inference, and fine-tuning on...  ...for Generative AI at DoorDash, leading...  ...serving and inference engines, fine-tuning and...  ...is ideal for a senior engineer who enjoys...  ...industry experience in software engineeringDeep...  ...with Kubernetes, cloud infrastructure... 
    Senior
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    Seattle, WA
    2 days ago
  • Designworks Talent is seeking an Inference Engineer to build and operate production-grade model-serving and inference systems in a hybrid Bellevue...  ...across distributed systems, GPU optimization, and production AI infrastructure to deliver high-throughput, low-latency... 
    Senior

    Designworks Talent

    Bellevue, WA
    1 day ago
  • NVIDIA is seeking a seasoned engineer to advance LLM inference on edge AI hardware. You’ll evaluate frameworks, map model architectures to GPU, and optimize across multi-node deployments, focusing on performance and stability. You’ll own validation workflows, develop actionable... 
    Senior

    NVIDIA AI

    Seattle, WA
    5 days ago
  • $186.07k - $218.9k

    Coinbase is seeking a Senior Software Engineer to own the compute orchestration infrastructure for our products. You will work within the Compute...  .... The ideal candidate has extensive experience with Kubernetes and cloud infrastructure, and will collaborate with various... 
    Senior

    Coinbase

    Seattle, WA
    5 days ago
  • CoreWeave in Bellevue seeks a Senior Software Engineer II to develop and manage its Kubernetes-native platform for AI workloads. You will be responsible for the design, build, and operation of orchestration services, improving system performance and reliability. The ideal... 
    Senior
    Flexible hours

    CoreWeave

    Bellevue, WA
    5 days ago
  • What You’ll Do As a Senior Software Engineer II (IC4) on the AI Workload Orchestration team, you will help build and operate CoreWeave’s Kubernetes-native platform for admitting, scheduling, and...  ...to support modern AI training and inference workflows. It complements SUNK (... 
    Senior
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Bellevue, WA
    5 days ago
  • $165k - $242k

     ...traffic-shift strategies. Mentor IC1/IC2 engineers; review cross-team designs and elevate...  ...workloads. Hands‑on experience with Kubernetes at production scale, CI/CD, and observability...  ...). Practical knowledge of inference internals: batching, caching, mixed precision... 
    Senior
    Permanent employment
    Temporary work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Bellevue, WA
    5 days ago
  • $139k - $204k

    What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements...  ..., orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours
    Shift work

    CoreWeave

    Bellevue, WA
    5 days ago
  • $140.8k - $176k

     ...the world. We are seeking a Senior Software Engineer (IC3) to join our Customer...  ...instrumental in supporting our AI initiatives, building...  ...reliability, from fine-tuning Kubernetes deployments to migrating...  ...collaborate across teams (Inference, Billing, DOKS). Nice to Have... 
    Senior
    Work experience placement
    Local area
    Worldwide
    Flexible hours

    Dormont Manufacturing Co

    Seattle, WA
    4 days ago
  • $182k - $242k

     ...Essential Cloud for AI™. Built for pioneers...  ...rendering, and real-time inference. Our stack is engineered for speed, scale,...  ...We're looking for a Senior Engineer for...  ...computing, GPU/accelerator software, or performance-...  ...DSL. Experience with Kubernetes at production scale.... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Socket

    Bellevue, WA
    1 day ago
  • $153k - $224k

    CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,...  ...world's largest AI training and inference workloads run on. As a Senior Software Engineer you will build features across...  ...governs them, all delivered through Kubernetes. Storage at CoreWeave sits next... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Coreweave

    Seattle, WA
    2 days ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI. Built for pioneers by...  ...’ll Do Develop and enhance Kubernetes-native benchmarking services...  ...end-to-end MLPerf Training and Inference runs, including workload...  ...within the team. Break down engineering tasks into clear milestones and... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Bellevue, WA
    5 days ago
  • $182k - $266k

    CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,...  ...world's largest AI training and inference workloads run on. As a Senior Software Engineer II you will build and operate...  ...Go and Rust and delivered through Kubernetes. Storage at CoreWeave sits next to... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    2 days ago
  • $165k - $220k

    CoreWeave, the AI Hyperscaler™, acquired Weights...  ...agent building, and inference at scale, we’re...  ...the intersection of software, hardware, and AI, there...  ...Role Reporting to the Senior Engineering Manager for ML Workflows...  ..., containers and Kubernetes, cloud infrastructure... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    Weights & Biases

    Bellevue, WA
    3 days ago
  • NVIDIA in Seattle, WA seeks outstanding AI systems engineers to advance the inference software stack for AI workloads. You will develop libraries, code generators, and GPU kernel technologies for NVIDIA hardware, including new abstractions and runtimes for large language... 
    Senior

    NVIDIA

    Seattle, WA
    3 days ago
  •  ...As a Model Optimization & Deployment Engineer, you will focus on bringing highly efficient...  ...CUDA kernels, and build highly concurrent inference code to ensure real-time, deterministic execution...  ...latency and maximize memory bandwidth on AI accelerators. Write production-level,... 
    Senior
    Temporary work
    Relocation package

    Zoox

    Seattle, WA
    more than 2 months ago
  • $143.7k - $194.4k

    We are looking for a Software Development Engineer to join the EKS KCP Scalability team and work on some...  ...customers — from startups to the largest AI/ML workloads on the planet —...  ...work across the full stack: from the Kubernetes API server process and upstream community... 
    Internship
    Flexible hours
    Shift work

    Amazon

    Seattle, WA
    3 days ago
  • $185k - $210k

     ...CoreWeave is the AI Hyperscaler™, delivering a cloud platform...  .... We are seeking senior observability engineers with specializations in logging...  ...years of experience in a software or infrastructure engineering...  ...You have experience using Kubernetes, a conceptual understanding... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    Coreweave

    Bellevue, WA
    21 hours ago
  • $184k - $287.5k

     ...developing advanced multi-rack, multi-tenant AI/ML datacenters with NVIDIA GB200, and upcoming GB300 GPUs. NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service Provider)...  ...enhancements, and debug the toughest Kubernetes + Slurm issues in multi-rack, multi-... 
    Senior
    Full time
    Remote work

    Nvidia

    Seattle, WA
    21 hours ago
  •  ...will light a fire within you.Senior Software EngineerSeattle,...  ...exceptional Senior Software Engineers to help take it to the next...  ...full-stack engineers who use AI-assisted development not as...  ...environmentsNice to HaveExperience with Kubernetes and Helm for container orchestration... 
    Senior

    NICE Systems

    Seattle, WA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, Kubernetes AI Inference. Be the first to apply!