Senior Software Engineer, Kubernetes AI Inference
$161k - $239kMinimum qualifications: Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages (e.g., Java, C/C++, Python, or Go), and with data structures/algorithms. 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture. 3 years of experience in AI/ML related engineering, developing, deploying, managing, and maintaining Machine Learning infrastructure, or managing and maintaining a production-ready Kubernetes environment. 1 year of experience with developing infrastructure, distributed systems. Preferred qualifications: Master's degree or PhD in Computer Science or related technical field. 3 years of experience working in an organization involving cross-functional or cross-business projects. Experience with open-source development and community engagement. Experience running ML platforms. Knowledge of Kubernetes and AI inference workloads. About the job Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. In this role, you will be working in Google Kubernetes Engine and Kubernetes Open Source community, interacting with customers, and internal and external industry leads. Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. The US base salary range for this full-time position is $161,000-$239,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google. Responsibilities Write and test product or system development code. Lead design reviews with peers and stakeholders to decide on available technologies. Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency). Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality. #J-18808-Ljbffr Google
$177.69k - $341.73k
Senior Software Engineer - Inference Infrastructure Location: Seattle Team: Infrastructure Employment Type:... ...open-source maintainer of AIBrix, a Kubernetes-native control plane for large-scale... ...internal and external developers to bring AI workloads from research to...SeniorTemporary workLocal area- ...edge hardware and software innovation to deliver... ...most adventurous AI workloads. We’re a... ...of innovative engineers dedicated to solving... ...for an outstanding Senior Systems Software... ...technologies such as Kubernetes and containers,... ...plugins to distributed inference serving and cloud...SeniorWorldwide
- Anthropic is seeking a Software Engineer for their Launch Engineering team... ...deployment infrastructure for their AI systems. The role involves... ...the deployment of inference code across multiple hardware... ...engineering skills, proficiency with Kubernetes, and experience in building...Senior
$184k - $287.5k
Join NVIDIA's Accelerated Kubernetes Runtime team and be at the forefront of building the... ...Kubernetes runtime distributions. As a Software Engineer on the Runtime team, you will design and... ...runtime packages powering NVIDIA's AI Accelerators. You'll work on innovative...Senior- Google is looking for a Software Engineer in Sunnyvale, California, to develop next-generation technologies... ...billions of users. You’ll engage with Kubernetes and influence large-scale system design... ...development background, especially in AI/ML engineering, with at least 5 years...Senior
$320k
...interpretable, and steerable AI systems. We want AI to... ...committed researchers, engineers, policy experts, and... ...’s mandate is to make inference deployment boring and unattended. As a Software Engineer on Launch... ...pipelines Proficiency with Kubernetes-based deployments,...SeniorWork at officeVisa sponsorshipFlexible hoursShift work$152k - $241.5k
...unlimited potential of AI to define the next... ...edge hardware and software innovation to... ...forward‑thinking engineers tackling some of the... ...searching for a Senior Systems Software Engineer... ...systems, Kubernetes, containers, and systems... ..., distributed inference serving, and major...SeniorRemote work- CoreWeave is looking for a Staff Software Engineer to design and operate critical backend services... ...candidate will have expertise in Go, Kubernetes, Terraform, and PostgreSQL, primarily focusing... .... Join us at CoreWeave to help drive AI innovation! #J-18808-Ljbffr CoreWeaveSenior
$131.4k - $176.4k
LVT is seeking a Senior Cloud Engineer to architect and implement scalable and secure AWS infrastructure for our innovative AI and IoT ecosystems. This role will involve driving automation... ...containerized workloads via Kubernetes, and developing CI/CD pipelines to streamline...Senior- A leading technology firm in Seattle is seeking a Senior Software Engineer for their Inference Infrastructure team. This role focuses on designing and building large-scale cloud-native GPU and AI systems, requiring expertise in container technologies and distributed systems...Senior
- Compa is seeking a Staff Engineer for their Platform team in San Francisco, California... ...across cloud, data, and AI/ML systems, driving multi-cloud initiatives... ...candidate has over 8 years of software engineering experience, strong Kubernetes and Python skills, and a passion...Senior
- A leading technology company in Seattle is seeking a Senior Software Engineer for the CSP Engagements team. This role focuses on cloud-native stacks for AI/ML datacenters, requiring strong expertise in Kubernetes and Slurm. Responsibilities include deep debugging, gathering...Senior
- A cloud technology company is looking for a Senior Engineer 2 to enhance their AI Inference Optimization team. In this role, you will drive architectural decisions that improve throughput and reduce latency in large models. Candidates should have over 5 years of experience...SeniorRemote job
- ...usher in this new era, we seek AI-native thinkers across... ...future of how work gets done. Senior Software Engineer — Cortex Training The... ...orchestration, multi-node training and inference, fault tolerance, and... ...and operating them on Kubernetes in production. Familiarity...Senior
- NVIDIA AI in Seattle is seeking a Senior Systems Software Engineer to lead innovations in Kubernetes node engineering and cloud infrastructure. This role will focus on managing the node layer within NVIDIA Kubernetes Engine, ensuring reliability at AI scale. The ideal candidate...Senior
$202.16k - $368.22k
...Scheduling team uses Kubernetes and Serverless technologies... ...jobs daily, including AI and LLM workloads. The... ...on K8s, and the LLM inference control plan project... ...Computer Science, Computer Engineering or a related area with... ...large‑scale software systems. Familiarity...SeniorTemporary workInternshipLocal area$320k - $405k
Anthropic, based in New York, is seeking a Senior Kubernetes Engineer. In this role, you will own, operate, and extend the Kubernetes scheduler for our accelerator fleets, ensuring that the control plane scales efficiently and reliably. Your deep Kubernetes expertise will...SeniorFlexible hours$150k - $220k
Senior Software Engineer (AI Infra) - Seattle, WA (USA) Location: Seattle, WA (United States) Type: Full... ...systems that power our causal inference engine and intelligent reliability workflows... ...services (AWS, Azure, GCP) and Kubernetes Experience operating production systems...SeniorFull time$184k - $287.5k
...019395 Job Category Engineering Time Type Full time... ...merges fresh hardware and software innovations to offer... ...the most challenging AI workloads worldwide. Our... ...We are looking for a Senior Systems Software... ...strong experience in Kubernetes node engineering, OS image...SeniorFull timeWorldwide$186.07k - $218.9k
Coinbase is seeking a Senior Software Engineer to own the compute orchestration infrastructure for our products. You will work within the Compute... .... The ideal candidate has extensive experience with Kubernetes and cloud infrastructure, and will collaborate with various...Senior$167.2k - $209k
A pioneering cloud service provider in Seattle seeks a Senior Engineer 2 for its AI Inference Data Plane team. This role requires designing and delivering... ...expertise in distributed systems, AI/ML, and strong software engineering skills, particularly in GoLang or Python....SeniorRemote job- ...The Essential Cloud for AI™. Built for pioneers... ...at . About the role Senior Engineers are area owners who lead... ...to interact with Kubernetes and other infrastructure... ...proficiency in Go and/or Python software development. Hands‑on... ...and training / inference Wondering if you’re a...Senior
$165k - $242k
...traffic-shift strategies. Mentor IC1/IC2 engineers; review cross-team designs and elevate... ...workloads. Hands‑on experience with Kubernetes at production scale, CI/CD, and observability... ...). Practical knowledge of inference internals: batching, caching, mixed precision...SeniorPermanent employmentTemporary workWork at officeRemote workFlexible hoursShift work- CoreWeave in Bellevue seeks a Senior Software Engineer II to develop and manage its Kubernetes-native platform for AI workloads. You will be responsible for the design, build, and operation of orchestration services, improving system performance and reliability. The ideal...SeniorFlexible hours
- What You’ll Do As a Senior Software Engineer II (IC4) on the AI Workload Orchestration team, you will help build and operate CoreWeave’s Kubernetes-native platform for admitting, scheduling, and... ...to support modern AI training and inference workflows. It complements SUNK (...SeniorTemporary workCasual workWork at officeRemote workFlexible hours
- ByteDance is seeking a Senior Compute Infrastructure Engineer to design and evolve large-scale Kubernetes-based infrastructure for AI/LLM workloads in Seattle. You will improve control and data-plane performance and lead data-driven optimization initiatives across a global...Senior
$139k - $204k
What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements... ..., orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$182k - $242k
...CoreWeave is The Essential Cloud for AI. Built for pioneers by... ...’ll Do Develop and enhance Kubernetes-native benchmarking services... ...end-to-end MLPerf Training and Inference runs, including workload... ...within the team. Break down engineering tasks into clear milestones and...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hours$140.8k - $176k
...the world. We are seeking a Senior Software Engineer (IC3) to join our Customer... ...instrumental in supporting our AI initiatives, building... ...reliability, from fine-tuning Kubernetes deployments to migrating... ...collaborate across teams (Inference, Billing, DOKS). Nice to Have...SeniorWork experience placementLocal areaWorldwideFlexible hours$152k - $241.5k
NVIDIA in Seattle is looking for a Senior Systems Software Engineer to enhance AI infrastructure. The role involves performance analysis, development of Kubernetes architectures, and collaboration with AI teams and the open-source community. The ideal candidate should...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Kubernetes AI Inference. Be the first to apply!
- ngo software engineer Seattle, WA
- software developer Seattle, WA
- software developer internship no experience Seattle, WA
- junior software developer Seattle, WA
- part time software developer remote Seattle, WA
- financial software developer Seattle, WA
- senior software engineer ruby on rails Seattle, WA
- software engineer amazon Seattle, WA
- senior software design engineer Seattle, WA
- software engineer part time Seattle, WA
