Senior Software Engineer, Kubernetes AI Inference
$161k - $239kMinimum qualifications: Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages (e.g., Java, C/C++, Python, or Go), and with data structures/algorithms. 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture. 3 years of experience in AI/ML related engineering, developing, deploying, managing, and maintaining Machine Learning infrastructure, or managing and maintaining a production-ready Kubernetes environment. 1 year of experience with developing infrastructure, distributed systems. Preferred qualifications: Master's degree or PhD in Computer Science or related technical field. 3 years of experience working in an organization involving cross-functional or cross-business projects. Experience with open-source development and community engagement. Experience running ML platforms. Knowledge of Kubernetes and AI inference workloads. About the job Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. In this role, you will be working in Google Kubernetes Engine and Kubernetes Open Source community, interacting with customers, and internal and external industry leads. Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. The US base salary range for this full-time position is $161,000-$239,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google. Responsibilities Write and test product or system development code. Lead design reviews with peers and stakeholders to decide on available technologies. Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency). Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality. #J-18808-Ljbffr Google
$300k
...interpretable, and steerable AI systems. We want AI to... ...researchers, engineers, policy experts, and business... ...Role The Cloud Inference team scales and... ...Have significant software engineering experience... ...Azure), with exposure to Kubernetes, Infrastructure as Code...SeniorFull timeWork at officeVisa sponsorshipFlexible hours$168.1k - $227.4k
AWS Neuron is the complete software stack for the AWS Inferentia and Trainium... ...accelerators. This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is... ...production on GPUs, Neuron, TPU or other AI acceleration hardware.Amazon is...SeniorWork experience placementFlexible hours$184k - $287.5k
...unlimited potential of AI to define the next... ...edge hardware and software innovation to... ...forward‑thinking engineers tackling some of the... ...searching for a Senior Systems Software Engineer... ...systems, Kubernetes, containers, and systems... ..., distributed inference serving, and major...SeniorFull timeRemote work$92k - $135k
...CoreWeave is the AI Hyperscaler™, delivering a cloud platform... ...What You’ll Do: Join the Inference team to ship production... ...mentorship from experienced engineers. About the role: Implement... ...Exposure to containers and Kubernetes (coursework or projects welcome...SuggestedPermanent employmentFull timeTemporary workCasual workInternshipWork at officeRemote workFlexible hours$300k
...interpretable, and steerable AI systems. We want AI to... ...researchers, engineers, policy experts, and business... ...the role Our Inference team is responsible... ...Have significant software engineering experience... ...caching strategies Kubernetes and cloud infrastructure...SuggestedFull timeWork at officeWorldwideVisa sponsorshipFlexible hours$320k
...interpretable, and steerable AI systems. We want AI to... ...researchers, engineers, policy experts, and business... ...mandate is to make inference deployment boring and... ...unattended. As a Software Engineer on the Launch... ...~ Proficiency with Kubernetes-based deployments, rolling...Full timeWork at officeVisa sponsorshipFlexible hoursShift work$143.7k - $194.4k
...forefront of ultra-scale AI/ML infrastructure,... ...fine-tuning, and agentic inference that's shaping the... ...backend data store for Kubernetes. EKS etcd team is part... ...value technically strong engineers who take initiative to... ...professional software development experience...InternshipFlexible hours- ...usher in this new era, we seek AI-native thinkers across... ...future of how work gets done.Senior Software Engineer — Cortex TrainingThe... ...orchestration, multi-node training and inference, fault tolerance, and... ...services and operating them on Kubernetes in production.Familiarity...Senior
$184k - $287.5k
...merges fresh hardware and software innovations to offer... ...for the most challenging AI workloads worldwide. Our team of skilled engineers is committed to... ...world!We are looking for a Senior Systems Software Engineer... ...with strong experience in Kubernetes node engineering, OS...SeniorFull timeWorldwide$170k - $253k
About the RoleNetApp's Cloud AI team is building an... ...frameworks, and production cloud engineering.We are hiring a Senior Software Engineer to design... ...building systems that run model inference in production (tool... ...containerization (Docker, Kubernetes), and infrastructure as...SeniorLocal area- ...-throughput batch inference, and fine-tuning on... ...for Generative AI at DoorDash, leading... ...serving and inference engines, fine-tuning and... ...is ideal for a senior engineer who enjoys... ...industry experience in software engineeringDeep... ...with Kubernetes, cloud infrastructure...SeniorHourly payWork at officeLocal areaRemote workFlexible hours
- Designworks Talent is seeking an Inference Engineer to build and operate production-grade model-serving and inference systems in a hybrid Bellevue... ...across distributed systems, GPU optimization, and production AI infrastructure to deliver high-throughput, low-latency...Senior
- NVIDIA is seeking a seasoned engineer to advance LLM inference on edge AI hardware. You’ll evaluate frameworks, map model architectures to GPU, and optimize across multi-node deployments, focusing on performance and stability. You’ll own validation workflows, develop actionable...Senior
$186.07k - $218.9k
Coinbase is seeking a Senior Software Engineer to own the compute orchestration infrastructure for our products. You will work within the Compute... .... The ideal candidate has extensive experience with Kubernetes and cloud infrastructure, and will collaborate with various...Senior- CoreWeave in Bellevue seeks a Senior Software Engineer II to develop and manage its Kubernetes-native platform for AI workloads. You will be responsible for the design, build, and operation of orchestration services, improving system performance and reliability. The ideal...SeniorFlexible hours
- What You’ll Do As a Senior Software Engineer II (IC4) on the AI Workload Orchestration team, you will help build and operate CoreWeave’s Kubernetes-native platform for admitting, scheduling, and... ...to support modern AI training and inference workflows. It complements SUNK (...SeniorTemporary workCasual workWork at officeRemote workFlexible hours
$165k - $242k
...traffic-shift strategies. Mentor IC1/IC2 engineers; review cross-team designs and elevate... ...workloads. Hands‑on experience with Kubernetes at production scale, CI/CD, and observability... ...). Practical knowledge of inference internals: batching, caching, mixed precision...SeniorPermanent employmentTemporary workWork at officeRemote workFlexible hoursShift work$139k - $204k
What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements... ..., orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$140.8k - $176k
...the world. We are seeking a Senior Software Engineer (IC3) to join our Customer... ...instrumental in supporting our AI initiatives, building... ...reliability, from fine-tuning Kubernetes deployments to migrating... ...collaborate across teams (Inference, Billing, DOKS). Nice to Have...SeniorWork experience placementLocal areaWorldwideFlexible hours$182k - $242k
...Essential Cloud for AI™. Built for pioneers... ...rendering, and real-time inference. Our stack is engineered for speed, scale,... ...We're looking for a Senior Engineer for... ...computing, GPU/accelerator software, or performance-... ...DSL. Experience with Kubernetes at production scale....SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours$153k - $224k
CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,... ...world's largest AI training and inference workloads run on. As a Senior Software Engineer you will build features across... ...governs them, all delivered through Kubernetes. Storage at CoreWeave sits next...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$182k - $242k
...CoreWeave is The Essential Cloud for AI. Built for pioneers by... ...’ll Do Develop and enhance Kubernetes-native benchmarking services... ...end-to-end MLPerf Training and Inference runs, including workload... ...within the team. Break down engineering tasks into clear milestones and...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hours$182k - $266k
CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,... ...world's largest AI training and inference workloads run on. As a Senior Software Engineer II you will build and operate... ...Go and Rust and delivered through Kubernetes. Storage at CoreWeave sits next to...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$165k - $220k
CoreWeave, the AI Hyperscaler™, acquired Weights... ...agent building, and inference at scale, we’re... ...the intersection of software, hardware, and AI, there... ...Role Reporting to the Senior Engineering Manager for ML Workflows... ..., containers and Kubernetes, cloud infrastructure...SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours- NVIDIA in Seattle, WA seeks outstanding AI systems engineers to advance the inference software stack for AI workloads. You will develop libraries, code generators, and GPU kernel technologies for NVIDIA hardware, including new abstractions and runtimes for large language...Senior
- ...As a Model Optimization & Deployment Engineer, you will focus on bringing highly efficient... ...CUDA kernels, and build highly concurrent inference code to ensure real-time, deterministic execution... ...latency and maximize memory bandwidth on AI accelerators. Write production-level,...SeniorTemporary workRelocation package
$143.7k - $194.4k
We are looking for a Software Development Engineer to join the EKS KCP Scalability team and work on some... ...customers — from startups to the largest AI/ML workloads on the planet —... ...work across the full stack: from the Kubernetes API server process and upstream community...InternshipFlexible hoursShift work$185k - $210k
...CoreWeave is the AI Hyperscaler™, delivering a cloud platform... .... We are seeking senior observability engineers with specializations in logging... ...years of experience in a software or infrastructure engineering... ...You have experience using Kubernetes, a conceptual understanding...SeniorFull timeTemporary workCasual workWork at officeRemote workFlexible hours$184k - $287.5k
...developing advanced multi-rack, multi-tenant AI/ML datacenters with NVIDIA GB200, and upcoming GB300 GPUs. NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service Provider)... ...enhancements, and debug the toughest Kubernetes + Slurm issues in multi-rack, multi-...SeniorFull timeRemote work- ...will light a fire within you.Senior Software EngineerSeattle,... ...exceptional Senior Software Engineers to help take it to the next... ...full-stack engineers who use AI-assisted development not as... ...environmentsNice to HaveExperience with Kubernetes and Helm for container orchestration...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Kubernetes AI Inference. Be the first to apply!
- senior robotics software engineer Seattle, WA
- software system engineer Seattle, WA
- part time software developer Seattle, WA
- security software engineer Seattle, WA
- intel software engineer Seattle, WA
- software developer fintech Seattle, WA
- new graduate software engineer Seattle, WA
- software development engineer aws Seattle, WA
- information technology software engineer Seattle, WA
- graduate software developer no experience Seattle, WA


