Senior Software Engineer, Kubernetes AI Inference
$161k - $239kMinimum qualifications:
- Bachelor’s degree or equivalent practical experience.
- 5 years of experience with software development in one or more programming languages (e.g., Java, C/C++, Python, or Go), and with data structures/algorithms.
- 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
- 3 years of experience in AI/ML related engineering, developing, deploying, managing, and maintaining Machine Learning infrastructure, or managing and maintaining a production-ready Kubernetes environment.
- 1 year of experience with developing infrastructure, distributed systems.
Preferred qualifications:
- Master's degree or PhD in Computer Science or related technical field.
- 3 years of experience working in an organization involving cross-functional or cross-business projects.
- Experience with open-source development and community engagement.
- Experience running ML platforms.
- Knowledge of Kubernetes and AI inference workloads.
About the job
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
In this role, you will be working in Google Kubernetes Engine and Kubernetes Open Source community, interacting with customers, and internal and external industry leads.
Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.
The US base salary range for this full-time position is $161,000-$239,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.
Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google.
Responsibilities
- Write and test product or system development code.
- Lead design reviews with peers and stakeholders to decide on available technologies.
- Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
- Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
- Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
$152k - $241.5k
We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate the discovery and deployment of... ...fundamentals: concise, well-tested code; fluent with AI-assisted toolingExperience with ML accelerators with a...SeniorFull time$102.1k - $202.2k
...Less than 25%Profession: Software EngineeringDiscipline:... ...’s Azure Data engineering team is leading the transformation... ...for the age of AI, powering a new class... ...Software Engineer II and Senior Software Engineer to... ...someone who can own complex Kubernetes-based platform systems...SeniorOngoing contractLocal area3 days per week$92k - $135k
...CoreWeave is the AI Hyperscaler™, delivering a cloud platform... ...What You’ll Do: Join the Inference team to ship production... ...mentorship from experienced engineers. About the role: Implement... ...Exposure to containers and Kubernetes (coursework or projects welcome...SuggestedPermanent employmentFull timeTemporary workCasual workInternshipWork at officeRemote workFlexible hours- ...usher in this new era, we seek AI-native thinkers across... ...future of how work gets done.Senior Software Engineer — Cortex TrainingThe... ...orchestration, multi-node training and inference, fault tolerance, and... ...services and operating them on Kubernetes in production.Familiarity...Senior
$152k - $241.5k
...We are looking for a driven Software Engineer to bring ground breaking models... ...the future of Physical AI!What you'll be doing:Design,... ...and optimize containerized inference execution for the latest 3D... ...applications using Docker, Kubernetes, endpoints and their APIs (REST...SeniorFull time$170k - $253k
About the RoleNetApp's Cloud AI team is building an... ...frameworks, and production cloud engineering.We are hiring a Senior Software Engineer to design... ...building systems that run model inference in production (tool... ...containerization (Docker, Kubernetes), and infrastructure as...SeniorLocal area$119.8k - $234.7k
...than 25%Profession: Software EngineeringDiscipline... ...team in Finetuning, Inference and Training (FIT) group is looking for a Senior Software Engineer who loves to build scalable... ...that run in Kubernetes. The Infrastructure team... ...data plane services for AI Platform.The team...SeniorOngoing contractLocal area3 days per week- ...CoreWeave in Bellevue seeks a Senior Software Engineer II to develop and manage its Kubernetes-native platform for AI workloads. You will be responsible for the design, build, and operation of orchestration services, improving system performance and reliability. The...SeniorFlexible hours
$182k - $242k
...Essential Cloud for AI™. Built for pioneers... ...rendering, and real-time inference. Our stack is engineered for speed, scale,... ...We're looking for a Senior Engineer for... ...computing, GPU/accelerator software, or performance-... ...Experience with Kubernetes at production scale....SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$165k - $242k
...traffic-shift strategies. Mentor IC1/IC2 engineers; review cross-team designs and elevate... .... ~ Hands‑on experience with Kubernetes at production scale, CI/CD, and observability... ...). ~ Practical knowledge of inference internals: batching, caching, mixed precision...SeniorPermanent employmentTemporary workWork at officeRemote workFlexible hoursShift work- ...What You’ll Do As a Senior Software Engineer II (IC4) on the AI Workload Orchestration team, you will help build and operate CoreWeave’s Kubernetes-native platform for admitting, scheduling,... ...to support modern AI training and inference workflows. It complements SUNK (Slurm...SeniorTemporary workCasual workWork at officeRemote workFlexible hours
$182k - $242k
...CoreWeave is The Essential Cloud for AI. Built for pioneers by... ...ll Do Develop and enhance Kubernetes-native benchmarking services... ...end-to-end MLPerf Training and Inference runs, including workload... ...within the team. Break down engineering tasks into clear milestones and...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hours$153k - $224k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers... ...world's largest AI training and inference workloads run on. As a Senior Software Engineer you will build features across... ...them, all delivered through Kubernetes. Storage at CoreWeave sits next...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$182k - $266k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers... ...world's largest AI training and inference workloads run on. As a Senior Software Engineer II you will build and operate... ...and Rust and delivered through Kubernetes. Storage at CoreWeave sits next...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$165k - $220k
...CoreWeave, the AI Hyperscaler™, acquired Weights... ...agent building, and inference at scale, we’re... ...the intersection of software, hardware, and AI, there... ...Reporting to the Senior Engineering Manager for ML Workflows... ...production, containers and Kubernetes, cloud infrastructure...SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours- ...areMoveworks is the Agentic AI Assistant platform that... ...Moveworks’ Reasoning Engine and natural language... ...enabler, not a blocker. As a Senior Identity & Access... ...models across AWS, Azure, Kubernetes, and beyond; reduce... ...production-ready scalable software, Infrastructure as Code...SeniorWork at officeRemote workFlexible hours
$185k - $210k
...CoreWeave is the AI Hyperscaler™, delivering a cloud platform... .... We are seeking senior observability engineers with specializations in logging... ...years of experience in a software or infrastructure engineering... ...You have experience using Kubernetes, a conceptual understanding...SeniorFull timeTemporary workCasual workWork at officeRemote workFlexible hours$184k - $287.5k
...developing advanced multi-rack, multi-tenant AI/ML datacenters with NVIDIA GB200, and upcoming GB300 GPUs. NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service Provider)... ...enhancements, and debug the toughest Kubernetes + Slurm issues in multi-rack, multi-...SeniorFull timeRemote work$152k - $241.5k
...tapping into the unlimited potential of AI to define the next era of computing.... ...doing:Join the Developer Tools team as a senior software engineer to work on profiling tools within the... ...in C++).Track record of working with Kubernetes and in distributed environments.Strong...SeniorFull timeRemote work- ...usher in this new era, we seek AI-native thinkers across every... ...development, platform engineering, infrastructure, and internal... ...production-ready features.AS A SENIOR SOFTWARE ENGINEER FOR THE APPS &... ...infrastructure and services running on Kubernetes.Improve deployment,...Senior
$184k - $287.5k
...the forefront of the generative AI revolution, building the software and systems that power the world’... ...workloads. We are looking for a Senior Software Engineer to lead the bring-up, triage, benchmarking... ...of distributed training and inference workloads across NVIDIA GPU...SeniorFull timeRemote work$152k - $241.5k
...computing platforms are powering the AI revolution across many... ...and industries. Within our software stack, CUTLASS stands out as... ...the-art deep learning models’ inference and training passes to identify... ...Computer Science, Computer Engineering, or related field (or equivalent...SeniorFull time$200k - $287.5k
...usher in this new era, we seek AI-native thinkers across every... ...passionate SeniorSoftware Engineer for our Snowpark Container... ...Snowflake’s Data Cloud Mission.AS A SENIOR SOFTWARE ENGINEER, YOU WILL: Design... .... Design and build Kubernetes based OCI compliant container...SeniorWork at office$152k - $241.5k
NVIDIA is looking for outstanding software engineers to help us expand our enterprise GPU management... ...build cloud-native management agents, Kubernetes integrations, and end-to-end... ...the future of accelerated computing and AI.What you'll be doing:Develop and maintain...SeniorFull time$184k - $287.5k
We are now looking for a Senior Software Engineer for AI Resiliency!At NVIDIA, we are pushing the boundaries of what’s possible in AI. We are currently... ..., ensuring seamless operation of AI training and inference workloads.What We Need to See:You've achieved a Bachelor’...SeniorFull time$180k - $270k
...backend, vary quarter by quarter). AI tooling fluency is preferred:... ...including coordinating other engineers’ workBringing a focus on... ...cycle and reduce traditional software development and maintenance... ...context switchingKnowledge of AWS, Kubernetes, networking infrastructure....SeniorWork at officeFlexible hours- ...category-leading enterprise software that unleashes that power.... ...most ambitious product - an AI agentic orchestration... ...two consecutive years. As a Senior Software Engineer, you'll be at the forefront... ...Maestro, BPMN, Step Functions)Kubernetes and distributed infrastructure...SeniorWork at officeImmediate startRemote work
$147k - $202k
Secure Every Identity, from AI to HumanIdentity is the... ...for an Observability Engineer to help ensure that our... ...to rapidly ship software that our customers love... ...development in these areas.As a Senior Engineer on this team,... ...tools (e.g., Docker, Kubernetes).A data-driven approach...SeniorLocal areaWorldwideFlexible hours$168.1k - $227.4k
# Job Summary - Senior Software Development Engineer, SageMaker AI StudioAmazon Web Services (AWS) is seeking a Senior Software Development Engineer to join... ...- Familiarity with ML workflows (training, inference, model management) and the challenges practitioners...SeniorInternshipFlexible hours$148.5k - $223.9k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...scale. We're seeking a Senior Member of Technical... ...scalable, high-quality software while collaborating... ...geographically distributed engineers and product owners. You... ...custom Kubernetes operators and controllers...SeniorFull timeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, Kubernetes AI Inference. Be the first to apply!
- senior robotics software engineer Kirkland, WA
- intel software engineer Kirkland, WA
- software developer fintech Kirkland, WA
- software development engineer aws Kirkland, WA
- information technology software engineer Kirkland, WA
- ngo software engineer Kirkland, WA
- software engineer travel Kirkland, WA
- remote entry level software developer Kirkland, WA
- software engineer healthcare Kirkland, WA
- entry level software engineer remote Kirkland, WA



