Senior Kubernetes AI Inference Engineer
$161k - $239kMinimum qualifications: Bachelor’s degree or equivalent practical experience. 5 years of experience with software development in one or more programming languages (e.g., Java, C/C++, Python, or Go), and with data structures/algorithms. 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture. 3 years of experience in AI/ML related engineering, developing, deploying, managing, and maintaining Machine Learning infrastructure, or managing and maintaining a production-ready Kubernetes environment. 1 year of experience with developing infrastructure, distributed systems. Preferred qualifications: Master's degree or PhD in Computer Science or related technical field. 3 years of experience working in an organization involving cross-functional or cross-business projects. Experience with open-source development and community engagement. Experience running ML platforms. Knowledge of Kubernetes and AI inference workloads. About the job Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. In this role, you will be working in Google Kubernetes Engine and Kubernetes Open Source community, interacting with customers, and internal and external industry leads. Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems. The US base salary range for this full-time position is $161,000-$239,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google. Responsibilities Write and test product or system development code. Lead design reviews with peers and stakeholders to decide on available technologies. Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency). Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback. Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality. #J-18808-Ljbffr Google
- NVIDIA is seeking outstanding AI systems engineers to advance inference software, building libraries, code generators, and GPU kernel technologies for our hardware architecture. You will design abstractions for LLM serving engines and just-in-time compilers to accelerate...Senior
$165k - $242k
...traffic-shift strategies. Mentor IC1/IC2 engineers; review cross-team designs and elevate... ...workloads. Hands‑on experience with Kubernetes at production scale, CI/CD, and observability... ...). Practical knowledge of inference internals: batching, caching, mixed precision...SeniorPermanent employmentTemporary workWork at officeRemote workFlexible hoursShift work$139k - $204k
What You’ll Do Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements... ..., orchestration, and hardware teams to evolve our Kubernetes‑native inference platform and meet strict P99 SLAs at scale. About The Role...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hoursShift work$152k - $241.5k
...tapping into the unlimited potential of AI to define the next era of computing. An era... ...for outstanding High Performance AI Engineer to build groundbreaking multi-agent systems... ...libraries, frameworks, distributed training, and inference/serving—and with model/agent teams.What...SeniorFull timeRemote work$102.1k - $202.2k
...MicrosoftOverviewMicrosoft’s Azure Data engineering team is leading the... ...data platform for the age of AI, powering a new class of data... ...a Software Engineer II and Senior Software Engineer to help build... ...someone who can own complex Kubernetes-based platform systems end to...SeniorOngoing contractLocal area3 days per week$182k - $242k
...Senior Software and AI Engineer Livingston, NJ / New York, NY / Sunnyvale, CA / San Francisco, CA / Bellevue, WA CoreWeave is The Essential... ...environments (AWS, Azure, or GCP), container orchestration (e.g., Kubernetes), and proficiency with DevOps and CI/CD principles ....SeniorFull timeTemporary workCasual workWork at officeFlexible hours$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing... ...pre-training, post-training, inference. Our objective is to deliver a... ...an AI infrastructure software engineer to join our team. You'll be instrumental... ...of AI systems.As a senior DGX Cloud AI Infrastructure software...SeniorFull timeRemote work- Implement quantized and sparse recipes within inference engines and manage model export pipelines to ensure correct serialization. Develop benchmarking... ...Engineering, Data Analysis, Numerical Debugging, Large Language Models Benefits: Equity Benefits #J-18808-Ljbffr NVIDIA AISenior
- Robinhood's Software Platform team in Bellevue, WA is seeking a Senior Software Engineer to design and operate scalable container infrastructure using Kubernetes, while migrating workloads to Amazon EKS for zero-downtime deployments. You will collaborate across Robinhood...SeniorWork at office
- Veeam Software Corporation is seeking a Senior Technical Support Engineer to design and develop complex solutions for technical product support, engaging... ...virtualization, backup, and recovery across OpenShift, Kubernetes, and multiple cloud platforms. You will contribute to...Senior
$125k - $150k
...workflows through Microsoft cloud, AI, automation, and enterprise application engineering solutions. Position Summary Artic Consulting is seeking a Senior Consultant, Microsoft Full Stack... ...Docker, Azure Container Apps, Kubernetes (AKS), and Infrastructure as Code...SeniorFlexible hours- CoreWeave seeks a Senior Engineer in Bellevue, WA, to lead designs and improve system performance. This role requires expertise in distributed systems, cloud solutions, and Kubernetes, alongside strong coding skills in Python or Go. Successful candidates will mentor junior...SeniorRemote jobFlexible hours
$119.8k - $234.7k
...EngineeringDiscipline: Software EngineeringCompany: MicrosoftOverviewThe Cloud & AI organization accelerates Microsoft’s mission and bold... ...Microsoft's cloud environment at scale. We are looking for a Senior AI Engineer, Security AI to help build AI-powered security systems for...SeniorOngoing contractWork at officeLocal area3 days per week$152k - $241.5k
...looking for a driven Software Engineer to bring ground breaking... ...build the future of Physical AI!What you'll be doing:Design,... ..., and optimize containerized inference execution for the latest 3D VLMs... ...distributed applications using Docker, Kubernetes, endpoints and their APIs (...SeniorFull time- ...is not a pen test engagement. A Cybersecurity Forward Deployed Engineer is a production engineer who works embedded inside a client’s enterprise... ...to shoulder with their security and engineering teams—to make AI systems secure, governed, and resilient in real, complex...SeniorFull timeWork experience placementLive inWork at officeLocal area
$13 per hour
...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive... ...You'll be managed by the same founders and engineers who built the original company, offering... ...been waiting for this for 20 years."As a Senior/Lead AI Software Engineer, for the Agentforce...SeniorFull timeImmediate start- We are:A forward-thinking services company at the forefront of AI-native innovation. We partner with enterprise clients to create next-generation, agent-powered workflows engineered to scale in real-world settings. Our engineers embed deeply with customers, moving projects...SeniorFull timeWork experience placementLive inWork at officeLocal area
- Google Kirkland, WA seeks a Senior Software Engineer to advance Generative AI within Google Workspace. You will write and test critical code, participate in design reviews, review peers’ work for quality, contribute to documentation, and triage complex issues impacting...Senior
- NVIDIA in Redmond, WA is seeking a Senior Software Engineer to join the Agentic AI High-Performance Code Generation team. You will help design autonomous coding agents, scale distributed systems, and shape evaluation frameworks across the NVIDIA stack. The role requires...Senior
$119.8k - $234.7k
...Infrastructure team in Finetuning, Inference and Training (FIT) group is looking for a Senior Software Engineer who loves to build scalable,... ...microservices that run in Kubernetes. The Infrastructure team... ...and data plane services for AI Platform.The team focuses on:...SeniorOngoing contractLocal area3 days per week$188k - $275k
...Description CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,... ...'ll Do Description of the team: The Inference team is responsible for delivering high-performance... ...: We are looking for an Applied AI Engineer to help us understand, measure, and...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- ...Job Description Job Description Position Summary We are seeking a highly experienced Senior AI Solutions Engineer to design, develop, and deploy production-grade AI and Generative AI solutions. The ideal candidate will have strong backend/full-stack engineering...Senior
- Google in Kirkland, WA seeks software engineers to build infrastructure at scale, across distributed systems, networking, and data storage. You’ll tackle projects critical to Google’s needs with opportunities to switch teams as you grow. We offer comprehensive Washington...Senior
- NVIDIA AI in Redmond, WA is seeking a lead engineer to design and implement autonomous coding agents capable of multi-step reasoning and self-correction. You will build high-performance distributed systems and evaluation frameworks to optimize AI-generated code for NVIDIA...Senior
- ...usher in this new era, we seek AI-native thinkers across... ...future of how work gets done.Senior Software Engineer — Cortex TrainingThe... ...orchestration, multi-node training and inference, fault tolerance, and... ...services and operating them on Kubernetes in production.Familiarity...Senior
$165.6k - $296.4k
...work on a product that transforms Microsoft AI technologies and a modern-work suite to... ...employees.As a Principal AI Software Engineer, you will collaborate with a diverse multi... ...code for model training, evaluation, and inference pipelinesOptimize AI models for performance...Ongoing contractLocal area3 days per week$112.8k - $153.7k
...supportive people, willing to listen to your ideas. This is a senior engineering role. You will architect, operate, and continuously improve cloud... ...(Azure, Snowflake, Databricks, etc.) are a plus.Hands-on AI/ML/GenAI enablement experience (model lifecycle, AI Search, Azure...SeniorFull timeContract workLocal areaFlexible hours- ...Job Description Job Description Senior Platform Engineer PortX is a leading AI-powered data and integration company for modern banking, bringing... ...infrastructure and continuous deployment systems for PortX’s Kubernetes-based hosting platform in AWS. The platform...SeniorImmediate startVisa sponsorshipFlexible hours
- CoreWeave's OpenPipe team is seeking an applied research engineer to advance continuous learning for self-improving agents. You will generate research ideas, validate directions across real customer tasks, and harness a GPU-rich stack to push production-ready solutions...Senior
- CoreWeave is hiring a Senior Software Engineer for Storage to build features across the file and block storage stack, including NFS data path... ...components, collaborate with senior staff, and contribute to Kubernetes CSI features such as dynamic provisioning and snapshots...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Kubernetes AI Inference Engineer. Be the first to apply!
- ai developer Kirkland, WA
- ai engineer Kirkland, WA
- senior network engineer remote Kirkland, WA
- senior manager legal Kirkland, WA
- senior staff systems engineer Kirkland, WA
- senior commercial counsel Kirkland, WA
- senior manager tax Kirkland, WA
- senior construction accountant Kirkland, WA
- senior infrastructure engineer Kirkland, WA
- senior living Kirkland, WA


