Senior Staff Software Engineer - AI/ML Inference Engineering
$201.3k - $352.3kServiceNow
Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500 work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.Join us to put AI to work for people.Job DescriptionWhat you get to do in this role:About the team - The AI Services Platform Group at ServiceNow is a customer-focused innovation group building intelligent software and smart user experiences using existing and latest advanced technologies to enable end-to-end, industry-leading work experiences for customers. We are a group of researchers, applied scientists, engineers, and product managers with a dual mission. We build and evolve the AI platform, and partner with teams to build products and end-to-end AI-powered work experiences. In equal measure, we lay the foundations, research, experiment, and de-risk AI technologies that unlock new work experiences in the future.We are seeking a Senior Staff Software Engineer - AI/ML Inference Engineering to lead the architecture, optimization, and operational excellence of our AI inference platform. You will own the end-to-end inference lifecycle—from onboarding cutting-edge models to deploying optimized inference engines in production across multiple backends on Kubernetes infrastructure. You'll also architect the intelligent gateway layer using Envoy and ext_proc to enforce access control, provide observability, and enable advanced request routing. This role combines deep technical expertise in GPU compute, LLM APIs, inference frameworks, containerization, orchestration, and API gateway architecture with a bias toward pragmatic engineering and measurable performance impact. QualificationsTo be successful in this role you have:Expertise in Go or Python, OOP, Design Patterns, time and space-efficient algorithmsModel-serving and runtime experience, such as vLLM, TensorRT-LLM, Triton Inference Server.Exposure to LLM APIs or ML-serving systems, or a clear ability to ramp up quicklyExperience building new products that use challenging algorithmsExpertise in coding efficient, object-oriented, modularized and quality softwareKnowledge of core AI/ML techniques and algorithmsKnowledge of unit testing, profiling, and code tuningAI skills Artificial intelligence strategy is a critical skill at Experienced proficiency for IC5 — it applies to how you build and to what you build. Confident use of AI coding assistants such as GitHub Copilot or Cursor, paired with the critical eye to review AI-generated code as rigorously as any other — catching logic errors, security anti-patterns, and missed edge cases rather than treating model output as production-ready. AI-assisted debugging and trace analysis, and a clear understanding of the data privacy rules governing what goes into a prompt.Mandatory minimum 8+ years of Backend software engineering experience 4+ years of designing and operating distributed systems Bachelor’s degree in computer science, software engineering, or a closely related technical field required.A master’s degree may offset up to one year of the experience minimum. Equivalent practical experience is considered where technical depth is clearly demonstrable.Desired skills:Deploy, scale, and operate services in production Kubernetes environments, including Helm-based deployments and CI/CD pipelines that make releases repeatable and safe to roll back. Own observability for what you build — meaningful metrics, useful logs, real tracing, and alerts that fire on customer impact rather than on noise. Debug and resolve production incidents independently, participate in on-call, run root-cause analysis, and operate against defined service level objectives. For positions in this location, we offer a base pay of $201,300 - $352,300, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.Additional InformationWork PersonasWe approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.Equal Opportunity EmployerServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements. AccommodationsWe strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact View email address on click.appcast.io for assistance. Export Control RegulationsFor positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. From Fortune. 2026 Fortune Media IP Limited. All rights reserved. Used under license.SummaryType: Full-timeFunction: EngineeringExperience level: Not ApplicableIndustry: Information Technology And Services
$168.1k - $227.4k
...customers by building ML-distributed systems... ...deploy Generative AI models for... ...Specifically, the SageMaker Inference Platform enables... ...across hardware and software stacks, identifying... ...and mentoring newer engineers on the team.-... ...have a deep mix of senior talent presenting itself...SeniorInternshipFlexible hours$102.1k - $202.2k
...Less than 25%Profession: Software EngineeringDiscipline: Software... ..., deploy and operate AI solutions at scale. Join an engineering team building the... ...makes model training and inference faster, more reliable and... ...Software Engineer II and Senior Software Engineers to join...SeniorOngoing contractLocal area3 days per week$182k - $242k
Senior Engineer CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables... ...and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale. Key...SeniorTemporary workCasual workWork at officeFlexible hoursShift work$143.7k - $194.4k
...for large language model (LLM) inference is growing fast, and the engineers who make it faster and more... ...efficient are shaping the future of AI at Amazon. We are looking for a Software Development Engineer to focus... ...with applied scientists, ML engineers, and infrastructure...SuggestedInternshipFlexible hoursNight shiftDay shift$185k - $235k
...information powered by advanced AI, recommendation systems,... ...how well every downstream ML model performs: better... ...looking for an experienced Senior Machine Learning Engineer to design and build the data... ...and low-latency, high-QPS inference for real-time bidding.Experience...SeniorFull timeLocal areaWork from home- ...Our next-generation agentic AI - goal-directed, adaptive,... ...to life.We’re looking for a Senior Machine Learning Engineer to develop these... ...behaviors, AI planning and goal inference frameworks, and agent memory... ...simulation-based evaluation, and ML/AI safety within real-time...SeniorFull timeWork at officeWorldwide
$188k - $275k
...is The Essential Cloud for AI™. Built for pioneers by pioneers... ...at . What You’ll Do: Inference Platform Team The... ...About the role: As a Staff Software Engineer (IC5) on the Inference team,... ...Exposure to large-scale AI/ML infrastructure or hyperscale...Full timeTemporary workCasual workWork at officeFlexible hours$182k - $242k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...a large fraction of the total inference market, which is worth tens of... ...qualifications, we're looking for strong engineers with great taste. The most... ...on experience with modern ML frameworks such as PyTorch or...SeniorFull timeTemporary workCasual workWork at officeFlexible hours- ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,... ...in March 2025. Learn more at Senior Deployment Engineer - LLM Inference & Optimization About the role... ...~5+ years of experience in software engineering, ML engineering, AI infrastructure, or...SeniorFull timeTemporary workCasual workWork at officeFlexible hours
$217.2k - $288.4k
...running the world's best data and AI infrastructure platform, so... ...central to their missions.Our engineering teams build highly technical... ...most trusted data analytics and ML platform in the world.... ...bad actors. We are looking for senior leaders such as yourselves to...SeniorLocal areaWorldwide$152k - $204k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...at . What You’ll Do: Senior engineers are area owners who lead... ...evolve our Kubernetes-native inference platform and meet strict P99... ...performance. ~ Optimize end-to-end ML system performance by...SeniorFull timeTemporary workCasual workWork at officeFlexible hoursShift work$139k - $204k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...performance GPU workloads across AI/ML, VFX, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost... ...role We are looking for Senior Software Engineer to help us understand...SeniorFull timeTemporary workCasual workWork at officeFlexible hours- Introduction At IBM Software, we transform client challenges... ...the world's leading AI-powered, cloud-native... ...separate system to run inference or build an agent, our... ...events at scale. As an engineer, you'll own delivery of... ...t need a background in ML research or model training...Full timeTemporary workPart timeLive in
$236k - $330k
...usher in this new era, we seek AI-native thinkers across every... ...the state of the art in LLM inference systems and optimization.Our... ...tuning. We embrace AI-native engineering, using AI not only as the workload... ...approaches to accelerate software development, experimentation,...Senior$120k - $160k
CoreWeave is The Essential Cloud for AI™. Built for pioneers by... ...performance GPU workloads across AI/ML, VFX, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost... .... About the role As a Junior Software Engineer (IC1/IC2) on the Inference...Full timeTemporary workCasual workWork at officeRemote workFlexible hours$236k - $339.2k
...enterprise. To usher in this new era, we seek AI-native thinkers across every function... ...modeling or database systems.As a Staff Software Engineer you willServe as tech lead for a group... .... Guide model-specific hosting and inference optimizations with infrastructure partners...$170k - $260k
...Staff Applied AI/ML Software Engineer Also open to senior-level software engineers (5+ years) Location: Bellevue, WA | Hybrid: In the office 3 days per week | Employees: 150 | Industry: AdTech Responsibilities Own the full software development lifecycle...Work at office3 days per week$168.1k - $227.4k
We are looking for a Senior Machine Learning Engineer who will serve as a technical... ...complex, large-scale ML systems that have... ...super-intelligent AI systems, lead the... ...internship professional software development experience... ..., training/inference lifecycles, and optimization...SeniorInternshipFlexible hours$148.7k - $244.6k
...OpportunityUnity Vector represents the next generation of our AI-powered advertising ecosystem, a forward-looking evolution... ...learning infrastructure and models.We are seeking a Senior Machine Learning Engineer to join our Vector Ads Modeling team. In this role, you will...SeniorFull timeWork at officeWorldwide$119.8k - $234.7k
...Less than 25%Profession: Software EngineeringDiscipline: Software... ...using Generative AI. Our work enables developers... ...customers.We are looking for a Senior/Principal Software Engineer who will define the future... ...art model training and inference.We seek highly innovative...SeniorOngoing contractLocal area3 days per week- ...massive, multi-tenant data and AI platform into one customers... ...scale. We are looking for a senior technical leader to drive strategy... ...these surfaces, raising the engineering bar of the combined team, and... ...reliable, high-quality software and the operational practices...SeniorWorldwide
$119.8k - $234.7k
...Overview The Senior Machine Learning Engineer will design build deploy and scale... ...model training evaluation inference and production operation.... ...with applied scientists and software engineers to solve complex... ...someone passionate about AI safety and Responsible AI...SeniorOngoing contractFull timeLocal area$217k - $312.2k
...and running the world's best data and AI infrastructure platform so our customers... ...enables data scientists, analysts, and engineers to securely discover, access, and collaborate... ...interoperability.We are seeking a Senior Staff Software Engineer to lead the technical...SeniorLocal areaWorldwide$119.8k - $234.7k
...: Less than 25%Profession: Software EngineeringDiscipline: Software... ...Artificial Intelligence (AI) Frameworks team at... ...inclusive culture. We own inference performance of OpenAI and other... ...Server, and Dynamics.As a Senior Software Engineer - Performance Tooling on the...SeniorOngoing contractWork at officeLocal area3 days per week$193.3k - $261.5k
# Job Summary - Senior Software Development Engineer, SageMaker AI StudioAmazon Web Services (AWS) is... ...that power the end-to-end ML development experience.... ...ML workflows (training, inference, model management) and the... ...employees, supervisors, and staff; adhere to standards of...SeniorInternshipLocal areaFlexible hours- Senior Machine Learning Engineer, Data InfrastructureUnity Vector builds an Data platform that powers insight, experimentation, attribution, and AI-driven decision-making across the company.Our systems operate... ...that power production ML systems.To support this growth...SeniorFull timeWork at officeWorldwide
$262k - $364k
Senior Staff Software Engineer, Machine Learning, ML Training Share Senior Staff Software Engineer, Machine Learning, ML Training _corporate_fare_ Google... ...for Google Cloud customers. + Design and implement AI frameworks software for ML workloads in the cloud...SeniorTemporary work$272k - $431.25k
We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you... ...workflows, involving data processing, model training, and inference pipelines.Proficiency in programming & scripting...Full time$102.1k - $202.2k
Overview The AI Frameworks team at Microsoft... ...develops the AI software used to train and... ...of compiler engineering, programming language... ...Engineers II and/or Senior Software Engineer... ...architects to ML developers. Identify... ...AI frameworks, AI inference systems, AI kernel...SeniorOngoing contractLocal area- Senior Software Engineer Lambda, the superintelligence cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers... ...of AI training and inference at scale. As a Senior Engineer... ...internal tools and CLIs that let ML/AI teams deploy and monitor their...SeniorWork at officeLocal areaWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff Software Engineer - AI/ML Inference Engineering. Be the first to apply!
- ai engineer Kirkland, WA
- ai developer Kirkland, WA
- senior living Kirkland, WA
- senior manager customer operations Kirkland, WA
- senior full stack web developer Kirkland, WA
- senior magento developer Kirkland, WA
- senior software design engineer Kirkland, WA
- senior marketing operations manager Kirkland, WA
- senior manager accenture Kirkland, WA
- senior accountant remote Kirkland, WA



