Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Staff Software Engineer - AI/ML Inference Engineering

$201.3k - $352.3k

ServiceNow

Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500 work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.Join us to put AI to work for people.Job DescriptionWhat you get to do in this role:About the team - The AI Services Platform Group at ServiceNow is a customer-focused innovation group building intelligent software and smart user experiences using existing and latest advanced technologies to enable end-to-end, industry-leading work experiences for customers. We are a group of researchers, applied scientists, engineers, and product managers with a dual mission. We build and evolve the AI platform, and partner with teams to build products and end-to-end AI-powered work experiences. In equal measure, we lay the foundations, research, experiment, and de-risk AI technologies that unlock new work experiences in the future.We are seeking a Senior Staff Software Engineer - AI/ML Inference Engineering to lead the architecture, optimization, and operational excellence of our AI inference platform. You will own the end-to-end inference lifecycle—from onboarding cutting-edge models to deploying optimized inference engines in production across multiple backends on Kubernetes infrastructure. You'll also architect the intelligent gateway layer using Envoy and ext_proc to enforce access control, provide observability, and enable advanced request routing. This role combines deep technical expertise in GPU compute, LLM APIs, inference frameworks, containerization, orchestration, and API gateway architecture with a bias toward pragmatic engineering and measurable performance impact. QualificationsTo be successful in this role you have:Expertise in Go or Python, OOP, Design Patterns, time and space-efficient algorithmsModel-serving and runtime experience, such as vLLM, TensorRT-LLM, Triton Inference Server.Exposure to LLM APIs or ML-serving systems, or a clear ability to ramp up quicklyExperience building new products that use challenging algorithmsExpertise in coding efficient, object-oriented, modularized and quality softwareKnowledge of core AI/ML techniques and algorithmsKnowledge of unit testing, profiling, and code tuningAI skills Artificial intelligence strategy is a critical skill at Experienced proficiency for IC5 — it applies to how you build and to what you build. Confident use of AI coding assistants such as GitHub Copilot or Cursor, paired with the critical eye to review AI-generated code as rigorously as any other — catching logic errors, security anti-patterns, and missed edge cases rather than treating model output as production-ready. AI-assisted debugging and trace analysis, and a clear understanding of the data privacy rules governing what goes into a prompt.Mandatory minimum 8+ years of Backend software engineering experience 4+ years of designing and operating distributed systems Bachelor’s degree in computer science, software engineering, or a closely related technical field required.A master’s degree may offset up to one year of the experience minimum. Equivalent practical experience is considered where technical depth is clearly demonstrable.Desired skills:Deploy, scale, and operate services in production Kubernetes environments, including Helm-based deployments and CI/CD pipelines that make releases repeatable and safe to roll back. Own observability for what you build — meaningful metrics, useful logs, real tracing, and alerts that fire on customer impact rather than on noise. Debug and resolve production incidents independently, participate in on-call, run root-cause analysis, and operate against defined service level objectives. For positions in this location, we offer a base pay of $201,300 - $352,300, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.Additional InformationWork PersonasWe approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.Equal Opportunity EmployerServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.  AccommodationsWe strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact View email address on click.appcast.io for assistance. Export Control RegulationsFor positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. From Fortune. 2026 Fortune Media IP Limited. All rights reserved. Used under license.SummaryType: Full-timeFunction: EngineeringExperience level: Not ApplicableIndustry: Information Technology And Services

Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Senior Staff Software Engineer - AI/ML Inference Engineering in Kirkland, WA vacancy
  • $168.1k - $227.4k

     ...customers by building ML-distributed systems...  ...deploy Generative AI models for...  ...Specifically, the SageMaker Inference Platform enables...  ...across hardware and software stacks, identifying...  ...and mentoring newer engineers on the team.-...  ...have a deep mix of senior talent presenting itself... 
    Senior
    Internship
    Flexible hours

    Amazon

    Bellevue, WA
    2 days ago
  • $102.1k - $202.2k

     ...Less than 25%Profession: Software EngineeringDiscipline: Software...  ..., deploy and operate AI solutions at scale. Join an engineering team building the...  ...makes model training and inference faster, more reliable and...  ...Software Engineer II and Senior Software Engineers to join... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    1 day ago
  • $182k - $242k

    Senior Engineer CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables...  ...and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale. Key... 
    Senior
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    GenAI.Jobs

    Bellevue, WA
    1 day ago
  • $143.7k - $194.4k

     ...for large language model (LLM) inference is growing fast, and the engineers who make it faster and more...  ...efficient are shaping the future of AI at Amazon. We are looking for a Software Development Engineer to focus...  ...with applied scientists, ML engineers, and infrastructure... 
    Suggested
    Internship
    Flexible hours
    Night shift
    Day shift

    Amazon

    Bellevue, WA
    1 day ago
  • $185k - $235k

     ...information powered by advanced AI, recommendation systems,...  ...how well every downstream ML model performs: better...  ...looking for an experienced Senior Machine Learning Engineer to design and build the data...  ...and low-latency, high-QPS inference for real-time bidding.Experience... 
    Senior
    Full time
    Local area
    Work from home

    News Break

    Bellevue, WA
    1 day ago
  •  ...Our next-generation agentic AI - goal-directed, adaptive,...  ...to life.We’re looking for a Senior Machine Learning Engineer to develop these...  ...behaviors, AI planning and goal inference frameworks, and agent memory...  ...simulation-based evaluation, and ML/AI safety within real-time... 
    Senior
    Full time
    Work at office
    Worldwide

    Unity Technologies

    Bellevue, WA
    2 days ago
  • $188k - $275k

     ...is The Essential Cloud for AI™. Built for pioneers by pioneers...  ...at  . What You’ll Do: Inference Platform Team The...  ...About the role: As a Staff Software Engineer (IC5) on the Inference team,...  ...Exposure to large-scale AI/ML infrastructure or hyperscale... 
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    4 days ago
  • $182k - $242k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...a large fraction of the total inference market, which is worth tens of...  ...qualifications, we're looking for strong engineers with great taste. The most...  ...on experience with modern ML frameworks such as PyTorch or... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    6 days ago
  •  ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers,...  ...in March 2025. Learn more at  Senior Deployment Engineer - LLM Inference & Optimization About the role...  ...~5+ years of experience in software engineering, ML engineering, AI infrastructure, or... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    7 days ago
  • $217.2k - $288.4k

     ...running the world's best data and AI infrastructure platform, so...  ...central to their missions.Our engineering teams build highly technical...  ...most trusted data analytics and ML platform in the world....  ...bad actors. We are looking for senior leaders such as yourselves to... 
    Senior
    Local area
    Worldwide

    DataBricks

    Bellevue, WA
    3 days ago
  • $152k - $204k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...at  . What You’ll Do: Senior engineers are area owners who lead...  ...evolve our Kubernetes-native inference platform and meet strict P99...  ...performance. ~ Optimize end-to-end ML system performance by... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    Bellevue, WA
    4 days ago
  • $139k - $204k

     ...CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...performance GPU workloads across AI/ML, VFX, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost...  ...role We are looking for Senior Software Engineer to help us understand... 
    Senior
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    4 days ago
  • Introduction At IBM Software, we transform client challenges...  ...the world's leading AI-powered, cloud-native...  ...separate system to run inference or build an agent, our...  ...events at scale. As an engineer, you'll own delivery of...  ...t need a background in ML research or model training... 
    Full time
    Temporary work
    Part time
    Live in

    IBM

    Bellevue, WA
    1 hour ago
  • $236k - $330k

     ...usher in this new era, we seek AI-native thinkers across every...  ...the state of the art in LLM inference systems and optimization.Our...  ...tuning. We embrace AI-native engineering, using AI not only as the workload...  ...approaches to accelerate software development, experimentation,... 
    Senior

    Snowflake

    Bellevue, WA
    10 hours ago
  • $120k - $160k

    CoreWeave is The Essential Cloud for AI™. Built for pioneers by...  ...performance GPU workloads across AI/ML, VFX, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost...  .... About the role As a Junior Software Engineer (IC1/IC2) on the Inference... 
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Bellevue, WA
    1 day ago
  • $236k - $339.2k

     ...enterprise. To usher in this new era, we seek AI-native thinkers across every function...  ...modeling or database systems.As a Staff Software Engineer you willServe as tech lead for a group...  .... Guide model-specific hosting and inference optimizations with infrastructure partners... 

    Snowflake

    Bellevue, WA
    2 hours ago
  • $170k - $260k

     ...Staff Applied AI/ML Software Engineer Also open to senior-level software engineers (5+ years) Location: Bellevue, WA | Hybrid: In the office 3 days per week | Employees: 150 | Industry: AdTech Responsibilities Own the full software development lifecycle... 
    Work at office
    3 days per week

    Cypress HCM

    Bellevue, WA
    16 days ago
  • $168.1k - $227.4k

    We are looking for a Senior Machine Learning Engineer who will serve as a technical...  ...complex, large-scale ML systems that have...  ...super-intelligent AI systems, lead the...  ...internship professional software development experience...  ..., training/inference lifecycles, and optimization... 
    Senior
    Internship
    Flexible hours

    Amazon

    Bellevue, WA
    4 days ago
  • $148.7k - $244.6k

     ...OpportunityUnity Vector represents the next generation of our AI-powered advertising ecosystem, a forward-looking evolution...  ...learning infrastructure and models.We are seeking a Senior Machine Learning Engineer to join our Vector Ads Modeling team. In this role, you will... 
    Senior
    Full time
    Work at office
    Worldwide

    Unity Technologies

    Bellevue, WA
    10 hours ago
  • $119.8k - $234.7k

     ...Less than 25%Profession: Software EngineeringDiscipline: Software...  ...using Generative AI. Our work enables developers...  ...customers.We are looking for a Senior/Principal Software Engineer who will define the future...  ...art model training and inference.We seek highly innovative... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    2 days ago
  •  ...massive, multi-tenant data and AI platform into one customers...  ...scale. We are looking for a senior technical leader to drive strategy...  ...these surfaces, raising the engineering bar of the combined team, and...  ...reliable, high-quality software and the operational practices... 
    Senior
    Worldwide

    DataBricks

    Bellevue, WA
    10 hours ago
  • $119.8k - $234.7k

     ...Overview The Senior Machine Learning Engineer will design build deploy and scale...  ...model training evaluation inference and production operation....  ...with applied scientists and software engineers to solve complex...  ...someone passionate about AI safety and Responsible AI... 
    Senior
    Ongoing contract
    Full time
    Local area

    Microsoft

    Redmond, WA
    6 days ago
  • $217k - $312.2k

     ...and running the world's best data and AI infrastructure platform so our customers...  ...enables data scientists, analysts, and engineers to securely discover, access, and collaborate...  ...interoperability.We are seeking a Senior Staff Software Engineer to lead the technical... 
    Senior
    Local area
    Worldwide

    DataBricks

    Bellevue, WA
    3 days ago
  • $119.8k - $234.7k

     ...: Less than 25%Profession: Software EngineeringDiscipline: Software...  ...Artificial Intelligence (AI) Frameworks team at...  ...inclusive culture.  We own inference performance of OpenAI and other...  ...Server, and Dynamics.As a Senior Software Engineer - Performance Tooling on the... 
    Senior
    Ongoing contract
    Work at office
    Local area
    3 days per week

    Microsoft

    Redmond, WA
    1 day ago
  • $193.3k - $261.5k

    # Job Summary - Senior Software Development Engineer, SageMaker AI StudioAmazon Web Services (AWS) is...  ...that power the end-to-end ML development experience....  ...ML workflows (training, inference, model management) and the...  ...employees, supervisors, and staff; adhere to standards of... 
    Senior
    Internship
    Local area
    Flexible hours

    Amazon

    Bellevue, WA
    10 hours ago
  • Senior Machine Learning Engineer, Data InfrastructureUnity Vector builds an Data platform that powers insight, experimentation, attribution, and AI-driven decision-making across the company.Our systems operate...  ...that power production ML systems.To support this growth... 
    Senior
    Full time
    Work at office
    Worldwide

    Unity Technologies

    Bellevue, WA
    4 days ago
  • $262k - $364k

    Senior Staff Software Engineer, Machine Learning, ML Training Share Senior Staff Software Engineer, Machine Learning, ML Training _corporate_fare_ Google...  ...for Google Cloud customers. + Design and implement AI frameworks software for ML workloads in the cloud... 
    Senior
    Temporary work

    Google

    Kirkland, WA
    17 days ago
  • $272k - $431.25k

    We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you...  ...workflows, involving data processing, model training, and inference pipelines.Proficiency in programming & scripting... 
    Full time

    Nvidia

    Redmond, WA
    10 hours ago
  • $102.1k - $202.2k

    Overview The AI Frameworks team at Microsoft...  ...develops the AI software used to train and...  ...of compiler engineering, programming language...  ...Engineers II and/or Senior Software Engineer...  ...architects to ML developers. Identify...  ...AI frameworks, AI inference systems, AI kernel... 
    Senior
    Ongoing contract
    Local area

    Microsoft Corporation

    Redmond, WA
    1 hour ago
  • Senior Software Engineer Lambda, the superintelligence cloud, is a leader in AI cloud infrastructure serving tens of thousands of customers...  ...of AI training and inference at scale. As a Senior Engineer...  ...internal tools and CLIs that let ML/AI teams deploy and monitor their... 
    Senior
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda Corporation

    Bellevue, WA
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff Software Engineer - AI/ML Inference Engineering. Be the first to apply!