Senior Staff Software Engineer - AI/ML Inference Engineering
$181.2k - $317.1kServiceNow
Company Description It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started. Join us to put AI to work for people.
Job Description
What you get to do in this role: About the team - The AI Services Platform Group at ServiceNow is a customer-focused innovation group building intelligent software and smart user experiences using existing and latest advanced technologies to enable end-to-end, industry-leading work experiences for customers. We are a group of researchers, applied scientists, engineers, and product managers with a dual mission. We build and evolve the AI platform, and partner with teams to build products and end-to-end AI-powered work experiences. In equal measure, we lay the foundations, research, experiment, and de-risk AI technologies that unlock new work experiences in the future. We are seeking a Senior Staff Software Engineer - AI/ML Inference Engineering to lead the architecture, optimization, and operational excellence of our AI inference platform. You will own the end-to-end inference lifecycle—from onboarding cutting-edge models to deploying optimized inference engines in production across multiple backends on Kubernetes infrastructure. You'll also architect the intelligent gateway layer using Envoy and ext_proc to enforce access control, provide observability, and enable advanced request routing. This role combines deep technical expertise in GPU compute, LLM APIs, inference frameworks, containerization, orchestration, and API gateway architecture with a bias toward pragmatic engineering and measurable performance impact.Qualifications
To be successful in this role you have:- Expertise in Go or Python, OOP, Design Patterns, time and space-efficient algorithms
- Model-serving and runtime experience, such as vLLM, TensorRT-LLM, Triton Inference Server.
- Exposure to LLM APIs or ML-serving systems, or a clear ability to ramp up quickly
- Experience building new products that use challenging algorithms
- Expertise in coding efficient, object-oriented, modularized and quality software
- Knowledge of core AI/ML techniques and algorithms
- Knowledge of unit testing, profiling, and code tuning
- Confident use of AI coding assistants such as GitHub Copilot or Cursor, paired with the critical eye to review AI-generated code as rigorously as any other — catching logic errors, security anti-patterns, and missed edge cases rather than treating model output as production-ready.
- AI-assisted debugging and trace analysis, and a clear understanding of the data privacy rules governing what goes into a prompt.
- 8+ years of Backend software engineering experience
- 4+ years of designing and operating distributed systems
- Bachelor’s degree in computer science, software engineering, or a closely related technical field required.
- A master’s degree may offset up to one year of the experience minimum. Equivalent practical experience is considered where technical depth is clearly demonstrable.
- Deploy, scale, and operate services in production Kubernetes environments, including Helm-based deployments and CI/CD pipelines that make releases repeatable and safe to roll back.
- Own observability for what you build — meaningful metrics, useful logs, real tracing, and alerts that fire on customer impact rather than on noise.
- Debug and resolve production incidents independently, participate in on-call, run root-cause analysis, and operate against defined service level objectives.
Additional Information
Work Personas We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service. Equal Opportunity Employer ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements. Accommodations We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance. Export Control Regulations For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.$230k - $315k
.../ Seattle, WA / San Diego, CASoftware - Software Platforms and Product /Full-time /HybridWe are looking for a Senior/Staff Software Engineer to lead the development and scaling of our... ...skills.We may use artificial intelligence (AI) tools to support parts of the hiring...SeniorFull timeTemporary workRelocation package$234.88k - $352.32k
...Job Description Shield AI is a venture-backed... ...include Hivemind autonomy software, V-BAT and X-BAT aircraft... ...and production, our engineers build the data pipelines... ...and hardware-accelerated inference frameworks.... ...training an deploying ML models for computer vision...SeniorFull timeTemporary workPart timeWork experience placementWorldwide$205.5k - $277.5k
...Come join the Data Engineering Team as a Senior Staff Software Engineer. We are leveraging big data technologies to... ...enhance software applications with AI technology. Introduce new approaches... ...and Linux. ~ Knowledge of AI / ML, Generative AI, and experience with...SeniorFull timeTemporary workWork experience placementImmediate start$171.9k - $300.8k
...DescriptionIt all started when engineer Fred Luddy wrote code... ..., ServiceNow is the AI control tower for... ...share what works. Mentor senior and mid-level engineers... ...they don’t. 12+ years of software engineering experience,... ...leadership at the staff level or equivalent. Strong...SeniorWork at officeImmediate startRemote workFlexible hours$110k - $180k
...Marlin Alliance, Inc. is seeking a Senior Machine Learning Engineer to design, develop, and... ...cloud-native development, and software engineering best practices. The Senior ML Engineer will collaborate with... ...teams to deliver mission-focused AI solutions that integrate into...SeniorContract work- ...Coastline Digital Coastline Digital is a forward-deployed AI and software firm specializing in enterprise applications that are... ...role From business problem to production AI. The Senior AI/ML Engineer contract role is a remote position focused on designing, building...SeniorContract workRemote work
$181.2k - $317.1k
Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious... ...work. Today, ServiceNow is the AI control tower for business reinvention. Our... ...code by enforcing best practices around software engineering architecture and processes (Code...SeniorWork experience placementWork at officeImmediate startRemote workFlexible hours$194.4k - $291.6k
...Qualcomm Technologies, Inc.Job Area:Engineering Group, Engineering Group > Machine... ...Summary:Qualcomm AI Research is looking for talented AI software engineers to enable AI technologies... ...and enhance the implementation of ML/AI SW stack, kernels, and runtime...SeniorFull timeWork experience placementWork from home- ...Job Description Job Description We are looking for a Senior/Staff Software Engineer to lead the development and scaling of our cloud services and... ...experiences, and skills. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as...SeniorTemporary workRelocation package
- ...applied intelligence that brings AI into the real world. Our... ...performance simulation, and modern software engineering to accelerate the design,... ...waiting on it. Build the ML data pipelines for training,... ...batch, online, and asynchronous inference, with safe rollout, rollback,...SeniorFull time
$129.4k - $194k
...thought possible.We are seeking a Senior Bioinformatics Scientist specializing in AI-enabled protein design and engineering to help invent the next... ...developing and applying AI/ML methods to protein and enzyme... ...screening.Knowledge of best software development practices and...SeniorFull timeWork experience placementLocal area$140.8k - $211.2k
...Technologies, Inc. ## Job Area: Engineering Group, Engineering Group >... ...General Summary: Qualcomm AI Research is looking for world... ...within Qualcomm which spans software, hardware, and systems. Our members... ...in LLM reasoning or inference acceleration research · Experience...SeniorFull timeWork experience placementWork from homeWorldwide$162.5k - $220k
...imperfect.Experimentation and Causal Inference: Own the inference approach... ...them by hand. Work with Data Engineering to ensure data quality and... ...real-time analytic capabilities.AI Integration: Collaborate with... ...Python or R; experience building ML and GenAI models, including...SeniorShift work$149.8k - $262.2k
...Company Description It all started when engineer Fred Luddy wrote code that automated a... ...meaningful work. Today, ServiceNow is the AI control tower for business reinvention.... .... About the team: We are seeking a Senior Staff Software Engineer (IC5 Level) to join our Data...SeniorPermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$149.8k - $262.2k
...DescriptionIt all started when engineer Fred Luddy wrote... ...ServiceNow is the AI control tower for... ....Role SummaryAs a Staff AI Security &... ...engines, and real-time inference. You will bring... ...Evaluate where AI/ML has a legitimate role... ...years of professional software engineering...Work at officeImmediate startRemote workFlexible hours$260k - $320k
...station — Architect the hardware, software, and network stack (HSM, key... ...which includes manufacturing engineering, with a comparable depth of... ...processes. Ideally 3 years at a Staff level or equivalent. ~ PKI... ...researchers, and product experts in AI and robotics. ~ Freedom to...SeniorFull timeContract workWork at office$150k - $220k
...need. Crucible is the software that runs that network.... .... We are hiring a Staff Machine Learning Engineer to build the applied AI systems behind Crucible.... ...optimization and ML models, integrate foundation... ...models and local model inference Experience with manufacturing...Temporary workLocal areaRelocationRelocation package$181.2k - $317.1k
...DescriptionIt all started when engineer Fred Luddy wrote... ...ServiceNow is the AI control tower for... ...scientists and software engineers working... ...Otto.We are seeking a Staff AI-Native DevOps... ...understanding of how ML and LLM-based... ...architectures, including model inference, retrieval-...SeniorWork at officeImmediate startRemote workFlexible hours$181.2k
...Company Description It all started when engineer Fred Luddy wrote code that automated a... ...work. Today, ServiceNow is the AI control tower for business reinvention.... ...will be considered. About the team As a Senior Staff Software Engineer with the Data Platform organization...SeniorPermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$264k - $363k
...re more than just a software company — we're building the AI-native platform where... ...Machine Learning Engineer to help define and lead... ...in partnership with senior leadership.Scale... ...standards for end-to-end ML systems: data... ...evaluation, deployment, and inference infrastructure....Full timeFlexible hours$142.3k - $214.3k
...a hardworking team of engineers in a highly reciprocal... ...for battery algorithm software engineer to design and... ...architecture of machine learning inference pipelines and... ...infrastructure.Experience in using AI coding tools and... ...and creative ML feature development in...Relocation$188.5k - $255k
...imaginative thinkers. In pursuit of becoming AI-native, we recognize that fostering a "... ...execute on web, mobile, and front end software developmentProvides technical direction and... ...AI technologyCoach and mentor junior engineers on best practices of software engineering...Work experience placementWorldwide$188.5k - $255k
...imaginative thinkers. In pursuit of becoming AI-native, we recognize that fostering a "... ...the design and implementation of durable software solutions to solve critical customer... ...with AI technologyCoach and mentor junior engineers on best practices of software engineering...Work experience placementWorldwide$140k
...Senior Machine Learning Engineer Location: San Diego, CA, US Sensoride has been driven by a simple vision - to make sensing... ...learning models for radar signal processing. Evaluate novel ML and deep learning architecture for radar data. Develop...SeniorFlexible hours$155.6k - $233.4k
...thought possible.We are searching for a software engineer who is ready to join us in this important... ...estimated base salary range for the Staff Software Engineer role based in the United... ...of generative artificial intelligence (AI) in the application and interview process...Full timeLocal areaWorldwide$198.2k - $297.4k
...PlayStationPlus, acclaimed PlayStation software titles from PlayStation... ...of Sony Corporation.Staff Software Engineer - Data Do you want to join a... ...analytics architecture, integrate AI-powered platform... ...applications.·Experience applying AI/ML techniques and modern AI...Immediate start- ...unleashing the power of AI to create value at... ...Supply Chain and Engineering, and Talent, with... ....com.The RoleAs Senior Manager, Pre-Sales... ...support complex software sales cycles by delivering... ...rules-based and ML detection. Agents... ..., managed LLM inference, event streaming,...SeniorWork experience placementLive inWork at officeLocal area
- ...customer interactions into an engine for growth, moving... ...their customers.Service AI & Data puts AI at the heart... ...experience managing senior stakeholder relationships... ...including model serving and inference, deployment pipelines,... ...running AI and ML workloads in production,...SeniorLive inWork at officeLocal areaShift work
- ...Job Description Job Description Shield AI is a venture-backed defense-tech company... .... Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon... ...Job Description: We are hiring a Software Engineer, Autonomy Integration, who will be...SeniorFull timeTemporary workPart timeWorldwide
$170k - $180k
...180,000 base + bonus Join an established global enterprise technology company making significant investments in AI infrastructure, platform engineering, and modern developer tooling. The Mission The company is building and scaling a centralized AI platform that...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Staff Software Engineer - AI/ML Inference Engineering. Be the first to apply!
- machine learning ai engineer San Diego, CA
- ai engineer San Diego, CA
- ai prompt engineer San Diego, CA
- ai developer San Diego, CA
- ai engineer remote San Diego, CA
- senior ai engineer San Diego, CA
- ai ml engineer San Diego, CA
- senior ml engineer San Diego, CA
- machine learning software engineer San Diego, CA
- computer vision machine learning engineer San Diego, CA






