Senior Staff ML Engineer - AI Inference & Kubernetes

Jobleads-US

ServiceNow is seeking a Senior Staff Machine Learning Engineer (DevOps) to lead architecture, optimization, and operations of our AI inference platform in a production Kubernetes environment. You will own the end-to-end lifecycle from onboarding models to deploying optimized inference engines across backends and backends on Kubernetes.

You will architect the gateway layer with Envoy/ext_proc for access control, observability, and routing, balancing pragmatic engineering with measurable

#J-18808-Ljbffr Jobleads-US

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Senior Staff ML Engineer - AI Inference & Kubernetes in Santa Clara, CA vacancy

Senior ML Engineer (DevOps) for AI Inference Platform
...ServiceNow is hiring a Senior Staff (DevOps) Machine Learning Engineer to lead architecture, optimization, and operational excellence of the AI inference platform. You will own the end-to-end lifecycle... ...engines in production across Kubernetes backends, with gateway workloads...
Senior
Jobleads-US
Santa Clara, CA
1 day ago
Senior Staff ML Ops Engineer
$130.7k - $261.3k
..., and scientists.THE OPPORTUNITYThis Senior Staff ML Ops Engineer position can work out of our Santa Clara... ...'s Medical Devices Digital (MDD) AI initiatives, driving the architecture... ...containerization technologies (e.g., Docker, Kubernetes), pipeline orchestration tools (e.g....
Senior
Shift work
Abbott
Santa Clara, CA
1 day ago
Senior Staff (DevOps) Machine Learning Engineer
$201.3k - $352.3k
...all started when engineer Fred Luddy wrote code... ...ServiceNow is the AI control tower for... ....We are seeking a Senior Staff Machine Learning... ...excellence of our AI inference platform. You will... ...backends on Kubernetes infrastructure. You... ...softwareKnowledge of core AI/ML techniques and...
Senior
Work experience placement
Work at office
Immediate start
Remote work
Flexible hours
ServiceNow
Santa Clara, CA
1 day ago
Senior ML Performance Engineer - Training & Inference
...Wayve is building an end-to-end AI platform for autonomous driving, combining... ...deployment. We’re seeking a senior leader to drive performance across ML workloads, GPUs and distributed systems... ...hardware strategy for training and inference, enabling faster models and safer...
Senior
Jobleads-US
Sunnyvale, CA
2 days ago
Senior/Staff Machine Learning Engineer, Motion Planning
$130k - $220k
Santa Clara, CASoftware Engineering - Motion Planning /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual... ...deploy the latest generation of ML-based planning algorithms on... ...TensorRT, ONNX Runtime, CUDA, or ML inference optimization.Experience with...
Senior
Full time
Plus.ai
Santa Clara, CA
3 days ago
Senior Staff Machine Learning Engineer
$227k - $300k
...driving the transformation to AI-enabled software-defined... ...are looking for a great Senior Staff Machine Learning Engineer to join our seasoned AI team... ...will own the end-to-end ML pipeline—from data ingestion... ...modern C++ (C++14/17 for inference).Deep proficiency with...
Senior
Work at office
Worldwide
Flexible hours
Shift work
3 days per week
Sonatus
Sunnyvale, CA
2 days ago
Senior Staff Machine Learning Engineer
$201.3k - $352.3k
...entrepriseIt all started when engineer Fred Luddy wrote code that automated... .... Today, ServiceNow is the AI control tower for business... ...Team Emerging tech is a small senior group inside AI Engineering and... ...Exposure to LLM fine-tuning or inference optimization in productionWhy...
Senior
Work experience placement
Work at office
Immediate start
Remote work
Flexible hours
ServiceNow
Santa Clara, CA
3 days ago
Senior Staff ML Engineer
$300k
...Grindr is an AI-native platform powering millions... ...evolution, and you’ll be a senior technical leader... ...We’re doubling down on ML as the future of Grindr... ...teams, collaborating with engineering, data science and product... ...(Snowflake, Airflow, Kubernetes, Docker, Helm, Spark, PySpark...
Senior
Casual work
Work at office
Immediate start
Worldwide
Flexible hours
Grindr
Palo Alto, CA
2 days ago
Senior Staff ML Engineer
$150k - $300k
...Overview: We are seeking an accomplished Senior Staff ML Engineer who will serve as a technical leader for Generative AI applications at GEICO. In this individual contributor... ...life cycle (e.g. CI/CD pipelines, Kubernetes-based deployments, testing, monitoring & alerting...
Senior
Hourly pay
Work experience placement
Local area
Government Employees Insurance Company
Palo Alto, CA
1 day ago
Senior Inference Solutions Architect: Kubernetes GPU Pipelines
...NVIDIA Corporation is hiring a Solutions Architect focused on AI inference to design and deploy scalable inference pipelines on Kubernetes and GPU clusters. You will collaborate with engineering and customer teams to deliver enterprise AI solutions and production-grade...
Senior
Jobleads-US
Santa Clara, CA
1 day ago
Matterport - Senior ML Ops Engineer
$173k - $253k
Matterport - Senior ML Ops Engineer Job Description CoStar Group is a leading... ...performance, optimize inference speed and resource... ...acceleration, and efficient AI.Contribute to the continuous... ...technologies (e.g., Docker, Kubernetes).Demonstrated ability to build...
Senior
Full time
Work at office
Work from home
Matterport
Sunnyvale, CA
1 day ago
Senior Staff Machine Learning Engineer_Voice AI Engineer
$201.3k - $352.3k
Company DescriptionIt all started when engineer Fred Luddy wrote code that automated a tedious... ...work. Today, ServiceNow is the AI control tower for business reinvention. Our... ...highly available distributed workloads on Kubernetes following a DevOps approach.  Experience...
Senior
Work experience placement
Work at office
Immediate start
Remote work
Flexible hours
ServiceNow
Santa Clara, CA
4 hours ago
Senior ML Inference & Compiler Engineer
...NVIDIA Corporation is seeking a Senior Machine Learning Applications and Compiler Engineer to advance end-to-end inference optimization across NVIDIA platforms. You will work at the intersection of large-scale systems, compilers, and deep learning to map neural network...
Senior
Jobleads-US
Santa Clara, CA
1 day ago
Senior Applied ML Engineer
$182k - $242k
...Senior Applied ML Engineer Bellevue, WA / Sunnyvale, CA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers... ...fraction of the total inference market, which is worth tens... ...many others): Kubernetes Megatron Temporal...
Senior
Full time
Temporary work
Casual work
Work at office
Flexible hours
CoreWeave
Sunnyvale, CA
4 days ago
Staff / Principal Machine Learning Engineer, Inference - USA
...Inworld is a research lab and inference provider focused on realtime AI for consumer-facing... ...Scaling. Experience with Kubernetes, Ray, custom load balancing... ...to major inference engines, or deep-dive technical write... ...experience building backend or ML systems. Who Thrives...
Full time
Work at office
Relocation package
Jobleads-US
Mountain View, CA
11 hours ago
Senior Staff Machine Learning Engineer - Autonomous Driving Foundation Models
$244.14k - $413.16k
...of innovation, integrating advanced AI and autonomous driving technologies into... ...scenarios of global driving. As a Senior Staff Machine Learning Engineer, you will architect the transition from... ...resources to support your ML model development/research.Opportunity...
Senior
Full time
Overseas
XPENG Motors
Santa Clara, CA
2 days ago
Senior/Staff Machine Learning Engineer (Reinforcement Learning), Motion Planning
$130k - $220k
Santa Clara, CASoftware Engineering - Motion Planning /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe, Plus...
Senior
Full time
Plus.ai
Santa Clara, CA
3 days ago
Staff Machine Learning Engineer - Agentic Models, LLM, RAG, GenAI
$232k - $310k
...is a global leader in AI-native enterprise talent... ...and high standards. Our engineers, product leaders, and... ...world works.About AII/ML TeamOur AI/ML team is building... ...technologies (Docker, Kubernetes).Understanding of... ...strategies (QLORA, DPO) and inference optimization (vLLM,...
Work experience placement
Work at office
Remote work
Flexible hours
3 days per week
Eightfold
Santa Clara, CA
3 days ago
Staff ML Engineer
Company DescriptionAxiado is an AI-enhanced security processor... ...the roleWe're looking for an ML engineer who works across the full... ...comfortable optimizing training and inference performance on GPU/AI-... ...EngineeringExperience level: Mid-Senior LevelIndustry: Semiconductors
Axiado Corporation
San Jose, CA
2 days ago
Staff ML Engineer - Embodied AI Onboard Autonomy
$180k - $280k
...driving? Join the Embodied AI team at General Motors. Our... ...across real-world scenarios.As a Staff AI/ML Engineer within the Onboard Embodied... ...organization, you will be a senior individual contributor... ...solutions capable of real-time inference and robust autonomous driving...
Full time
Local area
Work from home
Relocation
Relocation package
General Motors
Sunnyvale, CA
4 days ago
Senior Staff Machine Learning Engineer
$150k - $300k
...Great Careers. GEICO is seeking a Senior Staff AI engineer to join our AI org. This person will play... ...high performance, multi-system AI/ML platforms, with hands-on experience and... ...cycle (version control, CICD pipelines, Kubernetes clusters, testing, monitoring &...
Senior
Hourly pay
Work experience placement
Local area
GEICO
Palo Alto, CA
5 days ago
Senior Staff Machine Learning Engineer
$157.5k - $225k
...believe the future of work is Human + AI and are building an AI-native... ...Zscaler. Role We are looking for a Senior Staff Machine Learning Engineer to join our team. This is a remote (USA... ...) Experience with production AI or ML systems where cost, latency, and accuracy...
Senior
Full time
For contractors
Work at office
Local area
Remote work
Zscaler
Santa Clara, CA
3 days ago
Senior Staff Machine Learning Engineer, Agentic Systems - Moveworks
...we areMoveworks is the Agentic AI Assistant platform that... ...automation with Moveworks’ Reasoning Engine and natural language... ...Engineer to help build cutting edge ML infrastructure for building and... ...including distributed training and inference pipeline for large language...
Senior
Permanent employment
Work at office
Remote work
Flexible hours
Moveworks
Mountain View, CA
4 days ago
Senior Staff Machine Learning Engineer, ML Platform
$262.5k - $394k
...Senior Staff Machine Learning Engineer, ML Platform Cupertino, California, United States Software and Services At Apple, we work every day... ...foundational infrastructure in model training, inference and agentic AI, as well as associated data and application services...
Senior
Immediate start
Relocation
Jobleads-US
Cupertino, CA
3 days ago
Senior AI/ML Performance Engineer
$144.7k - $261.3k
...cloud infrastructure, and ML/AI GPU platforms for AV research... ...GM is looking for a Senior Performance Engineer to join the AV Capacity and... ...large‑scale ML training and inference environments. Your skills... ...Hands‑on experience with Kubernetes for orchestrating complex...
Senior
Work at office
Local area
Remote work
Work from home
Flexible hours
3 days per week
General Motors
Sunnyvale, CA
1 day ago
Staff Machine Learning Engineer - Data Lake, Anomaly Detection
$152k - $190k
...future of work is Human + AI and are building an... ...are looking for a Staff Software Engineer to join our team. This... ..., fine-tuning, and inference optimizationWork with... ...understanding of AI/ML technologies and experience... ...microservices using Kubernetes and Docker in Python,...
Full time
Work at office
Local area
Worldwide
3 days per week
Zscaler
San Jose, CA
2 days ago
Senior ML Engineer, Metropolis
$184k - $287.5k
...harnessing the boundless capabilities of AI to build the next era of computing. An... ...autonomous systems at scale. We seek a Senior ML Engineer to compose and deliver next-generation... ...compression, quantization, and real-time inference optimization for production deployments...
Senior
Full time
Nvidia
Santa Clara, CA
3 days ago
Senior Machine Learning Engineer, DevOps/SRE
$148.75k - $361k
...Reinforcement Learning, AI, Control and... ...Experimentation, and Inference Platform that powers... ...talented and experienced Senior Software Engineer, MLOps/DevOps, to join... ...platforms that accelerate ML experimentation and... ...on GCP and AWS using Kubernetes, Apache Airflow,...
Senior
Work at office
Local area
Remote work
Monday to Thursday
Flexible hours
Roku
San Jose, CA
2 days ago
Senior Staff Machine Learning Engineer
$201.3k - $352.3k
...It all started when engineer Fred Luddy wrote code that automated... ...work. Today, ServiceNow is the AI control tower for business reinvention... ...like. The role As a Senior Staff Engineer, you own the... ...systems and probabilistic or ML-driven scoring—graph modeling,...
Senior
Full time
Work at office
Immediate start
Remote work
Flexible hours
ServiceNow
Santa Clara, CA
28 days ago
Staff ML Performance Engineer
...the future. Very few people in AI can say this. Every role here,... ...role covers. About our Engineering Teams The Performance Architecture... ...across training and cloud inference, so that performance unlocks new... ...ll be working on Profiling ML workloads across training and...
Work at office
Remote work
Visa sponsorship
Relocation package
Flexible hours
Shift work
Jobleads-US
Sunnyvale, CA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Staff ML Engineer - AI Inference & Kubernetes. Be the first to apply!