Staff Inference Engineer — GPU-Optimized ML Serving
Uniphore
Uniphore, a leading Business AI company, seeks a Staff Inference Engineer to own the inference layer across cloud and on-premises. You will implement context-aware runtimes, optimize KV-cache and prompt-prefix handling, and drive high-performance multi-GPU deployments. This hands-on role collaborates with research, model engineering, and platform teams. You will contribute to autoregressive inference, model lifecycle management, and scalable serving with zero-downtime upgrades. #J-18808-Ljbffr Uniphore
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Staff Inference Engineer — GPU-Optimized ML Serving in Palo Alto, CA vacancy
- ...research lab and inference provider focused on... ...party speech models, serve LLMs, and run the... ...a case.Inference Optimization. Deep... ...balancing, multi-GPU/multi-node inference... ...to major inference engines, or deep-dive technical... ...building backend or ML systems.Who Thrives...SuggestedFull timeWork at officeRelocation package
Inworld AI
Mountain View, CA3 days ago $175k - $218.7k
...business. Job Description:Staff Inference Engineer -Uniphore is building... ...-aware runtime serving finetuned SLMs across... ...premises, and widely used GPU platforms.This is a... ...and computation optimization: Build paged KV-cache... ...distributed inference, or ML serving• Production...SuggestedFull timeUniphore
Palo Alto, CA1 day ago$207k - $340k
...centered on trust and optimized for culture,... ...hiring a Principal Staff Software Engineer to lead LinkedIn’s GPU-Based Retrieval Platform... ...distributed serving, GPU scheduling, memory... ...NCCL, distributed inference, multi-GPU communication... ...Skills:AI / ML Infrastructure Technical...SuggestedFor contractorsWork at officeRemote workWork from homeFlexible hoursLinkedin
Mountain View, CA1 day ago- ...Moveworks’ Reasoning Engine and natural... ...looking for a hands-on Staff Engineer who can... ...intersection of ML systems, platform... ...management, serving, monitoring, feedback... ...data pipelines, inference services, model quality... ...and resource optimization, including GPU resources where...SuggestedWork at officeImmediate startRemote workFlexible hours
Moveworks
Mountain View, CA2 days ago - ...possible with LLM inference on heterogeneous hardware... ...patterns to deep optimization of inference... ...applied research and engineering team that moves... ...production-grade inference serving.This RoleWe are... ....Familiarity with GPU kernel programming... ...inference or ML systems projects....Suggested
d-Matrix
Santa Clara, CA3 days ago $207k - $300k
...through advanced context engineering and agentic feedback loops... ...bottlenecks in recommending and serving AIGC content to optimize efficiency for low-latency... ...machine learning inference, resolving system-level bottlenecks... ...user interests. As a Staff Machine Learning Engineer...Google
Mountain View, CA19 hours ago$278k - $330k
...team responsible for ML and work alongside industry... ...scientists and engineers. As a Staff Machine Learning Engineer... ...order to scale and optimize our ML systems—... ..., post-training, and inference strategies for large... ...training, inference, and serving infrastructure.Is comfortable...Permanent employmentOtter.ai
Mountain View, CA1 day ago$200k - $250k
...experienced Senior Staff Engineer specializing in AI... ...-generation AI inference pipelines. This role... ...data movement across GPU, memory, and... ...large-scale system optimization, with a proven track... ...layers.Partner with AI/ML engineering teams... ...systems, LLM serving architectures, and...DataDirect Networks
Santa Clara, CA2 days ago- ...with Moveworks’ Reasoning Engine and natural language... ...help build cutting edge ML infrastructure for building and serving LLM’s at Moveworks. This... ...be critical in building, optimizing and scaling end-to-end machine... ...training and inference pipeline for large language...Permanent employmentWork at officeRemote workFlexible hours
Moveworks
Mountain View, CA2 days ago $171k
Sr. Staff ll, AI Engineer - Search (L7-2)We exist to wow our customers... ...Models (LLMs) serve as the fundamental core... ..., high-throughput inference, and real-time data pipelines... ...hallucinations and optimizing large-scale cost-... ...latest advancements in AI/ML.Exposure/experience...Temporary workFlexible hoursCoupang
Mountain View, CA1 day ago$175k - $265k
...possibilities of AI. Senior Staff Inference Performance EngineerLocation... ...OverviewThe Inference Cloud Engineering team builds the deployment and... ...problems across the full serving path, from orchestration (scheduling... ...in an LLM serving system.GPU programming and profiling...Permanent employmentRemote workShift workd-Matrix
Santa Clara, CA1 day ago$192.6k - $317.8k
...scale. We're hiring a Staff Backend Engineer to build and operate the... ...reliability, and scalability of inference systems. Join us and... ..., high-throughput serving infrastructure Partner with ML engineers to ensure... ...and Grafana Manage and optimize cloud infrastructure on...Work at officeWorldwide$210k - $275k
..., and rapidly changing inference infrastructure. We’re hiring a Staff Backend Engineer to help build and operate... ...exists to serve the product: the systems... ...batching, caching, or GPU‑backed workloads. Experience... ...deployment systems. Experience optimizing systems for throughput,...Work at officeImmediate start- ...and identify training and inference bottlenecks involving memory... ...attention techniques. Optimize model code for TPU and GPU accelerators using... ...-latency, high-throughput serving solutions for generative models... ...PyTorch. ~ Expertise with ML workload profiling tools such...Full timeRemote work
- ...exists We need a Backend Engineer to build the systems that orchestrate GPU clusters for AI... ...compute per hour, where your optimizations directly impact whether... ...Optimize cold starts for model serving and implement efficient... ...Understanding of ML,AI workload patterns and...Hourly payFull timeWork at officeWork from homeVisa sponsorship
- ...About the role As a Staff AI Engineer for Applied AI, you... .... Keep production inference fast and economical — serving stack choice and tuning... ..., batching, GPU utilization, and routing... ...; MS/PhD in ML, CV, or a related field... ...knowledge of inference optimization (serving stacks,...Odd jobNight shift
$152k - $277k
...organization is responsible for optimizing customers' navigation... ...offline and online ML platforms to support... ...be easily consumed by engineers and scientists. You will... ...also be responsible for serving complex ML models in... ...compensation.The base pay for Staff position ranges from $1...Temporary workCoupang
Mountain View, CA4 days ago$187k
Sr. Staff ll, ML Engineer - Search & Discovery Relevance We exist to wow our customers. We know we... ...this effort across the stack, including serving, pipelines, and machine learning.The... ...into underlying components, design and optimize the stack end-to-end and be a role...Temporary workWork experience placementFlexible hoursCoupang
Mountain View, CA2 days ago- ...an experienced and passionate engineer leader that can drive this effort... ...across the stack, including serving, pipelines, and machine... ...underlying components, design and optimize the stack end-to-end and be a... ...technical blockersEnsure solid ML design and operational excellenceBe...Temporary work
Coupang
Mountain View, CA3 days ago $106k - $205k
Title: Staff System Engineers Engineer, AI/MLAbout GlobalFoundries... ...a seasoned Staff AI/ML Systems Engineer to lead... ...we study, model, and optimize AI/ML workloads for... ...organizations, and serve as a technical authority... ...— NPUs, dedicated inference accelerators, DSP-based...Full timeWork at officeLocal areaGlobalfoundries
Santa Clara, CA1 day ago$202.5k - $274k
...people and communities we serve. With tens of millions of customers... ...is looking for a Staff Machine Learning Engineer to own the data and platform... ...evaluation frameworks, real-time inference serving, and the handoff... ...engineering standards for ML systems on this team — testing...WorldwideIntuit
Mountain View, CA3 days ago$184.6k - $253.55k
....-level Senior AI Research Engineer with solid ML/AI technology background and... ...efficient on-device inference Conduct feasibility studies... ...~ Experience designing and optimizing algorithms to work efficiently... ...veteran" means a veteran who served on active duty in the U.S....For contractorsWork at officeLocal area$190.9k - $334.1k
...It all started when engineer Fred Luddy wrote code that... ...Description Senior Staff Software Engineer,... ...search infrastructure that serves as the backbone of our... ...with Search Ranking, ML, Platform, and AI teams... ...-aware representations optimized for agent consumption....Full timeWork at officeImmediate startRemote workFlexible hoursServiceNow
Mountain View, CA17 days ago$170k - $225k
...the RoleAs a Senior/Staff Machine Learning Engineer, you will be working... ...scaling our current ML pipelines to cover more... ...training and inference pipelines using PyTorch... ...and experiments to optimize model performance and... ...across training and serving pipelinesMaintain clean...WorldwideDexterity
Redwood City, CA19 hours ago- ...plugs into that. About Our Engineering Teams The Performance... ...training and cloud inference, so that performance unlocks... ...teams on cloud GPU hardware strategy. What... ...Be Working On Profiling ML workloads across training... ...Experience optimising inference serving systems (e.g. latency,...Work at officeRemote workVisa sponsorshipRelocation packageFlexible hoursShift work
- ...seeking a high-impact Machine Learning Engineer to join the Uber Freight marketplace team and advance ML models that power pricing, matching, and optimization for a $1T market. You'll own end-to... ...predictive modeling, causal inference, and marketplace design challenges...
$152k
...organization is responsible for optimizing customers’ navigation... ...build scalable offline and online ML platforms to support ranking and... ...that can be easily consumed by engineers and scientists. You will also be responsible for serving complex ML models in real time...Temporary workFlexible hours$175k - $287k
...centered on trust and optimized for culture,... ...trust platforms. As a Staff AI Software Engineer you will own end-to-end... ...efficacy, and managing the GPU fleets that run them... ...quality improvement (i.e. inference/training efficiency,... ...applying AI/ML to recommender systems...For contractorsWork at officeImmediate startFlexible hoursLinkedin
Mountain View, CA2 days ago$197.5k - $272k
...looking for a great Staff Machine Learning Engineer to join our... ...own the end-to-end ML pipeline—from data ingestion... ...edge devices and model optimization. You will work in a... ...execution on CPU/GPU-bound targets or embedded... ...C++ (C++14/17 for inference). ~ Deep...Work at officeWorldwideFlexible hoursShift work3 days per weekSonatus
Mountain View, CA6 days ago$190.9k - $334.1k
...all started when engineer Fred Luddy wrote code... ...a hands-on Senior Staff Engineer (... ...learning systems, inference engines, and security... ...RoleDesign and implement ML-driven security... ...and performance optimization.Proven track record... ...quantization, model serving infrastructure,...Work experience placementWork at officeImmediate startRemote workFlexible hoursServiceNow
Santa Clara, CA19 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Inference Engineer — GPU-Optimized ML Serving. Be the first to apply!
Related searches
- staff engineer Palo Alto, CA
- engineering aide Palo Alto, CA
- technology administrator Palo Alto, CA
- assistant engineer Palo Alto, CA
- senior staff engineer Palo Alto, CA
- senior staff systems engineer Palo Alto, CA
- software engineer staff Palo Alto, CA
- machine learning Palo Alto, CA
- machine learning part time Palo Alto, CA
- artificial intelligence - machine learning intern Palo Alto, CA