Scale ML Inference & Model-Serving Engineer
Mixpeek
zaimler is seeking an engineer to own our inference and model-serving infrastructure end to end, enabling production-grade AI agents to run fast and reliably at scale. You’ll report to Sofus and collaborate with ML and infra teams on deployment and scalability.
You will set up and scale inference systems, manage GPU resources for concurrency, and optimize the engine that powers scalable agent orchestration, joining an early engineering team in a cutting-edge context.
#J-18808-LjbffrVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Scale ML Inference & Model-Serving Engineer in San Mateo, CA vacancy
- ...Digitailor is seeking an experienced ML systems engineer to join its AI systems team in... ...You will optimize training and inference performance for image, video, and world-model workloads, focusing on GPU... ...execution, and high-performance serving systems. The role requires...Suggested
Digitailor
Menlo Park, CA1 day ago - ...Member of Technical Staff to build the ML systems that make sustained AI research... ...own performance-critical systems across model serving, GPU execution, and distributed... ...workloads. The work goes beyond deploying an inference engine: you will understand its internals, identify...SuggestedFull time
Bake AI Inc.
San Mateo, CA9 hours ago $397.46k
...technical challenges at scale, and helping to... .... Our Economy ML team sits at the heart... ...a Distinguished Engineer/Technical Director... ..., generative modeling, and LLM-powered personalization... ...training to live inference.Complex surfaces,... ...for training, serving, and evaluating...SuggestedFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayRoblox
San Mateo, CA4 days ago- ...Senior/Staff Inference Reliability EngineerParasail... ...Reliability Engineer will own the end-to... ...across the entire serving path—from APIs, routing... ...autoscaling through model servers, GPUs, networking... ...with GPUs, ML infrastructure, model... ...storage, or large-scale production engineering...Suggested
Parasail
San Mateo, CA5 days ago $419.39k
...solving unique technical challenges at scale, and helping to create safer, more... ...for everyone.As a Distinguished Engineer/Technical Director on Discovery,... ...infrastructure for training, serving, and evaluating both traditional ML models and Generative AI models (e.g., embedding...SuggestedFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayRoblox
San Mateo, CA4 days ago$176k - $224k
...Description AI Field Engineer - Enterprise... ...customer-facing AI/ML field engineering (... ...environment Hands-on LLM inference and fine-tuning... ..., and tuned open-model deployments Ran... ...Hard Skills LLM serving frameworks (vLLM, SGLang... ...to production at scale Manage multi-...Full timeWork experience placementH1bWork at officeRemote workVisa sponsorshipCross Border Talents
San Mateo, CA2 days ago$170k - $277.5k
...Autonomy Engineer - Deep Learning Model Acceleration San Mateo, California, United States... ...for building and scaling the infrastructure that supports... ...-performance deep learning inference for CV workloads that can deliver... ...using Machine Learning (ML) Leverage your expertise...Full timeLocal areaRelocation packageSkydio
San Mateo, CA1 day ago- ...to build, train, and serve AI models tailored to their own... ...training and harness engineering. (blog) The fine-tuning... ...depend on to ship and scale it. These engagements... ...GenAI, architect the inference foundations that capability... ...Solutions Architect, ML Engineer with field exposure...
Fireworks AI
San Mateo, CA4 days ago $176k - $224k
...Description AI Field Engineer - Enterprise... ...Confidential — generative AI inference and fine-tuning... ...choose the right model architecture and deployment... ...to production at scale. Manage multi-... ...client-facing AI/ML roles (forward... ...tuning: open-model serving frameworks (vLLM, SGLang...Full timeH1bRemote workVisa sponsorshipTransparent Search Group
San Mateo, CA14 days ago- ...world. Our foundation model, Newton, understands the... ...Role** You will own the serving path for Newton and... ...multimodal models. Much of our inference stack is Rust-native:... ...runtime, built on Rust ML stacks (candle, Burn)... ...** ~6+ years software engineering, several of them in ML...
Pivots Hiring
San Mateo, CA9 hours ago $300k - $400k
...state-of-the-art models to accelerate breakthroughs... ...training and inference fast, efficient,... ...in large-scale training runs Run... ..., scheduling, and serving architecture at production... ...distributed ML systems to identify... ...— the scientists, engineers, and problem-solvers...Visa sponsorshipFlexible hoursShift workPeriodic Labs
Menlo Park, CA9 hours ago$160k - $200k
...building Machine Learning models for computer vision.... ...Vision and developing ML models. Additionally, you... ...for updating and scaling our current ML pipelines... ...to build training and serving pipelines is also a key... ...cases require low latency inference that approaches real time...Dexterity
Redwood City, CA4 days ago$170k - $236.5k
...Vision. The successful candidate will be responsible for optimizing deep learning inference processes across various hardware platforms, while ensuring performance efficiency and effective model management. This position offers a competitive salary range of $170,000 to $23...Relocation packageSkydio
San Mateo, CA3 days ago- ...Forward Deployed Engineer (FDE)As a Forward Deployed... ...them integrate model APIs, GPU... ...including:Model APIs and inference endpointsDedicated... ...HaveExperience with AI/ML infrastructure, LLMs... ..., or distributed serving frameworks.Experience... ..., CUDA, or large-scale compute systems.Background...Work at office
Novita AI
San Mateo, CA1 day ago $170k - $240k
...About The Role As a Senior Engineer on the Autonomy Data... ...turn it into high‑quality, model‑ready datasets that... ...and slicing fast and self‑serve for Autonomy teams (e.g.... ...data pipelines for large‑scale datasets (ETL/ELT, streaming... ...evaluation loops for ML models. Compensation At...Full timeLocal areaRelocation packageSkydio
San Mateo, CA4 days ago$175k - $215k
...delivery service. We are on a mission to serve all humans equally by ensuring access to... ...across the globe.We operate at a global scale and are looking for practical problem solvers... ...control.Partner directly with the design engineers, test engineers, and the TPM on our team,...Contract workPart timeLocal areaZipline
South San Francisco, CA4 days ago- ...We provide high-performance Model APIs, dedicated inference infrastructure, and Agent... ...enterprises build, deploy, and scale production AI applications.As a Forward Deployed Engineer, you'll work directly with... ..., Linux, networking, model serving, and distributed systems....
Novita AI
San Mateo, CA5 days ago - ...Senior Site Reliability Engineer who is equally at home... ...large fleet of GPU-backed models. We run nearly 30... ...admission control and scaling. The goal: route and schedule inference calls so we use our capacity... ...Familiarity with ML inference serving and model deployment (e...Shift work
Hippocratic-Ai
Menlo Park, CA9 hours ago $243.29k - $295.25k
...unique technical challenges at scale, and helping to create safer,... ...Foundation Hardware Engineering team, you will play a key role... ...massive-scale rendering and ML workloads run on the most optimized... ...rendering and low-latency AI inference.Firmware & Systems: Lead firmware...Full timeWork experience placementH1bWork at officeLocal areaRemote workVisa sponsorshipMonday to FridayRoblox
San Mateo, CA5 days ago$243.29k - $295.25k
...unique technical challenges at scale, and helping to create safer,... ...learning, classifiers for 3D models, experimentation, automation,... ...the single most critical engineering problem we face. The platform... ...creating frictionless, self-serve onboarding pathways for new safety...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayShift workRoblox
San Mateo, CA2 days ago- ...to build, train, and serve AI models tailored to their own... ...hiring a Manager, Field Engineering to lead a team of Field... ...of Fireworks’ inference and fine-tuning platform... ...regional sales leadership to scale the engagement model,... ...latency issue with an ML engineer in the same...
Fireworks Inc
San Mateo, CA1 day ago $188k - $282k
...The Hivemind Software Engineering Integration and Test team... ...code, machine learning models, simulation and... ...environments. Build automated ML validation pipelines... ...model and data drift, inference health, test results, and... ...data leakage, training-serving skew, nondeterminism,...Full timeTemporary workPart timeWorldwideShift workShield
San Mateo, CA4 days ago$345.04k - $399.42k
..., solving unique technical challenges at scale, and helping to create safer, more civil... ...experiences for everyone.As a Principal Software Engineer on Creator Services Data, you’ll be... ...systems including infrastructure, serving layers, clients, and web APIs.Expand the...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayRoblox
San Mateo, CA1 day ago- ...SkyPilot is seeking an engineer to own the GPU and ML-systems layer that powers frontier... ..., utilization, and the serving path across clouds and... ...enabling scalable training, inference, and multi-cluster serving... ...cutting-edge AI compute forward at scale. #J-18808-Ljbffr...Remote work
SkyPilot Cloud Consulting Inc.
San Mateo, CA4 days ago - ...adopted by multiple ML teams and use cases.... ...utilization, and training or inference cost. Investigate... ...Collaborate with ML engineers and data scientists... ...tracking, model registries, or model serving. ~ Experience designing... ...GPU workloads at scale on Kubernetes, including...Full timeWork at officeMonday to Friday
$254k - $350k
...multi-modality foundation model to drive the next... ...and System Optimization Engineer, you will orchestrate and... ...allow for more efficient inference by sharing various... ...production-ready large-scale models to our on-vehicle... ...addition, you will optimize ML models, write custom...Full timeTemporary workRelocation packageZoox
Foster, CA2 days ago$196.75k - $243.29k
...unique technical challenges at scale, and helping to create safer,... ...everyone.As a Senior Security Engineer on the Detection and Response... ...Lead partners through threat modeling and logging, to deploying actionable... ....Embody security culture: Serve as a trusted security partner...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayRoblox
San Mateo, CA2 days ago$100k - $300k
...without failing. We believe massive scale through data-driven machine learning... ...Overview We are seeking a Principal Sales Engineer to own the technical modeling and system design process that... ...our warehouse robotics systems while serving as the primary feedback loop between...Hourly paySkild AI
San Mateo, CA5 days ago- ...Senior Manager, Applied Field Engineering — AI/ML Product Specialists to lead... ...— including Cortex AI, ML modeling, and agentic workflows. You... ...capabilities. Critically, you will serve as a strategic bridge... ...customers successfully build and scale AI/ML workloads on Snowflake...
Precision Labs
Menlo Park, CA4 days ago $200k - $250k
...in seconds, not minutes. We’re rapidly scaling this impact: today, more than 2 million... ...Work cross functionally with Security, IT, Engineering, Product and Legal to provide guidance... ...campaign badge veteran” means a veteran who served on active duty in the U.S. military,...Full timeFor contractorsWork visaFlexible hoursShift workVerkada Inc.
San Mateo, CA9 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Scale ML Inference & Model-Serving Engineer. Be the first to apply!
Related searches
- senior ml engineer San Mateo, CA
- machine learning software engineer San Mateo, CA
- machine learning engineer San Mateo, CA
- computer vision machine learning engineer San Mateo, CA
- machine learning research scientist San Mateo, CA
- machine learning San Mateo, CA
- data engineer machine learning San Mateo, CA
- machine learning part time San Mateo, CA
- artificial intelligence - machine learning intern San Mateo, CA
- machine learning remote San Mateo, CA