Kubernetes ML Inference Engineer: Model Serving
Abridge
Abridge is seeking an ML Infrastructure Engineer, Model Inference in San Francisco to build and optimize the core inference infrastructure powering our AI‑driven healthcare solutions. You will collaborate across Infrastructure and Research to deploy, optimize, and orchestrate AI models at scale. Ideal candidates have 2+ years of production ML infrastructure experience, strong Kubernetes know‑how, and a track record of engineering scalable APIs and distributed systems for real-time workloads. #J-18808-Ljbffr Abridge
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Kubernetes ML Inference Engineer: Model Serving in San Francisco, CA vacancy
- ...We are the first AI inference neocloud, using ASIC compute... ...You’ll take a new model and get it running — correctly... ...our silicon and start serving it. You own that loop:... ...5+ years in systems or ML systems, with real... ...tooling that did real engineering work, not demos. #J-1...SuggestedLive in
General Compute
San Francisco, CA1 day ago - ...technology company is looking for an ML Infrastructure Engineer in San Francisco. The successful... ...training pipelines and ensure low-latency model serving. Candidates should have over 4 years... ...in Python, and familiarity with Kubernetes. This role offers competitive salaries...SuggestedWork at office
- ...infrastructure company is looking for a Senior ML Engineer to optimize performance for voice models such as speech-to-text and text-to-... ...on productionizing models on advanced serving engines, focusing on GPU utilization and inference optimization. With over 5 years of...Suggested
- At Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize large-scale model serving systems from distributed infrastructure to low-level performance tuning, enabling reliable, scalable inference across...Suggested
$190k - $265k
...their business. Founded by engineers — and customer-obsessed — we... ...from data apps, AI agents, model training, model serving, and Vector Search. You'll... ...of AI.The Foundation Model Inference team is the backbone of Databricks... ...with platform, infra, and ML teams to deliver seamless...SuggestedLocal areaWorldwideDataBricks
San Francisco, CA6 days ago$190k - $265k
...their business. Founded by engineers — and customer-obsessed — we... ...from data apps, AI agents, model training, model serving, and Vector Search. You'll... ...AI. The Foundation Model Inference team is the backbone of... ...with platform, infra, and ML teams to deliver seamless end...Local areaWorldwideDatabricks Inc.
San Francisco, CA1 day ago- ...Learning Infrastructure Engineer to help architect the... ...next-generation model performance. Backed by... ...venture capital firms and serving elite technology enterprises... ...orchestration (e.g., Kubernetes) and modern... ...distributed training or inference engines.Practical experience...Full timeWork at officeFlexible hours
Objective Paradigm
San Francisco, CA2 days ago $200k - $280k
Engineering San Francisco Full-time $200,000 - $280,00... ...About the Role Join our ML Infrastructure team... ...train, deploy, and serve our AI models at scale. You'll work... ...systems for low-latency inference Implement monitoring... ...) Experience with Kubernetes and container orchestration...Full timeWork at office$204k - $216k
...the organization it serves. Let's achieve... ...build and run the inference infrastructure that turns the models and reasoning behind... ...research, and platform engineering, and you make the... ...right. The AI/ML Infrastructure and... ...accelerator runtimes. Kubernetes, containers, and...- ...Administrator / DevOps Engineer, you will maintain... ...behind both our model training and our inference cloud. You’ll split... ...orchestration systems (Slurm, Kubernetes) Experience... ...Prior work supporting ML/AI infrastructure,... ...deploying and operating LLM serving stacks (e.g., vLLM,...Work at officeRemote workRelocation package
Zyphra
San Francisco, CA1 day ago - ...AI/ML Engineer - San Francisco - Engineering - Hybrid - Full-time... ...that supports model execution, inference optimization, evaluation,... ...That may include: Model serving, inference pipelines, and... ...Face, vLLM, Triton, Ray, Kubernetes, or comparable model-serving...Full timeImmediate start
Theory Ventures
San Francisco, CA1 day ago $192k - $260k
A leading data and AI company is seeking a Staff Engineer to design and implement core systems for Foundation Model Serving. The ideal candidate will have over 10 years of experience in building large-scale distributed systems and will collaborate closely across teams...$220k - $320k
...Help us make inference blazingly fast. If you... ...specialized language models for companies that... ...-person team of engineers who work in-person... ...with the goal of serving models faster and... ...Collaborate with applied ML engineers to... ...Experience with Docker and Kubernetes You don't...Work at officeInference
San Francisco, CA4 days ago$170.17k - $286k
...Safety AI builds the ML and computer... ...that turn static model artifacts into high... ...firmware and full-stack engineers, and product... ...models — how they're served, evaluated, versioned... ...(Docker, Kubernetes), CI/CD pipelines,... ..., processing, and inference. Experience shipping...Remote workWork from homeFlexible hoursSamsara Inc.
San Francisco, CA5 days ago- ...scientist can scale an ML application from their... ...role The Customer Engineer will play a crucial role... ...-sun customer support model to ensure continuity... ...training, fine-tuning, and inference/serving of LLMs ~ Experience... ...platforms (e.g., Kubernetes), infrastructure as code...
Anyscale
San Francisco, CA1 day ago - ...curating data solutions for foundation model development. We serve every frontier AI lab with the... ...ll have the opportunity to shape the engineering organization and lead major technical... ...Ship the runtime adaptor: streaming inference, latency budgets, fail-open vs. fail...Local area
AfterQuery
San Francisco, CA1 day ago $147k - $268.4k
...the communities we serve. This is hard,... ...done. If you’re an engineer, scientist, or builder... ...and frontier AI models trained on Lilly data... ...Be Doing As an ML Ops Engineer, you... ...large-scale inference platforms that support... ...environments (Docker, Kubernetes, Slurm, Ray)....Full timeRemote workFlexible hours2 days per week100 Eli Lilly and Company
South San Francisco, CA21 hours ago$260k - $340k
...Overview As the Engineering Manager for Model Infrastructure, you'... ...initiatives to improve inference efficiency, reduce... ...infrastructure, LLM serving, or machine learning... ...Experience with Kubernetes, cloud infrastructure... ...training platforms, or ML infrastructure. Familiarity...Harvey AI
San Francisco, CA3 days ago$160k - $250k
...We are on a mission to serve all humans equally by ensuring... ...You and The Role As an ML Training & Inference Infrastructure Engineer on the Data Platform... ...distributed training, continuous model integration, evaluation,... ....Experience with Kubernetes or other container...Local areaZipline
South San Francisco, CA4 days ago$231k - $340k
...Overview As a Staff Software Engineer on the Model Infrastructure team, you'll... ...excellence for AI inference. Design and improve Harvey... ...with AI infrastructure, LLM serving, or machine learning platforms... ...LLMs. Experience with Kubernetes, cloud infrastructure, and...Harvey
San Francisco, CA1 day ago$300k
...We’re doubling down on ML as the future of Grindr... ...recommendation systems to serve millions, balancing... ...cross-functionally with engineering, data science and product... ...(Snowflake, Airflow, Kubernetes, Docker, Helm, Spark, PySpark... ...machine/deep learning models with at least one...Casual workWork at officeImmediate startWorldwideFlexible hoursGrindr
San Francisco, CA4 days ago$219k - $329k
...Manager, Machine Learning Engineering (ML and AI Operations). In this... ...(data → training → online inference → monitoring), a strong understanding... ...pipelines, feature stores, model serving, and monitoring/... ..., AWS, Databricks, Docker, Kubernetes, Terraform, Snowflake, and...Full timeWork at officeFlexible hoursGoFundMe, Inc.
San Francisco, CA1 day ago$250k
...scale AI training and inference workloads. With expanding... .... As a Senior ML Infrastructure Engineer, the successful candidate... ...help build and scale Kubernetes-based machine learning... ...infrastructure, including model packaging, deployment, and serving optimisation...Full timeSan Francisco, CAmore than 2 months ago- ...generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed... ...support from AMD engineers the team is... ...collaborate closely with ML researchers and... ..., and distributed inference features.... ...~ Experience with Kubernetes, Containerization...Work at officeFlexible hours
Sciforium
San Francisco, CA1 day ago $145k - $180k
...infrastructure: productionizing ML model checkpoints, running the... ...Partner Portal, optimizing inference serving, and giving ML Scientists... ...custom solution), Docker, Kubernetes (Jobs/CronJobs, Helm) Python... ...tickets, and mentoring engineers as the team scales Comfort...SPREEAI
San Francisco, CA4 days ago- ...infrastructure, tools, and model access that teams... ...high-performance inference, orchestration, and observability... ...a Machine Learning Engineer to own the ML and the ML... ...Python, torch, diffusers, Kubernetes, and the fal Python... ...infrastructure that serves it in production Comfortable...Relocation package
fal
San Francisco, CA1 day ago - Job title: ML Engineer / Researcher, Large Language Models WORK AUTHORIZATION Must be authorized to work in the U.S.;... ...learning Research ways to reduce inference cost and latency while maintaining or improving clinical quality Serve and optimize open‑weight models in...Work at officeVisa sponsorship
- Trajectory is seeking an ML Infrastructure Engineer to join our research-driven team in San Francisco. You will own the innermost loop of our continual learning platform, spanning training, inference and kernels, and collaborate with researchers to translate new algorithms...
- Reactor in San Francisco is seeking an ML Inference Engineer to maximize performance of generative media models and push ultra-low-latency, high-throughput inference. You will craft an in-house runtime, implement optimizations with PyTorch tools, and collaborate with partner...
- DeepMind is hiring engineers to build a next-generation compute platform for AI inference workloads, focusing on memory technologies, hardware acceleration, and SW/HW codesign. This coding role emphasizes ML compiler stack and inference infrastructure, joining a team of...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Kubernetes ML Inference Engineer: Model Serving. Be the first to apply!
Related searches
- senior ml engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- machine learning researcher San Francisco, CA