LLM Serving Platform Engineer
Scale AI
United States Digital Space LLC is seeking a Software Engineer on the ML Infrastructure team to design and build scalable platforms for serving LLMs. You will bridge research and engineering to deliver reliable, high-performance systems that power internal and external use cases across environments. You will collaborate with researchers and engineers to optimize production deployment, architect fault-tolerant services, and contribute to observability, monitoring, and end-to-end project delivery #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the LLM Serving Platform Engineer in San Francisco, CA vacancy
- ...Senior LLM Platform EngineerHandshake is hiring a Senior LLM Platform Engineer to join our Data and ML Platform team. This team supports Handshake's core career marketplace... ...systems for workflow orchestration, model serving, shared cloud infrastructure, and developer...SuggestedFull timeWork at officeFlexible hours
Handshake
San Francisco, CA3 days ago - ...looking for a seasoned Staff DevOps and Platform Engineer to own and evolve the infrastructure... ...Canary routing infrastructure for LRA (LLM REST API) via Traefik and GitOps patterns... ...campaign badge veteran" means a veteran who served on active duty in the U.S. military,...SuggestedFor contractorsRemote work
Liberate
San Francisco, CA14 hours ago - ...Summary Gravie is seeking a hands-on Staff Platform Engineer to do three things at once: build the... ...platform was avoided. Experience serving as a central technical point across multiple... .... Production observability and LLM observability practice, including Datadog...SuggestedFlexible hoursShift work
Gravie
San Francisco, CA2 days ago $236.7k - $319.5k
...view to how we show up in the world and serve our customers.Old Navy democratizes... ....About the roleAs a Sr Director - AI & Platform Engineering you are accountable for building and operating... ...Hands-on experience building agent and LLM platforms, including agent frameworks,...SuggestedMinimum wageGap
San Francisco, CA2 days ago- ...your skills to a deeply meaningful mission—serving a community that has been underserved... ...re looking for a highly technical Staff Platform Engineer to lead the platform and security foundations... ...security model end to end. Treat the LLM and its tools as adversarial. Own...SuggestedRemote work
Felix
San Francisco, CA1 day ago - ...Handshake is hiring a Senior LLM Platform Engineer to join our Data and ML Platform team. This role owns our shared LLM control plane and related infrastructure, enabling production workflows across Handshake’s career marketplace and Handshake AI. You will collaborate...Remote work
Handshake
San Francisco, CA3 days ago $231k - $340k
...frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re... ...Role Overview As a Staff Software Engineer on the Model Infrastructure team, you'll... ...Have Experience with AI infrastructure, LLM serving, or machine learning platforms. Experience...Harvey, Inc.
San Francisco, CA14 hours ago- ...Own platform components from design through production operation,... ...maintaining services for model serving, agentic infrastructure, observability... ...-grade Python, platform engineering fundamentals, and production... ...understand transformers, LLM inference, experiment design,...Remote workRelocation packageFlexible hours
Code Metal, Inc.
San Francisco, CA4 days ago - ...foundation model development. We serve every frontier AI lab with... ...systems that power our platform from the ground up. Equity... ...the opportunity to shape the engineering organization and lead major technical... ...~ Background in AI research, LLM evaluations, or human‑in‑the‑...Local area
AfterQuery
San Francisco, CA5 days ago - ...models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding... ...AMD with hands‑on support from AMD engineers the team is scaling rapidly to build the... ...inference engine like vLLM, Sglang, or TRT-LLM Proficiency in CUDA or ROCm and...Work at officeFlexible hours
Sciforium
San Francisco, CA14 hours ago - ...never been done. If you’re an engineer, scientist, or builder who... ...Engineer, you build and operate the platforms that run the end-to-end... ...learning platforms, including model serving, monitoring, and large-scale... ...as Triton, vLLM, or TensorRT-LLM. Experience with...Remote workFlexible hours2 days per week
- ...leader in automated software engineering you can trust. As AI writes more... ...same foundations: models to serve, agents to run, context to... ...and results to measure. Our AI Platform team builds those foundations... ...vLLM, SGLang, and TensorRT-LLM. Own the model gateway that teams...Remote workRelocation packageFlexible hoursShift work
Code Metal, Inc.
San Francisco, CA5 days ago $300k - $390k
...highly motivated and experienced engineering leader to lead a team... ...for our Lila's product data platform. You will own the data platform... ...learning workloads across Lila, serving autonomous DBTL cycles, instrument... .... ~ Familiarity with LLM/AI-native data patterns — vector...Full timeWork at officeLocal areaFlexible hoursLila Sciences, Inc.
San Francisco, CA4 days ago- ...Data Platform Engineering Manager Berkshire Hathaway Homestate Companies, Workers Compensation... ...engineering teams. Champions Claude and LLM tooling for schema documentation, data... ...platforms adopted over time. Serves as the final technical escalation point...Work experience placementWork at officeWork from home2 days per week
Berkshire Hathaway Homestate Companies
San Francisco, CA1 day ago $130.6k - $192k
About the TeamDoorDash’s GenAI Platform team sits within Machine... ...DeepSeek) ourselves — real-time GPU serving, high-throughput batch... ...platform surfaces including the LLM Gateway, Agent Gateway, evals... ...across model serving and inference engines, fine-tuning and training pipelines...Hourly payWork at officeLocal areaRemote workFlexible hoursDoordash
San Francisco, CA2 days ago$176k - $242k
About FaireFaire is a technology wholesale platform built on the belief that the future is... ...by request, or waits on a partner engineering pod carrying its own roadmap. The Marketing... ...vs. in-house solution, or build a self-serve, agentic landing page service. The outcome...Contract workTemporary workWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per weekFaire
San Francisco, CA3 days ago$187k
...role Chime’s Machine Learning Platform (MLP) team builds and... ...enable data scientists and ML engineers to develop, train, deploy, and... ...conventional predictive models to LLM-powered and multi-step agentic... ...aspect of our business, serving as a north star that guides us...Full timeWork at officeLocal areaRemote workChime
San Francisco, CA5 days ago$174.5k - $240k
About FaireFaire is a technology wholesale platform built on the belief that the future is... ...ours.About the roleOur Client Platform Engineering team is responsible for the lifecycle and... ...: You'll own meaningful problems that serve customers around the globe with the agency...Work experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per weekFaire
San Francisco, CA4 days ago- ...company and is on a mission to build the best engineering team in the world. We’re looking for a Senior Infrastructure/Platform Engineer focusedon owning and scaling the... ...deployment, and play a key role in enabling Slash to serve billions of dollars in business spend...Work at office
Slash
San Francisco, CA14 hours ago - ...on a mission to empower builders. Massive reach: Our docs platform serves 100 million+ developers every year and powers documentation... ...re looking to align the two quickly. As a Senior Platform Engineer, you’ll own critical systems from architecture through production...Immediate start
Mintlify
San Francisco, CA2 days ago - ...Intelligence Arena is the platform for evaluating how AI models perform... ...is looking for a Software Engineer - Platform to build the core... ...automated arena runtimes, and serving layers that make real-world model... ...the role. Experience with LLM provider APIs (OpenAI,...Permanent employmentWork at officeRemote workFlexible hoursShift work3 days per week
Arena Intelligence, Inc.
San Francisco, CA14 hours ago - ...Description You'll own the infrastructure platform that our AI models run on. This isn't a... ...is dropping packets. Department Engineering Location San Francisco We run... .... Partner with ML engineers on model serving: container optimization, health checks and...RelocationVisa sponsorship
Reactor
San Francisco, CA14 hours ago - ...Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE... ...runtime that powers large-scale LLM inference on Baseten. Our inference platform... ...tool/function calling, and multimodal serving. Implement platform fundamentals such...Flexible hours
Baseten
San Francisco, CA1 day ago - ...generation of software development, where engineers direct fleets of agents, every... ...’s core services and inference platforms. You’ll play a key role in... ...operating infrastructure for modern LLM workloads , including inference serving, fine-tuning, and training workflows...Odd job
Devopsroles
San Francisco, CA14 hours ago $205k - $235k
...Parthenon service line, the EY Growth Platforms AI ML Engineering Director will collaborate with Business... ...core advanced analytics platform and serving the technical execution lead for high‑... ...Weaviate, Chroma), retrieval systems, and LLM fine‑tuning. Strong understanding of...Full timeFor contractorsWork experience placementSummer holidayFlexible hours$189k - $236k
...are building a workplace that reflects the people we serve.All full-time employees receive competitive base pay... ...process.About the Role:We’re hiring seasoned engineers to join our teams that work on core platform capabilities, improving our existing systems for extensibility...Full timeWork at officeLocal areaRemote work2 days per week3 days per weekGusto
San Francisco, CA1 day ago$250k - $300k
...Crusoe.About the Role:We are seeking Sr. Staff Software Engineers to serve as the Managed Platform Services (MAPS) organization’s most senior floating... ...features and intelligent insights — both rule-based and LLM-based — our platform can offer. Partner with customer success...Permanent employmentTemporary workShift workCrusoe
San Francisco, CA4 days ago- ...dive in headfirst into new problems. About The Role As a Platform Engineer at Phonic, you'll build the foundation that lets our... ...similar) Familiarity with ML/AI infrastructure — model serving, GPU workloads, or inference optimization Strong proficiency...Work at office
Phonic
San Francisco, CA4 days ago $200k - $330k
...Decagon is the leading conversational AI platform empowering every brand to deliver... ...team. About the Team The Security Engineering team at Decagon protects the platform that... ...work is close to the business. Decagon serves some of the world's most security-conscious...Full timeWork at officeLocal areaDecagon AI, Inc.
San Francisco, CA14 hours ago- ...Reducto is the agentic document platform for leading AI teams who... ...Opportunity As the Lead Software Engineer on Platform, you’ll own the... ...Python services, queues, model-serving paths, Kubernetes/container infrastructure... ...a small team, and uses modern LLM coding tools fluently to move...Work at officeLocal area
Reducto, Inc.
San Francisco, CA14 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Serving Platform Engineer. Be the first to apply!
Related searches
- client platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- platform developer San Francisco, CA
- platform engineer San Francisco, CA
- data platform engineer San Francisco, CA
- senior platform engineer San Francisco, CA
- platform manager San Francisco, CA
- power platform San Francisco, CA
- digital platform specialist San Francisco, CA
- director of digital platform San Francisco, CA