Senior Model Serving Engineer - Low-Latency AI Platform
Jobleads-US
A leading data and AI company in San Francisco is seeking a Staff Engineer to design and implement systems for their AI/ML Model Serving platform. You will collaborate with product, infrastructure, and research teams to ensure high-performance system delivery. The ideal candidate has over 10 years of experience in distributed systems and model serving. This role offers a competitive salary and a commitment to diversity and inclusion. #J-18808-Ljbffr Jobleads-US
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Model Serving Engineer - Low-Latency AI Platform in San Francisco, CA vacancy
- A leading data and AI company in San Francisco is seeking a Senior Engineer to enhance their Model Serving platform. This role requires expertise in building large-scale distributed systems and collaboration across teams to optimize performance and reliability. Ideal candidates...PlatformSenior
$166k - $225k
...the world's best data and AI infrastructure platform so our customers can use... ...their business. Databricks’ Model Serving product provides... ...models. It offers real-time, low-latency inference, governance, monitoring... ...and cost efficiency.As a Senior Engineer, you’ll play a critical...PlatformSeniorLocal areaWorldwide$193.4k - $290k
...combining frontier agentic AI, an enterprise-grade platform, and deep domain... ...a Staff Software Engineer on the Model Infrastructure team... ...Reliability and latency optimization Provider... ...high availability, low latency, and... ...infrastructure, LLM serving, or machine learning...PlatformSeniorFull time- ...Responsibilities As a senior Machine Learning Systems Engineer on the Search Platform team, you will... ...scalable search serving infrastructure,... ...high-throughput, low-latency search systems... ...relevance quality.ML Model Development &... ...Partner with Rovo and AI platform teams to...PlatformSeniorWork at officeLocal area
$190.8k - $267.1k
...Reddit's advertising platform, enabling advertisers... ...partners closely with Ads Engineering teams to improve... ...domains including ad serving, auctions, targeting,... ...Experience operating high-QPS, low-latency services where latency... ...intelligence (AI). You will have the opportunity...PlatformSeniorFor contractorsWork experience placementRemote workFlexible hours$220k - $320k
...specialized language models for companies that... ...frontier-quality AI at a fraction of... ...90% cheaper. Our platform handles everything... ...ten-person team of engineers who work in-person... ...with the goal of serving models faster and... ...inference performance: latency, throughput, cost...PlatformSeniorWork at officeInference
San Francisco, CA2 days ago$300 per month
...vertically integrated AI infrastructure... ...our Production Engineering team ensures the... ...optimized cloud platform. We’re looking for a Senior Production... ...large language models to help us build... ...compute-intensive, latency-sensitive workloads... ...with a focus on serving and scaling LLM...PlatformSeniorTemporary work$130k - $163k
Ironclad is the leading AI contracting platform that transforms... ...is hiring a Senior Finance Systems & AI Engineer to own the data infrastructure... ...maintain reliable, low-manual-touch... ...BigQuery pipelines that serve as the analytics... ...platform end-to-end: model architecture,...PlatformSeniorFull timeContract work$300 per month
...vertically integrated AI infrastructure... ...Crusoe, our Production Engineering team ensures the reliability... ...AI-optimized cloud platform. We’re looking for a Senior Production Engineer... ...compute-intensive, latency-sensitive workloads... ...with a focus on serving and scaling LLM workloadsDefine...PlatformSeniorTemporary work- ...organization develops AI-native silicon... ...of frontier models. By co-designing... ...supercomputing platform. About the Role... ...the inference engine that executes complex... ...of the cluster serving software stack,... ...for throughput, latency, utilization,... ...while retaining the low-level control...PlatformFull time
OpenAI
San Francisco, CA22 hours ago - ...world's most dynamic AI companies, like Cursor... ...to bring cutting-edge models into production. We're... ...us and help build the platform engineers turn to to ship AI products... ...systems, model serving, and developer experience... ...track record of owning low‑latency, reliable backend...PlatformFull timeFlexible hours
Baseten
San Francisco, CA22 hours ago $204k - $348k
...Principal Software Engineer, Scientific... ...We are seeking a Senior Principal or Principal... ...next-generation AI-driven scientific platform. In this role, you will serve as a technical leader... ...systems that model scientific intent... ...high availability, low latency, observability,...PlatformSeniorFull timeWork at officeLocal areaFlexible hours$192k - $260k
...the world's best data and AI infrastructure platform so our customers can use... ...their business. Foundation Model Serving is the API Product for... ...necessary. We’re looking for engineers who have owned high scale... ...enable high-throughput, low-latency inference on GPU...PlatformLocal areaWorldwide$188k - $275k
...The Essential Cloud for AI™. Built for pioneers by... ..., CoreWeave delivers a platform of technology, tools,... ...You'll Do: The Field Engineering organization at... ...this role, you will: Serve as the primary technical... ...Define and operationalize models for managing customer bare...PlatformSeniorPermanent employmentFull timeContract workTemporary workCasual workWork at officeFlexible hoursCoreWeave
San Francisco, CA28 days ago$165k - $190k
...CAQPU - Hardware Engineering /Full-time /On-... ...are seeking a Senior Mechanical/... ...cause analysis. Serve as the mechanical... ...documentation — CAD models, drawings, BOMs... ...Cloud Services platform. The company’s... ...provides ultra-low latency integration... ...intelligence (AI) tools to support...PlatformSeniorFull timeWork experience placementLocal areaFlexible hours$174k - $210k
Forge is looking for a Senior Software Engineer II in San Francisco to enhance our trading platform functionality. The role involves owning production changes, delivering software efficiently, and collaborating with cross-functional teams to improve the user experience...PlatformSenior- ...worldwide.We’re a team of engineers, clinicians, and... ...of PositionAs a Senior Systems GPU Engineer - AI & Robotics, you will... ...Responsibilities• GPU & Model Performance &... ...roadmap for the robotics platform—from foundational models... ...inference—while serving as a core contributor...PlatformSeniorLocal areaWorldwideFlexible hours
$180k - $237.5k
...17, we’re delivering low-cost and large-scale... ...already have. Senior Software Engineer – Site Controller, Energy... ...(BESS). It is the platform that allows us to harmonize... ...that ensure low-latency, reliable data flow between... ..."Pack Manager" to serve as a universal...PlatformSeniorFull timeLocal areaRedwood Materials
San Francisco, CA22 hours ago$150k - $250k
A tech-driven financial platform is seeking a Senior IT Engineer to improve workflows for the Legal, Risk, and Compliance teams. The role involves building... ..., managing integrations with various APIs, and serving as a trusted advisor to improve efficiency. Ideal candidates...PlatformSenior$298k - $368k
...applied to a range of vehicle platforms and product use cases. The... ...diverse set of sensors, enabling engineers like you to (1) develop... ...-world data, to (2) develop models and model training at scale,... ...models). ~ Proven expertise in low-latency on-device inference...PlatformSeniorFull timeRemote workWaymo
San Francisco, CA22 hours ago$170k - $200k
...in communities around the globe. Our AI-powered labor marketplace helps local... ...way the world works.We are seeking a Senior Software Engineer - Instawork Robotics to contribute to... ..., stadiums, and more. Our AI-powered platform serves thousands of businesses across more than...PlatformSeniorHourly payTemporary workLocal areaShift work$175k - $190k
...(CTEM). The HackerOne Platform unites agentic AI solutions with the ingenuity... ..., and accountability.Senior GTM Systems & Process... ...architecting the revenue engine, building an AI-native operating model that connects planning,... ...sales processes.Serve as a hands-on Salesforce...PlatformSeniorContract workApprenticeshipLocal areaRemote workFlexible hoursShift work$130k - $196.5k
LiveRamp is the data collaboration platform of choice for the world’s most... ...privacy requirements. We on the Pixel Serving team are part of the Identity Engineering teams at LiveRamp. We are LiveRamp... ...and scaling the next-generation, AI-forward advertising technology stack...PlatformSeniorFull timeWork from homeFlexible hoursNight shift$165k - $227k
Secure Every Identity, from AI to HumanIdentity is the... ...too, let's talk.The Engineering OpportunityWe are looking for an experienced Senior Site Reliability... ...continuously invest in platform engineering, observability... ...production systems. You will serve as a key contributor...PlatformSeniorLocal areaWorldwideFlexible hours$180k - $300k
...creating the generative models that power how... ...high-performance APIs serving millions of... ...Optimize inference latency and throughput across... ...task queues Cloud platforms (AWS, GCP, or Azure... ...includes: Real-time or low-latency inference... ...edge of generative AI. #J-18808-Ljbffr Black...PlatformRemote workWorldwide2 days per week$98k - $140k
...the collaborative AI workspace where teams... ...with product and engineering teams to build... ...ll shape Notion's model strategy and work... ...dimensions: quality, latency, cost, edge cases.... ...observability and eval platforms (e.g., Braintrust)... ...— You can self‑serve insights from...PlatformLive inLocal area- ...philosophy that blends robotics, AI, and systems engineering at the frontier. About the Role We’re seeking a Senior Robotics Software Engineer to join... ...skills in C++ for embedded platforms, optimizing for reliability and low‑latency Sensor Integration: Interface with...PlatformSeniorRelocation
- A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal...PlatformSenior
$166k - $225k
...and running the world's best data and AI infrastructure platform so our customers can use deep data... ...improve their business. Founded by engineers — and customer obsessed — we leap at... ...reliability of a data warehouse, and the low latency of streaming. Its higher level...PlatformSeniorLocal areaWorldwide$134.5k - $265.1k
...a GCP Forward Deployed Engineer, Senior Consultant and help organizations... ...secure Google Cloud Platform (GCP) cloud and artificial intelligence (AI) workloads at scale. In... ...Agent Platform, Model Garden, and Model Armor... ...industries/sectors you serve.Limited immigration sponsorship...PlatformSeniorLocal areaVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Model Serving Engineer - Low-Latency AI Platform. Be the first to apply!
Related searches
- platform engineer San Francisco, CA
- client platform engineer San Francisco, CA
- platform developer San Francisco, CA
- senior platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- data platform engineer San Francisco, CA
- senior network engineer remote San Francisco, CA
- senior app developer San Francisco, CA
- senior manager legal San Francisco, CA
- senior retail sales associate San Francisco, CA