Senior Model Serving Engineer - Low-Latency AI Platform
Neon
A leading data and AI company in San Francisco is seeking a Staff Engineer to design and implement systems for their AI/ML Model Serving platform. You will collaborate with product, infrastructure, and research teams to ensure high-performance system delivery. The ideal candidate has over 10 years of experience in distributed systems and model serving. This role offers a competitive salary and a commitment to diversity and inclusion. #J-18808-Ljbffr Neon
Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Senior Model Serving Engineer - Low-Latency AI Platform in San Francisco, CA vacancy
$166k - $225k
...the world's best data and AI infrastructure platform so our customers can use... ...their business. Databricks’ Model Serving product provides... ...models. It offers real-time, low-latency inference, governance, monitoring... ...and cost efficiency.As a Senior Engineer, you’ll play a critical...PlatformSeniorLocal areaWorldwideDataBricks
San Francisco, CA5 days ago- ...Deepgram is the leading platform underpinning the... ...trillion-dollar Voice AI economy, providing real... ...-native foundation models are accessed through... ...unmatched accuracy, low latency, and cost efficiency.... ...Deepgram is looking for a Senior Software Engineer - Model Evaluation &...PlatformSenior
- ...Responsibilities As a senior Machine Learning Systems Engineer on the Search Platform team, you will... ...scalable search serving infrastructure,... ...high-throughput, low-latency search systems... ...relevance quality.ML Model Development &... ...Partner with Rovo and AI platform teams to...PlatformSeniorWork at officeLocal area
Atlassian
San Francisco, CA1 day ago - ...Hedra is the platform, models, and infrastructure... ...spans model serving, compute infrastructure... ...investors. Engineers at Hedra work... ...looking for a Senior or Staff Software... ...come from an AI company or already... ...throughput, latency, reliability, and... ...-throughput or low-latency systems...PlatformSeniorWork at office
Hedra Inc.
San Francisco, CA3 days ago - ...is a leader in AI cloud infrastructure serving tens of thousands... ...company—Finance, GTM, Engineering, and People—to... ..., data platform and analytics, compliance... ...and deploy low-code/no-code and... ...gateways to route model traffic, manage... ...limits, optimize latency, and control...PlatformSeniorWork at officeLocal areaWork from homeFlexible hours
Lambda Inc.
San Francisco, CA3 days ago $184.7k - $324.8k
...experienced ML Engineer to build, deploy... ...Large Language Model (LLM)-based... ...Description As an AI Engineer on our... ...pipelines and serving infrastructure... .... As a senior member of the team... ...and KV-cache for low-latency inference as designing... ...platforms, including web-...PlatformSeniorRelocationApple Inc.
San Francisco, CA1 day ago$220k - $320k
...specialized language models for companies that... ...frontier-quality AI at a fraction of... ...90% cheaper. Our platform handles everything... ...ten-person team of engineers who work in-person... ...with the goal of serving models faster and... ...inference performance: latency, throughput, cost...PlatformSeniorWork at officeInference
San Francisco, CA3 days ago- ...we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will... ...design and optimize large-scale model serving systems from distributed infrastructure to low-level performance tuning,... ...You will collaborate with senior ML engineers to fine-tune and...PlatformSenior
$300 per month
...vertically integrated AI infrastructure... ...our Production Engineering team ensures the... ...optimized cloud platform. We’re looking for a Senior Production... ...large language models to help us build... ...compute-intensive, latency-sensitive workloads... ...with a focus on serving and scaling LLM...PlatformSeniorTemporary workCrusoe
San Francisco, CA6 days ago- ...PlatformThe Search Platform team is... ...technical lead for Search Serving, you will set its... ...search quality, tail latency, reliability, scalability... ...and rollback, model-quality... ...fragmented systems, mentor senior engineers, and align... ...operating large-scale, low-latency search, recommendation...PlatformSeniorWork at officeLocal area
Atlassian
San Francisco, CA3 days ago $166.6k - $208.3k
...growing fast in scope and in stakes. Models increasingly drive real-time... ..., and the Machine Learning Platform (MLP) team exists to build a paved... ...burden themselves. We also serve low-latency, highly available scores to the decision engine that depends on them. The platform...PlatformSeniorMercury
San Francisco, CA3 days ago$300 per month
...vertically integrated AI infrastructure... ...Crusoe, our Production Engineering team ensures the reliability... ...AI-optimized cloud platform. We’re looking for a Senior Production Engineer... ...compute-intensive, latency-sensitive workloads... ...with a focus on serving and scaling LLM workloadsDefine...PlatformSeniorTemporary workCrusoe
San Francisco, CA5 days ago$180k - $250k
...Internal Software Engineering /Full-time /HybridAt... ...and measurement platform.To continue advancing... ....We're a small, senior team that enjoys... ...software team use AI coding agents safely... ...backend or serving systemsExperience... ...infrastructure provides ultra-low latency integration with...PlatformSeniorFull timeWork experience placementLocal areaRigetti Computing
Berkeley, CA5 days ago- ...category-defining AI automation platform that healthcare teams... ...and we're proud to serve 100+ leading health... ...is hiring a Senior Site Reliability Engineer (SRE) to keep our production... ...health: uptime, latency, and availability targets... ...follow a hybrid model, with two days per...PlatformSeniorFull timeWork at officeRemote workFlexible hours2 days per week
Plenful
San Francisco, CA4 days ago - ...& Gallagher LLP is seeking a Senior Innovation Engineer to design and deliver secure, scalable AI and low-code solutions for attorneys... ...and runs Power Automate/Power Platform builds across California offices... ...interactive AI sessions, and serve as a trusted AI advisor while...PlatformSeniorWork at office3 days per week
- Coinbase is seeking a Senior Data Engineer for Market Data on the Institutional Markets team to build... ...operate real-time data systems with low latency. You will design feed handlers,... ...distribution layers, enabling trading across the platform. You’ll ship features end-to-end,...PlatformSeniorRemote job
$189k - $283.6k
...time. TIDAL is a music platform that empowers artists to... ...continuously improve AI-driven tooling and automation... ...sev 0–1 incidents Serve as primary oncall,... ...for uptime, error rates, latency regression, and resource... ...perform and grow as an engineer ~5+ years of software...PlatformSeniorFull timeLocal areaRemote workRelocation packageFlexible hoursShift workDevopsroles
San Francisco, CA1 day ago- Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin... ...path that turns models and AI capabilities into... ...the deployment, serving, release automation,... ...clear contracts for latency, availability, correctness... ...MLOps or ML platform capabilities, such as...PlatformSeniorFull timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA2 days ago - ...States Position Title: Senior Systems Engineer, Workers AI About Us At Cloudflare,... ...LLMs, and customer-deployed models running on a... ..., and a model deployment platform serving both Cloudflare and customers... ...routing logic to reduce latency for end-users. System Reliability...PlatformSeniorLocal areaWorldwide
- Sciforium is seeking a Senior Software Engineer to help build the core model serving platform across C++, Python, runtime execution, and distributed infrastructure for real-time AI applications. You will work with ML researchers and systems engineers to deploy high-performance...PlatformSenior
$179k - $252k
...HP IQ is HP’s new AI innovation lab. Combining... ..., world-class team—engineers, designers,... ...algorithms, and interaction models. If you enjoy... ...startup environment Serve as a technical... ...Drive execution of low-level driver and framework... ...and / or embedded platform software...PlatformSeniorFull timeTemporary workLocal areaFlexible hours$266k
...Software Engineer, Model Runtime Hardware - San... ...organization develops AI-native silicon and... ...’s supercomputing platform. About the Role... ...of the cluster serving software stack, translating... ...for throughput, latency, utilization, and... ...retaining the low-level control...PlatformWork at officeLocal areaRelocation packageFlexible hoursOpenAI, Inc.
San Francisco, CA1 day ago$165k - $190k
...CAQPU - Hardware Engineering /Full-time /... ...are seeking a Senior Mechanical/Cryogenic... ...analysis. Serve as the mechanical... ...documentation — CAD models, drawings, BOMs... ...Cloud Services platform. The company’s... ...provides ultra-low latency integration... ...intelligence (AI) tools to support...PlatformSeniorFull timeWork experience placementLocal areaFlexible hoursRigetti Computing
Berkeley, CA2 days ago- Samsara is hiring a Machine Learning Engineer for Safety AI who will design production ML APIs, build data... ...partner with applied scientists, firmware and platform teams to deploy models, monitor performance, and ensure low latency, high-throughput inference across millions...PlatformSeniorRemote job
$231k - $340k
...combining frontier agentic AI, an enterprise-grade platform, and deep domain... ...As a Staff Software Engineer on the Model Infrastructure team, you... ...ensure high availability, low latency, and operational excellence... ...AI infrastructure, LLM serving, or machine learning platforms...PlatformHarvey
San Francisco, CA1 day ago$150k - $250k
A tech-driven financial platform is seeking a Senior IT Engineer to improve workflows for the Legal, Risk, and Compliance teams. The role involves building... ..., managing integrations with various APIs, and serving as a trusted advisor to improve efficiency. Ideal candidates...PlatformSenior$165k - $200k
...only vertically integrated AI infrastructure company... ...Crusoe Cloud is seeking a Senior Network Production Operations Engineer to support production reliability... ...tooling, and serve as a responder during high... ...EOS) and Juniper (Junos) platforms in leaf-spine CLOS architectures...PlatformSeniorTemporary workWorldwideCrusoe
San Francisco, CA3 days ago$164k - $259k
About the roleChime Engineering is growing rapidly as we... ...for our members.As a Senior Engineer, you'll provide... ...of one of our Chime Platforms within Trust & Safety.... ...and maintain robust, low-latency APIs and backend services... ...scalePrior experience serving as a technical lead...PlatformSeniorFull timeWork at officeLocal areaRemote workChime
San Francisco, CA3 days ago$220k - $280k
Ironclad is the leading AI contracting platform that transforms agreements into assets. Contracts... ...evaluation process. As the Senior Manager of Solutions Engineering, you will play a pivotal role in... ...motivating, and performance-driven.Serve as a subject matter expert in...PlatformSeniorFull timeContract workIronclad
San Francisco, CA1 day ago$170k - $200k
...in communities around the globe. Our AI-powered labor marketplace helps local... ...way the world works.We are seeking a Senior Software Engineer - Instawork Robotics to contribute to... ..., stadiums, and more. Our AI-powered platform serves thousands of businesses across more than...PlatformSeniorHourly payTemporary workLocal areaShift workInstawork
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Model Serving Engineer - Low-Latency AI Platform. Be the first to apply!
Related searches
- client platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- platform developer San Francisco, CA
- platform engineer San Francisco, CA
- data platform engineer San Francisco, CA
- senior platform engineer San Francisco, CA
- senior living San Francisco, CA
- senior associate vice president San Francisco, CA
- senior php developer remote San Francisco, CA
- senior app developer San Francisco, CA