Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Model Serving Engineer - Low-Latency AI Platform

Jobleads-US

A leading data and AI company in San Francisco is seeking a Staff Engineer to design and implement systems for their AI/ML Model Serving platform. You will collaborate with product, infrastructure, and research teams to ensure high-performance system delivery. The ideal candidate has over 10 years of experience in distributed systems and model serving. This role offers a competitive salary and a commitment to diversity and inclusion. #J-18808-Ljbffr Jobleads-US

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Model Serving Engineer - Low-Latency AI Platform in San Francisco, CA vacancy
  • HP IQ in San Francisco is seeking a Software Engineer with deep expertise in device software development...  ...across Android, Windows, and embedded platforms, collaborating with hardware partners to deliver secure, low‑latency experiences for enterprise devices. Ideal candidates... 
    Platform
    Senior

    HP

    San Francisco, CA
    15 hours ago
  • Databricks Mosaic AI is seeking an experienced backend/infrastructure engineer to build platforms powering AI workloads, including model training, serving, and vector search. You will join a high-visibility team connected to research, product, and enterprise use cases,... 
    Platform
    Senior

    Databricks

    San Francisco, CA
    1 day ago
  • $166k - $225k

     ...the world's best data and AI infrastructure platform so our customers can use...  ...their business. Databricks’ Model Serving product provides...  ...models. It offers real-time, low-latency inference, governance, monitoring...  ...and cost efficiency.As a Senior Engineer, you’ll play a critical... 
    Platform
    Senior
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  •  ...Responsibilities As a senior Machine Learning Systems Engineer on the Search Platform team, you will...  ...scalable search serving infrastructure,...  ...high-throughput, low-latency search systems...  ...relevance quality.ML Model Development &...  ...Partner with Rovo and AI platform teams to... 
    Platform
    Senior
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    3 days ago
  • $220k - $320k

     ...specialized language models for companies that...  ...frontier-quality AI at a fraction of...  ...90% cheaper. Our platform handles everything...  ...ten-person team of engineers who work in-person...  ...with the goal of serving models faster and...  ...inference performance: latency, throughput, cost... 
    Platform
    Senior
    Work at office

    Inference

    San Francisco, CA
    15 hours ago
  • $300 per month

     ...vertically integrated AI infrastructure...  ...our Production Engineering team ensures the...  ...optimized cloud platform. We’re looking for a Senior Production...  ...large language models to help us build...  ...compute-intensive, latency-sensitive workloads...  ...with a focus on serving and scaling LLM... 
    Platform
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  • $166.6k - $208.3k

     ...growing fast in scope and in stakes. Models increasingly drive real-time...  ..., and the Machine Learning Platform (MLP) team exists to build a paved...  ...burden themselves — and we serve low-latency, highly available scores to the decision engine that depends on them. The platform... 
    Platform
    Senior

    Mercury

    San Francisco, CA
    3 days ago
  • $300 per month

     ...vertically integrated AI infrastructure...  ...Crusoe, our Production Engineering team ensures the reliability...  ...AI-optimized cloud platform. We’re looking for a Senior Production Engineer...  ...compute-intensive, latency-sensitive workloads...  ...with a focus on serving and scaling LLM workloadsDefine... 
    Platform
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  •  ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of...  ...currently Tuesday. Engineering at Lambda is responsible...  ...Datacenter Ops teams for low-level or cross-functional...  ...the validation of platform quality. Design, build,... 
    Platform
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    1 day ago
  •  ...world's most dynamic AI companies, like Cursor...  ...to bring cutting-edge models into production. We're...  ...us and help build the platform engineers turn to to ship AI products...  ...systems, model serving, and developer experience...  ...track record of owning low‑latency, reliable backend... 
    Platform
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    15 hours ago
  •  ...Summary : The Senior Salesforce...  ...ecosystem, including platform maintenance,...  ...or integration engineer.  This position...  ...Responsibilities Serve as the portfolio...  ...Translate manual and/or low-tech processes...  ...scalable data models; develop and...  ...artificial intelligence (AI) tools to... 
    Platform
    Senior
    Full time
    Casual work
    Work at office
    Afternoon shift

    GLIDE

    San Francisco, CA
    a month ago
  • $98k - $140k

     ...the collaborative AI workspace where teams...  ...with product and engineering teams to build...  ...ll shape Notion's model strategy and work...  ...dimensions: quality, latency, cost, edge cases....  ...observability and eval platforms (e.g., Braintrust)...  ...— You can self-serve insights from... 
    Platform
    Live in
    Local area

    Notion Labs

    San Francisco, CA
    2 days ago
  • $192k - $260k

     ...the world's best data and AI infrastructure platform so our customers can use...  ...their business. Foundation Model Serving is the API Product for...  ...necessary. We’re looking for engineers who have owned high scale...  ...enable high-throughput, low-latency inference on GPU... 
    Platform
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  •  ...worldwide.We’re a team of engineers, clinicians, and...  ...of PositionAs a Senior Systems GPU Engineer - AI & Robotics, you will...  ...Responsibilities• GPU & Model Performance &...  ...roadmap for the robotics platform—from foundational models...  ...inference—while serving as a core contributor... 
    Platform
    Senior
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    San Francisco, CA
    2 days ago
  • $165k - $190k

     ...CAQPU - Hardware Engineering /Full-time /On-...  ...are seeking a Senior Mechanical/...  ...cause analysis. Serve as the mechanical...  ...documentation — CAD models, drawings, BOMs...  ...Cloud Services platform. The company’s...  ...provides ultra-low latency integration...  ...intelligence (AI) tools to support... 
    Platform
    Senior
    Full time
    Work experience placement
    Local area
    Flexible hours

    Rigetti Computing

    Berkeley, CA
    3 days ago
  • $174k - $210k

    Forge is looking for a Senior Software Engineer II in San Francisco to enhance our trading platform functionality. The role involves owning production changes, delivering software efficiently, and collaborating with cross-functional teams to improve the user experience... 
    Platform
    Senior

    Forge

    San Francisco, CA
    2 days ago
  • $180k - $237.5k

     ...17, we’re delivering low-cost and large-scale...  ...already have.   Senior Software Engineer – Site Controller, Energy...  ...(BESS). It is the platform that allows us to harmonize...  ...that ensure low-latency, reliable data flow between...  ..."Pack Manager" to serve as a universal... 
    Platform
    Senior
    Full time
    Local area

    Redwood Materials

    San Francisco, CA
    15 hours ago
  • $155k

     .... For us, it also serves as a practical framework...  ...The Quality Engineering team builds the shared...  ...with frontend and platform engineers across...  ...are looking for a Senior Software Engineer,...  ...implementing how AI reshapes quality...  ...clear test ownership models so teams can... 
    Platform
    Senior
    Full time
    Contract work
    Local area
    Home office
    Flexible hours
    Shift work
    Early shift

    Scribd, Inc.

    San Francisco, CA
    15 hours ago
  • $150k - $250k

    A tech-driven financial platform is seeking a Senior IT Engineer to improve workflows for the Legal, Risk, and Compliance teams. The role involves building...  ..., managing integrations with various APIs, and serving as a trusted advisor to improve efficiency. Ideal candidates... 
    Platform
    Senior

    Airwallex

    San Francisco, CA
    3 days ago
  • $298k - $368k

     ...applied to a range of vehicle platforms and product use cases. The...  ...diverse set of sensors, enabling engineers like you to (1) develop...  ...-world data, to (2) develop models and model training at scale,...  ...models). ~ Proven expertise in low-latency on-device inference... 
    Platform
    Senior
    Full time
    Remote work

    Waymo

    San Francisco, CA
    15 hours ago
  • $170k - $200k

     ...in communities around the globe. Our AI-powered labor marketplace helps local...  ...way the world works.We are seeking a Senior Software Engineer - Instawork Robotics to contribute to...  ..., stadiums, and more. Our AI-powered platform serves thousands of businesses across more than... 
    Platform
    Senior
    Hourly pay
    Temporary work
    Local area
    Shift work

    Instawork

    San Francisco, CA
    4 days ago
  • $102k - $182.71k

     ...OverviewWe’re seeking a Senior Search Systems Engineer to build the...  ...of our marketing and AI visibility data. This...  ...environments.This role serves as the bridge between...  ...and analytical data models that support downstream...  ...warehouses, and marketing platforms Data Quality and... 
    Platform
    Senior
    Full time
    For contractors
    Remote work
    Shift work

    Autodesk

    San Francisco, CA
    1 day ago
  • AI Backend Engineer, Artificial Intelligence (AI) Required...  ...across our platform. This role sits at...  ...AI stack, between models, backend systems,...  ...real users, where latency, correctness, reliability...  ...systems that serve AI‑powered insurance...  ...reliably at scale with low latency and high... 
    Platform
    Remote job
    Work from home

    Gina’s Tech Jobs - IT Recruiting Agency

    San Francisco, CA
    2 days ago
  • $115k - $125k

     ...based Managed Service Provider serving small and mid-sized...  ...Role We're looking for a senior MSP engineer who can own difficult problems...  ...secondary technical owner of core platforms including Kaseya, HaloPSA,...  ...including thoughtful use of AI where it can improve efficiency... 
    Platform
    Senior
    Work at office
    Remote work
    Work from home
    Flexible hours
    Weekend work

    Fogdog IT, LLC

    San Francisco, CA
    11 days ago
  •  ...Senior Compliance Engineer, AI Governance True Anomaly seeks those with the talent...  ...and large language models (LLMs) deployed across the...  ..., and products, this role serves as the organizational authority...  ..., evaluate AI vendors and platforms (including OpenAI, Anthropic... 
    Platform
    Senior
    Permanent employment

    True Anomaly

    San Francisco, CA
    2 days ago
  •  ...philosophy that blends robotics, AI, and systems engineering at the frontier. About the Role We’re seeking a Senior Robotics Software Engineer to join...  ...skills in C++ for embedded platforms, optimizing for reliability and low‑latency Sensor Integration: Interface with... 
    Platform
    Senior
    Relocation

    Theconstructsim

    San Francisco, CA
    2 days ago
  • $180k - $300k

     ...creating the generative models that power how...  ...high-performance APIs serving millions of...  ...Optimize inference latency and throughput across...  ...task queues Cloud platforms (AWS, GCP, or Azure...  ...includes: Real-time or low-latency inference...  ...edge of generative AI. #J-18808-Ljbffr Black... 
    Platform
    Remote work
    Worldwide
    2 days per week

    Black Forest Labs

    San Francisco, CA
    2 days ago
  • A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal... 
    Platform
    Senior

    LMArena

    San Francisco, CA
    1 day ago
  • $166k - $225k

     ...and running the world's best data and AI infrastructure platform so our customers can use deep data...  ...improve their business. Founded by engineers — and customer obsessed — we leap at...  ...reliability of a data warehouse, and the low latency of streaming. Its higher level... 
    Platform
    Senior
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    3 days ago
  • $218.4k - $273k

     ...bottleneck in Physical AI. This position will...  ...Robotics data and model evaluation. We...  ...and experienced Senior Machine Learning Engineer, Computer Vision to...  ...deployment on edge devices (low power, low latency) and/or large-scale...  ...Leadership: Serve as the subject... 
    Senior
    Full time

    Scale Ai

    San Francisco, CA
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Model Serving Engineer - Low-Latency AI Platform. Be the first to apply!