Senior Model Serving Engineer - Low-Latency AI Platform
Jobleads-US
A leading data and AI company in San Francisco is seeking a Staff Engineer to design and implement systems for their AI/ML Model Serving platform. You will collaborate with product, infrastructure, and research teams to ensure high-performance system delivery. The ideal candidate has over 10 years of experience in distributed systems and model serving. This role offers a competitive salary and a commitment to diversity and inclusion. #J-18808-Ljbffr Jobleads-US
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Model Serving Engineer - Low-Latency AI Platform in San Francisco, CA vacancy
$166k - $225k
...the world's best data and AI infrastructure platform so our customers can use... ...their business. Databricks’ Model Serving product provides... ...models. It offers real-time, low-latency inference, governance, monitoring... ...cost efficiency. As a Senior Engineer, you’ll play a critical...PlatformSeniorLocal areaWorldwide- Baseten in San Francisco seeks an engineer to own the Model API surface for fast, reliable inference... ...scalable, developer‑friendly serving experiences across multi‑GPU... ...metering, and auth, contributing to a platform used by leading AI deployments. #J-18808-Ljbffr BasetenPlatform
- Sequen is seeking a Core Systems Engineer to optimize and build a reliable model serving infrastructure using Rust. This role focuses on ensuring low-latency data processing and supporting rapid... ...opportunity to engage with cutting-edge AI technologies in a dynamic...Senior
$220k - $320k
...specialized language models for companies that... ...frontier-quality AI at a fraction of... ...90% cheaper. Our platform handles everything... ...ten‑person team of engineers who work in‑person... ...with the goal of serving models faster and... ...inference performance: latency, throughput, cost...PlatformSeniorWork at officeSolana Foundation
San Francisco, CA5 days ago- ...is seeking a Site Reliability Engineer in San Francisco, California, to... ...ensure the reliability of our AI infrastructure platform. Your mission is to operate the core systems that power ultra-low-latency serverless computing as we serve billions of requests. With a focus...Platform
- Senior Software Engineer - AI Inference Systems AI needs far more compute... .... Shape both the platform and the engineering... ...The role This isn't a model training role. You’... ...systems. Improving latency, throughput and... ...inference or model serving systems. A solid understanding...PlatformSenior
- ...understanding in healthcare. Our AI-powered platform was purpose‑built for... ...creatives, technologists, and engineers working together to empower... ...to identify performance and latency bottlenecks across all of our... ...service templates and self‑serve infrastructure. Work with application...PlatformSenior
- ...Site Reliability Engineering (SRE) is a discipline that... ...Python supported by Gen AI tooling to accelerate development... ...and orchestration platforms, mainly Kubernetes and... ...in Enterprise Low Code Development, and most... ...as the organizations we serve, ensuring every individual...PlatformSeniorImmediate startRemote workWorldwide
OutSystems
San Francisco, CA4 days ago $250.8k - $286.2k
...responsible and reliable AI systems, changing... ...class applied science and engineering teams to deliver our... ...capabilities to reimagine how we serve our customers and... ...of customers. Our AI models and platforms empower teams across... ...— scalability, cost, latency, throughput — of large...PlatformSeniorFull timePart timeLocal areaCapital One
San Francisco, CA5 days ago- ...reliability of Block's platform and critical infrastructure... ...continuously improve AI-driven tooling and... ...of sev 0-1 incidents Serve as primary on-call, maintaining... ...uptime, error rates, latency regression, and... ...perform and grow as an engineer 5+ years of software development...PlatformSeniorFlexible hours
$166.6k - $208.3k
...growing fast in scope and in stakes. Models increasingly drive real‑time... ..., and the Machine Learning Platform (MLP) team exists to build a paved... ...burden themselves — and we serve low‑latency, highly available scores to the decision engine that depends on them. The platform...PlatformSenior$165k - $220k
...Essential Cloud for AI™. Built for... ...CoreWeave delivers a platform of technology, tools... ...internal and customer engineering teams, offering valuable... ...Role, You Will Serve as the primary... ...publications/talks on latency, optimization, or advanced model‑server architectures...PlatformSeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours$200k - $240k
...analytics and AI solutions to help... ...and AI platforms include solutions... ...for all. The AI Engineering Team is chartered... ...Large Language Models (LLMs) and agentic... ...pipelines, serve models with millisecond-level latency, and provide the... ...the market. As a Senior or Staff ML Systems...PlatformSeniorRemote workWorldwide$166.9k - $225.9k
...keeps the people we serve at the center of... ...thoughtful hybrid model because we believe... ...as both a central engineering function and an... ...incidents Central SRE Platform Work Beyond... ...AIOps - using AI/ML-based tooling for... ...g., LLM inference latency, non-determinism,...PlatformSeniorWork at officeImmediate startWorldwideMonday to FridayFlexible hoursDrata Inc
San Francisco, CA4 days ago$210.8k - $248k
...understanding in healthcare. Our AI‑powered platform is purpose‑built for medical... ..., technologists, and engineers working together throughout... ...to identify performance and latency bottlenecks across all systems... ...service templates and self‑serve infrastructure. Help application...PlatformSeniorHourly payFull timeFlexible hours$174k - $210k
Forge is looking for a Senior Software Engineer II in San Francisco to enhance our trading platform functionality. The role involves owning production changes, delivering software efficiently, and collaborating with cross-functional teams to improve the user experience...PlatformSenior$148.5k - $161k
...vertically integrated AI infrastructure... ...climate. As a Senior Storage Systems Engineer , you will be the... ...sub-millisecond latency required for world... ...storage footprint, serving as the subject... ...our flash-based platforms. Your work ensures... ...fabrics to ensure low-latency data delivery...PlatformSeniorTemporary workCrusoe Energy Systems
San Francisco, CA2 days ago$150k - $250k
A tech-driven financial platform is seeking a Senior IT Engineer to improve workflows for the Legal, Risk, and Compliance teams. The role involves building... ..., managing integrations with various APIs, and serving as a trusted advisor to improve efficiency. Ideal candidates...PlatformSenior- Gravity Engineering Services Pvt Ltd. is seeking a Staff Engineer to design and build scalable systems for Databricks Model Serving. You will optimize performance and lead technical initiatives across CPU and GPU workloads. Ideal candidates have 10+ years of experience...
- ...Senior Compliance Engineer, AI Governance True Anomaly seeks those with the talent... ...and large language models (LLMs) deployed across the... ..., and products, this role serves as the organizational authority... ..., evaluate AI vendors and platforms (including OpenAI, Anthropic...PlatformSeniorPermanent employment
True Anomaly
San Francisco, CA2 days ago $275k - $350k
AI Talent Now is seeking an AI Lead in San Francisco, California to integrate AI capabilities into their design tool. Responsibilities include fine-tuning AI models and managing infrastructure for deployment. The ideal candidate will have 5-10 years of experience in machine...Senior- ...Deepgram is the leading platform underpinning the... ...-dollar Voice AI economy, providing... ...native foundation models are accessed through... ...accuracy, low latency, and cost efficiency... ...the intersection of engineering, product, and customer... ...live deployments. Serve as an escalation...PlatformSeniorHome officeFlexible hours
- Sequen AI is leading the charge for building... ...frontier ranking models for search and... ...frontier AI models serve production traffic... ...a Core Systems Engineer with a deep mastery... ...logic with ultra-low latency. You will replace... ...working with cloud platforms like AWS, GCP, or...PlatformSenior
$180k - $360k
...world's most dynamic AI companies, like Cursor... ...to bring cutting‑edge models into production. We're... ...us and help build the platform engineers turn to to ship AI products... ...systems, model serving, and developer experience... ...track record of owning low‑latency, reliable backend...PlatformFlexible hours$167.2k - $209k
...DigitalOcean is expanding its AI Infrastructure layer... .... We are seeking a Senior Engineer 2 to join our AI... ...deploy and scale their models with industry-leading... ...SLOs to ensure superior platform health. What You’ll Bring... ...distributed inference serving frameworks such as llm...PlatformSeniorLocal areaRemote workWorldwideFlexible hours- ...Senior SRE Unify is building the first AI-native outbound platform where agents and sellers work side by side.... ...changes that improve latency and throughput. Build... ...and alerting that give engineers clear visibility into... ...incidents. ~ Collaborative, low-ego attitude and...PlatformSenior
Unify
San Francisco, CA4 days ago $180k - $250k
...industry-leading global engineering platform is expanding its... ...practice and is seeking a Senior Mechanical Engineer to... ...focused sector driven by AI and digital... ...architectural disciplines Serve as a primary client contact... ...of redundancy models such as N, N+1, and 2N...PlatformSenior- ...philosophy that blends robotics, AI, and systems engineering at the frontier. About the Role We’re seeking a Senior Robotics Software Engineer to join... ...skills in C++ for embedded platforms, optimizing for reliability and low‑latency Sensor Integration: Interface with...PlatformSeniorRelocation
- A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal...PlatformSenior
$163k - $237k
Senior Developer Relations Engineer, AI for Builders Google - San Francisco, CA, USA Mid Minimum qualifications... ...and Ads APIs are just some of the platforms you promote and support. With your... ...to our Product Managers and serve as their Google support in application...PlatformSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Model Serving Engineer - Low-Latency AI Platform. Be the first to apply!
Related searches
- data platform engineer San Francisco, CA
- client platform engineer San Francisco, CA
- platform engineer San Francisco, CA
- platform developer San Francisco, CA
- senior platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- senior trade analyst San Francisco, CA
- senior app developer San Francisco, CA
- senior customer service advisor San Francisco, CA
- senior international account manager San Francisco, CA