Senior Model Serving Engineer - Low-Latency AI Platform
Jobleads-US
A leading data and AI company in San Francisco is seeking a Staff Engineer to design and implement systems for their AI/ML Model Serving platform. You will collaborate with product, infrastructure, and research teams to ensure high-performance system delivery. The ideal candidate has over 10 years of experience in distributed systems and model serving. This role offers a competitive salary and a commitment to diversity and inclusion. #J-18808-Ljbffr Jobleads-US
- HP IQ in San Francisco is seeking a Software Engineer with deep expertise in device software development... ...across Android, Windows, and embedded platforms, collaborating with hardware partners to deliver secure, low‑latency experiences for enterprise devices. Ideal candidates...PlatformSenior
- Databricks Mosaic AI is seeking an experienced backend/infrastructure engineer to build platforms powering AI workloads, including model training, serving, and vector search. You will join a high-visibility team connected to research, product, and enterprise use cases,...PlatformSenior
$166k - $225k
...the world's best data and AI infrastructure platform so our customers can use... ...their business. Databricks’ Model Serving product provides... ...models. It offers real-time, low-latency inference, governance, monitoring... ...and cost efficiency.As a Senior Engineer, you’ll play a critical...PlatformSeniorLocal areaWorldwide- ...Responsibilities As a senior Machine Learning Systems Engineer on the Search Platform team, you will... ...scalable search serving infrastructure,... ...high-throughput, low-latency search systems... ...relevance quality.ML Model Development &... ...Partner with Rovo and AI platform teams to...PlatformSeniorWork at officeLocal area
$220k - $320k
...specialized language models for companies that... ...frontier-quality AI at a fraction of... ...90% cheaper. Our platform handles everything... ...ten-person team of engineers who work in-person... ...with the goal of serving models faster and... ...inference performance: latency, throughput, cost...PlatformSeniorWork at office$300 per month
...vertically integrated AI infrastructure... ...our Production Engineering team ensures the... ...optimized cloud platform. We’re looking for a Senior Production... ...large language models to help us build... ...compute-intensive, latency-sensitive workloads... ...with a focus on serving and scaling LLM...PlatformSeniorTemporary work$166.6k - $208.3k
...growing fast in scope and in stakes. Models increasingly drive real-time... ..., and the Machine Learning Platform (MLP) team exists to build a paved... ...burden themselves — and we serve low-latency, highly available scores to the decision engine that depends on them. The platform...PlatformSenior$300 per month
...vertically integrated AI infrastructure... ...Crusoe, our Production Engineering team ensures the reliability... ...AI-optimized cloud platform. We’re looking for a Senior Production Engineer... ...compute-intensive, latency-sensitive workloads... ...with a focus on serving and scaling LLM workloadsDefine...PlatformSeniorTemporary work- ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of... ...currently Tuesday. Engineering at Lambda is responsible... ...Datacenter Ops teams for low-level or cross-functional... ...the validation of platform quality. Design, build,...PlatformSeniorFull timeWork at officeLocal areaWork from homeFlexible hours
- ...world's most dynamic AI companies, like Cursor... ...to bring cutting-edge models into production. We're... ...us and help build the platform engineers turn to to ship AI products... ...systems, model serving, and developer experience... ...track record of owning low‑latency, reliable backend...PlatformFull timeFlexible hours
- ...Summary : The Senior Salesforce... ...ecosystem, including platform maintenance,... ...or integration engineer. This position... ...Responsibilities Serve as the portfolio... ...Translate manual and/or low-tech processes... ...scalable data models; develop and... ...artificial intelligence (AI) tools to...PlatformSeniorFull timeCasual workWork at officeAfternoon shift
$98k - $140k
...the collaborative AI workspace where teams... ...with product and engineering teams to build... ...ll shape Notion's model strategy and work... ...dimensions: quality, latency, cost, edge cases.... ...observability and eval platforms (e.g., Braintrust)... ...— You can self-serve insights from...PlatformLive inLocal area$192k - $260k
...the world's best data and AI infrastructure platform so our customers can use... ...their business. Foundation Model Serving is the API Product for... ...necessary. We’re looking for engineers who have owned high scale... ...enable high-throughput, low-latency inference on GPU...PlatformLocal areaWorldwide$165k - $190k
...CAQPU - Hardware Engineering /Full-time /On-... ...are seeking a Senior Mechanical/... ...cause analysis. Serve as the mechanical... ...documentation — CAD models, drawings, BOMs... ...Cloud Services platform. The company’s... ...provides ultra-low latency integration... ...intelligence (AI) tools to support...PlatformSeniorFull timeWork experience placementLocal areaFlexible hours- ...worldwide.We’re a team of engineers, clinicians, and... ...of PositionAs a Senior Systems GPU Engineer - AI & Robotics, you will... ...Responsibilities• GPU & Model Performance &... ...roadmap for the robotics platform—from foundational models... ...inference—while serving as a core contributor...PlatformSeniorLocal areaWorldwideFlexible hours
$180k - $237.5k
...17, we’re delivering low-cost and large-scale... ...already have. Senior Software Engineer – Site Controller, Energy... ...(BESS). It is the platform that allows us to harmonize... ...that ensure low-latency, reliable data flow between... ..."Pack Manager" to serve as a universal...PlatformSeniorFull timeLocal area$174k - $210k
Forge is looking for a Senior Software Engineer II in San Francisco to enhance our trading platform functionality. The role involves owning production changes, delivering software efficiently, and collaborating with cross-functional teams to improve the user experience...PlatformSenior$155k
.... For us, it also serves as a practical framework... ...The Quality Engineering team builds the shared... ...with frontend and platform engineers across... ...are looking for a Senior Software Engineer,... ...implementing how AI reshapes quality... ...clear test ownership models so teams can...PlatformSeniorFull timeContract workLocal areaHome officeFlexible hoursShift workEarly shift$150k - $250k
A tech-driven financial platform is seeking a Senior IT Engineer to improve workflows for the Legal, Risk, and Compliance teams. The role involves building... ..., managing integrations with various APIs, and serving as a trusted advisor to improve efficiency. Ideal candidates...PlatformSenior$298k - $368k
...applied to a range of vehicle platforms and product use cases. The... ...diverse set of sensors, enabling engineers like you to (1) develop... ...-world data, to (2) develop models and model training at scale,... ...models). ~ Proven expertise in low-latency on-device inference...PlatformSeniorFull timeRemote work$102k - $182.71k
...OverviewWe’re seeking a Senior Search Systems Engineer to build the... ...of our marketing and AI visibility data. This... ...environments.This role serves as the bridge between... ...and analytical data models that support downstream... ...warehouses, and marketing platforms Data Quality and...PlatformSeniorFull timeFor contractorsRemote workShift work$170k - $200k
...in communities around the globe. Our AI-powered labor marketplace helps local... ...way the world works.We are seeking a Senior Software Engineer - Instawork Robotics to contribute to... ..., stadiums, and more. Our AI-powered platform serves thousands of businesses across more than...PlatformSeniorHourly payTemporary workLocal areaShift work- AI Backend Engineer, Artificial Intelligence (AI) Required... ...across our platform. This role sits at... ...AI stack, between models, backend systems,... ...real users, where latency, correctness, reliability... ...systems that serve AI‑powered insurance... ...reliably at scale with low latency and high...PlatformRemote jobWork from home
$115k - $125k
...based Managed Service Provider serving small and mid-sized... ...Role We're looking for a senior MSP engineer who can own difficult problems... ...secondary technical owner of core platforms including Kaseya, HaloPSA,... ...including thoughtful use of AI where it can improve efficiency...PlatformSeniorWork at officeRemote workWork from homeFlexible hoursWeekend work- ...Senior Compliance Engineer, AI Governance True Anomaly seeks those with the talent... ...and large language models (LLMs) deployed across the... ..., and products, this role serves as the organizational authority... ..., evaluate AI vendors and platforms (including OpenAI, Anthropic...PlatformSeniorPermanent employment
- ...philosophy that blends robotics, AI, and systems engineering at the frontier. About the Role We’re seeking a Senior Robotics Software Engineer to join... ...skills in C++ for embedded platforms, optimizing for reliability and low‑latency Sensor Integration: Interface with...PlatformSeniorRelocation
$166k - $225k
...and running the world's best data and AI infrastructure platform so our customers can use deep data... ...improve their business. Founded by engineers — and customer obsessed — we leap at... ...reliability of a data warehouse, and the low latency of streaming. Its higher level...PlatformSeniorLocal areaWorldwide$180k - $300k
...creating the generative models that power how... ...high-performance APIs serving millions of... ...Optimize inference latency and throughput across... ...task queues Cloud platforms (AWS, GCP, or Azure... ...includes: Real-time or low-latency inference... ...edge of generative AI. #J-18808-Ljbffr Black...PlatformRemote workWorldwide2 days per week- A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal...PlatformSenior
$200k - $400k
...Job Title: Founding AI Engineer Location: San Francisco, CA (On-site; relocation assistance available) Compensation: $2... ...evaluation. You’ll join at a pivotal growth stage — our AI-powered platform already serves millions of users and generates strong recurring revenue....PlatformSeniorFull timeImmediate startRelocationVisa sponsorshipRelocation packageFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Model Serving Engineer - Low-Latency AI Platform. Be the first to apply!
- data platform engineer San Francisco, CA
- client platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- platform developer San Francisco, CA
- senior platform engineer San Francisco, CA
- platform engineer San Francisco, CA
- senior operations associate San Francisco, CA
- senior safety specialist San Francisco, CA
- senior technology project manager San Francisco, CA
- remote senior business analyst San Francisco, CA



