Staff Software Engineer ML Platform & Inference
Cohere
Cohere is seeking Members of Technical Staff to join the Model Serving team in San Francisco. You will help build and operate the AI platform delivering large language models through easy-to-use API endpoints. Ideal candidates have 5+ years of engineering in production infrastructure, experience with Kubernetes, cloud platforms, and high-performance distributed systems. This role is remote-friendly with office options in SF and travel per policy. #J-18808-Ljbffr Cohere
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer ML Platform & Inference in San Francisco, CA vacancy
$190.9k - $232.8k
P-1285About This RoleAs a staff software engineer for GenAI inference, you will lead the architecture, development... ...overheadDrive cross-team collaboration: with platform engineers, cloud infrastructure,... ...end-to-endDeep understanding of ML inference internals: attention,...SuggestedLocal areaWorldwideDataBricks
San Francisco, CA2 days ago$190k - $265k
...best data and AI infrastructure platform so our customers can use deep... ...their business. Founded by engineers — and customer-obsessed — we... ...generation of AI.The Foundation Model Inference team is the backbone of... ...with platform, infra, and ML teams to deliver seamless end...SuggestedLocal areaWorldwideDataBricks
San Francisco, CA2 days ago- ...financial infrastructure platform for businesses.... ...to innovate in ML Platform at Stripe... ...that enable ML engineers and data scientists... ...driven products. As a Staff Engineer, you'll... ...low-latency model inference, large-scale... ...and operating great software systems.Who you areWe...SuggestedFlexible hours
Stripe
San Francisco, CA4 days ago - ...Location Type Hybrid Department Inference Model Serving Who are we? Our... ...is a team of researchers, engineers, designers, and more, who are... ...build the next generation of AI platforms powering advanced NLP... ...looking for Members of Technical Staff to join the Model Serving team...SuggestedFull timeWork experience placementWork at officeRemote workFlexible hours
$230k - $390k
About usSierra is the leading platform for customer-facing AI... ...reason and act in real time. The Inference team builds the systems that... ...and efficient at scale.As a Software Engineer on Inference, you’ll help... ...AI. You don’t need to be an ML researcher—we’re looking for...SuggestedFull timeFlexible hoursSierra
San Francisco, CA1 day ago$252k - $315k
...GP (Scale Generative AI Platform) is an enterprise-grade... ...knowledge retrieval, inference, evaluation, and more.... ...are looking for a strong engineer to join our team and help... ...understanding of software engineering principles... ...interacting with LLMs and ML models. You will solve...Full timeScale AI
San Francisco, CA2 days ago- ...Rippling AI and the core AI Platform. These foundational systems... ...product areas. As a Senior Staff Software Engineer, you will own broad, ambiguous... ...strong, hands-on engineers. AI/ML background is a strong plus,... ..., model infrastructure, inference, sandboxing, workflow automation...Work at office3 days per week
Rippling
San Francisco, CA7 hours ago $190k - $270k
Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are... ...the world’s best data and AI platform so our customers can focus on... ...large‑scale training and inference experiment workloads across... ...closely with research scientists, ML engineers, and platform...Local areaWorldwideDataBricks
San Francisco, CA7 hours ago- ...for Search at Rippling, designing cross-platform search primitives that will power the next... ...multiple Rippling products.Elevate the entire engineering organization through strategic design... ...retrieval, semantic/vector search, or ML-assisted ranking experience.Experience with...Work at office3 days per week
Rippling
San Francisco, CA3 days ago $208.59k - $429.45k
...the world come to our platform to find creative ideas,... ...Data Science, Design, and engineering teams to ship... ...looking for:10+ years of software engineering experience,... ...including meaningful time as a Staff, Senior Staff, or... ...building or partnering on ML-, AI-, or GenAI-adjacent...Work at officeLocal areaRelocationRelocation packagePinterest
San Francisco, CA1 day ago$254k - $350k
...Francisco, CASoftware - Autonomy Software /Full-time /HybridZoox is... ...for an experienced software engineer to work on large-scale simulation... ...behaviorsImprove the ML training pipelines supporting... ...learning workloads (training, inference, data generation) from a cost...Full timeTemporary workRelocation packageZoox
San Francisco, CA3 days ago$190k - $260k
...and AI infrastructure platform so our customers can use... ...their business. Founded by engineers — and customer obsessed... ...when necessary. As a Staff Engineer, you will... ...Product, Machine Learning (ML) and Large Language... ...in machine learning and software engineering, coupled with...Local areaWorldwideDataBricks
San Francisco, CA2 days ago$245.4k - $429.45k
...people around the world come to our platform to find creative ideas, dream about... ...in our recruiting process here.Sr. Staff Software Engineer, Product ML InfrastructureMillions of people... ...unified data, training, feature, and inference infrastructure; this role will set...Work at officeLocal areaRemote workRelocationRelocation packagePinterest
San Francisco, CA3 days ago$208.45k - $364.8k
...of people around the world come to our platform to find creative ideas, dream about new... ...recruiting process here.Pinterest is seeking a Staff Software Engineer to help evolve the serving platforms... ...efficiency goals.Partner with product, ML, infrastructure, and Core/Ads...Work at officeLocal areaRelocationRelocation packagePinterest
San Francisco, CA7 hours ago$227.2k - $324.5k
About the Role:As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world-class machine learning inference platforms. These platforms power essential services like personalized recommendations...Full timeTemporary workLocal areaFlexible hoursTubi TV
San Francisco, CA2 days ago- About us Sierra is the leading platform for customer-facing AI... ...reason and act in real time. The Inference team builds the systems that... ...efficient at scale. As a Software Engineer on Inference, you’ll help define... ...AI. You don’t need to be an ML researcher—we’re looking for...Full timeFlexible hours
$250k - $300k
...production. That means owning the inference stack end to end: profiling... ...work directly with customer engineering teams to tailor deployments... ...methods across many kinds of ML models, with an emphasis on large... ....Build and support the software and product features around the...Temporary workCrusoe
San Francisco, CA2 days ago- As vCluster Labs' Staff Software Engineer , you aren't just writing code; you are... ...architect of the vCluster Platform, tasked with navigating complex... ...Kubernetes, Slurm, Ray, and inference clusters, so they can turn... ...framework built for running AI, ML, and GPU-intensive workloads...Remote workFlexible hours
- ...Systems Administrator / DevOps Engineer, you will maintain and build... ...our model training and our inference cloud. You’ll split your time... ...reliability of our inference platform. What We’re Looking For... ...Terraform) Prior work supporting ML/AI infrastructure, including...Work at officeRemote workRelocation package
Zyphra
San Francisco, CA5 days ago - ...About the Role You'll build the software backbone that powers autonomous manufacturing... ...operations at Tenkara. As a Senior/Staff Software Engineer on the Platform team, you'll design scalable backend... ...productionize LLM-based agents, AI/ML infrastructure, and RAG patterns for...Full time
Tenkara
San Francisco, CAa month ago - ...Hivemapper Data Platform EngineerHivemapper is a decentralized global... ...etc. feed sensor fusion and ML models at the edge. Data is... ...customers develop and deploy software directly to our dashcams to get... ...called Map AI.The Platform Engineering team is responsible for the core...Flexible hours
Hivemapper
San Francisco, CA3 days ago $210k - $300k
Senior/Staff Software Engineer, Infrastructure (ML)Nimble is an AI robotics company building the autonomous supply... ...'ll help build the training and inference systems that power our general-purpose... ...into a reliable, high-throughput platform for model development....Local areaFlexible hours$192k - $260k
...and AI infrastructure platform so our customers can use... ...serving frontier AI model inference for open source models... ...this role, no prior ML or AI experience is necessary... .... We’re looking for engineers who have owned high‑... ...runtimes at scale. As a Staff Engineer, you’ll play a...Local areaWorldwide- ...systems. We are seeking a Member of Technical Staff to build AI-native products that tackle high-impact healthcare problems across platforms, data infrastructure, and UI experiences.... ...at customer sites, advancing a scalable ML-driven platform. You’ll collaborate with founders...
$236k - $290k
...agentic AI, an enterprise-grade platform, and deep domain expertise,... ...started.Role OverviewAs a Staff Software Engineer on the Core Infrastructure... ...that routes millions of daily inference requests while maintaining... ...building infrastructure for AI/ML workloads or high-throughput...Relocation package$182k - $228k
## Staff Software Engineer, Search Platform - BackendApply: San Francisco: Full time: Posted Yesterday: R-102743# **About the team**Turo's Search Platform... ...Science or related field* Experience working with ML-based ranking infrastructure.* Strong communicator - Explaining...Full timeFixed term contractWork at office3 days per week$190k - $265k
...world's best data and AI infrastructure platform so our customers can use deep data... ...sophisticated AI teams in the world.As a Staff Software Engineer for AI Runtime, you will play a critical... ...infrastructure, high-performance computing, or ML systems.Hands-on experience with...Local areaWorldwideDataBricks
San Francisco, CA2 days ago$190k - $261.25k
...and AI infrastructure platform so our customers can turn... ...impact.Founded by engineers and driven by customer... ...getting started.As the Staff Technical Lead (TL) for... ...experts (SMEs) across Software, Support, and internal... ...environmentsHands-on experience with ML-assisted systems,...Local areaWorldwideDataBricks
San Francisco, CA2 days ago$272k - $340k
...community of millions of daily active users who use the platform for many different reasons, but there’s one thing... ..., and after playing games.We're looking to hire a Staff Machine Learning Engineer on our Consumer Revenue ML team. This team applies Machine Learning across...Full timeLive inWork at officeRemote workDiscord
San Francisco, CA3 days ago$200.7k - $298.8k
...constellation.That’s what our Risk product engineering teams do at Mercury. We guide thousands... ...precision, and care.We’re looking for a Staff Software Engineer to contribute with building the... ....Partner with Data Science and ML teams to productionize models, build reliable...Night shiftMercury
San Francisco, CA7 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer ML Platform & Inference. Be the first to apply!
Related searches
- client platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- platform developer San Francisco, CA
- platform engineer San Francisco, CA
- data platform engineer San Francisco, CA
- senior platform engineer San Francisco, CA
- software product owner San Francisco, CA
- software quality assurance San Francisco, CA
- entry level software sales San Francisco, CA
- software technical writer San Francisco, CA