Lead ML Inference & Distributed Systems Engineer
Jobleads-US
Tubi is seeking a Staff Software Engineer for the ML Infrastructure team to build world-class ML inference platforms powering recommendations, search, and content understanding. You will advance low-latency model serving, feature/vector stores, and experimentation engines across the ML stack.
You will collaborate with ML, Product, and cross-functional teams to define the long-term architecture, deploy scalable services, and contribute to open-source efforts, with opportunities to influence
#J-18808-Ljbffr Jobleads-USVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead ML Inference & Distributed Systems Engineer in San Francisco, CA vacancy
- ...Baseten powers mission-critical inference for AI companies, uniting research, flexible infrastructure, and developer tooling... ...scalability, and reliability across the platform. As a distributed systems engineer on the Inference Platform, you will own end-to-end...SuggestedFlexible hours
- ...foundation models; as a Software Engineer on Inference, you’ll help define the... ...party providers. You’ll work on systems for serving and routing... ...role at the intersection of distributed infrastructure and AI. You don’t need to be an ML researcher—but you should love...Suggested
- ...Baseten is hiring distributed systems engineers to build the runtime that powers large-scale LLM inference. You will deploy and operate Model APIs, routing, autoscaling, and orchestration on Kubernetes, while focusing on speed, reliability, and cost efficiency. You...Suggested
- ...Hedra Inc. in San Francisco is seeking a Senior or Staff Software Engineer with deep expertise in building and operating distributed production systems. You will work on Hedra’s inference infrastructure, designing and operating systems that schedule, route, and manage...Suggested
$227.2k - $324.5k
...:As a Staff Software Engineer on the ML Infrastructure team,... ...class machine learning inference platforms. These... ...latency ML model serving systems that support Deep Learning... ...new frameworks, lead critical cross-functional... ..., and low latency distributed systems using...SuggestedFull timeTemporary workLocal areaFlexible hoursTubi TV
San Francisco, CA2 days ago- Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team... ...pod is creating the systems that determine what... ...ll work closely with ML Scientists, Data Scientists... ...online and batch inference capabilities that... ...related experiences.Lead through influence by...Full timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA3 days ago - ...interpretable, and steerable AI systems. We want AI to be safe and... ...of committed researchers, engineers, policy experts, and... ...is an unusually demanding distributed system. Training, sampling... ...qualifications Experience running ML training or inference infrastructure at scale...Visa sponsorshipShift work
- ...Beam is an ultrafast AI inference platform. We built a serverless... ...someone to help us with Platform Engineering work. We’re working on lots... ...fun problems: Low‑level systems development: working with... ...experience working with a large distributed system ~ Comfortable with...
Beam
San Francisco, CA3 days ago - ...have a legal entity. Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize large-scale model... .... You will have the chance to own everything from distributed infrastructure (global KV cache, continuous...Work at officeLocal area
Atlassian
San Francisco, CA3 days ago - ...A, and Conversational AI system that integrates seamlessly... ...ecosystem.About the AI & ML Platform TeamOur team’s... ...RoleAs a Senior ML System Engineer on the AI & ML Platform’s Inference team, you will design and... ...will own everything from distributed infrastructure (global KV...Work at officeLocal area
Atlassian
San Francisco, CA1 day ago - ...Principal Machine Learning Systems Engineer (P60) to lead technical directions of... ...You'll Doð Design and Build ML SystemsArchitect and implement... ...-scale model training, inference pipelines, or search/... ...Nice to HaveBackground in distributed systems, high-performance...Work at officeLocal area
Atlassian
San Francisco, CA5 days ago $144k - $192k
...are looking for a Machine Learning Systems Engineer to join our ML Acceleration team. In this role, you... ...impact our ability to scale large-scale distributed model training and reduce the time-... ...model execution during training and inference, alongside a strong understanding of...Work at officeRemote workMotional
San Francisco, CA2 days ago$148.5k - $223.9k
...career at the company leading workforce transformation... ...in developing distributed filesystems in an ever... ...review, mentoring junior engineers, and providing technical... ...developing distributed systems at scale. - Proficiency... ...with Big-Data/ML and S3 Hands-on experience...Full timeImmediate startSalesforce
San Francisco, CA5 days ago- ...Sierra is the leading platform for customer-facing AI agents, based in San Francisco. We are seeking a Software Engineer on the Inference team to define architectures for self-hosted and... ...scale. You will work across distributed systems to build, optimize, and operate...
- ...Modal is seeking a systems engineer to advance the container runtime stack used for inference workloads, working close to Linux, containers, storage, GPU drivers, and distributed systems. You will build production runtime infrastructure in Rust and Go, diagnose tough Linux...
$300k - $400k
...to build it. About the Role We're hiring a Software Engineer, Distributed Systems to design and build the core distributed systems that everything... ...distributed compute or orchestration systems for AI or ML workloads Fluent in containerization, orchestration, and...Visa sponsorshipWork visaRelocation package- ...Description ThisWay Global is looking for a Distributed Systems Engineer in a remote role within the United States. ThisWay Global, Inc. is... ...Experience with HPC environments, exascale computing, or AI/ML infrastructure. Exposure to operating systems internals,...Full timeRemote work
GrabJobs
San Francisco, CA1 day ago - ...into action. We’re looking for engineers who want to build the operating system for AI Data Applications and Workflows... ...We're looking for experienced distributed systems engineers to build the core... ...to them You can autonomously lead, design, and build fault-tolerant...
Tensorlake Inc.
San Francisco, CA4 days ago $200k - $260k
...assembled authentication, integrations, distributed systems, and AI experts from Okta, Redis,... ...desire to ship. ~7+ years of software engineering experience comprising of: ~5+ years... ...scale distributed systems Experience leading teams and mentoring more junior...Work at officeShift workArcade
San Francisco, CA1 day ago$175k - $300k
...the frontier forward. The Production Engineering Team Examples of key exciting... ...management, actual state inspection, and distributed command execution. One interface for the... ...company, not a hundred scripts. Make the system's view of itself always match reality:...Local areaFluidStack
San Francisco, CA5 days ago- ...Distributed Systems EngineerAs a distributed systems engineer, you'll work across the stack to solve problems as they come up and help build Archil volumes. You'... ...operations take, and what kind of bottlenecks could lead to a reduction in potential throughput.Most of all...Flexible hours
Archil
San Francisco, CA3 days ago $300k - $400k
...more work for it. We’re looking for a Systems Engineer who knows how to find bottlenecks and... ...go, and fix what matters Reliable distributed systems - design how work and data move... ...sandboxes, agent harnesses, training, and inference run efficiently together across CPUs...- ...shift to the New using leading-edge technologies on... ...reliability of deployed systems.The Work:• Formulate... ...representatives, business owners, engineers, architects, and UI... ...of experience in distributed computing systems and... ...and deploying AI/ML based software to a cloud...Full timeWork experience placementLive inWork at officeLocal areaShift work
Accenture
San Francisco, CA5 days ago - ...Hinge Health is seeking a Senior AI Engineer focused on MLOps & distributed systems to own the production path turning AI capabilities into reliable member... ...cost-conscious in production. You’ll collaborate with ML Scientists, Data Engineers, and Software Engineers to...
- ...that you will help lead.As the technical... ...determine where new ML capabilities can... ...quality agentic search systems, addressing tail... ..., and ML inference. Turn advances in... ...systems, mentor senior engineers, and align technical... ...operations.Strong distributed-systems expertise...Work at officeLocal area
Atlassian
San Francisco, CA5 days ago - ...Thinking Machines is seeking a Software Engineer, Distributed Systems to design and build the core distributed systems that run Inkling and Tinker across thousands of machines. You’ll work on orchestration, scheduling, storage, and networking to coordinate reliably at...
$120k - $250k
...and state, and work over time. We're looking for an engineer who wants to design systems that continue working after individual machines fail. You... ...those cases understandable and testable. You'll own distributed services from the initial contract through...Contract workWork at officeVisa sponsorshipRelocation packageDedalus Labs, Inc.
San Francisco, CA11 days ago$164.7k - $266k
...disconnected from business systems of record, costing... ...'ll doWe are seeking a Lead AI Architect to turn enterprise... ..., Data, Product, and Engineering teams to shape long-... ...with AI/ML, product, and engineering... ...architecture, data engineering, distributed data systems, or AI/data...Contract workWork at officeLocal areaRemote work2 days per weekDocuSign
San Francisco, CA3 days ago$180k - $270k
Lead RF Systems and Defense Engineer- HP IQDescription -Who We AreHP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates.We’re assembling...Full timeTemporary workLocal areaRelocationFlexible hoursShift workJuniper Networks
San Francisco, CA4 days ago$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed framework for large language... ...training and inference. The platform has... ...excitement about system optimizationExperience... ...software engineering skills, proficient... ...power the world's leading models, and help...Full timeScale AI
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead ML Inference & Distributed Systems Engineer. Be the first to apply!
Related searches
- computer vision machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- senior linux systems engineer San Francisco, CA
- system engineer contract San Francisco, CA
- data systems engineer San Francisco, CA