Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Infrastructure Engineer — Low-Latency Inference

$227.2k - $417k

Tubitv

Tubitv is seeking a Software Engineer to join its ML Infrastructure team in San Francisco. You will be responsible for building systems that support machine learning and enhance user experience through scalable architectures. The position requires expertise in languages like Scala, experience with AWS, and a knack for designing low-latency systems. Tubi offers a flexible remote work environment, various benefits, and a competitive salary range of $227,200 – $417,000 annually. #J-18808-Ljbffr Tubitv

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Infrastructure Engineer — Low-Latency Inference in San Francisco, CA vacancy
  • Pinterest in San Francisco is seeking a Systems / Platform Engineer to join the tvScientific AI infrastructure team, focusing on sub‑millisecond decisioning, low‑latency data access, and a scalable training/serving stack. You’ll work with SRE, data infra, and software... 
    Suggested

    Pinterest

    San Francisco, CA
    1 day ago
  • A media technology company in San Francisco is seeking a Founding Engineer specializing in ML Inference. This highly technical role requires expertise in the ML infrastructure stack and aims to optimize generative media performance. The ideal candidate will drive innovations... 
    Suggested
    Relocation package

    Reactor.am

    San Francisco, CA
    4 days ago
  •  ...expertise in AI simulation development. The role emphasizes optimizing training efficiency, enhancing GPU performance, and ensuring low-latency inference. Applicants should be proficient in methodologies for gradient checkpointing, Nsight profiling, and job management tools... 
    Suggested

    Embedding VC

    San Francisco, CA
    1 day ago
  • $202k - $222k

    Discord is looking for a Machine Learning Engineer to develop and iterate on ML-driven products that enhance user engagement. The ideal candidate will have over 8 years of experience in creating low latency, complex machine learning systems. This role emphasizes collaboration... 
    Suggested
    Remote job

    Discord

    San Francisco, CA
    1 day ago
  • $275k

     ...Platform | Hybrid (LA or SF) We’re hiring a Senior ML Infrastructure / Backend Engineer to join a well-funded AI company building the visual...  ...at scale — supporting high-concurrency user traffic, low-latency inference, and rapid iteration as the platform grows. You’ll work... 
    Suggested
    Work at office

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • Mach9 is looking for an experienced ML infrastructure engineer in San Francisco to build and maintain systems powering production AI models. This...  ...centralized versioning systems, optimizing real-time inference services, and ensuring reliable deployments. Candidates should... 

    Mach9

    San Francisco, CA
    1 day ago
  •  ...strong foundation in low-level operating...  ...experienced with modern inference systems like TGI ,...  ...model serving infrastructure for high throughput and low latency at scale Developing...  ...staying current with ML infrastructure developments...  ...requires a large engineering effort dedicated to... 
    Work at office

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    4 days ago
  •  ...looking for a Member of Technical Staff, specializing in ML Infrastructure and Inference, focused on building and optimizing scalable systems....  ...performance. The ideal candidate will possess strong software engineering fundamentals, experience with model serving, and... 

    Acceler8 Talent

    San Francisco, CA
    3 days ago
  •  ...conditions, needs the same foundational infrastructure.A way to route between models. A...  ...it. We're looking for a Staff ML Platform Engineer - Large Scale Training (LLMOps/MLOps...  ...code that enables high-throughput, low-latency inference pipelines for state-of-the-art models... 
    Flexible hours

    TrueFoundry

    San Francisco, CA
    1 day ago
  • $183.7k - $248.6k

     ...a Senior Machine Learning Infrastructure Engineer to join our Vector Ads team...  ...platform. This is a high‑scale, low‑latency environment — processing...  ...infrastructure that brings ML models from training into...  ...serving, model versioning, and inference optimization What we’re... 
    Work at office
    Remote work
    Worldwide
    Relocation package

    Unity

    San Francisco, CA
    1 day ago
  •  ...Numerics in San Francisco is seeking a Member of Technical Staff, ML Product Engineer to develop APIs and systems that support genome-scale...  ...involves building reliable batch systems and ensuring efficient inference for scientific applications. The ideal candidate will have... 

    Jobr

    San Francisco, CA
    3 days ago
  • Gravity Engineering Services Pvt Ltd. is seeking an experienced API Engineer to join their team in San Francisco, California. This role...  ...and operating high-performance APIs with a focus on low latency and high throughput. The ideal candidate will have at least 5... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal... 

    LMArena

    San Francisco, CA
    6 hours ago
  • $123.7k - $254.67k

     ...looking for an ambitious Systems / Platform Engineer to join a team at the intersection of SRE and low-latency distributed systems. This team will help...  ...power Pinterest’s next generation of realtime ML and measurement infrastructure, with a focus on sub‑millisecond... 
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago
  • $183k - $310k

    Build the data infrastructure for robots operating in the real...  ...need to be improved, engineers rely on data to...  ...Role We're looking for a ML Platform Engineer with...  ...platform itself, from inference serving and pipeline orchestration...  ...that directly impact latency, throughput,... 
    Remote work

    Foxglove

    San Francisco, CA
    1 day ago
  • RZR in San Francisco is seeking a skilled Network Engineer to design and maintain high-performance network infrastructure for their programmatic platform. This role involves working with advanced open networking technologies and collaborating closely with engineering teams... 

    Rzr Co

    San Francisco, CA
    16 hours ago
  • causal, located in San Francisco, is seeking infrastructure engineers passionate about solving unsolved problems in AI. The role involves designing and maintaining large distributed ML training and inference clusters. The ideal candidate should have a deep understanding... 

    causal

    San Francisco, CA
    1 day ago
  •  ...company in San Francisco is seeking a Senior Machine Learning Engineer for Voice AI to optimize voice model inference and productionize cutting-edge voice applications. The ideal candidate will have over 5 years of ML engineering experience, strong Python and PyTorch skills,... 

    Together AI

    San Francisco, CA
    1 day ago
  • Preference Model seeks experienced Machine Learning Engineers for its Low Level / Kernels Capabilities team. This role focuses on crafting reinforcement...  ...compensation, autonomy, and opportunities to work with top ML engineers in a dynamic startup environment. #J-18808-Ljbffr... 

    Preference Model

    San Francisco, CA
    4 days ago
  • A cutting-edge visual AI platform is seeking a talented individual to optimize model inference and enhance the core engine's performance. The ideal candidate is passionate about AI technology and has a strong background in production-level PyTorch. Responsibilities include... 

    ComfyUI

    San Francisco, CA
    1 day ago
  • $200k

    Platform Engineer - Inference Optimization We build and operate large-scale LLM inference and training infrastructure serving millions of users. This role focuses on deep optimization...  ...frameworks and building a scalable, low-latency, cost-efficient AI platform across inference... 

    Kaon (prev. FlowGPT)

    San Francisco, CA
    1 day ago
  •  ...new Machine Learning Engineer opportunities posted on...  ...and optimize end-to-end ML pipelines encompassing...  ...with the latest AI infrastructure, tooling, and research...  ...high performance and low latency. Machine Learning Enginer...  ...tuning training and inference end-to-end for high throughput... 
    Flexible hours

    AI Chopping Block, Inc.

    San Francisco, CA
    1 day ago
  • A technology company in San Francisco is seeking an experienced Infrastructure Engineer to ensure 99.99% uptime while working with custom inference stacks and managing GPU loads. The ideal candidate will have deep infrastructure expertise and a passion for tackling complex... 

    Morph

    San Francisco, CA
    1 day ago
  •  ...looking for a Distributed Training and Inference Engineer to optimize the software stack for AI training...  ...with various machine learning infrastructure components. The ideal candidate has significant industry experience in ML systems and programming expertise in Python... 
    Flexible hours

    Sciforium

    San Francisco, CA
    1 day ago
  • Gravity Engineering Services Pvt Ltd. is seeking a Senior ML Engineer to optimize the model serving layer for voice workloads. This role involves working hands-on with inference engines to enhance model performance for speech applications. The ideal candidate will have... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • A leading AI platform company in San Francisco is seeking a talented individual to optimize model inference for their advanced visual AI product. The ideal candidate will engage in building efficient AI models and tackling complex challenges. The role requires a strong... 

    Comfy

    San Francisco, CA
    4 days ago
  •  ...based in San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate will have hands-on experience... 

    Reflection AI

    San Francisco, CA
    3 days ago
  • $166k - $244k

    A leading technology company is seeking a Research Software Engineer to develop next-generation technologies that enhance communication through...  ...learning performance, and bridging high-level algorithms with low-level hardware. The position offers a salary range of $166,000-$... 

    Google

    San Francisco, CA
    7 hours ago
  • An AI infrastructure company is looking for a Senior ML Engineer to optimize performance for voice models such as speech-to-text and text-to-speech. You will work...  ...serving engines, focusing on GPU utilization and inference optimization. With over 5 years of experience... 

    Together AI

    San Francisco, CA
    1 day ago
  •  ...We are seeking an Applied ML Engineer to productionize and scale...  ...transforming models into reliable, low‑latency, production‑grade systems...  ...Platform teams to optimize inference performance, build...  ...scale models using AWS‑based infrastructure Build automated evaluation... 

    Knowtex

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Infrastructure Engineer — Low-Latency Inference. Be the first to apply!