Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Infra Engineer — Real-Time, Low-Latency

LMArena

A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal applicants have over five years of experience in software engineering with a strong background in distributed systems and a passion for building reliable infrastructure. This role offers competitive compensation and a chance to work with cutting-edge AI technologies in a collaborative environment.#J-18808-Ljbffr

Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Senior ML Infra Engineer — Real-Time, Low-Latency in San Francisco, CA vacancy
  •  ...next generation of AI products. As a Senior Data Engineer at fal, you will build the data infrastructure...  ...data signals into analytics stores. You will design low-latency pipelines, implement ingestion to BigQuery and ClickHouse, and partner with infra, #J-18808-Ljbffr
    Senior

    The Consensus

    San Francisco, CA
    9 hours ago
  • $200k - $280k

     ...voice AI startup is seeking a Founding Senior Machine Learning Engineer to fine-tune and deploy human-like voice agents, handling millions of real-time calls. This role offers a salary range...  ...real-world experience in deploying ML models and work well in a fast-paced environment... 
    Senior

    Retell AI

    San Francisco, CA
    3 days ago
  •  ...Shipt is seeking a Staff Machine Learning Engineer on the Personalization Platform team to...  ...will architect and implement scalable ML infrastructure, design data pipelines...  ...serving models, and lead the team to deliver low-latency, real-time or batch recommendations with robust... 
    Suggested

    Shipt

    San Francisco, CA
    9 hours ago
  •  ...Parafin, Inc. is seeking a Software Engineer to lead the evolution of its ML Platform within the Infrastructure team. You will build scalable, reliable...  ...and own ML platform end-to-end, supporting batch and real-time underwriting infrastructure in collaboration with Data... 
    Senior

    Parafin, Inc.

    San Francisco, CA
    9 hours ago
  • $160k - $240k

    Togetherai in San Francisco is hiring a Senior Data Engineer to design and build data infrastructure handling millions of events. You will work with cross-functional teams developing real-time analytics systems and contributing to the company's mission of advancing AI... 
    Senior

    Togetherai

    San Francisco, CA
    4 days ago
  •  ...Whatnot is looking for a Software Engineer to join their Fraud Experience team. You'll lead...  ...and a strong understanding of Python and ML libraries. Whatnot offers a flexible work...  ...inclusive workplace. Benefits include generous time off, health insurance options, and support... 
    Senior
    Remote work
    Flexible hours

    Whatnot

    San Francisco, CA
    9 hours ago
  • $190k - $222k

    Wheel the World in San Francisco seeks a Senior Machine Learning Engineer to lead the perception stack for their Archimedes project. This role requires...  ...in developing and deploying perception systems under real-world conditions. The successful candidate will have extensive... 
    Senior

    Wheel the World

    San Francisco, CA
    6 days ago
  •  ...AI is building the best inference infrastructure for voice applications. We seek a Staff ML Engineer to own the model serving stack and optimize latency and throughput for real-time voice workloads. You'll work with state-of-the-art accelerators and collaborate with... 

    Together

    San Francisco, CA
    9 hours ago
  • $170.1k - $258.3k

     ...efficiently and reliably on real vehicles at scale....  ..., and performance engineering so that every cycle...  ..., faster reaction times, and more robust...  ...of our on‑vehicle ML inference for ADAS...  ...meeting strict latency, throughput, and reliability...  ...with low latency or real time... 
    Senior
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    San Francisco, CA
    2 days ago
  •  ...AI agents. You will design scalable cloud infrastructure and own end-to-end features while collaborating with major customers on real-time deployments. The role is fully on-site in San Francisco, with a strong emphasis on customer-facing work, high technical bar, and the... 
    Senior

    David Joseph & Company

    San Francisco, CA
    4 days ago
  •  ...CHAOS Industries is seeking exceptional backend and cloud engineers to design and operate the secure cloud platform behind...  ...and systems engineers to ingest, process, and deliver real-time sensor data with low latency and high security. This high-ownership role lets you... 
    Senior

    CHAOS Industries

    San Francisco, CA
    9 hours ago
  • $174k - $210k

     ...Forge is looking for a Senior Software Engineer II in San Francisco to enhance our trading platform functionality. The role involves owning production changes, delivering software efficiently, and collaborating with cross-functional teams to improve the user experience... 
    Senior

    Forge

    San Francisco, CA
    9 hours ago
  •  ...Google San Francisco, CA invites a Senior Software Engineer for the Audio team in Google Beam. You...  ...design, implement, test and validate real-time processing within a high-performance,...  ...and innovation in 3D spatial audio, low-latency streaming, and embedded firmware aspects... 
    Senior

    Google Inc.

    San Francisco, CA
    9 hours ago
  • Aurelius Systems in San Francisco is seeking a Senior ML Engineer to lead the perception stack for Archimedes—detection, tracking...  ...robotics software team. You will ship perception on real hardware, optimize for latency, and mentor growing engineers. This is a hands-on... 
    Senior

    Doist

    San Francisco, CA
    4 days ago
  •  ...Systems, Inc in San Francisco is seeking a Senior Machine Learning Engineer to lead perception architecture for...  ...have over 5 years of experience in real-world perception systems, strong...  ...C++, and a proven track record in real-time optimization. Join a team that values... 
    Senior

    Aurelius Systems, Inc

    San Francisco, CA
    6 days ago
  •  ...technology company in San Francisco is seeking a Founding Engineer specializing in ML Inference. This highly technical role requires expertise in...  .... The ideal candidate will drive innovations in real-time model performance, design in-house inference runtimes, and... 
    Relocation package

    Reactor.am

    San Francisco, CA
    5 days ago
  •  ...San Francisco is hiring a Senior Machine Learning Engineer to design and ship the next...  ...of LLM agent frameworks, real-time voice tech, and streaming...  ...Product, Voice channel, and ML Platform teams to...  ...agent research into reliable, low-latency, multi-channel experiences... 
    Senior

    AppFolio

    San Francisco, CA
    9 hours ago
  •  ...the Waymo Driver to improve mobility and save lives. The role focuses on designing and scaling real-time fleet monitoring and anomaly detection systems, with production-grade ML infrastructure and collaboration with data scientists. The candidate will work with Java/... 

    Neura Market

    San Francisco, CA
    9 hours ago
  •  ...expertise in AI simulation development. The role emphasizes optimizing training efficiency, enhancing GPU performance, and ensuring low-latency inference. Applicants should be proficient in methodologies for gradient checkpointing, Nsight profiling, and job management... 

    Embedding VC

    San Francisco, CA
    2 days ago
  •  ...simplify AI integration into real-world systems, with the observability...  ...are looking for a visionary Senior ML Engineer who will bridge the gap...  ..., and performance in real-time Develop and enforce technical...  ...You have a high-confidence, low-ego mindset Requirements... 
    Senior
    Full time
    Shift work

    Palm Venture Studios

    San Francisco, CA
    1 day ago
  •  ...decisions and operate across enterprise systems. We seek a senior ML engineer to own end-to-end ML lifecycle—from data ingestion to deployment...  .... You’ll help design robust, scalable pipelines and ship real-time models powering our core products. Based in San Francisco,... 

    Happyrobot Inc.

    San Francisco, CA
    9 hours ago
  • Stealth Startup in San Francisco seeks a Founding Machine Learning Research Engineer to advance real-time AI by exploring state-of-the-art LLMs, speech models, and multimodal AI for human-like voice agents operating in complex environments. You’ll design evaluation frameworks... 

    Stealth Startup

    San Francisco, CA
    5 days ago
  •  ...for. Everyone at Orb has real ownership over their...  ...three questions in real time: what has this customer...  ...side, it’s real systems engineering: alerts, balances, and...  ...enough to stand behind latency guarantees. On the other...  ...about real‑time and low‑latency tradeoffs—this... 
    Senior
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Orb Staging

    San Francisco, CA
    9 hours ago
  •  ...deployment of its devices to monitor critical infrastructure and detect real-world fault events. You will own, test, operate, and plan...  ...updates. As a GCAP team member, your decisions will influence long-term architecture, enabling scalable, low-latency #J-18808-Ljbffr
    Senior

    Socket.dev

    San Francisco, CA
    9 hours ago
  • $148.7k - $199.4k

    Job Posting Title:Senior Machine Learning Engineer - ESPNReq ID:10150610Job Description...  ...scale data infrastructure and real‑time processing platforms that...  ...distributed data and ML infrastructure that supports high‑throughput, low‑latency data processing and real‑time... 
    Senior
    Full time
    Worldwide

    Hulu

    San Francisco, CA
    1 day ago
  •  ...Orb is seeking a senior software engineer to own a critical revenue-design surface that processes real-time usage, entitlements, and spend controls. You will design APIs, primitives...  ...ability to ship fast while maintaining latency and reliability guarantees. #J-18808-... 
    Senior

    Orb Staging

    San Francisco, CA
    9 hours ago
  • $128.7k - $261.3k

     ...efficiently and reliably on real vehicles at scale....  ..., and performance engineering so that every cycle...  ..., faster reaction times, and more robust...  .... The RoleAs a Senior Compiler Engineer on...  ...and effortless for ML engineers across the...  ..., and on‑vehicle latency. Along the way, you... 
    Senior
    Full time
    Local area
    Remote work
    Work from home
    Relocation package
    Flexible hours

    General Motors

    San Francisco, CA
    5 days ago
  •  ...for. Everyone at Orb has real ownership over their...  ...three questions in real time: what has this customer...  ...side, it’s real systems engineering: alerts, balances, and...  ...enough to stand behind latency guarantees. On the other...  ...about real‑time and low‑latency tradeoffs—this... 
    Senior
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Orb

    San Francisco, CA
    4 days ago
  •  ...role at the intersection of infrastructure and product, tackling real-time analytics, entitlements, and spend controls. You will own a...  ..., and collaborate with enterprise and AI customers to turn pain points into scalable, latency-guaranteed solutions. #J-18808-Ljbffr
    Senior

    Orb

    San Francisco, CA
    9 hours ago
  • $94.6k - $157.8k

    Join to apply for the Senior Sales Specialist - Real Time Feeds role at LSEG . The Sales Specialist is accountable for driving LSEG’s Data & Analytics...  ...the Data and Feeds Team and will focus on Real‑Time, Low Latency and Historical Data Feed solutions primarily into... 
    Senior
    Part time
    Internship

    LSEG

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Infra Engineer — Real-Time, Low-Latency. Be the first to apply!