Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Infrastructure Engineer — Real-Time Inference & Pipelines

Mach9

Mach9 is looking for an experienced ML infrastructure engineer in San Francisco to build and maintain systems powering production AI models. This mid-career role involves designing centralized versioning systems, optimizing real-time inference services, and ensuring reliable deployments. Candidates should have 3+ years of experience, a relevant degree, and be proficient in Python and PyTorch. Join us to innovate in civil engineering and surveying applications! #J-18808-Ljbffr Mach9

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Infrastructure Engineer — Real-Time Inference & Pipelines in San Francisco, CA vacancy
  • $160k - $220k

    Peregrine in San Francisco is seeking a Data Infrastructure Engineer to own the data layer that drives...  ...that handle massive volumes of real-time data. The ideal candidate will have a...  ...infrastructure, experience with data pipelines, and strong software engineering skills... 
    Pipeline

    Peregrine

    San Francisco, CA
    1 day ago
  • $150k - $250k

     ...building next-generation financial infrastructure that allows businesses to move...  ...with simple APIs that enable real-time receivables, payables, and...  ...closely with a small, experienced engineering team Improve internal tooling, CI/CD pipelines, and operational workflows Take... 
    Pipeline
    Work at office
    2 days per week
    3 days per week

    Eden Prescott

    San Francisco, CA
    1 day ago
  • $275k

     ...SF) We’re hiring a Senior ML Infrastructure / Backend Engineer to join a well-funded AI...  ...out of chat boxes and into real-time, interactive 3D...  ...user traffic, low-latency inference, and rapid iteration as the...  ...post-processing, and data pipelines What We’re Looking For: Strong... 
    Pipeline
    Work at office

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • Mercury is seeking an experienced Machine Learning Engineer to build and operate a real-time inference service for risk decisioning. The role requires over 5...  ...skills and be able to handle the end-to-end deployment of ML models in production. Mercury offers a competitive... 
    Suggested

    Mercury

    San Francisco, CA
    1 day ago
  •  ...company in San Francisco is seeking a Senior Machine Learning Engineer for Voice AI to optimize voice model inference and productionize cutting-edge voice applications. The ideal candidate will have over 5 years of ML engineering experience, strong Python and PyTorch skills,... 
    Suggested

    Together AI

    San Francisco, CA
    1 day ago
  • Gravity Engineering Services Pvt Ltd. is seeking a Senior ML Engineer to optimize the model serving layer for voice workloads. This role involves working hands-on with inference engines to enhance model performance for speech applications. The ideal candidate will have... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  •  ...Bay Area and remote-friendly team seeks a Machine Learning Infrastructure Engineer to design, build, and maintain scalable infrastructure for training and deploying ML models, with emphasis on real-time inference and large data handling. You will work with data... 
    Remote job

    Cuein AI

    San Francisco, CA
    1 day ago
  • An AI infrastructure company is looking for a Senior ML Engineer to optimize performance for voice models such as speech-to-text and text-to-speech. You will work...  ...serving engines, focusing on GPU utilization and inference optimization. With over 5 years of experience... 

    Together AI

    San Francisco, CA
    1 day ago
  • $160k - $225k

     ...people automatically, in real time, right where they work...  ...the foundational data infrastructure powering a category-...  ...Work closely with engineering, data science, and product...  ...time services to data pipeline. You’ll ensure...  ...closely with data and ML teams and contribute to... 
    Pipeline
    Work experience placement
    Relocation package
    Flexible hours

    Fable

    San Francisco, CA
    1 day ago
  •  ...through advanced hardware engineering and AI solutions. Our...  ...Machine Learning Infrastructure Engineer to join our team...  ..., production-grade ML ecosystem to support rapid...  ...infrastructure, data pipelines, and modeling flows....  ...GPU communication, and real-time training monitoring Create... 
    Pipeline
    Flexible hours

    Echo

    San Francisco, CA
    3 hours ago
  • $183.7k - $248.6k

     ...Senior Machine Learning Infrastructure Engineer to join our Vector...  ..., where we build the real‑time systems that power Unity...  ...that brings ML models from training...  ...scalable model serving pipelines — owning latency, throughput...  ...versioning, and inference optimization What we... 
    Pipeline
    Work at office
    Remote work
    Worldwide
    Relocation package

    Unity

    San Francisco, CA
    1 day ago
  • $275k

    A forward-thinking AI company is seeking a Senior ML Infrastructure / Backend Engineer to develop backend systems supporting real-time AI functionality. You will manage APIs, scale cloud infrastructure, and ensure system reliability while collaborating with various teams... 

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • $200k - $280k

     ...seeking a Founding Senior Machine Learning Engineer to fine-tune and deploy human-like voice agents, handling millions of real-time calls. This role offers a salary range of $2...  ...should have real-world experience in deploying ML models and work well in a fast-paced... 

    Retell AI

    San Francisco, CA
    3 hours ago
  • $183.7k - $248.6k

    Unity is seeking a Senior Machine Learning Infrastructure Engineer in San Francisco to join our Vector Ads team. You will design, build, and maintain the infrastructure that serves ML models in real-time, ensuring they run reliably at scale. Ideal candidates have experience... 

    Unity

    San Francisco, CA
    1 day ago
  • Gravity Engineering Services Pvt Ltd. is looking for a Founding ML Engineer to lead the development of core ML intelligence systems. You will dive into the complexities...  ...contributions to the way AI agents access real-time information. Experience in NLP and entity... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • $155.58k - $320.32k

    Pinterest is seeking a talented engineer skilled in Python to write production code that powers real-time bidding and model training. Ideal candidates will have a strong...  ...responsibility, including the training and deployment of ML models that drive ad decisions. Located in San... 

    Pinterest

    San Francisco, CA
    1 day ago
  •  ...leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal... 

    LMArena

    San Francisco, CA
    3 hours ago
  • $244k - $320k

    A leading AI marketing platform is seeking a Senior Machine Learning Engineer to build and operate scalable ML systems that drive real-time personalization. The ideal candidate will have over 6 years of experience in production ML software, strong Python skills, and familiarity... 
    Full time

    Attentive

    San Francisco, CA
    1 day ago
  •  ...experienced with modern inference systems like TGI...  ...model serving infrastructure for high...  ...staying current with ML infrastructure developments...  ...requires a large engineering effort dedicated...  ...specialized pipelines for every...  ...heuristics we built over time. Put simply, we... 
    Pipeline
    Work at office

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    4 days ago
  •  ...Overview The Data Engineering team is seeking a...  ...Analytics & Real‑Time Data Platforms. In...  ...time streaming data pipelines. These pipelines...  ...for Analytics & ML Expert‑level SQL...  ...training, batch/online inference, and pipeline...  ..., and AI‑serving infrastructure is a plus. Qualifications... 
    Pipeline

    Paramount

    San Francisco, CA
    1 day ago
  •  ...Technical Staff focused on ML systems and inference in San Francisco. You will...  ...build inference systems under real production constraints,...  ...include optimizing inference pipelines and managing cache allocation...  ...foundations in software engineering, experience with ML inference... 
    Pipeline

    Gimlet Labs, Inc.

    San Francisco, CA
    3 days ago
  • $300k

     ...committed researchers, engineers, policy experts,...  ...Role The Cloud Inference team scales and...  ..., and make smart infrastructure decisions that...  ...validation and deployment pipelines, that reliably...  ...based on real‑world production...  ...least 25% of the time. Some roles may require... 
    Pipeline
    Visa sponsorship

    Anthropic

    San Francisco, CA
    1 day ago
  • $225k - $400k

     ...pioneering AI research firm is seeking a Founding Machine Learning Research Engineer in San Francisco to develop innovative AI systems for real-time voice agents. This high-impact role requires a strong ML research background and proficiency in PyTorch. Responsibilities... 

    Retell AI

    San Francisco, CA
    2 days ago
  • Clera is seeking an AI/ML Engineer to shape the future of computer-aided engineering. You will design, train, and deploy models to enhance...  ...to integrate machine learning into high-fidelity simulation pipelines, driving faster iteration and earlier diagnoses for improved product... 
    Pipeline

    Clera

    San Francisco, CA
    1 day ago
  • Decagon in San Francisco is looking for a Senior Data Infrastructure Engineer to design and operate the data systems that power its AI products. You will be responsible for building data pipelines and ensuring reliability while collaborating with product teams. The ideal... 
    Pipeline

    Decagon

    San Francisco, CA
    1 day ago
  • $183k - $310k

    Build the data infrastructure for robots operating in the real world. Robotics is moving from...  ...need to be improved, engineers rely on data to understand...  ...We're looking for a ML Platform Engineer with...  ...platform itself, from inference serving and pipeline orchestration to... 
    Pipeline
    Remote work

    Foxglove

    San Francisco, CA
    1 day ago
  • Peregrine is seeking a Data Infrastructure Engineer in San Francisco to take ownership of the data layer that supports all company operations....  ...contributor role focuses on building and optimizing distributed data pipelines using technologies like Apache Spark and establishing best... 
    Pipeline
    Work at office

    Peregrine

    San Francisco, CA
    1 day ago
  • $142k - $203k

    Early Warning Services LLC is seeking a Senior ML Ops Engineer in San Francisco to enhance our machine learning operations. This role involves designing and maintaining scalable ML infrastructure and collaborating with data scientists and engineers. The ideal candidate... 

    Early Warning Services LLC

    San Francisco, CA
    1 day ago
  •  ...seeks a Founding Software Engineer to join as the first...  ...engineering hire. You will build real-time video and audio pipelines from wearable hardware to...  ...owning edge, relay, and inference surfaces. You will design...  ...contribute to the core infrastructure of a physical-AI platform... 
    Pipeline

    Jack & Jill

    San Francisco, CA
    1 day ago
  • $180k - $195k

    A technology firm focused on grid management is seeking a Senior Data Engineer to design and scale data infrastructure for real-time monitoring of the electrical grid. You will develop data pipelines that transform sensor data into actionable insights, ensuring high data... 
    Pipeline

    Gridware

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Infrastructure Engineer — Real-Time Inference & Pipelines. Be the first to apply!