Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Infra Engineer: GPU Inference & 99.99% Uptime

Morph

A technology company in San Francisco is seeking an experienced Infrastructure Engineer to ensure 99.99% uptime while working with custom inference stacks and managing GPU loads. The ideal candidate will have deep infrastructure expertise and a passion for tackling complex challenges in both traditional and innovative setups. This role offers the opportunity to work on exciting projects with a highly skilled team. #J-18808-Ljbffr Morph

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior ML Infra Engineer: GPU Inference & 99.99% Uptime in San Francisco, CA vacancy
  •  ...company based in San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate will have hands-on... 
    Senior

    Reflection AI

    San Francisco, CA
    3 days ago
  • DoorDash USA in San Francisco is searching for a senior engineer to lead the design and architecture of its Generative AI infrastructure. You will oversee the model serving stack, ensuring performance and reliability while mentoring your team. You should have a strong background... 
    Senior
    Flexible hours

    DoorDash USA

    San Francisco, CA
    1 day ago
  • Goal: 99.99% uptime We serve custom inference stacks that have irregular GPU load. We're looking for people that have done genuinely...  ...around inference engines and GPU loads. This is a role...  ...will inherently require deep infra experience. #J-18808-Ljbffr Morph
    Senior

    Morph

    San Francisco, CA
    1 day ago
  •  ...company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for...  ...distributed training systems and optimize GPU utilization while collaborating with...  ...candidates have over 5 years of experience in ML infrastructure and a strong background... 
    Senior

    Baseten

    San Francisco, CA
    3 days ago
  • An AI infrastructure company is looking for a Senior ML Engineer to optimize performance for voice models such as speech-to-text...  ...productionizing models on advanced serving engines, focusing on GPU utilization and inference optimization. With over 5 years of experience required,... 
    Senior

    Together AI

    San Francisco, CA
    1 day ago
  • MakerMaker is seeking a talented Senior ML Systems Engineer to build and maintain production inference systems in San Francisco. This role requires at least 3 years of...  ...candidate is fluent in Python and has experience with GPU-accelerated inference. Enjoy autonomy and... 
    Senior

    MakerMaker

    San Francisco, CA
    3 days ago
  •  ...growing AI infrastructure company to own the core cluster infrastructure powering a heterogeneous AI cloud. You will manage large CPU/GPU/accelerator clusters, bare‑metal provisioning, and production readiness across Kubernetes and other schedulers. This role focuses on... 
    Senior

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  •  ...innovative AI company in San Francisco is seeking a Senior Machine Learning Engineer for Voice AI to optimize voice model inference and productionize cutting-edge voice...  ...The ideal candidate will have over 5 years of ML engineering experience, strong Python and PyTorch... 
    Senior

    Together AI

    San Francisco, CA
    1 day ago
  • Gravity Engineering Services Pvt Ltd. is seeking a Senior ML Engineer to optimize the model serving layer for voice workloads. This role involves working hands-on with inference engines to enhance model performance for speech applications. The ideal candidate will have... 
    Senior

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • $170.9k - $325.2k

     ...learning solutions that impact the organization. The candidate must have a strong background in AI/ML, with proven experience in tools like Pytorch and a solid understanding of GPU workloads. Responsibilities include contributing backend services for generative AI features... 
    Senior

    Adobe

    San Francisco, CA
    1 day ago
  • A leading AI platform company in San Francisco is seeking a talented individual to optimize model inference for their advanced visual AI product. The ideal candidate will engage in building efficient AI models and tackling complex challenges. The role requires a strong... 
    Senior

    Comfy

    San Francisco, CA
    4 days ago
  • A cutting-edge visual AI platform is seeking a talented individual to optimize model inference and enhance the core engine's performance. The ideal candidate is passionate about AI technology and has a strong background in production-level PyTorch. Responsibilities include... 
    Senior

    ComfyUI

    San Francisco, CA
    1 day ago
  •  ...San Francisco, CA, is looking for a Distributed Training and Inference Engineer to optimize the software stack for AI training. The role involves...  .... The ideal candidate has significant industry experience in ML systems and programming expertise in Python and C++. This... 
    Senior
    Flexible hours

    Sciforium

    San Francisco, CA
    1 day ago
  •  ...training, from managing GPU/TPU compute and job...  ...researchers and model engineers to translate ideas into...  ...at the intersection of ML, software engineering,...  ...You Will Own training/inference infrastructure: Design,...  ...Translate research needs into infra capabilities and guide... 
    Full time

    Monograph

    San Francisco, CA
    21 hours ago
  • $224k - $280k

    Cssmerge is seeking a foundational Machine Learning Infrastructure Engineer based in San Francisco. You will design ML training infrastructure, scale distributed GPU workloads, and collaborate with researchers. This role offers an ambitious challenge in automating the... 
    Senior
    Flexible hours

    Cssmerge

    San Francisco, CA
    1 day ago
  • $224k - $280k

     ...page is seeking a Staff Machine Learning Infrastructure Engineer to design and implement ML training infrastructure in San Francisco. The role involves...  ...-performance training pipelines and managing distributed GPU workloads. Ideal candidates should have 8+ years of... 
    Senior

    ATOMS Careers page

    San Francisco, CA
    1 day ago
  • Atoms, based in San Francisco, is seeking a Machine Learning Infrastructure Engineer to design the ML training infrastructure for autonomous transport models. The role involves scaling distributed GPU workloads, leading to innovations across their platform. Ideal... 
    Senior

    Atoms

    San Francisco, CA
    1 day ago
  •  ...seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache...  ...components. Ideal candidates should have strong software engineering skills and experience with ML inference systems, particularly in Python and C++. This... 
    Senior

    Gimlet Labs

    San Francisco, CA
    1 day ago
  • $220k

    Perplexity is looking for an engineer to join their team in San Francisco....  ...work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-...  ...software engineering with a focus on ML inference, familiarity with deep... 
    Senior

    Perplexity

    San Francisco, CA
    2 days ago
  • $220k - $320k

    inference.net, a growing company in San Francisco, seeks an experienced engineer to optimize AI inference performance. The ideal candidate will have over 2 years of experience in ML systems and GPU programming. Key responsibilities include implementing optimization techniques... 
    Senior

    inference.net

    San Francisco, CA
    3 days ago
  • Maven Robotics, Inc. is seeking an exceptional Infrastructure Engineer to design and scale the backend systems that power machine learning...  ...have experience in distributed systems, backend services, and GPU compute infrastructure. Strong programming skills in Python, Go,... 
    Senior

    Maven Robotics, Inc.

    San Francisco, CA
    1 day ago
  • An established industry player is seeking a Senior Network Engineer to ensure high uptime and optimize network performance. This role offers the chance to work on critical network operations, collaborate with engineering teams, and contribute to exciting projects. With... 
    Senior
    Flexible hours

    Xperi Inc.

    Emeryville, CA
    1 day ago
  • $183.7k - $248.6k

    Unity is seeking a Senior Machine Learning Infrastructure Engineer in San Francisco to join our Vector Ads team. You will design, build, and maintain the infrastructure that serves ML models in real-time, ensuring they run reliably at scale. Ideal candidates have experience... 
    Senior

    Unity

    San Francisco, CA
    1 day ago
  • Waymo is seeking a Senior Machine Learning Infrastructure Engineer to lead the development of AI/ML infrastructure for advanced simulations. Candidates should have significant experience in software engineering and ML infrastructure, focusing on large models. This role... 
    Senior

    Waymo

    San Francisco, CA
    1 day ago
  • A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal... 
    Senior

    LMArena

    San Francisco, CA
    11 hours ago
  • $275k

    A forward-thinking AI company is seeking a Senior ML Infrastructure / Backend Engineer to develop backend systems supporting real-time AI functionality. You will manage APIs, scale cloud infrastructure, and ensure system reliability while collaborating with various teams... 
    Senior

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  • TRM Labs, an AI-powered intelligence company, seeks a Senior or Staff ML Systems Engineer - LLM to scale AI infrastructure and production-grade ML tooling. You will build modular stacks, embed models into real-time workflows, and evaluate state-of-the-art AI tools to ensure... 
    Senior

    Trm-Labs

    San Francisco, CA
    11 hours ago
  • Jaide Health is seeking an engineer for their Model Efficiency team in...  ...focuses on building reliable ML systems while enhancing core performance...  ...techniques such as GPU/CUDA optimizations and collaborate...  ...and insights into the LLM inference ecosystem. A commitment to diversity... 
    Remote job

    Jaide Health

    San Francisco, CA
    1 day ago
  •  ...leading AI infrastructure company in San Francisco is looking for a Senior Staff Technical Program Manager. You will oversee a portfolio of...  .... The ideal candidate has significant experience in managing GPU generations and has operated at a senior level within major tech... 
    Senior

    Crusoe

    San Francisco, CA
    1 day ago
  •  ...team of second-time founders, engineers, and designers pairs exceptional...  ...is fixed (reserved GPU instances, instance quotas, API...  ...Building and scaling GPU-based inference services, optimizing for both...  ...Railway, etc.) Tried fine-tuning an ML model Knowledge of training infrastructure... 
    Senior

    Drafted

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Infra Engineer: GPU Inference & 99.99% Uptime. Be the first to apply!