Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Distributed ML Training & Inference Engineer

Sciforium

Sciforium, located in San Francisco, CA, is looking for a Distributed Training and Inference Engineer to optimize the software stack for AI training. The role involves ensuring efficient and scalable distributed training systems and integrating with various machine learning infrastructure components. The ideal candidate has significant industry experience in ML systems and programming expertise in Python and C++. This position offers a competitive salary and various benefits including medical insurance and flexible time off. #J-18808-Ljbffr Sciforium

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Distributed ML Training & Inference Engineer in San Francisco, CA vacancy
  • $167.2k - $209k

     ...applications. We are seeking a Senior Engineer 2 to join our AI Inference Data Plane team. In this...  ...at the intersection of distributed systems and specialized...  ...as code. AI/ML Domain Knowledge: Hands‑on...  ...for relevant conferences, training, and education. All employees... 
    Senior
    Training
    Local area
    Remote work
    Worldwide
    Flexible hours

    DigitalOcean

    San Francisco, CA
    2 days ago
  • Senior Software Engineer - AI Inference Systems AI needs far more compute than exists today...  ...role This isn't a model training role. You’ll focus on building...  ...with engineers across distributed systems, networking and...  ...building or operating ML inference or model serving... 
    Senior
    Training

    Acceler8 Talent

    San Francisco, CA
    1 day ago
  •  ...San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training and fine-tuning of foundation models. You will design distributed training systems and optimize...  ...5 years of experience in ML infrastructure and a strong background... 
    Senior
    Training

    Baseten

    San Francisco, CA
    3 days ago
  • $120k - $200k

     ...more. About the Role As a Senior Infrastructure Engineer at Bland, you'll help us...  ...running, you're architecting distributed systems that handle real-...  ...voice processing, scale ML inference, and integrate with...  ...supporting our AI models, from training pipelines to real-time... 
    Senior
    Training
    Work at office
    Night shift

    Bland AI

    San Francisco, CA
    1 day ago
  • $170k - $290k

     ...hands-on, first-principles engineer who is fluent in Linux, comfortable...  ...production clusters for training and inference across AWS and OCI,...  ...optimize throughput for massive distributed training jobs. What Sets...  ...-scale GPU clusters for AI/ML workloads (training or inference... 
    Senior
    Training
    Work experience placement

    Luma | Dream Lab

    San Francisco, CA
    1 day ago
  • $190k - $250k

     ...from AMD with hands‑on support from AMD engineers the team is scaling rapidly to build...  ...is seeking a highly skilled Distributed Training and Inference Engineer to build, optimize, and maintain...  ...optimizing performance at every layer of the ML stack. You will play a pivotal role... 
    Training
    Flexible hours

    Sciforium

    San Francisco, CA
    1 day ago
  • Senior Site Reliability Engineer - AI Infrastructure Location: Global Remote / San...  .... Our platform routes training and inference jobs across global supply...  ...infrastructure used for distributed training and inference,...  ...networking, orchestration, and ML frameworks. Drive... 
    Senior
    Training
    Full time
    Remote work

    Andromeda

    San Francisco, CA
    1 day ago
  •  ...build and operate the infrastructure for Krea's research and inference. Distributed training, 1000+ K8s GPU clusters, petabyte scale data pipelines,...  ...Collaborate with researchers on evolving RL infrastructure Applied ML pipelines Find clean scenes in millions of videos using... 
    Training

    krea.ai

    San Francisco, CA
    1 day ago
  • Anyscale is seeking a Distributed LLM Inference Engineer in San Francisco, California. This pivotal role involves pushing the boundaries of performance for ML inference at scale. You'll work closely with product teams to deliver end-to-end solutions while leveraging open... 

    Anyscale

    San Francisco, CA
    3 days ago
  • $225k

     ...Manufacturing Co is looking for a Software Engineer on the Inference & RL Systems team in San Francisco. The role involves designing distributed systems, optimizing performance, and...  ...high reliability for RL and post-training workflows. The ideal candidate will possess... 
    Training

    Dormont Manufacturing Co

    San Francisco, CA
    2 days ago
  •  ...leading AI research firm located in San Francisco is seeking a Senior ML Systems Engineer to build and maintain the training framework for large-scale language models. The role involves designing distributed training solutions and improving training throughput across... 
    Senior
    Training
    Flexible hours

    Cohere

    San Francisco, CA
    1 day ago
  • $115.4k - $173k

     ...content into other game engines and 3D environments —...  ...graphics, networking, distributed systems, media, and AI...  ...integrating AI/ML into production software...  ...including areas such as model training, data collection,...  ...agents, multimodal models, inference pipelines, embeddings,... 
    Senior
    Training
    Work at office
    Worldwide
    Relocation package

    Unity

    San Francisco, CA
    1 day ago
  • $200.8k - $251k

     ...a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251... 
    Training
    Full time

    Scale AI

    San Francisco, CA
    2 days ago
  • Gravity Engineering Services Pvt Ltd. is looking for a Distributed LLM Inference Engineer to join their team. This critical role focuses on enhancing performance for ML inference, ensuring scalability and efficiency in solutions used by both open-source and corporate clients... 

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    4 days ago
  • $227.2k - $417k

     ...Role: As a Software Engineer on the ML Infrastructure team,...  ...class machine learning inference platforms. These platforms...  ..., and a mentor to senior engineers, fostering...  ..., and low latency distributed systems using Scala...  ..., ElastiCache, model training orchestration, etc.... 
    Training
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubitv

    San Francisco, CA
    1 day ago
  • $325k

     ...leading AI research company in San Francisco seeks an engineer to optimize their powerful AI models for high-volume...  ...engineering experience, strong familiarity with ML architectures, and experience with distributed systems. This role involves collaboration with researchers... 
    Senior

    Jobleads-US

    San Francisco, CA
    3 days ago
  • $300k

     ...experimentation, full-scale model training, or inference. As a Platform Engineer/Senior Site Reliability Engineer, you’ll...  ...workloads. Collaborate with ML, networking, and platform teams to...  ...Background in reliability engineering, distributed systems, or hardware acceleration... 
    Senior
    Training
    Permanent employment
    San Francisco, CA
    more than 2 months ago
  • $250k - $280k

     ...increase GPU utilization and make AI model training and inference, machine learning, and other compute-...  ...journey. The West regional Sales Engineer will join our rapidly growing sales...  ...- Experience with NFS, SMB and distributed parallel file systems Strong Linux OS... 
    Senior
    Training
    Work experience placement
    Local area
    Flexible hours

    WekaIO

    San Francisco, CA
    20 hours ago
  • $286.2k - $326.7k

     ...Overview Senior Distinguished Engineer, AI Compute (Remote Eligible) At...  ...our applications of AI & ML are bringing humanity and...  ...leader passionate about distributed systems, to engineer and...  ...to ML / DL model training, model inference and feature generation pipelines... 
    Senior
    Training
    Full time
    Part time
    Local area
    Remote work

    Capital One

    San Francisco, CA
    more than 2 months ago
  • MakerMaker is seeking a talented Senior ML Systems Engineer to build and maintain production inference systems in San Francisco. This role requires at least 3 years of experience in production-grade infrastructure for large-scale models, along with strong analytical skills... 
    Senior

    MakerMaker

    San Francisco, CA
    3 days ago
  • Senior ML Systems Engineer, Frameworks & Tooling at Cohere Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who...  ...of large‑scale training, distributed systems, and HPC infrastructure... 
    Senior
    Training
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    San Francisco, CA
    1 day ago
  •  ...seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache...  ...components. Ideal candidates should have strong software engineering skills and experience with ML inference systems, particularly in Python and C++. This... 
    Senior

    Gimlet Labs

    San Francisco, CA
    1 day ago
  •  ...specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate will have hands-on experience with modern inference frameworks and a solid... 
    Senior
    Training

    Reflection AI

    San Francisco, CA
    3 days ago
  • $190k - $230k

     ...This Role We’re seeking a Senior Staff Systems Engineer to play a key role in executing...  ...through code reviews, training, and technical enablement programs...  ..., including 3+ years in AI/ML or AI application...  ...Experience designing scalable, distributed systems in cloud environments... 
    Senior
    Training
    Temporary work

    Crusoe

    San Francisco, CA
    3 days ago
  • $196k - $220.5k

     ...actioned. We’re looking for a Senior Software Engineer who can take ownership of...  ...projects within a complex distributed system from end-to-end that...  ...with Trust & Safety, Policy, ML, Data Science, and Legal...  ...and relevant education or training. Please note that the compensation... 
    Senior
    Training
    Full time
    Relocation
    Relocation package

    United States Digital Space LLC

    San Francisco, CA
    2 days ago
  • $196k - $220.5k

     ...company. We are looking for a Senior Software Engineer who can handle complex,...  ...of automation, large-scale distributed systems, and content safety...  ...Trust & Safety operations, ML teams, Policy, and product...  ...and relevant education or training. Please note that the compensation... 
    Senior
    Training
    Full time
    Relocation
    Relocation package

    United States Digital Space LLC

    San Francisco, CA
    3 days ago
  • $250k

     ...platform designed for AI training, experimentation, and inference at scale. The company...  ...is looking for a Senior / Staff Site Reliability Engineer to support and scale...  ...closely with platform, ML, and infrastructure...  ...observability across distributed compute environments... 
    Senior
    Training
    Permanent employment
    Remote work
    San Francisco, CA
    a month ago
  • $250.8k - $286.2k

     ...real time, our applications of AI & ML are bringing humanity and...  ...build world-class applied science and engineering teams to deliver our industry leading...  ...components including foundation model training, large language model inference, similarity search, guardrails, model... 
    Senior
    Training
    Full time
    Part time
    Local area

    Capital One

    San Francisco, CA
    3 days ago
  • $200k - $275k

     ...safer and more secure. The AI Engineering Team is chartered with...  ...faster than the market. As a Senior or Staff ML Systems Engineer - LLM ,...  ...CI/CD workflows for model training, evaluation, and deployment...  ...Francisco, TRM operates as a distributed-first company with hubs in... 
    Senior
    Training
    Remote work
    Worldwide

    Trm-Labs

    San Francisco, CA
    1 day ago
  • Dormont Manufacturing Co is looking for a Software Engineer for their Pre-training Systems team in San Francisco. Your primary role will be to design and maintain the distributed infrastructure that trains long-context models at scale, tackling challenges related to memory... 
    Training

    Dormont Manufacturing Co

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Distributed ML Training & Inference Engineer. Be the first to apply!