Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Systems Engineer: Distributed LLM Training & Inference

$200.8k - $251k

Scale AI

A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251,000, along with comprehensive benefits. #J-18808-Ljbffr Scale AI

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer: Distributed LLM Training & Inference in Seattle, WA vacancy
  •  ...reliable, field-ready AI systems that solve the...  ...rigorous engineering with learning systems...  ...are seeking a Staff ML Systems Engineer to...  ...architect and build the distributed infrastructure...  ...processing, model training, evaluation, and...  ...learning training and inference systems.... 
    Training
    Local area

    FieldAI

    Seattle, WA
    10 days ago
  •  ...technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will...  ...programming skills in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This... 
    Suggested

    ByteDance

    Seattle, WA
    3 days ago
  • $184.5k

     ...Senior Machine Learning Engineer role is part of the Distribution & Supply team which...  ...learning-driven systems that power how our...  ...into clear ML‑driven solutions, selecting...  ...including model training, evaluation, and deployment...  ...large‑scale batch inference, including clear,... 
    Training
    Full time

    Expedia

    Seattle, WA
    6 days ago
  • $182k - $242k

     ...to successfully training self-improving...  ...fraction of the total inference market, which...  ...for strong engineers with great...  ...high-performance LLM tracing dashboards...  ...with modern ML frameworks such...  ...Experience with distributed training, GPU acceleration...  ...model training systems. Experience... 
    Training
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    2 days ago
  • $171.7k - $303.9k

     ...world! The Data Labeling Engineering team designs, builds,...  ...engineering , and AI/ML , defining the...  ...that create reliable training data at scale. Our tools...  ...impact across teams and systems that unblock the next...  ...experience building robust distributed platforms and applications... 
    Training
    Local area
    Work from home
    Flexible hours

    General Motors

    Seattle, WA
    2 days ago
  • $153.9k - $300.96k

     ...Technology Machine Learning Engineer Graduate (E-Commerce...  ...Chain & Logistics - LLM/Agent) - 2027 Start (PhD...  ...learning, retrieval systems, and software engineering...  ...covering continued pre-training / CPT, SFT, preference...  ...design, model compression, inference cost and latency... 
    Training
    Temporary work
    Local area

    TikTok

    Seattle, WA
    1 day ago
  • $127.4k - $191.2k

     ...the machine learning systems that decide which...  ...world's leading game engine. Recommendation and...  ...using causal inference, A/B testing, and offline...  ...full pipeline from training data to deployed...  ...reinforcement learning, LLM post-training or...  ...-scale data and ML systems, whether through... 
    Training
    Full time
    Internship
    Work at office
    Worldwide
    Shift work

    Unity Technologies

    Bellevue, WA
    7 days ago
  •  ...Advanced machine learning systems to detect and prevent...  ...- Design prompt engineering and reasoning workflows...  ...indicators, and real-time LLM-based decisions.- Knowledge...  ...part of a cutting-edge ML + LLM team shaping the...  ...Experience with LLM post-training applications ,... 
    Training
    Worldwide

    TikTok

    Seattle, WA
    5 days ago
  • $175k - $200k

     ...Machine Learning Engineer Truveta is the world...  ...adaptive agentic systems and fine-tuned foundation...  .... You’ll blend ML craftsmanship with...  ...understanding of LLM fundamentals —...  ...interpretability, and inference performance. Think...  ...development & training opportunities for... 
    Training
    For contractors
    Visa sponsorship
    Work visa
    Flexible hours

    Truveta

    Seattle, WA
    4 days ago
  •  ...the Product and Engineering team at...  ...MLE) on the AI & ML (Insights) team...  ...architecture, training, deployment, and...  ...scalable data systems. You will be expected...  ...models that can infer meaning and...  ...grade GenAI or LLM-based systems with...  ...pipelines and distributed systems using technologies... 
    Training
    Work at office
    Remote work
    Visa sponsorship

    PitchBook Data

    Seattle, WA
    5 days ago
  • $90.1k - $191.8k

     ...the world! The Data Labeling Engineering team designs, builds, and operates...  ..., data engineering , and ML , defining labeling...  ...controls that create reliable training data at scale. Our team builds...  ...leadership, and work directly on systems that unblock the next generation... 
    Training
    Work experience placement
    Local area
    Work from home
    Flexible hours

    General Motors

    Seattle, WA
    3 days ago
  • $184k - $287.5k

     ...seeking a Senior MLOps Engineer to join our DSX...  ...experts on the demands of ML workloads, help...  ...full-stack AI and ML system problems, and work on...  ...initiatives, including LLM performance evaluation...  ...Partners (NCPs), including distributed training, inference optimization, and... 
    Training
    Full time
    Remote work

    Nvidia

    Seattle, WA
    6 days ago
  • $229k - $343k

     ...services.Snap’s Generative ML Platform team builds...  ...device and server-side inference. Our team creates...  ...platforms, and agentic systems that empower creators,...  ...for a Machine Learning Engineer to join Snap Inc!What you...  ...related fieldExperience training large-scale diffusion models... 
    Training
    Full time
    Live in
    Work at office
    Local area
    Worldwide

    Snap

    Seattle, WA
    7 days ago
  • $189.6k - $237k

     ...ML Research Engineer, ML SystemsScale's ML platform (RLXF) team...  ...builds our internal distributed framework for large language model training and inference. The platform has been...  ...training and evaluation of LLM's, as well as...  ...Strong excitement about system... 
    Training
    Full time

    Scale AI

    Seattle, WA
    3 days ago
  •  ...MaaS platforms using LLMs and multimodal models, spanning training, inference, prompt engineering, and evaluation pipelines. The team builds end-to-end...  ...groups to drive product improvements. A strong background in ML and Python is essential. #J-18808-Ljbffr ByteDance
    Training

    ByteDance

    Seattle, WA
    9 hours ago
  • $121.6k - $243.2k

     ...scaling our recommendation system to provide the best...  ...optimizing the training and inference efficiency of generative models on GPUs. LLM for Recommendation Research...  ..., long-tail item distribution, and user intent understanding...  ...Science, Electrical Engineering, Mathematics,... 
    Training
    Temporary work
    Local area

    Tik Tok

    Seattle, WA
    9 hours ago
  • General Motors' Data Labeling Engineering team builds and operates hybrid human/machine labeling tools powering autonomous vehicle ML models. We work across software, data, and ML to create scalable training data, with a modern full‑stack including TypeScript, React, GraphQL... 
    Training

    General Motors

    Seattle, WA
    9 hours ago
  •  ...will apply LLMs, agents, reinforcement learning, and retrieval systems to real-world, global supply chain problems and help build AI-native...  ...for logistics at scale. You will contribute to model training, evaluation, and deployment while collaborating with experts and... 
    Training
    Internship

    TikTok

    Seattle, WA
    9 hours ago
  •  ...-level researcher in Seattle to advance recommender systems through generative modeling, LLM-based understanding, and agentic architectures. You...  ...generative retrieval, re-ranking, and efficient GPU training/inference to improve personalization for e-commerce contexts and... 
    Training

    Tik Tok

    Seattle, WA
    2 days ago
  • Xaira Therapeutics is seeking a Senior Software Engineer to join our Platform team to design, build, and deploy the AI infrastructure...  ...Scientists and engineers to enable thousands of GPUs for training and inference of biology foundation models in Seattle. This role covers... 
    Training

    Menlo Ventures

    Seattle, WA
    1 day ago
  •  ...Own end-to-end systems and infrastructure...  ...Build scalable training, evaluation, inference, and serving infrastructure...  ..., raise engineering standards, and...  ...large-scale distributed production platforms...  ...across the ML lifecycle, including...  ...agentic systems, LLM tool-use... 
    Training
    Full time
    Work at office
    Remote work

    Axon

    Seattle, WA
    11 days ago
  • $57 per hour

     ...scaling our recommendation system to provide the best...  ...optimizing the training and inference efficiency of generative models on GPUs. LLM for Recommendation Research...  ..., long‑tail item distribution, and user intent understanding...  ...Science, Electrical Engineering, Mathematics,... 
    Training
    Hourly pay
    Internship
    Local area

    TikTok

    Seattle, WA
    1 day ago
  • $200k - $250k

     ...Machine Learning Engineering within the Advanced...  ...our foundational systems that power our...  ...annotation pipelines, ML Infrastructure...  ...workflows (LLM-in-the-loop) to reduce...  ...lifecycle, including distributed training infrastructure,...  ...and low-latency inference services. Ensure... 
    Training
    Temporary work
    Work at office
    Local area

    Metropolis Corp

    Seattle, WA
    3 days ago
  • $121.6k - $243.2k

     ...Machine Learning Engineer Graduate (E-Commerce...  ..., retrieval systems, and software engineering...  ..., statistical inference and other algorithmic...  .... Use NLP and LLM algorithms to handle...  ...optimizing traffic distribution, to satisfy the requirements...  ...with LLM post-training, including SFT,... 
    Training
    Temporary work
    Local area

    Tik Tok

    Seattle, WA
    2 days ago
  • $142.3k - $263.3k

    Machine Learning Engineer, Human Centered...  ...generative AI systems. You will...  ...guardrails and training signals (e.g.,...  ...role blends deep ML engineering expertise...  ...heuristic, and LLM-assisted...  ...model training and inference. Improve Performance...  ...CD pipelines. Distributed Evaluation... 
    Training
    Relocation

    Apple Inc.

    Seattle, WA
    2 days ago
  •  ...Principal Machine Learning Engineer to serve as the...  ...technical authority for ML systems within a technology...  ...build large-scale training and inference systems, own model architecture...  ...in deep learning and LLM systems, and...  ...research Experience with distributed training on GPU... 
    Training
    Full time

    CONFIDENTIAL Scovai

    Seattle, WA
    13 days ago
  •  ...@2026 TikTok Technology Machine Learning Engineer Intern (E-Commerce Supply Chain & Logistics-LLM/Agent) - 2027 Start (PhD) Location: Seattle...  ...Experience with LLMs, agents, RAG, tool use, post-training, evaluation, or applied NLP systems Strong programming ability in Python and... 
    Training
    Internship

    TikTok

    Seattle, WA
    1 day ago
  • $175k - $280k

     ...consisting of a variety of LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost‑effective...  ...custom kernels to speed up inference. Find ways to reduce model...  ...low latency. Significant systems programming experience; ex.... 
    Training
    Contract work
    Flexible hours

    SESAME

    Bellevue, WA
    9 hours ago
  • $150.4k - $277.6k

     ...re seeking research engineers to build systems for breakthrough innovations...  ..., including model training, harness design,...  .... 2+ years of ML engineering experience...  ...maintaining training and inference systems - including...  ...-on experience with distributed ML systems - CI/CD... 
    Training
    Relocation

    Apple

    Seattle, WA
    3 days ago
  • $114.1k - $160k

     ...like to use network and Unix systems engineering to deliver simple, sustainable...  ...of the Machine Learning (ML) network infrastructure across...  ...Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization... 
    Training
    Local area
    Flexible hours

    Amazon

    Seattle, WA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Systems Engineer: Distributed LLM Training & Inference. Be the first to apply!