Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Systems Engineer: Distributed LLM Training & Inference

$200.8k - $251k

Scale AI

A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251,000, along with comprehensive benefits. #J-18808-Ljbffr Scale AI

Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer: Distributed LLM Training & Inference in Seattle, WA vacancy
  •  ...reliable, field-ready AI systems that solve the...  ...rigorous engineering with learning systems...  ...are seeking a Staff ML Systems Engineer to...  ...architect and build the distributed infrastructure...  ...processing, model training, evaluation, and...  ...learning training and inference systems.... 
    Training
    Local area

    FieldAI

    Seattle, WA
    1 day ago
  • $236k - $309.75k

     ...looking for talented systems developers and researchers...  ...state of the art in LLM inference systems and...  ...inference stack—from distributed serving and runtime systems...  ...We embrace AI-native engineering, using AI not only as...  ...including model or post-training techniques that... 
    Training
    Flexible hours
    Shift work

    Streamlit

    Bellevue, WA
    4 hours ago
  •  ...technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will...  ...programming skills in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This... 
    Suggested

    ByteDance

    Seattle, WA
    4 days ago
  • $182k - $242k

     ...to successfully training self-improving...  ...fraction of the total inference market, which...  ...for strong engineers with great...  ...high-performance LLM tracing dashboards...  ...with modern ML frameworks such...  ...Experience with distributed training, GPU acceleration...  ...model training systems Experience... 
    Training
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Bellevue, WA
    4 days ago
  • $125k - $180k

     ...the Product and Engineering team at...  ...MLE) on the AI & ML (Insights) team...  ...architecture, training, deployment, and...  ...scalable data systems. You will be expected...  ...models that can infer meaning and...  ...grade GenAI or LLM-based systems with...  ...pipelines and distributed systems using technologies... 
    Training
    Full time
    Work at office
    Remote work
    Visa sponsorship

    Pitchbook Data

    Seattle, WA
    more than 2 months ago
  •  ...About the job ML Engineer Our Client Is a rapidly...  ...evolving world of intelligent systems. Location : New York,...  ..., and drive innovation in LLM and audio ML applications....  ..., preprocessing, model training, deployment, inference, and monitoring in production... 
    Training
    Full time

    Catalyst Labs, LLC

    Seattle, WA
    1 day ago
  • $135.2k - $306.4k

     ...Principal AI Agent / ML Software Engineer is a Senior Staff...  ...-generation AI systems on Oracle Cloud...  ...workflows, scalable inference infrastructure,...  ...combines deep distributed systems experience...  ...understanding of LLM application patterns...  ...GPU inference or training workloads for... 
    Training
    Temporary work
    Flexible hours

    Oracle Corporation

    Seattle, WA
    2 days ago
  • $144.7k - $261.3k

     ...autonomous vehicle development. We engineer high-performance tools that...  ...partner with data-intensive ML teams to drive rapid innovation...  ...of next-generation autonomous systems. About The Role As a Senior...  ...evaluation signals back to data, training, and launch decisions. Your... 
    Training
    Local area
    Remote work
    Work from home
    Flexible hours

    General Motors

    Seattle, WA
    13 hours ago
  •  ...reliable, field-ready AI systems that solve the...  ...rigorous engineering with learning systems...  ...This Role Modern ML systems improve through...  ...into high-quality training data. What You'...  ...batch and offline inference pipelines for auto...  ...datasets using distributed or parallel computing... 
    Training
    Local area

    FieldAI

    Seattle, WA
    11 days ago
  • $195k - $343k

     .... Snap’s Generative ML Platform team builds cutting...  ...device and server-side inference. Our team creates...  ...platforms, and agentic systems that empower creators,...  ...for a Machine Learning Engineer to join Snap Inc! What...  ...related field Experience training large-scale diffusion... 
    Training
    Full time
    Live in
    Work at office
    Local area
    Worldwide

    Snap Inc.

    Seattle, WA
    2 days ago
  •  ...Principal Machine Learning Engineer to serve as the...  ...technical authority for ML systems within a technology...  ...build large-scale training and inference systems, own model architecture...  ...in deep learning and LLM systems, and...  ...research Experience with distributed training on GPU... 
    Training
    Full time

    CONFIDENTIAL Scovai

    Seattle, WA
    6 days ago
  • $175k - $280k

     ...consisting of a variety of LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost‑effective...  ...custom kernels to speed up inference. Find ways to reduce model...  ...low latency. Significant systems programming experience; ex.... 
    Training
    Contract work
    Flexible hours

    Sesame

    Bellevue, WA
    1 day ago
  • $200k - $250k

     ...Machine Learning Engineering within the Advanced...  ...our foundational systems that power our...  ...annotation pipelines, ML Infrastructure...  ...workflows (LLM-in-the-loop) to reduce...  ...lifecycle, including distributed training infrastructure,...  ...and low-latency inference services. Ensure... 
    Training
    Temporary work
    Work at office
    Local area

    Metropolis Corp

    Seattle, WA
    13 hours ago
  • $150.4k - $277.6k

     ...re seeking research engineers to build systems for breakthrough innovations...  ..., including model training, harness design,...  .... 2+ years of ML engineering experience...  ...maintaining training and inference systems - including...  ...-on experience with distributed ML systems - CI/CD... 
    Training
    Relocation

    Apple

    Seattle, WA
    4 days ago
  •  ...the world. The Production Engineering Team Examples of key exciting...  ...actual state inspection, and distributed command execution. One...  ...hundred scripts. Make the system's view of itself always match...  ...You're fluent with AI tooling. LLM APIs, MCP servers, and agentic... 
    Local area

    Fluidstack

    Seattle, WA
    3 days ago
  • VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great...  ...for real‑time data analysis and AI training and inference. Designed from the ground up to make...  ...expertise on storage products, distributed storage architectures, file systems,... 
    Training
    Traineeship

    VAST Data

    Seattle, WA
    3 days ago
  • $184.5k

     ...Machine Learning Engineer At Expedia Group...  ...role is part of the Distribution & Supply team...  ...machine learning–driven systems that power how our...  ...into clear ML-driven solutions,...  ...fundamentals including model training, evaluation, and...  ...large-scale batch inference, including clear,... 
    Training

    Expedia Group

    Seattle, WA
    1 day ago
  • $106.9k - $160.4k

     ...enterprise, we are seeking a skilled ML Engineer to design, build, and...  ...be responsible for developing, training, deploying, and operationalizing machine learning systems across Weyerhaeuser's AI portfolio...  ...deploy batch and real-time inference solutions using cloud-native services... 
    Training
    Full time
    Temporary work

    Weyerhauser Co

    Seattle, WA
    13 hours ago
  • $144.7k - $261.3k

     ...infrastructure, and ML/AI GPU platforms for...  ...a Senior Performance Engineer to join the AV Capacity...  ...support GM’s long-term GPU system strategy and "...  ...reliability of large-scale ML training and inference environments. Your...  ...within large-scale distributed production... 
    Training
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours
    3 days per week

    General Motors Ventures

    Seattle, WA
    13 hours ago
  • Software Engineer III We have an exciting and...  ...with appropriate systems Leverages enterprise...  ...skills: Formal training or certification on...  ...with emphasis on ML systems. Hands-on...  ...Experience working with distributed systems concepts...  ...Serving, Triton Inference Server) Familiarity... 
    Training

    Chase

    Seattle, WA
    13 hours ago
  • $59.15k - $106.93k

     ...career is good business. Leidos is seeking Distribution Engineers in Maui, HI and Oahu, HI who are...  ...nation's most unique electric utility systems. Your greatest work is ahead! Location...  ...Management Professional (PMP) , Leadership training, Formal Mentorship Programs,... 
    Training
    Local area
    Immediate start
    Relocation
    Relocation package
    Flexible hours
    Night shift

    Leidos

    Seattle, WA
    13 hours ago
  •  ...Machine Learning Engineer Firefly Foundry...  ...This is not a model-training or research role —...  ...You will set the inference architecture and technical...  ...that makes those systems fast and cost-...  .... Director, ML Engineering and ML...  ...expertise in Kubernetes, distributed systems, and MLOps... 
    Training

    Adobe

    Seattle, WA
    13 hours ago
  • $150k - $300k

     ...Senior Staff ML Engineer At GEICO, we offer a rewarding career where...  ...design, develop, and deploy systems that ensure scalability, reliability...  ...drive business value using LLM, agentic, and knowledge-...  ...~5+ years of experience with training, finetuning, real-time/batch... 
    Training
    Hourly pay
    Work experience placement
    Local area

    GEICO

    Seattle, WA
    13 hours ago
  • $164k - $282k

     ...Staff Machine Learning Engineer for Coupang Media...  ...generation of machine learning systems, optimization...  ...retrieval, foundation models, LLM-powered advertising...  .... Build scalable ML infrastructure and...  ...Experience with distributed training, model serving, and ML... 
    Training
    Temporary work
    Flexible hours

    Coupang

    Seattle, WA
    7 hours ago
  • $175k - $280k

     ...in Bellevue, Washington, is seeking a talented engineer to join our team focused on revolutionizing the...  ...product category, working with state-of-the-art LLM and vision models. Candidates should have significant systems programming and performance engineering experience... 

    Sesame

    Bellevue, WA
    13 hours ago
  •  ...continual learning capabilities across production tasks. This role demands rapid learning, strong engineering taste, and the ability to ship. You will work with a GPU-rich stack and collaborate with teams to push forward cutting-edge RL and LLM #J-18808-Ljbffr CoreWeave

    CoreWeave

    Bellevue, WA
    2 days ago
  • $175k - $308.5k

     ...developing algorithms and systems that enable 3D spatial...  .... This includes training and optimizing deep learning...  ...with large‑scale distributed training and model parallelism...  ...curation and pipeline engineering Experience with model...  ...integrating ML models into performance... 
    Training
    Relocation

    Apple

    Seattle, WA
    1 day ago
  • $59.15k - $106.93k

     ...is good business. Leidos is seeking Distribution Engineers & Designers in Seattle , WA region who...  ...Electrical Power Calculations, GIS design training, Field Data Collection, and Client...  ...Make Ready, using customer GIS and WMS systems such as EFD, AUD, Smallworld, ArcGIS,... 
    Training
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours
    2 days per week
    3 days per week

    Leidos

    Seattle, WA
    13 hours ago
  •  ...Advanced machine learning systems to detect and prevent...  ...- Design prompt engineering and reasoning workflows...  ...indicators, and real-time LLM-based decisions.- Knowledge...  ...part of a cutting-edge ML + LLM team shaping the...  ...Experience with LLM post-training applications ,... 
    Training
    Worldwide

    TikTok

    Seattle, WA
    1 day ago
  • $26.39 - $77.88 per hour

     ...You Are As an AI/ML Computational Scientist...  ...pipelines for training and production,...  ...reliability of deployed systems. The Work...  ...business owners, engineers, architects, and UI...  ...of experience in distributed computing systems...  ...language models like LLM's APIs and optimizing... 
    Training
    Hourly pay
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Seattle, WA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Systems Engineer: Distributed LLM Training & Inference. Be the first to apply!