ML Systems Engineer: Distributed LLM Training & Inference
$200.8k - $251kScale AI
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251,000, along with comprehensive benefits. #J-18808-Ljbffr Scale AI
- ...reliable, field-ready AI systems that solve the... ...rigorous engineering with learning systems... ...are seeking a Staff ML Systems Engineer to... ...architect and build the distributed infrastructure... ...processing, model training, evaluation, and... ...learning training and inference systems....TrainingLocal area
- ...technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will... ...programming skills in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This...Suggested
$184.5k
...Senior Machine Learning Engineer role is part of the Distribution & Supply team which... ...learning-driven systems that power how our... ...into clear ML‑driven solutions, selecting... ...including model training, evaluation, and deployment... ...large‑scale batch inference, including clear,...TrainingFull time$182k - $242k
...to successfully training self-improving... ...fraction of the total inference market, which... ...for strong engineers with great... ...high-performance LLM tracing dashboards... ...with modern ML frameworks such... ...Experience with distributed training, GPU acceleration... ...model training systems. Experience...TrainingPermanent employmentTemporary workCasual workWork at officeFlexible hours$171.7k - $303.9k
...world! The Data Labeling Engineering team designs, builds,... ...engineering , and AI/ML , defining the... ...that create reliable training data at scale. Our tools... ...impact across teams and systems that unblock the next... ...experience building robust distributed platforms and applications...TrainingLocal areaWork from homeFlexible hours$153.9k - $300.96k
...Technology Machine Learning Engineer Graduate (E-Commerce... ...Chain & Logistics - LLM/Agent) - 2027 Start (PhD... ...learning, retrieval systems, and software engineering... ...covering continued pre-training / CPT, SFT, preference... ...design, model compression, inference cost and latency...TrainingTemporary workLocal area$127.4k - $191.2k
...the machine learning systems that decide which... ...world's leading game engine. Recommendation and... ...using causal inference, A/B testing, and offline... ...full pipeline from training data to deployed... ...reinforcement learning, LLM post-training or... ...-scale data and ML systems, whether through...TrainingFull timeInternshipWork at officeWorldwideShift work- ...Advanced machine learning systems to detect and prevent... ...- Design prompt engineering and reasoning workflows... ...indicators, and real-time LLM-based decisions.- Knowledge... ...part of a cutting-edge ML + LLM team shaping the... ...Experience with LLM post-training applications ,...TrainingWorldwide
$175k - $200k
...Machine Learning Engineer Truveta is the world... ...adaptive agentic systems and fine-tuned foundation... .... You’ll blend ML craftsmanship with... ...understanding of LLM fundamentals —... ...interpretability, and inference performance. Think... ...development & training opportunities for...TrainingFor contractorsVisa sponsorshipWork visaFlexible hours- ...the Product and Engineering team at... ...MLE) on the AI & ML (Insights) team... ...architecture, training, deployment, and... ...scalable data systems. You will be expected... ...models that can infer meaning and... ...grade GenAI or LLM-based systems with... ...pipelines and distributed systems using technologies...TrainingWork at officeRemote workVisa sponsorship
$90.1k - $191.8k
...the world! The Data Labeling Engineering team designs, builds, and operates... ..., data engineering , and ML , defining labeling... ...controls that create reliable training data at scale. Our team builds... ...leadership, and work directly on systems that unblock the next generation...TrainingWork experience placementLocal areaWork from homeFlexible hours$184k - $287.5k
...seeking a Senior MLOps Engineer to join our DSX... ...experts on the demands of ML workloads, help... ...full-stack AI and ML system problems, and work on... ...initiatives, including LLM performance evaluation... ...Partners (NCPs), including distributed training, inference optimization, and...TrainingFull timeRemote work$229k - $343k
...services.Snap’s Generative ML Platform team builds... ...device and server-side inference. Our team creates... ...platforms, and agentic systems that empower creators,... ...for a Machine Learning Engineer to join Snap Inc!What you... ...related fieldExperience training large-scale diffusion models...TrainingFull timeLive inWork at officeLocal areaWorldwide$189.6k - $237k
...ML Research Engineer, ML SystemsScale's ML platform (RLXF) team... ...builds our internal distributed framework for large language model training and inference. The platform has been... ...training and evaluation of LLM's, as well as... ...Strong excitement about system...TrainingFull time- ...MaaS platforms using LLMs and multimodal models, spanning training, inference, prompt engineering, and evaluation pipelines. The team builds end-to-end... ...groups to drive product improvements. A strong background in ML and Python is essential. #J-18808-Ljbffr ByteDanceTraining
$121.6k - $243.2k
...scaling our recommendation system to provide the best... ...optimizing the training and inference efficiency of generative models on GPUs. LLM for Recommendation Research... ..., long-tail item distribution, and user intent understanding... ...Science, Electrical Engineering, Mathematics,...TrainingTemporary workLocal area- General Motors' Data Labeling Engineering team builds and operates hybrid human/machine labeling tools powering autonomous vehicle ML models. We work across software, data, and ML to create scalable training data, with a modern full‑stack including TypeScript, React, GraphQL...Training
- ...will apply LLMs, agents, reinforcement learning, and retrieval systems to real-world, global supply chain problems and help build AI-native... ...for logistics at scale. You will contribute to model training, evaluation, and deployment while collaborating with experts and...TrainingInternship
- ...-level researcher in Seattle to advance recommender systems through generative modeling, LLM-based understanding, and agentic architectures. You... ...generative retrieval, re-ranking, and efficient GPU training/inference to improve personalization for e-commerce contexts and...Training
- Xaira Therapeutics is seeking a Senior Software Engineer to join our Platform team to design, build, and deploy the AI infrastructure... ...Scientists and engineers to enable thousands of GPUs for training and inference of biology foundation models in Seattle. This role covers...Training
- ...Own end-to-end systems and infrastructure... ...Build scalable training, evaluation, inference, and serving infrastructure... ..., raise engineering standards, and... ...large-scale distributed production platforms... ...across the ML lifecycle, including... ...agentic systems, LLM tool-use...TrainingFull timeWork at officeRemote work
$57 per hour
...scaling our recommendation system to provide the best... ...optimizing the training and inference efficiency of generative models on GPUs. LLM for Recommendation Research... ..., long‑tail item distribution, and user intent understanding... ...Science, Electrical Engineering, Mathematics,...TrainingHourly payInternshipLocal area$200k - $250k
...Machine Learning Engineering within the Advanced... ...our foundational systems that power our... ...annotation pipelines, ML Infrastructure... ...workflows (LLM-in-the-loop) to reduce... ...lifecycle, including distributed training infrastructure,... ...and low-latency inference services. Ensure...TrainingTemporary workWork at officeLocal area$121.6k - $243.2k
...Machine Learning Engineer Graduate (E-Commerce... ..., retrieval systems, and software engineering... ..., statistical inference and other algorithmic... .... Use NLP and LLM algorithms to handle... ...optimizing traffic distribution, to satisfy the requirements... ...with LLM post-training, including SFT,...TrainingTemporary workLocal area$142.3k - $263.3k
Machine Learning Engineer, Human Centered... ...generative AI systems. You will... ...guardrails and training signals (e.g.,... ...role blends deep ML engineering expertise... ...heuristic, and LLM-assisted... ...model training and inference. Improve Performance... ...CD pipelines. Distributed Evaluation...TrainingRelocation- ...Principal Machine Learning Engineer to serve as the... ...technical authority for ML systems within a technology... ...build large-scale training and inference systems, own model architecture... ...in deep learning and LLM systems, and... ...research Experience with distributed training on GPU...TrainingFull time
- ...@2026 TikTok Technology Machine Learning Engineer Intern (E-Commerce Supply Chain & Logistics-LLM/Agent) - 2027 Start (PhD) Location: Seattle... ...Experience with LLMs, agents, RAG, tool use, post-training, evaluation, or applied NLP systems Strong programming ability in Python and...TrainingInternship
$175k - $280k
...consisting of a variety of LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost‑effective... ...custom kernels to speed up inference. Find ways to reduce model... ...low latency. Significant systems programming experience; ex....TrainingContract workFlexible hours$150.4k - $277.6k
...re seeking research engineers to build systems for breakthrough innovations... ..., including model training, harness design,... .... 2+ years of ML engineering experience... ...maintaining training and inference systems - including... ...-on experience with distributed ML systems - CI/CD...TrainingRelocation$114.1k - $160k
...like to use network and Unix systems engineering to deliver simple, sustainable... ...of the Machine Learning (ML) network infrastructure across... ...Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization...TrainingLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer: Distributed LLM Training & Inference. Be the first to apply!
- ai ml engineer Seattle, WA
- graduate machine learning engineer Seattle, WA
- senior ml engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- computer vision machine learning engineer Seattle, WA
- data scientist machine learning engineer Seattle, WA
- machine learning engineer Seattle, WA
- machine learning software engineer Seattle, WA
- senior staff systems engineer Seattle, WA
- application system engineer Seattle, WA



