ML Systems Engineer: Distributed LLM Training & Inference
$200.8k - $251kScale AI
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251,000, along with comprehensive benefits. #J-18808-Ljbffr Scale AI
- ...reliable, field-ready AI systems that solve the... ...rigorous engineering with learning systems... ...are seeking a Staff ML Systems Engineer to... ...architect and build the distributed infrastructure... ...processing, model training, evaluation, and... ...learning training and inference systems....TrainingLocal area
$236k - $309.75k
...looking for talented systems developers and researchers... ...state of the art in LLM inference systems and... ...inference stack—from distributed serving and runtime systems... ...We embrace AI-native engineering, using AI not only as... ...including model or post-training techniques that...TrainingFlexible hoursShift work- ...technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will... ...programming skills in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This...Suggested
$182k - $242k
...to successfully training self-improving... ...fraction of the total inference market, which... ...for strong engineers with great... ...high-performance LLM tracing dashboards... ...with modern ML frameworks such... ...Experience with distributed training, GPU acceleration... ...model training systems Experience...TrainingFull timeTemporary workCasual workWork at officeFlexible hours$125k - $180k
...the Product and Engineering team at... ...MLE) on the AI & ML (Insights) team... ...architecture, training, deployment, and... ...scalable data systems. You will be expected... ...models that can infer meaning and... ...grade GenAI or LLM-based systems with... ...pipelines and distributed systems using technologies...TrainingFull timeWork at officeRemote workVisa sponsorship- ...About the job ML Engineer Our Client Is a rapidly... ...evolving world of intelligent systems. Location : New York,... ..., and drive innovation in LLM and audio ML applications.... ..., preprocessing, model training, deployment, inference, and monitoring in production...TrainingFull time
$135.2k - $306.4k
...Principal AI Agent / ML Software Engineer is a Senior Staff... ...-generation AI systems on Oracle Cloud... ...workflows, scalable inference infrastructure,... ...combines deep distributed systems experience... ...understanding of LLM application patterns... ...GPU inference or training workloads for...TrainingTemporary workFlexible hours$144.7k - $261.3k
...autonomous vehicle development. We engineer high-performance tools that... ...partner with data-intensive ML teams to drive rapid innovation... ...of next-generation autonomous systems. About The Role As a Senior... ...evaluation signals back to data, training, and launch decisions. Your...TrainingLocal areaRemote workWork from homeFlexible hours- ...reliable, field-ready AI systems that solve the... ...rigorous engineering with learning systems... ...This Role Modern ML systems improve through... ...into high-quality training data. What You'... ...batch and offline inference pipelines for auto... ...datasets using distributed or parallel computing...TrainingLocal area
$195k - $343k
.... Snap’s Generative ML Platform team builds cutting... ...device and server-side inference. Our team creates... ...platforms, and agentic systems that empower creators,... ...for a Machine Learning Engineer to join Snap Inc! What... ...related field Experience training large-scale diffusion...TrainingFull timeLive inWork at officeLocal areaWorldwide- ...Principal Machine Learning Engineer to serve as the... ...technical authority for ML systems within a technology... ...build large-scale training and inference systems, own model architecture... ...in deep learning and LLM systems, and... ...research Experience with distributed training on GPU...TrainingFull time
$175k - $280k
...consisting of a variety of LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost‑effective... ...custom kernels to speed up inference. Find ways to reduce model... ...low latency. Significant systems programming experience; ex....TrainingContract workFlexible hours$200k - $250k
...Machine Learning Engineering within the Advanced... ...our foundational systems that power our... ...annotation pipelines, ML Infrastructure... ...workflows (LLM-in-the-loop) to reduce... ...lifecycle, including distributed training infrastructure,... ...and low-latency inference services. Ensure...TrainingTemporary workWork at officeLocal area$150.4k - $277.6k
...re seeking research engineers to build systems for breakthrough innovations... ..., including model training, harness design,... .... 2+ years of ML engineering experience... ...maintaining training and inference systems - including... ...-on experience with distributed ML systems - CI/CD...TrainingRelocation- ...the world. The Production Engineering Team Examples of key exciting... ...actual state inspection, and distributed command execution. One... ...hundred scripts. Make the system's view of itself always match... ...You're fluent with AI tooling. LLM APIs, MCP servers, and agentic...Local area
- VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great... ...for real‑time data analysis and AI training and inference. Designed from the ground up to make... ...expertise on storage products, distributed storage architectures, file systems,...TrainingTraineeship
$184.5k
...Machine Learning Engineer At Expedia Group... ...role is part of the Distribution & Supply team... ...machine learning–driven systems that power how our... ...into clear ML-driven solutions,... ...fundamentals including model training, evaluation, and... ...large-scale batch inference, including clear,...Training$106.9k - $160.4k
...enterprise, we are seeking a skilled ML Engineer to design, build, and... ...be responsible for developing, training, deploying, and operationalizing machine learning systems across Weyerhaeuser's AI portfolio... ...deploy batch and real-time inference solutions using cloud-native services...TrainingFull timeTemporary work$144.7k - $261.3k
...infrastructure, and ML/AI GPU platforms for... ...a Senior Performance Engineer to join the AV Capacity... ...support GM’s long-term GPU system strategy and "... ...reliability of large-scale ML training and inference environments. Your... ...within large-scale distributed production...TrainingWork at officeLocal areaRemote workWork from homeFlexible hours3 days per week- Software Engineer III We have an exciting and... ...with appropriate systems Leverages enterprise... ...skills: Formal training or certification on... ...with emphasis on ML systems. Hands-on... ...Experience working with distributed systems concepts... ...Serving, Triton Inference Server) Familiarity...Training
$59.15k - $106.93k
...career is good business. Leidos is seeking Distribution Engineers in Maui, HI and Oahu, HI who are... ...nation's most unique electric utility systems. Your greatest work is ahead! Location... ...Management Professional (PMP) , Leadership training, Formal Mentorship Programs,...TrainingLocal areaImmediate startRelocationRelocation packageFlexible hoursNight shift- ...Machine Learning Engineer Firefly Foundry... ...This is not a model-training or research role —... ...You will set the inference architecture and technical... ...that makes those systems fast and cost-... .... Director, ML Engineering and ML... ...expertise in Kubernetes, distributed systems, and MLOps...Training
$150k - $300k
...Senior Staff ML Engineer At GEICO, we offer a rewarding career where... ...design, develop, and deploy systems that ensure scalability, reliability... ...drive business value using LLM, agentic, and knowledge-... ...~5+ years of experience with training, finetuning, real-time/batch...TrainingHourly payWork experience placementLocal area$164k - $282k
...Staff Machine Learning Engineer for Coupang Media... ...generation of machine learning systems, optimization... ...retrieval, foundation models, LLM-powered advertising... .... Build scalable ML infrastructure and... ...Experience with distributed training, model serving, and ML...TrainingTemporary workFlexible hours$175k - $280k
...in Bellevue, Washington, is seeking a talented engineer to join our team focused on revolutionizing the... ...product category, working with state-of-the-art LLM and vision models. Candidates should have significant systems programming and performance engineering experience...- ...continual learning capabilities across production tasks. This role demands rapid learning, strong engineering taste, and the ability to ship. You will work with a GPU-rich stack and collaborate with teams to push forward cutting-edge RL and LLM #J-18808-Ljbffr CoreWeave
$175k - $308.5k
...developing algorithms and systems that enable 3D spatial... .... This includes training and optimizing deep learning... ...with large‑scale distributed training and model parallelism... ...curation and pipeline engineering Experience with model... ...integrating ML models into performance...TrainingRelocation$59.15k - $106.93k
...is good business. Leidos is seeking Distribution Engineers & Designers in Seattle , WA region who... ...Electrical Power Calculations, GIS design training, Field Data Collection, and Client... ...Make Ready, using customer GIS and WMS systems such as EFD, AUD, Smallworld, ArcGIS,...TrainingWork at officeLocal areaImmediate startRemote workFlexible hours2 days per week3 days per week- ...Advanced machine learning systems to detect and prevent... ...- Design prompt engineering and reasoning workflows... ...indicators, and real-time LLM-based decisions.- Knowledge... ...part of a cutting-edge ML + LLM team shaping the... ...Experience with LLM post-training applications ,...TrainingWorldwide
$26.39 - $77.88 per hour
...You Are As an AI/ML Computational Scientist... ...pipelines for training and production,... ...reliability of deployed systems. The Work... ...business owners, engineers, architects, and UI... ...of experience in distributed computing systems... ...language models like LLM's APIs and optimizing...TrainingHourly payWork experience placementLive inWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer: Distributed LLM Training & Inference. Be the first to apply!
- data scientist machine learning engineer Seattle, WA
- computer vision machine learning engineer Seattle, WA
- machine learning software engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- senior ml engineer Seattle, WA
- machine learning engineer Seattle, WA
- ai ml engineer Seattle, WA
- healthcare systems engineer Seattle, WA
- mission system engineer Seattle, WA
- senior linux systems engineer Seattle, WA




