ML Systems Engineer: Distributed LLM Training & Inference
$200.8k - $251kScale AI
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251,000, along with comprehensive benefits. #J-18808-Ljbffr Scale AI
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer: Distributed LLM Training & Inference in Seattle, WA vacancy
- ...reliable, field-ready AI systems that solve the... ...rigorous engineering with learning systems... ...are seeking a Staff ML Systems Engineer to... ...architect and build the distributed infrastructure... ...processing, model training, evaluation, and... ...learning training and inference systems....TrainingLocal area
FieldAI
Seattle, WA9 days ago - ...technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will... ...programming skills in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This...Suggested
$184.5k
...Senior Machine Learning Engineer role is part of the Distribution & Supply team which... ...learning-driven systems that power how our... ...into clear ML‑driven solutions, selecting... ...including model training, evaluation, and deployment... ...large‑scale batch inference, including clear,...TrainingFull time$127.4k - $191.2k
...the machine learning systems that decide which... ...world's leading game engine. Recommendation and... ...using causal inference, A/B testing, and offline... ...full pipeline from training data to deployed... ...reinforcement learning, LLM post-training or... ...-scale data and ML systems, whether through...TrainingFull timeInternshipWork at officeWorldwideShift work$143.7k - $194.4k
...products every day.Our systems and algorithms... ...and our distributed systems process... ...Tech (AGT) is an engineering team with the mission... ...end-to-end AI/ML pipelines including... ..., model training, optimization, and inference infrastructure.... ...Machine Learning and LLM fundamentals, including...TrainingInternshipFlexible hours- ...Advanced machine learning systems to detect and prevent... ...- Design prompt engineering and reasoning workflows... ...indicators, and real-time LLM-based decisions.- Knowledge... ...part of a cutting-edge ML + LLM team shaping the... ...Experience with LLM post-training applications ,...TrainingWorldwide
- ...the Product and Engineering team at... ...MLE) on the AI & ML (Insights) team... ...architecture, training, deployment, and... ...scalable data systems. You will be expected... ...models that can infer meaning and... ...grade GenAI or LLM-based systems with... ...pipelines and distributed systems using technologies...TrainingWork at officeRemote workVisa sponsorship
$168.1k - $227.4k
...Alexa+, Amazon's LLM-powered conversational... ...is agentic: LLM systems that reason and... ...dozens of chained inferences, coupled to real environments... ...Machine Learning Engineer to build and own... ...learning training systems, self-learning... ..., and large-scale distributed systems, serving...TrainingInternshipFlexible hoursDay shift- ...About the job ML Engineer Our Client Is a rapidly... ...evolving world of intelligent systems. Location : New York,... ..., and drive innovation in LLM and audio ML applications.... ..., preprocessing, model training, deployment, inference, and monitoring in production...TrainingFull time
Catalyst Labs, LLC
Seattle, WA4 days ago $204.8k - $296.6k
...a Senior Machine Learning Systems & Efficiency Engineer in Seattle. This critical... ...will focus on optimizing ML systems for efficiency and... ...relevant field and experience in distributed systems and performance... ...designing high-throughput inference systems, conducting...$100k - $150k
...ML Infrastructure Engineer - Remote Bright Vision Technologies is a... ...that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks,... ...queueing, and resource-sharing systems that maximize accelerator...TrainingFull timeH1bLocal areaImmediate startRemote workVisa sponsorshipBright Vision Technologies
Bellevue, WA29 days ago$200k - $250k
...Machine Learning Engineering within the Advanced... ...our foundational systems that power our... ...annotation pipelines, ML Infrastructure... ...workflows (LLM-in-the-loop) to reduce... ...lifecycle, including distributed training infrastructure,... ...and low-latency inference services. Ensure...TrainingTemporary workWork at officeLocal areaMetropolis
Seattle, WAmore than 2 months ago$100k - $150k
...ML Performance Engineer - Remote Bright Vision Technologies... ...cost across training and inference workloads for large neural network systems. The role spans the... ...kernel optimization to distributed system tuning, requiring... ...decoding for LLM serving. Drive compiler...TrainingFull timeH1bLocal areaImmediate startRemote workVisa sponsorship- ...Anomaly Detection, and LLM fine-tuning —... ...As one of our AI ML Engineer’s, you'll be a... ...performance multi-agent systems that perceive,... ...Build real-time inference pipelines for... ...architecting large-scale distributed systems on cloud... ..., Paternity) Training & Development...TrainingFull timeShift work
C-serv
Bellevue, WA1 day ago $175k - $280k
...consisting of a variety of LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost‑effective... ...custom kernels to speed up inference. Find ways to reduce model... ...low latency. Significant systems programming experience; ex....TrainingContract workFlexible hours$176.76k - $232k
...company for yoga, running, training, and other athletic... ...responsibilities As a Senior AI/ML Engineer, you will lead the... ...tuning to architectures and system design for serving AI/ML inference solutions in production.... ...architecture and engineering of LLM and GenAI systems...TrainingPermanent employmentFull timeContract workPart timeWork visa$114.1k - $160k
...like to use network and Unix systems engineering to deliver simple, sustainable... ...of the Machine Learning (ML) network infrastructure across... ...Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization...TrainingLocal areaFlexible hours$169.8k - $355.4k
...Principal AI Agent / ML Software Engineer is a Senior Staff... ...-generation AI systems on Oracle Cloud... ...workflows, scalable inference infrastructure,... ...combines deep distributed systems experience... ...understanding of LLM application patterns... ...GPU inference or training workloads for...TrainingTemporary workFlexible hours- ...built for large-scale AI training and inference. As a startup, we... ...and we’re looking for engineers who want to build it... ...are hiring a Senior Systems Engineer to support the... ...troubleshooting distributed systems or infrastructure... ...Preferred Experience in AI/ML infrastructure or HPC...TrainingWork at office
Nscale
Seattle, WA4 days ago $120k - $170k
...integrated AI cloud engineered for AI. We own and operate... ..., including training content, workshops, and... ...stacks on AI training and inference clusters. Confident... ...failures. ~ Linux systems engineering at scale.... ...of modern Linux distributions, kernel modules, systemd...TrainingFull timeRemote workFlexible hoursNscale
Seattle, WA2 days ago- ...Algorithm team is the core engine driving the ultimate... ..., and recommendation systems that connect millions of... ...ETA prediction, Causal Inference for dynamic pricing, and... ...purchase rates.- LLM & AI Agent Innovation:... ...data for Continual Pre-Training (CPT), Supervised Fine-...Training
$125.6k - $234.15k
...SeniorMachine Learning Engineers for our GenAI... ...performance generative AI systems—powering features... ...develop efficient inference pipelines,... ...and mentor other ML engineers.Job ResponsibilitiesDesign... ...customized) model training and inference—... ...in Kubernetes, distributed systems, and MLOps...TrainingFull timeTemporary workLocal areaWorldwide- ...talented software engineers that have a deep understanding... ...machine learning (ML), operations... ...and statistical inference. This position can... ...order allocation systems, able to meet... ...PyTorch / MXNet and its training and deployment... ...precision training and distributed training;Preferred...Training
$186.1k - $300.55k
...disconnected from business systems of record, costing... ...Machine Learning Engineer to redefine how we... ...dataOptimize inference pipelines to run... ...scale datasets to training, deployment, and... ...problemsExperience with distributed data processing... ...or Go), CI/CD for ML, and experience...TrainingContract workWork at officeLocal areaRemote work2 days per week$106.9k - $160.4k
...enterprise, we are seeking a skilled ML Engineer to design, build, and... ...be responsible for developing, training, deploying, and operationalizing machine learning systems across Weyerhaeuser’s AI portfolio... ...deploy batch and real-time inference solutions using cloud-native services...TrainingFull timeTemporary work$168.1k - $227.4k
...Senior Machine Learning Engineer with expertise in agentic system, production ML systems, and scalable... ...efficient model deployment, training, and optimization•... ...of Machine Learning and LLM fundamentals, including... ...architecture, training/inference lifecycles, and optimization...TrainingInternshipWorldwideFlexible hours- ...Fluidstack Production Engineering TeamExamples of key exciting problems... ...actual state inspection, and distributed command execution. One... ...not a hundred scripts.Make the system's view of itself always match... ...You're fluent with AI tooling. LLM APIs, MCP servers, and agentic...Local area
Fluidstack
Seattle, WA3 days ago $157.7k - $213.8k
...improve their business. Founded by engineers — and customer obsessed — we leap... ...be building the next generation distributed data storage and processing systems that can outperform specialized... ...experience, relevant certifications and training, and specific work location....TrainingLocal areaWorldwide$197.3k - $313.7k
...looking for a Staff Machine Learning Engineer with deep expertise in model training and finetuning to join our ML team. You'll design, train, and... ...:Expertise with recommendation systems or search.Familiarity with model optimization for inference (quantization, pruning,...TrainingFull time$130.4k - $195.6k
...into other game engines and 3D... ...We’re building systems that allow real... ...graphics, networking, distributed systems, media,... ...integrating AI/ML into production... ...such as model training, data collection... ...tool interfaces, LLM agents, multimodal models, inference pipelines,...TrainingFull timeWork at officeRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer: Distributed LLM Training & Inference. Be the first to apply!
Related searches
- graduate machine learning engineer Seattle, WA
- senior ml engineer Seattle, WA
- data scientist machine learning engineer Seattle, WA
- machine learning engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- machine learning software engineer Seattle, WA
- ai ml engineer Seattle, WA
- computer vision machine learning engineer Seattle, WA
- lead system engineer Seattle, WA
- distributed systems engineer Seattle, WA