ML Systems Engineer: Distributed LLM Training & Inference
$200.8k - $251kFull-time
Scale AI
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251,000, along with comprehensive benefits. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer: Distributed LLM Training & Inference in New York, NY vacancy
- Fintal Partners in New York is hiring engineers to build the distributed training and inference systems that take models from research into production. You’ll work side-by-side with researchers and traders on a trading floor-like environment, owning critical, IC-heavy infrastructure...Training
- General Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242 Work Areas... ...strategies and optimize inference workloads through capacity planningOwn... ...education, licensure/certifications, training, and skill level.Annual discretionary...TrainingPermanent employmentFull timeWork at officeLocal area1 day per week
- ...business problems.We’re training and deploying... ...are building AI systems. We believe that our... ...of researchers, engineers, designers, and more... ...-scale training, distributed systems, and HPC infrastructure... ...the full stack of ML systems, this role... ...for large-scale LLM training.Design...TrainingFull timeWork at officeLocal areaRemote workHome office
$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering... ...evaluation of LLM's, as well as... ...about system optimizationExperience... ...systemsStrong software engineering skills,...TrainingFull time$110 per hour
...Dorsey . Position: MLOps Engineer (JAX, PyTorch, Pallas/... ...performance in MLOps , training infrastructure, and ML framework-level topics .... ...solutions to MLOps and ML systems problems. Evaluate... ...training pipeline design, distributed systems reasoning, and kernel...TrainingContract workSummer workRemote workWeekday workMercor
New York, NY6 days ago$110 per hour
...Responsibilities Guide research and engineering teams to close knowledge... ...in MLOps , training infrastructure, and ML framework-level topics .... ...to MLOps and ML systems problems . Evaluate... ...training pipeline design, distributed systems reasoning, and kernel...TrainingContract workSummer workRemote workWeekday workMercor
New York, NYa month ago- Basis is seeking an ML Systems Engineer to own the full training and evaluation infrastructure, from distributed training frameworks to cloud administration, enabling researchers to iterate quickly while controlling compute costs. You will work across GPUs, networking,...TrainingWork at office
- ...organization that prioritizes human value. About the Role ML Systems Engineers at Basis ensure training and evaluation infrastructure is fast, reliable, and scalable. You will own the full stack from distributed training frameworks through cloud administration, making...TrainingFull timeWork at office
$264.8k - $331k
...state of the art post-training algorithms to reach... ...The Enterprise ML Research Lab works... ...an ML Sys Research Engineer, you'll work on building... ...to optimize our ML system. Your customer will... ...our training and inference framework.... ...least 1-3 years of LLM training in a production...TrainingFull timeScale AI
New York, NY4 days ago$157.95k - $259.48k
...platforms are on the training ground and in the... ...every sport — a system that connects the... ...highest-leverage engineering position in Phase... ...against the full distribution of real-world... ...Experience with causal inference or counterfactual... ...Familiarity with LLM evaluation...TrainingCatapult Sports
New York, NY15 days ago$227.2k - $417k
...Role:As a Software Engineer on the ML Infrastructure... ...machine learning inference platforms. These platforms... ...ML model serving systems that support Deep Learning, LLM, and Search models... ..., and low latency distributed systems using... ...ElastiCache, model training orchestration, etc...TrainingFull timeTemporary workLocal areaFlexible hours$127.4k - $191.2k
...the machine learning systems that decide which... ...world's leading game engine. Recommendation and... ...using causal inference, A/B testing, and offline... ...full pipeline from training data to deployed... ...reinforcement learning, LLM post-training or... ...-scale data and ML systems, whether through...TrainingFull timeInternshipWork at officeWorldwideShift work$264.8k - $331k
Machine Learning Systems Research Engineer, Agent Post-training - Enterprise GenAI AI is becoming... ...the world. The Enterprise ML Research Lab works on the... ...our training and inference framework. Post-train state... ...have: At least 1-3 years of LLM training in a production...TrainingFull timeContract workFor contractorsFor subcontractorWork at office$213k - $263k
...demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust... ...Conduct comprehensive experimentation to train and deploy state-of-the-art Multimodal LLMs... ...model training flows in a scalable, distributed and performant manner such as Data parallel...TrainingFull timeTemporary workRemote workWaymo
New York, NY20 hours ago$162k - $210k
...Machine Learning Engineers to help us... ...recommendation systems, multi-modal embedding... ...and real-time inference endpoints that... ...(e.g., LLM agents, MMoE models... ...track record of training and deploying large scale ML models specially... ...understanding of distributed computing for...TrainingFull timeWork experience placementMatch Group
New York, NY20 hours ago- VP - AI/ML Engineer - Compliance EngineeringYOUR IMPACTAre... ...data suitable for LLM applications.The... ...techniques for real-time inference such as quantization,... ...architecture design for distributed systems.Experience with data... ...personally, from our training and development...Training
$235k - $260k
...The Principal AI/ML Engineer, Semantic Data will... ...across MLS systems.This role combines... ...systems with applied LLM engineering to... ...environmentsOptimize inference workflows for... ...understanding of distributed systems and data... ...offering on-the-job training, feedback, and ongoing...TrainingWork at officeLocal areaRemote work1 day per week$147.6k - $274k
...enable researchers and engineers to move models from... ...scope extends beyond LLM serving. You will work... ...real-time and batch inference workloads, GPU-backed... ...infrastructure, Kubernetes, and distributed systems. Prior inference-... ..., distributed training, or large-scale data...TrainingFull timeLocal areaImmediate startWorldwideRelocation package$175k - $215k
...generative modeling, Bayesian inference, hierarchical learning... ...via data, eval, and systems - Implement and... ...developing recipes for ML models We prefer:... ...implement, and extend large distributed pipelines -... ...data for ML eval and training The expected base salary...TrainingFull timeRemote workWaymo
New York, NY11 hours ago$192k - $260k
...their business. Founded by engineers — and customer obsessed... ...bring enterprise-grade ML and AI personalization... ...have:Evaluate ML and LLM approaches for... ...evaluating ML models and/or LLM systems for real product or... ...relevant certifications and training, and specific work...TrainingWork at officeLocal areaWorldwide- ...businesses. The Role As a Senior ML Engineer for AWS and Real-Time Inference, you'll own the fast path:... ...scoring it in near real time. It's a systems-heavy role focused on streaming, low... ...pipelines that feed both model training and low-latency inference. The...TrainingFull time
TWG Global AI
New York, NY11 days ago $159.18k - $295.62k
...Machine Learning Engineer Team: Data &... ...(DAP) — ML Engineering... ...production ML systems that expand... ...pipelines, model training and optimization... ...scalable feature and inference pipelines on Databricks... ...; evaluate LLM- based... ...mentoring globally distributed teams. Our Technology...TrainingTemporary workLocal areaWarner Bros. Discovery
New York, NY3 days ago- Google DeepMind is hiring for a role focused on building and optimizing training infrastructure for Gemini Audio encoders and related models. You will work across research and engineering to accelerate training on TPUs, while improving audio representations for semantic...Training
- ...business problems.We’re training and deploying frontier... ...who are building AI systems. We believe that our work... ...team of researchers, engineers, designers, and more,... ..., highly available distributed systems with Kubernetes... ...latency and throughput of inference.Strong understanding...TrainingFull timeWork experience placementWork at officeLocal areaRemote workHome office
$200k - $250k
...Machine Learning Engineer Full-time... ...You will own the ML infrastructure that... ...enforcement systems, driving model training, evaluation, and... ...production: low-latency inference, batching,... ...for ML or LLM systems in production... ...stack: PyTorch, distributed training, fine-tuning...TrainingFull timeNextDeavor
New York, NY3 days ago$200k - $250k
...Principal ML Engineer New York, NY (Hybrid... ...model behavior, training objectives, data... .... You'll own the systems that turn that science... ...: low-latency inference, batching,... ...infrastructure for ML or LLM systems in... ...stack: PyTorch, distributed training, fine-tuning...TrainingWork at officeBlaze Talent
New York, NY1 hour ago$105.5k - $196.5k
...Machine Learning Engineer to support Chobani... ...learning, causal inference, optimization, supervised... ..., OCR, NLP / LLM workflows, anomaly... ...Experience with AI / ML tools, computer... ...North America and distributed in Australia and other... ...education or training. Your recruiter can...TrainingFull timeLocal areaFlexible hoursChobani
New York, NY1 day ago- ...and deploy production‑grade ML systems with end‑to‑end ownership... ..., and drive innovation in LLM and audio ML applications.... ..., preprocessing, model training, deployment, inference, and monitoring in production... ...experience in ML engineering. Strong programming skills...TrainingFull time
$111k - $231.25k
Machine Learning Engineer II (Finance) Yahoo... ...advanced backend systems and state-of-the-... ...edge of AI/ML trends-eager to test... ...experience developing, training, and deploying... ...vLLM, TensorRT-LLM, Triton Inference Server, or ONNX Runtime... ...working with distributed big data...TrainingWork at officeFlexible hours$85 per hour
...Larry Summers , and Jack Dorsey . Position: ML Engineer (Coding Agent Experience) Type: Contract Compensation... ...model-generated implementations involving model training , inference systems , MLOps , and LLM applications . Identify bugs, edge cases,...TrainingContract workSummer workRemote workMercor
New York, NYa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer: Distributed LLM Training & Inference. Be the first to apply!
Related searches
- senior ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- machine learning ai engineer New York, NY
- machine learning software engineer New York, NY
- ai ml engineer New York, NY
- computer vision machine learning engineer New York, NY
- junior machine learning research engineer New York, NY
- lead system engineer New York, NY
- distributed systems engineer New York, NY