ML Systems Engineer: Distributed LLM Training & Inference
$200.8k - $251kScale AI
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251,000, along with comprehensive benefits. #J-18808-Ljbffr Scale AI
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer: Distributed LLM Training & Inference in New York, NY vacancy
- Jobzhr, a leading global trading firm, is expanding its ML infrastructure in New York. We are hiring engineers to build distributed training and low-latency inference systems that move models from research into production. You will work closely with researchers and traders...Training
- Fintal Partners in New York is hiring engineers to build the distributed training and inference systems that take models from research into production. You’ll work side-by-side with researchers and traders on a trading floor-like environment, owning critical, IC-heavy infrastructure...Training
- General Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242 Work Areas... ...strategies and optimize inference workloads through capacity planningOwn... ...education, licensure/certifications, training, and skill level.Annual discretionary...TrainingPermanent employmentFull timeWork at officeLocal area1 day per week
- ...business problems.We’re training and deploying... ...are building AI systems. We believe that our... ...of researchers, engineers, designers, and more... ...-scale training, distributed systems, and HPC infrastructure... ...the full stack of ML systems, this role... ...for large-scale LLM training.Design...TrainingFull timeWork at officeLocal areaRemote workHome office
$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering... ...evaluation of LLM's, as well as... ...about system optimizationExperience... ...systemsStrong software engineering skills,...TrainingFull time- ...building out its machine learning function and hiring engineers to develop the distributed training and inference systems that take models from research into production.... ...part of the trading floor than a traditional ML function. What you'll do Build and scale distributed...TrainingFlexible hours
$110 per hour
...Responsibilities Guide research and engineering teams to close knowledge... ...in MLOps , training infrastructure, and ML framework-level topics .... ...to MLOps and ML systems problems . Evaluate... ...training pipeline design, distributed systems reasoning, and kernel...TrainingContract workSummer workRemote workWeekday workMercor
New York, NYa month ago- Basis is seeking an ML Systems Engineer to own the full training and evaluation infrastructure, from distributed training frameworks to cloud administration, enabling researchers to iterate quickly while controlling compute costs. You will work across GPUs, networking,...TrainingWork at office
- ...organization that prioritizes human value. About the Role ML Systems Engineers at Basis ensure training and evaluation infrastructure is fast, reliable, and scalable. You will own the full stack from distributed training frameworks through cloud administration, making...TrainingFull timeWork at office
- ...interpretable, and steerable AI systems. We want AI to be... ...researchers, engineers, policy experts, and... ...-edge systems that train AI models like... ...steerable AI. As an ML Systems Engineer on... ...performance, large scale distributed systems Large scale LLM training Python Implementing...TrainingWork at officeVisa sponsorshipFlexible hours
$264.8k - $331k
...state of the art post-training algorithms to reach... ...The Enterprise ML Research Lab works... ...an ML Sys Research Engineer, you'll work on building... ...to optimize our ML system. Your customer will... ...our training and inference framework.... ...least 1-3 years of LLM training in a production...TrainingFull timeScale AI
New York, NY1 day ago$157.95k - $259.48k
...platforms are on the training ground and in the... ...every sport — a system that connects the... ...highest-leverage engineering position in Phase... ...against the full distribution of real-world... ...Experience with causal inference or counterfactual... ...Familiarity with LLM evaluation...TrainingCatapult Sports
New York, NY17 days ago$227.2k - $417k
...Role:As a Software Engineer on the ML Infrastructure... ...machine learning inference platforms. These platforms... ...ML model serving systems that support Deep Learning, LLM, and Search models... ..., and low latency distributed systems using... ...ElastiCache, model training orchestration, etc...TrainingFull timeTemporary workLocal areaFlexible hours$127.4k - $191.2k
...the machine learning systems that decide which... ...world's leading game engine. Recommendation and... ...using causal inference, A/B testing, and offline... ...full pipeline from training data to deployed... ...reinforcement learning, LLM post-training or... ...-scale data and ML systems, whether through...TrainingFull timeInternshipWork at officeWorldwideShift work$264.8k - $331k
Machine Learning Systems Research Engineer, Agent Post-training - Enterprise GenAI AI is becoming... ...the world. The Enterprise ML Research Lab works on the... ...our training and inference framework. Post-train state... ...have: At least 1-3 years of LLM training in a production...TrainingFull timeContract workFor contractorsFor subcontractorWork at office$162k - $210k
...Machine Learning Engineers to help us... ...recommendation systems, multi-modal embedding... ...and real-time inference endpoints that... ...(e.g., LLM agents, MMoE models... ...track record of training and deploying large scale ML models specially... ...understanding of distributed computing for...TrainingFull timeWork experience placementMatch Group
New York, NY15 hours ago$213k - $263k
...demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust... ...Conduct comprehensive experimentation to train and deploy state-of-the-art Multimodal LLMs... ...model training flows in a scalable, distributed and performant manner such as Data parallel...TrainingFull timeTemporary workRemote workWaymo
New York, NY15 hours ago- VP - AI/ML Engineer - Compliance EngineeringYOUR IMPACTAre... ...data suitable for LLM applications.The... ...techniques for real-time inference such as quantization,... ...architecture design for distributed systems.Experience with data... ...personally, from our training and development...Training
$235k - $260k
...The Principal AI/ML Engineer, Semantic Data will... ...across MLS systems.This role combines... ...systems with applied LLM engineering to... ...environmentsOptimize inference workflows for... ...understanding of distributed systems and data... ...offering on-the-job training, feedback, and ongoing...TrainingWork at officeLocal areaRemote work1 day per week$147.6k - $274k
...enable researchers and engineers to move models from... ...scope extends beyond LLM serving. You will work... ...real-time and batch inference workloads, GPU-backed... ...infrastructure, Kubernetes, and distributed systems. Prior inference-... ..., distributed training, or large-scale data...TrainingFull timeLocal areaImmediate startWorldwideRelocation package$175k - $215k
...generative modeling, Bayesian inference, hierarchical learning... ...via data, eval, and systems - Implement and... ...developing recipes for ML models We prefer:... ...implement, and extend large distributed pipelines -... ...data for ML eval and training The expected base salary...TrainingFull timeRemote workWaymo
New York, NY15 hours ago$229k - $343k
...services.Snap’s Generative ML Platform team builds... ...device and server-side inference. Our team creates... ...platforms, and agentic systems that empower creators,... ...for a Machine Learning Engineer to join Snap Inc!What you... ...related fieldExperience training large-scale diffusion models...TrainingFull timeLive inWork at officeLocal areaWorldwide$192k - $260k
...their business. Founded by engineers — and customer obsessed... ...bring enterprise-grade ML and AI personalization... ...have:Evaluate ML and LLM approaches for... ...evaluating ML models and/or LLM systems for real product or... ...relevant certifications and training, and specific work...TrainingWork at officeLocal areaWorldwide- ...businesses. The Role As a Senior ML Engineer for AWS and Real-Time Inference, you'll own the fast path:... ...scoring it in near real time. It's a systems-heavy role focused on streaming, low... ...pipelines that feed both model training and low-latency inference. The...TrainingFull time
TWG Global AI
New York, NY13 days ago $159.18k - $295.62k
...Machine Learning Engineer Team: Data &... ...(DAP) — ML Engineering... ...production ML systems that expand... ...pipelines, model training and optimization... ...scalable feature and inference pipelines on Databricks... ...; evaluate LLM- based... ...mentoring globally distributed teams. Our Technology...TrainingTemporary workLocal areaWarner Bros. Discovery
New York, NY15 hours ago- Google DeepMind is hiring for a role focused on building and optimizing training infrastructure for Gemini Audio encoders and related models. You will work across research and engineering to accelerate training on TPUs, while improving audio representations for semantic...Training
$110 per hour
...Dorsey . Position: MLOps Engineer (JAX, PyTorch, Pallas/... ...performance in MLOps , training infrastructure, and ML framework-level topics .... ...solutions to MLOps and ML systems problems. Evaluate... ...training pipeline design, distributed systems reasoning, and kernel...TrainingRemote jobContract workSummer workWeekday work- ...business problems.We’re training and deploying frontier... ...who are building AI systems. We believe that our work... ...team of researchers, engineers, designers, and more,... ..., highly available distributed systems with Kubernetes... ...latency and throughput of inference.Strong understanding...TrainingFull timeWork experience placementWork at officeLocal areaRemote workHome office
- Scale AI is hiring a Machine Learning Systems Research Engineer, Agent Post-training for our Enterprise GenAI team in New York. You will build, optimize, and... ...cybersecurity to healthtech. You will collaborate with ML engineers to run large-scale experiments, iterate on post...Training
$200k - $250k
...Machine Learning Engineer Full-time... ...You will own the ML infrastructure that... ...enforcement systems, driving model training, evaluation, and... ...production: low-latency inference, batching,... ...for ML or LLM systems in production... ...stack: PyTorch, distributed training, fine-tuning...TrainingFull timeNextDeavor
New York, NY15 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer: Distributed LLM Training & Inference. Be the first to apply!
Related searches
- graduate machine learning engineer New York, NY
- senior ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- machine learning ai engineer New York, NY
- entry level machine learning engineer New York, NY
- machine learning software engineer New York, NY
- ai ml engineer New York, NY
- computer vision machine learning engineer New York, NY
- junior machine learning research engineer New York, NY