ML Systems Engineer: Distributed LLM Training & Inference
$200.8k - $251kScale AI
A leading AI technology company in San Francisco seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary range of $200,800 - $251,000, along with comprehensive benefits.#J-18808-Ljbffr
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer: Distributed LLM Training & Inference in New York, NY vacancy
- ...Fintal Partners in New York is hiring engineers to build the distributed training and inference systems that take models from research into production. You’ll work side-by-side with researchers and traders on a trading floor-like environment, owning critical, IC-heavy...Training
Fintal Partners
New York, NY12 hours ago - ...Jobzhr, a leading global trading firm, is expanding its ML infrastructure in New York. We are hiring engineers to build distributed training and low-latency inference systems that move models from research into production. You will work closely with researchers and...Training
Jobzhr
New York, NY12 hours ago - General Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242 Work Areas... ...strategies and optimize inference workloads through capacity planningOwn... ...education, licensure/certifications, training, and skill level.In NYC, NY, the good...TrainingPermanent employmentFull timeWork at officeLocal area1 day per week
- ...business problems.We’re training and deploying... ...are building AI systems. We believe that our... ...of researchers, engineers, designers, and more... ...-scale training, distributed systems, and HPC infrastructure... ...the full stack of ML systems, this role... ...for large-scale LLM training.Design...TrainingFull timeWork at officeLocal areaRemote workHome office
$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering... ...evaluation of LLM's, as well as... ...about system optimizationExperience... ...systemsStrong software engineering skills,...TrainingFull time- ...building out its machine learning function and hiring engineers to develop the distributed training and inference systems that take models from research into production.... ...part of the trading floor than a traditional ML function. What you’ll do Build and scale distributed...TrainingFlexible hours
Fintal Partners
New York, NY12 hours ago - ...View is hiring for a senior research-engineer role focusing on Gemini Audio. You will design, build, and maintain training infrastructure for Gemini Audio... ...and help optimize model training and inference across distributed systems. English proficiency required; equity...Training
Google Inc.
New York, NY12 hours ago - ...Jane Street is seeking an engineer with expertise in low-level systems programming and optimisation to join our ML team. The role focuses... ...optimizing model performance for training and inference, with attention to... ...memory hierarchies, and distributed systems, ensuring...Training
Trading Interview
New York, NY12 hours ago $110 per hour
...Responsibilities Guide research and engineering teams to close knowledge... ...in MLOps , training infrastructure, and ML framework-level topics .... ...to MLOps and ML systems problems . Evaluate... ...training pipeline design, distributed systems reasoning, and kernel...TrainingContract workSummer workRemote workWeekday workMercor
New York, NYa month ago- Basis is seeking an ML Systems Engineer to own the full training and evaluation infrastructure, from distributed training frameworks to cloud administration, enabling researchers to iterate quickly while controlling compute costs. You will work across GPUs, networking,...TrainingWork at office
- ...interpretable, and steerable AI systems. We want AI to be... ...researchers, engineers, policy experts, and... ...-edge systems that train AI models like... ...steerable AI. As an ML Systems Engineer on... ...performance, large scale distributed systems Large scale LLM training Python...TrainingWork at officeVisa sponsorshipFlexible hours
SignalAI
New York, NY12 hours ago - ...organization that prioritizes human value. About the Role ML Systems Engineers at Basis ensure training and evaluation infrastructure is fast, reliable, and scalable. You will own the full stack from distributed training frameworks through cloud administration, making...TrainingFull timeWork at office
$264.8k - $331k
...Machine Learning Systems Research Engineer, Agent Post-training - Enterprise GenAI AI is becoming... ...the world. The Enterprise ML Research Lab works on the... ...our training and inference framework. Post-train state... ...have: At least 1-3 years of LLM training in a production...TrainingFull timeContract workFor contractorsFor subcontractorWork at officeSCALE INC
New York, NY3 days ago$227.2k - $417k
...Role:As a Software Engineer on the ML Infrastructure... ...machine learning inference platforms. These platforms... ...ML model serving systems that support Deep Learning, LLM, and Search models... ..., and low latency distributed systems using... ...ElastiCache, model training orchestration, etc...TrainingFull timeTemporary workLocal areaFlexible hours$157.95k - $259.48k
...platforms are on the training ground and in the... ...every sport — a system that connects the... ...highest-leverage engineering position in Phase... ...against the full distribution of real-world... ...Experience with causal inference or counterfactual... ...Familiarity with LLM evaluation...TrainingCatapult Sports
New York, NY22 days ago$127.4k - $191.2k
...the machine learning systems that decide which... ...world's leading game engine. Recommendation and... ...using causal inference, A/B testing, and offline... ...full pipeline from training data to deployed... ...reinforcement learning, LLM post-training or... ...-scale data and ML systems, whether through...TrainingFull timeInternshipWork at officeWorldwideShift work- ...most valuable training data in the world... ...context distributed across all of them... ...improve how well our system understands and... ...-facing ML role. You will... ...model sweeps, LLM-assisted review... ...rollout Optimize inference cost, latency,... ...Data and Product Engineering on pipeline and...TrainingFull timeShift work
Sunset
New York, NY7 hours ago $213k - $263k
...demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust... ...Conduct comprehensive experimentation to train and deploy state-of-the-art Multimodal LLMs... ...model training flows in a scalable, distributed and performant manner such as Data parallel...TrainingFull timeTemporary workRemote workWaymo
New York, NY7 hours ago$162k - $210k
...Machine Learning Engineers to help us... ...recommendation systems, multi-modal embedding... ...and real-time inference endpoints that... ...(e.g., LLM agents, MMoE models... ...track record of training and deploying large scale ML models specially... ...understanding of distributed computing for...TrainingFull timeWork experience placementMatch Group
New York, NY7 hours ago- VP - AI/ML Engineer - Compliance EngineeringYOUR IMPACTAre... ...data suitable for LLM applications.The... ...techniques for real-time inference such as quantization,... ...architecture design for distributed systems.Experience with data... ...personally, from our training and development...Training
$235k - $260k
...The Principal AI/ML Engineer, Semantic Data will... ...across MLS systems.This role combines... ...systems with applied LLM engineering to... ...environmentsOptimize inference workflows for... ...understanding of distributed systems and data... ...offering on-the-job training, feedback, and ongoing...TrainingWork at officeLocal areaRemote work1 day per week$147.6k - $274k
...enable researchers and engineers to move models from... ...scope extends beyond LLM serving. You will work... ...real-time and batch inference workloads, GPU-backed... ...infrastructure, Kubernetes, and distributed systems. Prior inference-... ..., distributed training, or large-scale data...TrainingFull timeLocal areaImmediate startWorldwideRelocation package$175k - $215k
...generative modeling, Bayesian inference, hierarchical learning... ...via data, eval, and systems - Implement and... ...developing recipes for ML models We prefer:... ...implement, and extend large distributed pipelines -... ...data for ML eval and training The expected base salary...TrainingFull timeRemote workWaymo
New York, NY7 hours ago$229k - $343k
...services.Snap’s Generative ML Platform team builds... ...device and server-side inference. Our team creates... ...platforms, and agentic systems that empower creators,... ...for a Machine Learning Engineer to join Snap Inc!What you... ...related fieldExperience training large-scale diffusion models...TrainingFull timeLive inWork at officeLocal areaWorldwide$192k - $260k
...their business. Founded by engineers — and customer obsessed... ...bring enterprise-grade ML and AI personalization... ...have:Evaluate ML and LLM approaches for... ...evaluating ML models and/or LLM systems for real product or... ...relevant certifications and training, and specific work...TrainingWork at officeLocal areaWorldwide- ...Google DeepMind is hiring for a role focused on building and optimizing training infrastructure for Gemini Audio encoders and related models. You will work across research and engineering to accelerate training on TPUs, while improving audio representations for semantic...Training
Google DeepMind
New York, NY12 hours ago - ...Scale AI is hiring a Machine Learning Systems Research Engineer, Agent Post-training for our Enterprise GenAI team in New York. You will build, optimize, and... ...cybersecurity to healthtech. You will collaborate with ML engineers to run large-scale experiments, iterate on...Training
Scale
New York, NY12 hours ago - ...business problems.We’re training and deploying frontier... ...who are building AI systems. We believe that our work... ...team of researchers, engineers, designers, and more,... ..., highly available distributed systems with Kubernetes... ...latency and throughput of inference.Strong understanding...TrainingFull timeWork experience placementWork at officeLocal areaRemote workHome office
$200k - $250k
...Machine Learning Engineering role, you will own the ML infrastructure... ...compliance enforcement systems. Expect a... ...serving needed to train, measure, and... ...for low-latency inference, including batching... ...building ML or LLM infrastructure for... ...: PyTorch , distributed training, and fine...TrainingRemote workOn behalf of Next Deavor
New York, NY3 days ago- ...Machine Learning Engineer to help build and... ...machine learning systems—from experimentation... ...and productionize ML models that directly... ...including training pipelines, model serving... ...modeling, and causal inference methods... ...Docker/Kubernetes, and distributed compute frameworks...TrainingFull time
Next Ventures
New York, NYmore than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer: Distributed LLM Training & Inference. Be the first to apply!
Related searches
- ai ml engineer New York, NY
- senior ml engineer New York, NY
- computer vision machine learning engineer New York, NY
- machine learning engineer New York, NY
- machine learning ai engineer New York, NY
- junior machine learning research engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning software engineer New York, NY
- senior windows systems engineer New York, NY
- software system engineer New York, NY