ML Systems Engineer: Scalable Training & Realtime Inference
Jobzhr
Jobzhr, a leading global trading firm, is expanding its ML infrastructure in New York. We are hiring engineers to build distributed training and low-latency inference systems that move models from research into production. You will work closely with researchers and traders, operating in a fast-paced, IC-heavy environment near the trading floor. You should have 3+ years of hands-on experience with PyTorch, distributed training, and production-grade ML pipelines. #J-18808-Ljbffr Jobzhr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer: Scalable Training & Realtime Inference in New York, NY vacancy
$200.8k - $251k
...member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary...TrainingFull time- ...business problems.We’re training and deploying frontier... ...enterprises who are building AI systems. We believe that our... ...a team of researchers, engineers, designers, and more,... ...fast, reliable, and scalable model training — and... ...across the full stack of ML systems, this role gives...TrainingFull timeWork at officeLocal areaRemote workHome office
- ...Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242... ...ML platforms that enable scalable, reliable, and impactful... ...strategies and optimize inference workloads through capacity... .../certifications, training, and skill level.In NYC,...TrainingPermanent employmentFull timeWork at officeLocal area1 day per week
$229k - $343k
...Snap’s Generative ML Platform team builds... ...power creative, scalable experiences for hundreds... ...and server-side inference. Our team creates... ..., and agentic systems that empower creators... ...Machine Learning Engineer to join Snap Inc!... ...related fieldExperience training large-scale...TrainingFull timeLive inWork at officeLocal areaWorldwide- Fintal Partners in New York is hiring engineers to build the distributed training and inference systems that take models from research into production. You’ll work side-by-side with researchers and traders on a trading floor-like environment, owning critical, IC-heavy infrastructure...Training
- ...building out its machine learning function and hiring engineers to develop the distributed training and inference systems that take models from research into production.... ...part of the trading floor than a traditional ML function. What you'll do Build and scale distributed...TrainingFlexible hours
- Scale AI is hiring a Machine Learning Systems Research Engineer, Agent Post-training for our Enterprise GenAI team in... ...state-of-the-art models, enabling scalable agent training across enterprise use... ...healthtech. You will collaborate with ML engineers to run large-scale...Training
- United States Digital Space LLC in New York seeks an experienced ML Research Engineer to join the Enterprise ML Research Lab. You will build, profile and optimize our training and inference framework and post-train state-of-the-art models for enterprise engagements. You...Training
$180k - $230k
...stops, and billing systems designed to fight over... ...'re hiring a Senior ML Infrastructure Engineer to build and own the... ...powers it — from training models on tens of millions... ...in seconds against inference-time datasets that... ..., reproducible, and scalable as data volume and...TrainingArlo
New York, NY9 days ago$213k - $263k
...demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust... ...Conduct comprehensive experimentation to train and deploy state-of-the-art Multimodal LLMs... ...to production Develop and maintain scalable data pipelines for Training & Eval to...TrainingFull timeTemporary workRemote workWaymo
New York, NY8 hours ago$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed... ...for large language model training and inference. The platform has been... ...have:Strong excitement about system optimizationExperience with... ...distributed ML systemsStrong software engineering skills, proficient in...TrainingFull time- ...world of intelligent systems. Location : New York... ...production‑grade ML systems with end‑to‑... ...preprocessing, model training, deployment, inference, and monitoring in production... ...and processes for scalability and performance.... ...experience in ML engineering. Strong programming...TrainingFull time
Catalyst Labs, LLC
New York, NY3 days ago - ...veteran.**Job Description:****ML Engineer****3M Health Care is now... ...our Healthcare Information Systems (HIS). We are looking for a... ...AI services are secure and scalable.**Key Responsibilities****1... ...usable datasets for model training and inference.* **Feature Management:** Help...TrainingH1bRemote work
Solventum
New York, NY5 days ago - ...business problems.We’re training and deploying frontier... ...who are building AI systems. We believe that our work... ...team of researchers, engineers, designers, and more,... ...high-performance, scalable and reliable machine learning... ...and throughput of inference.Strong understanding or...TrainingFull timeWork experience placementWork at officeLocal areaRemote workHome office
$264.8k - $331k
...state of the art post-training algorithms to reach the... ...world. The Enterprise ML Research Lab works on the... ...As an ML Sys Research Engineer, you’ll work on building... ...technologies to optimize our ML system. Your customer will be... ...our training and inference framework. Post-train...TrainingFull timeUnited States Digital Space LLC
New York, NY4 days ago$110k - $130k
...Role Machine Learning (ML) at the New York... ...York Times real-time ML inference models, including both... ..., our partners are engineering systems that call these hosted... ...automate and refine the training, deployment,... ...deploying ML models as scalable, low-latency, and highly...TrainingLocal areaFlexible hours$264.8k - $331k
...Machine Learning Systems Research Engineer, Agent Post-training - Enterprise GenAI AI is becoming vitally important... ...enterprises around the world. The Enterprise ML Research Lab works on the front... ...and optimize our training and inference framework. Post-train state of the...TrainingFull timeContract workFor contractorsFor subcontractorWork at officeSCALE INC
New York, NY3 days ago- ...meet.About the RoleAs an ML Research Engineer at Maple, you'll be a... ...advanced models and systems that directly impact small... ...experimentation, training, and highly optimized production inference.Lead evaluations, error... ...maintain robustness and scalability.Balance research...TrainingWork at officeLocal area
Maple AI, Inc
New York, NY3 days ago $160k - $200k
...ML Research EngineerBoston or NYCLayer Health... ...that can accurately and scalably synthesize information... ...use cases. For health systems, our first product dramatically... ...an exceptional ML Engineer to join our team (... ...ML systems (design, training, inference, deployment, and monitoring...TrainingWork at officeLayer Health
New York, NY3 days ago$157.95k - $259.48k
...looking for a Senior ML / Data Engineer to build the data infrastructure... ...data. The systems you build will support... ...into reliable, scalable production infrastructure... ...relationships between athletes, training loads, injuries,... ...for model training, inference, and evaluation....TrainingFull timeTemporary workInternshipCatapult Sports
New York, NY2 days ago- ...platforms are on the training ground and in the arena... ...athlete in every sport — a system that connects the full... ...the highest-leverage engineering position in Phase 1 of... ...impactful, scalable people solutions. Drive... ...Experience with causal inference or counterfactual modeling...Training
$209k - $313k
...other digital services.Snap Engineering teams build fun and technically... ...complexity, bias/variance, scalability, and interpretabilityConduct... ...Strong understanding of causal inference and modern approaches to estimating... ...tests) and leveraging causal ML in production...Full timeLive inWork at officeLocal area$127.4k - $191.2k
...builds the machine learning systems that decide which ads... ...world's leading game engine. Recommendation and... ...experiments using causal inference, A/B testing, and offline... ...the full pipeline from training data to deployed model.... ...large-scale data and ML systems, whether through...TrainingFull timeInternshipWork at officeWorldwideShift work$300k - $400k
...Description As a Principal AI/ML Engineer in our AdTech team, you will be... ...science teams to ensure our ML systems are highly performant, scalable, and reliable. You will also... ...pipeline – from data ingestion and training to real-time inference , for our real-time bidding,...TrainingFull timeZeta Global
New York, NY8 hours ago- ...Hedge Fund is building a central AI engineering team and hiring senior engineers to work on production AI / ML systems used across investment, research... ...on model-layer work, including training, deployment, telemetry and real-time inference in a high-performance production...TrainingRelocation
$61k - $101k
...Science or a related Engineering field with 10+ years of... ...for accelerating LLM inference on specific GPU architectures... ...transformer-based systems. We require solid... ...knowledge of machine learning training, especially... ...enabled clusters to support scalable machine learning...TrainingFull timeJ.P. Morgan
New York, NY1 day ago$235k - $260k
...organization.The Principal AI/ML Engineer, Semantic Data will... ...workflows across MLS systems.This role combines... ...environmentsOptimize inference workflows for latency,... ...& InfrastructureBuild scalable, production-grade services... ..., offering on-the-job training, feedback, and ongoing...TrainingWork at officeLocal areaRemote work1 day per week$200k
...Machine Learning Performance Engineer to join our team, focusing... ...Learning infrastructure, training, and inference challenges to advance our futures... ...include:Building scalable and robust training and inference... ..., cuDNN, and cuBLASLinux system programming experienceExperience...TrainingWork at office$147.6k - $274k
...enable researchers and engineers to move models from... ...including real-time and batch inference workloads, GPU-backed... ..., and distributed systems. Prior inference-... ...implement, ship, and operate scalable model-serving... ...computing, distributed training, or large-scale data processing...TrainingFull timeLocal areaImmediate startWorldwideRelocation package$148.7k - $199.4k
...Machine Learning Engineer - ESPNReq ID:10150... ...distributed data and ML infrastructure... ...feature computation systems, and ML‑adjacent services... ...services such as inference inputs, feature... ....Contribute to scalable service patterns including... ...Experience/Skills/Training:Basic...TrainingFull timeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer: Scalable Training & Realtime Inference. Be the first to apply!
Related searches
- ai ml engineer New York, NY
- junior machine learning research engineer New York, NY
- senior ml engineer New York, NY
- machine learning ai engineer New York, NY
- computer vision machine learning engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- machine learning software engineer New York, NY
- senior staff systems engineer New York, NY
- application system engineer New York, NY