ML Systems Engineer: Scalable Training & Realtime Inference
Jobzhr
Jobzhr, a leading global trading firm, is expanding its ML infrastructure in New York. We are hiring engineers to build distributed training and low-latency inference systems that move models from research into production. You will work closely with researchers and traders, operating in a fast-paced, IC-heavy environment near the trading floor. You should have 3+ years of hands-on experience with PyTorch, distributed training, and production-grade ML pipelines. #J-18808-Ljbffr Jobzhr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Systems Engineer: Scalable Training & Realtime Inference in New York, NY vacancy
- Basis is seeking an ML Systems Engineer to own the full training and evaluation infrastructure, from distributed training frameworks to cloud administration, enabling researchers to iterate quickly while controlling compute costs. You will work across GPUs, networking,...TrainingWork at office
$200.8k - $251k
...member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary...TrainingFull time- ...business problems.We’re training and deploying frontier... ...enterprises who are building AI systems. We believe that our... ...a team of researchers, engineers, designers, and more,... ...fast, reliable, and scalable model training — and... ...across the full stack of ML systems, this role gives...TrainingFull timeWork at officeLocal areaRemote workHome office
- ...Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242... ...ML platforms that enable scalable, reliable, and impactful... ...strategies and optimize inference workloads through capacity... .../certifications, training, and skill level.Annual...TrainingPermanent employmentFull timeWork at officeLocal area1 day per week
- Fintal Partners in New York is hiring engineers to build the distributed training and inference systems that take models from research into production. You’ll work side-by-side with researchers and traders on a trading floor-like environment, owning critical, IC-heavy infrastructure...Training
- ...type of collaborative organization that prioritizes human value. About the Role ML Systems Engineers at Basis ensure training and evaluation infrastructure is fast, reliable, and scalable. You will own the full stack from distributed training frameworks through cloud administration...TrainingFull timeWork at office
- Scale AI is hiring a Machine Learning Systems Research Engineer, Agent Post-training for our Enterprise GenAI team in... ...state-of-the-art models, enabling scalable agent training across enterprise use... ...healthtech. You will collaborate with ML engineers to run large-scale...Training
- Anthropic is seeking an ML Systems Engineer to build and optimize the reinforcement learning infrastructure... ...models. You will help researchers train faster and more reliably, shaping the... ...experience, enjoy working on scalable systems, and are motivated to learn more...Training
$213k - $263k
...demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust... ...Conduct comprehensive experimentation to train and deploy state-of-the-art Multimodal LLMs... ...to production Develop and maintain scalable data pipelines for Training & Eval to...TrainingFull timeTemporary workRemote workWaymo
New York, NY12 hours ago$110 per hour
...Jack Dorsey . Position: MLOps Engineer (JAX, PyTorch, Pallas/Triton) Type... ...AI model performance in MLOps , training infrastructure, and ML framework-level topics . Design... ...structured solutions to MLOps and ML systems problems. Evaluate MLOps tasks...TrainingContract workSummer workRemote workWeekday workMercor
New York, NY7 days ago$110 per hour
...Responsibilities Guide research and engineering teams to close knowledge gaps and... ...AI model performance in MLOps , training infrastructure, and ML framework-level topics . Design... ...structured solutions to MLOps and ML systems problems . Evaluate MLOps tasks...TrainingContract workSummer workRemote workWeekday workMercor
New York, NYa month ago$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed... ...for large language model training and inference. The platform has been... ...have:Strong excitement about system optimizationExperience with... ...distributed ML systemsStrong software engineering skills, proficient in...TrainingFull time- ...businesses. The Role As a Senior ML Engineer for AWS and Real-Time Inference, you'll own the fast path:... ...scoring it in near real time. It's a systems-heavy role focused on streaming, low... ...pipelines that feed both model training and low-latency inference. The...TrainingFull time
TWG Global AI
New York, NY12 days ago - Google DeepMind is hiring for a role focused on building and optimizing training infrastructure for Gemini Audio encoders and related models. You will work across research and engineering to accelerate training on TPUs, while improving audio representations for semantic...Training
- ...business problems.We’re training and deploying frontier... ...who are building AI systems. We believe that our work... ...team of researchers, engineers, designers, and more,... ...high-performance, scalable and reliable machine learning... ...and throughput of inference.Strong understanding or...TrainingFull timeWork experience placementWork at officeLocal areaRemote workHome office
$264.8k - $331k
...state of the art post-training algorithms to reach the... ...world. The Enterprise ML Research Lab works on... ...As an ML Sys Research Engineer, you'll work on building... ...to optimize our ML system. Your customer will be... ...optimize our training and inference framework. Post-train...TrainingFull timeScale AI
New York, NY5 days ago- ...deploy production‑grade ML systems with end‑to‑end ownership... ...acquisition, preprocessing, model training, deployment, inference, and monitoring in... ...and processes for scalability and performance. Qualifications... ...experience in ML engineering. Strong programming skills...TrainingFull time
- A leading AI infrastructure company based in New York is seeking experienced engineers to enhance the performance of ML systems and contribute to open-source projects. Ideal candidates will have over 5 years of experience in writing high-quality code and familiarity with...
- ...protected veteran.Job Description:ML Engineer3M Health Care is now... ...our Healthcare Information Systems (HIS). We are looking for a... ...AI services are secure and scalable.Key Responsibilities1. MLOps... ...usable datasets for model training and inference.Feature Management: Help build...TrainingH1b
$160k - $200k
...ML Research EngineerBoston or NYCLayer Health... ...that can accurately and scalably synthesize information... ...use cases. For health systems, our first product dramatically... ...an exceptional ML Engineer to join our team (... ...ML systems (design, training, inference, deployment, and monitoring...TrainingWork at officeLayer Health
New York, NY2 days ago- ...Talent Network for Principal AI/ML Engineer Roles at VC-Backed Startups... ..., and scaling AI-powered systems at high-growth startups.... ...in architecting scalable AI systems and leading technical... ...optimization Develop scalable training and inference pipelines for AI-powered...TrainingFull time
Signal Fire Inc
New York, NY12 hours ago $300k - $400k
...Description As a Principal AI/ML Engineer in our AdTech team, you will be... ...science teams to ensure our ML systems are highly performant, scalable, and reliable. You will also... ...pipeline – from data ingestion and training to real-time inference , for our real-time bidding,...TrainingFull timeZeta Global
New York, NY12 hours ago$209k - $313k
...other digital services.Snap Engineering teams build fun and technically... ...complexity, bias/variance, scalability, and interpretabilityConduct... ...Strong understanding of causal inference and modern approaches to estimating... ...tests) and leveraging causal ML in production...Full timeLive inWork at officeLocal area$127.4k - $191.2k
...builds the machine learning systems that decide which ads... ...world's leading game engine. Recommendation and... ...experiments using causal inference, A/B testing, and offline... ...the full pipeline from training data to deployed model.... ...large-scale data and ML systems, whether through...TrainingFull timeInternshipWork at officeWorldwideShift work$195k - $343k
...Snap’s Generative ML Platform team builds... ...power creative, scalable experiences for hundreds... ...and server-side inference. Our team creates... ..., and agentic systems that empower creators... ...Machine Learning Engineer to join Snap Inc!... ...field Experience training large-scale...TrainingFull timeLive inWork at officeLocal areaWorldwide- ...are looking to bring on an experienced Data Engineer to join Eight Sleep’s machine learning team. This role involves monitoring production ML systems, building tools and pipelines for data analysis, dataset curation, training and evaluation and developing systems for automated...TrainingFull timeSleeping nightsFlexible hoursNight shift
- ...platforms are on the training ground and in the arena... ...athlete in every sport - a system that connects the full... ...the highest-leverage engineering position in Phase 1 of... ...impactful, scalable people solutions. Drive... ...Experience with causal inference or counterfactual modeling...Training
$264.8k - $331k
Machine Learning Systems Research Engineer, Agent Post-training - Enterprise GenAI AI is becoming vitally important in... ...around the world. The Enterprise ML Research Lab works on the front lines... ...and optimize our training and inference framework. Post-train state of the...TrainingFull timeContract workFor contractorsFor subcontractorWork at office$180k - $230k
...nobody stops, and billing systems designed to fight over... ...scale. We're hiring ML Engineer to build and own the... ...that powers it — from training models on tens of millions... ...in seconds against inference-time datasets that run... ..., reproducible, and scalable as data volume and model...TrainingArlo Corporation
New York, NY12 hours ago$100k - $250k
...innovative field blends AI, engineering, and materials science,... ...opportunity As an ML Engineer at Radical AI,... ...developing machine learning systems, data pipelines, and large-scale training infrastructure. You will... ...improve performance and scalability. Collaborate with...TrainingFull timeRadical Ai
New York, NY12 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Systems Engineer: Scalable Training & Realtime Inference. Be the first to apply!
Related searches
- senior ml engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- machine learning ai engineer New York, NY
- machine learning software engineer New York, NY
- ai ml engineer New York, NY
- computer vision machine learning engineer New York, NY
- junior machine learning research engineer New York, NY
- lead system engineer New York, NY
- distributed systems engineer New York, NY