Senior ML Engineer — Foundation Model Inference at Scale
Jobleads-US
Apple Inc. in New York City, NY, is seeking a Sr. Machine Learning Engineer to join the Foundation Model Inference team within Cloud OS & Inference.
You will help deploy high-performance, private inference stacks powering Siri and Apple AI across Apple services with low latency. You'll bridge research and production, owning inference efficiency, hardware/software codesign, and scalable tooling. The role requires hands-on ML infrastructure experience and a track record in large-scale systems,
#J-18808-Ljbffr Jobleads-USVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior ML Engineer — Foundation Model Inference at Scale in New York, NY vacancy
$295k
...enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are... .... Cohere is a team of researchers, engineers, designers, and more, who are all passionate... ...is critical to making progress in scaling intelligence. As models continue to become...SeniorFoundationFull timeWork at officeLocal areaRemote workHome officeCohere
New York, NY1 day ago$184k - $287.5k
...Machine Learning Engineers with a background... ...What You'll Be Doing:Model Development:... ...coordinate entire ML workflows, covering... ...the mathematical foundations of ML.Building and... ...workflows for large-scale datasets.Excellent... ...optimization for real-time inference on embedded or...SeniorFoundationFull timeRemote workWorldwideNight shiftNvidia
New York, NY5 hours ago- ...consumer world model that simulates... ...at civilization scale. We’re building... ...consumers. Our ML-driven... ...recommendation engine. We're seed... ...looking for a Senior Data & Machine... ...training, online inference, and the parity... .... ~ LLMs and foundation models applied...SeniorFoundation
PatternIQ
New York, NY4 days ago $184.7k - $324.8k
...Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference New York City, New York, United States Machine Learning and AI... ...using state-of-the-art techniques and ship them at Apple scale. This is a rare opportunity to directly shape how AI reaches...SeniorFoundationWorldwideRelocation- ...ecosystem.About the AI & ML Platform TeamOur... ...is to build the foundations to democratize AI... ...of AI & ML models and experiences.... ...About This RoleAs a Senior ML System Engineer on the AI & ML Platform’s Inference team, you will design... ...and optimize large-scale model serving systems...SeniorFoundationWork at officeLocal area
Atlassian
New York, NY14 hours ago $165k - $225k
...of its clients a Senior Machine Learning Engineer - this is a... ...experienced Senior ML Engineer to join... ...and generative modeling stack that powers... ...Work with large-scale pathology datasets... ..., and fine-tune foundation models and... ...ONNX export, and inference serving frameworks...SeniorFoundationRemote workWorldwideCareer Renew
New York, NY1 day ago$295k
...We build cutting-edge foundation AI models and end-to-end products... ...team of researchers, engineers, designers, and more,... ...Overview:We’re looking for a senior engineer to help build... ...powers our frontier-scale language models. This... ...the full stack of ML systems, this role gives...SeniorFoundationFull timeWork at officeLocal areaRemote workHome officeCohere
New York, NY1 day ago- ...DoorDash seeks a Senior Machine Learning Engineer to join Agentic Foundations, focusing on vertical agent development and production-ready agents like the Ask Assistant... ..., latency, and cost, and partner across teams to scale ML-driven grocery and retail delivery initiatives....SeniorFoundationWork at officeRemote work
$295k
...enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are... .... Cohere is a team of researchers, engineers, designers, and more, who are all passionate... ...learning systems and optimize audio inference serving efficiency using innovative...FoundationFull timeWork at officeLocal areaRemote workHome officeCohere
New York, NY1 day ago- ...Capital One is seeking a Machine Learning Engineer 5 to design, deploy, and scale ML models in production. Ideal candidates bring strong Python/Java/C++ skills, experience with PyTorch or TensorFlow, and proficiency in distributed systems like Spark and Ray. Cloud and...Senior
- ...One National Association is seeking a Machine Learning Engineer 4 in New York, NY to drive AI transformations and scale production models across the business. You'll work with Python/Java/Golang/C++ and leading ML frameworks, collaborating with product and data science...Senior
- ...determine where new ML capabilities can... ...processing, and ML inference. Turn advances in... ...rollout and rollback, model-quality... ...fragmented systems, mentor senior engineers, and align... ...and operating large-scale, low-latency search... ...retrieval and applied-ML foundations, with practical...SeniorFoundationWork at officeLocal area
Atlassian
New York, NY4 days ago $180k - $230k
.... AI is the foundation that makes this work... ...at meaningful scale: profitable, hundreds... .... We're hiring a Senior MLOps Engineer to build and own... ...— from training models on tens of... ...seconds against inference-time datasets that... ...ever. This is an ML infrastructure role...SeniorFoundationArlo
New York, NY17 days ago$182.4k - $250.6k
...transportation on a global scale. Are you passionate about... ...real-world scenarios.As a Senior AI/ML Future Sensing Engineer in the Embodied AI organization... ...ML and perception models that support safe and reliable... ...and selection, and foundation modeling to solve problems...SeniorFoundationFull timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hoursGeneral Motors
New York, NY1 day ago$180k - $275k
...companies, Yobi builds foundation models of human behavior... ...culture from the ground up. Engineers here own major... ...0→1 systems in large‑scale data and model infrastructure... ...Engineer focused on Inference and Serving at Yobi ,... ...This is an applied ML systems role—equal parts...FoundationRemote job- ...rare opportunity to deploy models with real purpose, where... ...overlooks. We're looking for a Senior Founding AI/ML Engineer to design, build, and ship... .... ~ Strong data science foundation, including hands-on... ...understandable code that scales as the team grows. ~ Curiosity...SeniorFoundationFull timeFlexible hours
Jobleads-US
New York, NY1 day ago $229.9k - $262.4k
...applications of AI & ML are bringing... ...applied science and engineering teams to deliver our... ...The Intelligent Foundations and Experiences (IFX... ...customers. Our AI models and platforms... ...large language model inference, similarity search... ...throughput — of large scale production AI...SeniorFoundationFull timePart timeLocal areaCapital One
New York, NY3 days ago$240k - $270k
...Senior AI/ML Engineer New York City, NY About the Role At Sigma, we'... ...focused on building the AI foundation that will power Sigma for the... ...workflows, and more Develop and scale AI/ML infrastructure that... ...or training foundation models (language or multimodal) for...SeniorFoundationFull timeWork at officeFlexible hoursSigma Computing
New York, NY1 day ago- ...Advertiser Growth team is the engine of this mission,... ...experimentation frameworks needed to scale their impact.In 2026,... ...pillars: Foundation, Smart, and Intelligence... ...integration of Generative AI models (Diffusion, LLMs) to... ...roadmaps and mentor senior engineers in a high-growth...SeniorFoundationFull timeWork at officeRemote workWorldwide
Unity Technologies
New York, NY14 hours ago - ...DoorDash seeks a Senior Machine Learning Engineer for the Agentic Foundations team in a hybrid role. You will own continuous improvement of flagship agents, starting with the Ask Assistant, using eval-driven loops to speed, cost-efficiency, and reliability for millions...SeniorFoundation
- ...evolution of our Technology, Engineering, Data, Product and User... ...the Role: As Senior Machine Learning Engineer in the AI & ML foundations team, you will design... ...applying AI research or model training - but to real... ...platform for production scale: caching, reliability,...SeniorFoundationLocal areaFlexible hours
Dow Jones & Company, Inc.
New York, NY3 days ago - Zip Security, Inc. is hiring a Senior Accountant to build and own the financial foundation for scalable growth. You will manage day-to-day accounting, GL, AP/AR,... ...help establish processes, controls, and systems that scale with the company and support tax, audit, and...SeniorFoundation
- ...will be deploying your engineering, data analytics and data... ...for auditing models, including criteria like... ...actionable recommendations at scale. Develop, train, and implement... ...LLMs and traditional ML models and at least 5... ..., data pipelines, and inference behaviors.- Capability...Senior
TikTok
New York, NY3 days ago $160k - $180k
...Senior MLOps Engineer New York, New York - 5 days onsite $16... ...be at the forefront of scaling AI automation applications... ...for machine learning model deployment and... ...Software engineering foundation: debugging, testing, maintainable... ...| Machine Learning | ML Engineer | Engineering...SeniorFoundationHarnham
New York, NY14 hours ago- ...Scientific, Inc. is seeking a Senior Member of Technical Staff, Infrastructure Engineer to design, scale, and operate the core platform... ...You will own the infrastructure foundation for AI agents and long-running... ..., collaborating with backend, ML, and research teams to deliver...SeniorFoundation
$156.77k - $198.27k
...Summary Machine Learning Engineers work to deploy end-to-... ...leveraging AI and/or ML principles as needed to... ...high-level agent and model architectures, and demonstrate... ...in agentic AI, foundation models, and MLOps/AgentOps... ...to apply Bayesian inference, frequentist statistics...SeniorFoundationWork experience placementLocal areaTalentify.io
New York, NY1 day ago$200k - $240k
...Senior Machine Learning Engineer (Computer Vision / Vision-Language Models) Remote (U.S. or Canada) | $... ...intelligence, and cloud-scale machine learning... ...Optimize inference pipelines for performance... ...of deploying ML systems into... ...influence over foundational AI architecture...SeniorRemote workHarnham
New York, NY1 day ago- Boundless is hiring an Applied AI/ML Engineer to ship AI-powered products end-to-end on our growing GPU inference fleet. You’ll own everything from serving low-latency... ...harnesses to drive fast iteration. A strong foundation in Python and PyTorch, plus GPU concepts, is...FoundationRemote job
- Capacity is seeking a senior cloud infrastructure engineer to own the cloud foundation on AWS. You will design and scale our multi-account AWS environment, manage Kubernetes (EKS), and drive cost optimization while mentoring other engineers. You will collaborate with DevOps...SeniorFoundationRemote job
$264.8k - $331k
Scale AI is the data foundation for AI, helping organizations build and deploy... ...customers.About the RoleAs a Senior/Staff Machine Learning Engineer (MLE) on the General... ...agent lifecycle—from model and system design to... ...production.Experience deploying ML systems in cloud...SeniorFoundationFull timeScale AI
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Engineer — Foundation Model Inference at Scale. Be the first to apply!
Related searches
- computer vision machine learning engineer New York, NY
- junior machine learning research engineer New York, NY
- machine learning software engineer New York, NY
- ai ml engineer New York, NY
- senior ml engineer New York, NY
- machine learning ai engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- senior service associate New York, NY
- senior safety specialist New York, NY