ML Engineer, Foundation Models - Real-Time Inference at Scale
Apple Inc.
Apple Inc. in Seattle is seeking a Software Engineer focused on Machine Learning and AI to build production-grade systems that serve real-time model inferences at scale. You will collaborate with researchers and product teams to prototype architectures, deploy and operate high-throughput services on cloud platforms using containers and Kubernetes, and write clean, reliable code in Go or Python. Required: 2+ years shipping production software, 5+ years ML/AI experience, and a BS in CS or related #J-18808-Ljbffr Apple Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Engineer, Foundation Models - Real-Time Inference at Scale in Seattle, WA vacancy
- Apple’s Foundation Model Services team builds the frameworks, services, and... ...product teams to deploy real-time model serving, and you’ll partner... ...researchers to prototype inference for state-of-the-art architectures... ...grow your impact as the system scales to #J-18808-Ljbffr AppleFoundation
$184.7k - $324.8k
Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference Santa Clara, California, United... ...techniques and ship them at Apple scale.This is a rare opportunity to... ...systems serving millions of customers in real time. Build profiling tools and simulators...FoundationWorldwideRelocation- ...in Seattle is seeking a Member of Technical Staff focused on model optimization and inference. This role demands expertise in refining AI models for real-time interactions, requiring a strong foundation in ML systems and familiarity with frameworks like vLLM and SGLang....Foundation
$229k - $343k
...Snap’s Generative ML Platform team... ...video generation to real-time AR, human understanding... ...AI, including foundational models, efficient... ...and server-side inference. Our team creates... ...Machine Learning Engineer to join Snap Inc!... ...fieldExperience training large-scale diffusion models...SuggestedFull timeLive inWork at officeLocal areaWorldwide- Apple Inc. seeks a Sr. Machine Learning Engineer for Foundation Models Inference in Cloud OS & Inference to advance private, scalable AI inference across... ...codesign, and system architectures at planetary scale. You will own high-throughput, low-latency serving, mentor...Foundation
$203.5k - $299.3k
...Machine Learning Engineer to help build the causal ML foundation behind how... ...systems: uplift models, heterogeneous... ...spine for a large-scale consumer marketplace... ...that influence real marketplace... ...with causal inference, econometrics,... ...benefits match, paid time off and paid...FoundationHourly payWork at officeLocal areaRemote workFlexible hours- ...do it than Apple. The Foundation Model Services team builds the... ...models at Apple's scale. Description Work closely... ...serving customers in real time. Partner with foundation... ...prototype and develop inference for cutting‑edge model... ...experience in ML technologies (LLMs, Machine...Foundation
- ...Machine Learning Engineer to help build the causal ML foundation behind how... ...systems: uplift models, heterogeneous... ...spine for a large-scale consumer marketplace... ...that influence real marketplace... ...with causal inference, econometrics,... ...benefits match, paid time off and paid...FoundationHourly payWork at officeLocal areaRemote workFlexible hours
- TikTok USDS Joint Venture LLC is seeking a machine learning engineer to help build scalable recommendation and e-commerce systems.... ...shopping experiences for TikTok users. You will design and optimize real-time models, work with merchants and creators to boost GMV, analyze large...
- ...edge computer vision problems. The role involves developing deep learning algorithms, optimizing models for 3D spatial understanding, and integrating solutions into real-time systems. Ideal candidates should have a Master's degree and experience in deep learning. A PhD...
- ...building the first real-time human foundation model — unifying text, speech... ...in voice — and infers meaning in context Generates... ...data pipelines for ML, including... ...eye for quality and scale. Can partner closely... ...research with the ruthless engineering needed for consumer-...FoundationShift work
$222.72k - $389.75k
...ll explore your foundational skills and how... ...Machine Learning Engineer to lead the... ...Conversion Core Modeling team, building... ...the-art applied ML projects for ads... ...and build large-scale DNN models to... ...intention and infer interests from... ...collaboration 1-2 times per month and therefore...FoundationWork at officeLocal areaRelocationRelocation package$200k - $300k
...Technical Staff — Model Optimization and Inference (New Grad)... ...photorealistic, real-time AI avatars with... ...we're developing foundation models designed... ...at early-career engineers finishing or recently... ..., or PhD in CS, ML, or a related field... ...at production scale yet; you do need...FoundationInternshipH1bWork at officeVisa sponsorship$266.72k - $350.07k
...Centre (SSC) Time Type: Full... ...at scale. The team leads... ...trusted unified data foundation, AI-driven data... ...a Principal AI/ML Engineer, you will define... ...and tools for model development, training... ..., inference platforms, evaluation... ...deployments, batch and real-time services,...FoundationPermanent employmentFull timePart timeWork visa$185.6k - $255k
...picture of a real human being—in... ...; it’s the foundation everything else... ...on an engineering queue. The bet... ...RoleAt Amperity, ML Engineers work... ...intersection of large-scale data, AI, and... ....Design real-time and batch... ...predictive models at scale.Improve model inference latency to...FoundationWork at officeLocal areaRemote work- ...About the job ML Engineer Our Client... ...captures and analyzes real-world... ...intelligence from model optimization to productized... ...Work type : Full Time, Compensation... ...teams to shape the foundations of the AI stack, improve... ..., deployment, inference, and monitoring in...FoundationFull time
Catalyst Labs, LLC
Seattle, WA3 days ago $127.4k - $191.2k
...s leading game engine. Recommendation... ...advertisers at massive scale.We are building... ...large language models, reinforcement... ...dynamics, and real-time ad delivery.... ...using causal inference, A/B testing,... ...Strong research foundations in one or more... ...scale data and ML systems, whether...FoundationFull timeInternshipWork at officeWorldwideShift work- ...Global E-commerce Algorithm role in Seattle. You will develop large-scale algorithms that merge physical logistics with digital... ...include building ETA predictions with OneTrans, pricing via causal inference, and integrating fulfillment factors into Search and Recommendation...
- TikTok USDS Joint Venture LLC is seeking a skilled ML engineer to develop and optimize bidding algorithms across ad delivery, focusing... ...on monetization efficiency and ROI. You will advance real-time, large-scale ML systems for advertising applications and improve...
- ...content production. You will develop machine learning algorithms, prototype novel solutions, and collaborate with Product and Tech teams to strengthen risk defenses while contributing to real-time data insights and scalable data infrastructure. #J-18808-Ljbffr ByteDance
$150k - $300k
...Senior Staff ML Engineer At GEICO, we offer... ...expectations while making a real impact on local... ...as their foundation. You bring a passion... ...solve complex, large-scale, cross-functional... ...resource allocation, and timely delivery of... ...systems for AI/ML models and LLMs used in production...FoundationHourly payWork experience placementLocal areaGEICO
Seattle, WA2 days ago- ...multimodal and video models to reliable,... ...operate large-scale video and... ...training, evaluation, inference, and serving... ...infrastructure for real-time and batch... ...direction, raise engineering standards, and... ...experience across the ML lifecycle,... ...experience, foundation model serving,...FoundationFull timeWork at officeRemote work
Axon
Seattle, WA4 days ago - ...growing. We're looking for ML engineers who want to define... .... That means less time on models in isolation and more... ...frontier model meets the real depth of a... ...on-device and server foundation models, including optimizing... ...constraints of on-device inference. Investigate model...FoundationWork at office
$57 per hour
...for building up and scaling our recommendation... ...the training and inference efficiency of generative models on GPUs. LLM for... ...context and making real‑time, personalized decisions... ..., Electrical Engineering, Mathematics, Statistics... ...discipline. Solid foundation in machine...FoundationHourly payInternshipLocal area$175k - $308.5k
...optimizing deep learning models, building data... ...models into real‑time production systems... ...Strong mathematical foundations in machine learning... ...Experience with large‑scale distributed... ...curation and pipeline engineering Experience with... ...experience integrating ML models into...FoundationRelocation$121.6k - $243.2k
...for building up and scaling our recommendation... ...the training and inference efficiency of generative models on GPUs. LLM for... ...context and making real-time, personalized... ...Science, Electrical Engineering, Mathematics, Statistics... .... Solid foundation in machine learning...FoundationTemporary workLocal area$129.96k - $246.24k
...you will build and scale high-impact... ...including recommendation engines, search relevance,... ...machine learning models for recommendation... ...systems to construct real-time and offline... .... Optimize online inference latency and system... ...September 25, 2025. Our foundation is a comprehensive...FoundationTemporary workLocal areaShift work$175k - $280k
...LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost‑... ...custom kernels to speed up inference. Find ways to reduce model initialization times without sacrificing... ...Bottleneck analysis in high‑scale server systems or...Contract workFlexible hours- ...technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will have at least... ...in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This position...
$42.75 per hour
...combines system engineering and machine... ...Language Model (LLM) service... .../fine-tuning/inference frameworks, prompt... ...large-scale log analytics... ...knowledge to real-world challenges... ...building a strong foundation for personal... ...a mainstream ML or agent... ...and paid sick time (56 hours if...FoundationHourly paySummer workInternship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Engineer, Foundation Models - Real-Time Inference at Scale. Be the first to apply!
Related searches
- data scientist machine learning engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- computer vision machine learning engineer Seattle, WA
- machine learning engineer Seattle, WA
- ai ml engineer Seattle, WA
- graduate machine learning engineer Seattle, WA
- machine learning software engineer Seattle, WA
- senior ml engineer Seattle, WA
- foundation manager Seattle, WA
- foundation program officer Seattle, WA