ML Engineer: Distributed Inference & Model Serving
ByteDance
A leading technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will have at least 5 years of experience and strong programming skills in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This position offers a competitive salary and benefits in a dynamic work environment. #J-18808-Ljbffr ByteDance
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the ML Engineer: Distributed Inference & Model Serving in Seattle, WA vacancy
- Veeda AI is seeking a highly skilled engineer to advance distributed training and high-performance inference for multimodal world models. You will own multi-node throughput, profile GPU utilization, and optimize kernels and CUDA/Triton code across NVLink fabrics. Candidates...Suggested
$165.2k - $223.6k
...Inferentia and Trainium ML accelerators. This... ...unparalleled ML inference and training... ...running a wide range of models and supporting... ...software boundary, our engineers build systematic... ...computing, and distributed architectures, where... ...offline inference serving with vLLM, SGLang,...SuggestedWork experience placementInternshipLocal areaFlexible hoursAmazon
Seattle, WA4 hours ago- ...At Atlassian, the ML System Engineer will design and optimize large-scale model serving systems, spanning distributed infrastructure to low-level GPU kernel optimizations. You’ll... ...serving systems, benchmarking and tuning inference engines, and partnering with senior ML engineers...SuggestedRemote job
$250k - $350k
...of Technical Staff - Model Optimization and Inference Company: Nuance Labs... ...hiring an experienced ML Infrastructure/Systems Engineer (2+ years) to own end-... ...Evaluate, deploy and extend serving frameworks such as... ...cost ~ Debugging distributed systems Nice to Have...SuggestedFull timeWork at officeVisa sponsorshipRelocation packageTransparent Search Group
Seattle, WA7 days ago$209k - $313k
...digital services.Snap Engineering teams build fun and technically... ...ll do:Design and build models that quantify causal... ...of causal inference and modern approaches to... ...and leveraging causal ML in production systemsPreferred... ...reinforce our values, and serve our community,...SuggestedFull timeLive inWork at officeLocal areaSnap
Seattle, WA4 days ago$198.36k - $416.1k
...Machine Learning Platform Engineer to develop and maintain... ...supports deep learning models for code development,... ...learning platform and serves as a foundation for recommendation... ...systems and distributed training of large-scale... ...developing key components of ML infrastructure and...Full timeTemporary workLocal areaImmediate start- ...building machine learning models and systems to protect... ...stability3. Context engineering and tool collaboration... ....2. Business value: Serving content safety for billions... ...understanding of distributed computing framework &... ...for training/finetuning/inference; Being familiar with...Flexible hoursShift work
TikTok
Seattle, WA1 day ago $182.8k - $247.3k
...supporting Foundation Model Providers (FMP) on... ..., and distributed computing at extraordinary... ...train, fine-tune, and serve state-of-the-art... ...) along with ML expertise to build... ...relationships with customer engineering teams• Dive deep... ..., training/inference lifecycles, and optimization...Flexible hoursAmazonWebServices
Seattle, WA4 days ago- ...to take your software engineering career to the next... ...experience, with emphasis on ML systems.Hands-on... ...working with distributed systems concepts, microservices... ...to ML model serving frameworks (e.g., TorchServe... ...TensorFlow Serving, Triton Inference Server)Familiarity...
JP Morgan Chase
Seattle, WA2 days ago $168.1k - $227.4k
...Senior Machine Learning Engineer who will serve as a technical leader... ...complex, large-scale ML systems that have... ...implementation of complex, multi-model ML systems at Amazon... ...plans- 4+ years of distributed systems experience,... ..., training/inference lifecycles, and optimization...InternshipFlexible hoursAmazon
Bellevue, WA4 days ago$150.75k - $241.2k
...Machine Learning Engineer at Axon, you’ll help... ...talented ML engineers and scientists... ...machine learning models across Axon devices... ...scale evaluation, inference optimization, data... ...machine learning, distributed systems, cloud infrastructure... ...communities we serve.Studies have shown...Work experience placementWork at officeRemote workAxon
Seattle, WA12 hours ago$185k - $235k
...well every downstream ML model performs: better signals... ..., and online serving — and we close the loop... ...Senior Machine Learning Engineer to design and build the... ...low-latency, high-QPS inference for real-time bidding.... ...Experience with large-scale / distributed model training and...Full timeLocal areaWork from homeNews Break
Bellevue, WA2 days ago- ...now scaling that model rapidly across the... ...One unified stack serves seven core surfaces... ...looking for experienced engineers and researchers... ...-device real-time inference.- Generative... ...TensorFlow, including distributed training and model... ...results in major ML competitions.Req ID...Temporary workShift work
TikTok
Seattle, WA1 day ago $151.8k - $265.35k
...SeniorMachine Learning Engineers for our GenAI... ...and develop efficient inference pipelines, optimize models for latency and through... ...of products that serve individual and enterprise... ..., and mentor other ML engineers.Job... ...expertise in Kubernetes, distributed systems, and MLOps platforms...Full timeTemporary workLocal areaWorldwideAdobe Systems
Seattle, WA4 days ago$176.76k - $232k
...responsibilities As a Senior AI/ML Engineer, you will lead the delivery... ...challenges from setting up model training and fine‑tuning to... ...and system design for serving AI/ML inference solutions in production.... ...monitoring Build and operate distributed training pipelines for...Permanent employmentFull timeContract workPart timeLocal areaWork visaLululemon athletica
Seattle, WA12 hours ago- ...architectures, combining rigorous engineering with learning systems... ...are seeking a Staff ML Systems Engineer to architect and build the distributed infrastructure that... ...data processing, model training, evaluation,... ...learning training and inference systems. Familiarity...Local area
FieldAI
Seattle, WA16 days ago $130k - $260k
...production-grade ML systems powering customer... ...pipelines, model training, evaluation, deployment, serving, monitoring, and continuous... ...systems.Establish engineering patterns and best... ..., deployment, inference, monitoring, and... ...understanding of distributed systems, APIs and...Full timeTemporary workPart timeWork experience placementWalmart
Bellevue, WA3 days ago$106.9k - $160.4k
...enterprise, we are seeking a skilled ML Engineer to design, build, and... ...transition from experimental models to trusted, production-grade AI... ...cases. Model Deployment & Serving Operationalize and deploy batch and real-time inference solutions using cloud-native services...Full timeTemporary workWeyerhauser Co
Seattle, WA12 hours ago$125k - $180k
...of the Product and Engineering team at PitchBook,... ...(MLE) on the AI & ML (Insights) team,... ...operationalization of ML models, including their... ...models that can infer meaning and... ...data pipelines and distributed systems using technologies... ...a veteran who served on active duty in...For contractorsWork at officeRemote workVisa sponsorshipPitchBook
Seattle, WA2 days ago- ...Machine Learning Engineer for our Personalization... ...and ranking models that drive engagement... ...architecture, ML infrastructure, and... ...from training and serving pipelines to CI/CD... ...) and low-latency inference. ~ Hands-on experience... ...~ Solid grasp of distributed systems,...Work at officeFlexible hours
Grid Dynamics
Seattle, WA1 day ago $152k - $228k
...Senior ML Engineer About Invoca Invoca is an AI-powered revenue execution... ...ML lifecycle at Invoca, from model training and fine-tuning through inference optimization and production APIs.... ...versioning, and deployment. Serve as the primary SME for...Currently hiringRemote workFlexible hoursInvoca
Seattle, WA4 days ago- ...looking for a Senior Data Scientist - Experimentation & Causal Inference to serve as the statistical brain behind our rapidly growing... ...infrastructure or writing backend services — our platform engineering team handles that. Your job is to design, validate, and continuously...Full time
ByLabs
Seattle, WA1 day ago $152k - $190k
...applications in any location. Distributed across 200+ public... ...a Machine Learning Engineer to join our... ...deploy end-to-end ML pipelines spanning... ...evaluation, and high-scale serving Develop deep learning models for security use... ...building scalable inference optimization...Full timeWork at officeLocal areaRemote workZscaler
Bellevue, WA12 hours ago$204k - $216k
...Foundational Model Research Data Scientist Seattle... ...the organization it serves. Let’s achieve more,... .... Partner with data engineering on the datasets that training... .... This is not an ML infrastructure role.... ...and vector systems. Distributed training and cloud or GPU...- ...multi-modality foundation model to drive the next... ...Optimization & Deployment Engineer, you will focus on bringing... ...You will optimize the ML models, write custom... ...build highly concurrent inference code to ensure real-... ...Radar). Experience with distributed training pipelines and...Temporary workRelocation package
Zoox
Seattle, WAa month ago $200k - $250k
...Machine Learning Engineering within the Advanced... ...annotation pipelines, ML Infrastructure and... ...state-of-art models into robust, autonomous... ...infrastructure to serve computer vision... ..., including distributed training infrastructure... ..., and low-latency inference services. Ensure high...Temporary workWork at officeLocal areaMetropolis
Seattle, WA26 days ago$175k - $308.5k
...Services Join the Apple Service Engineering (ASE) team and drive... ...integrate Large Language Models into our software... ...safely and effectively deploy ML-powered features. You will... ...architectural decisions for distributed systems involved in model serving, prioritizing reliability...Relocation- ...office, from home, or mix the two to fit their needs. As an ML System Engineer on the AI & ML Platform’s Inference team, you’ll design and optimize large-scale model serving systems end-to-end, owning distributed infrastructure and deep low-level optimizations. You’ll...Work at officeWork from home
$178.2k - $232.65k
...Engineering | Seattle, United States | Remote, Remote... ...legal entity. As a ML System Engineer on... ...the AI & ML Platform’s Inference team, you will design... ...optimize large-scale model serving systems end-to-end.... ...own everything from distributed infrastructure (global...Work at officeLocal areaRemote work- ...country where we have a legal entity. As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize large-scale model serving systems end-to-end. You will have the chance to own everything from distributed infrastructure (global KV cache,...Work at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Engineer: Distributed Inference & Model Serving. Be the first to apply!
Related searches
- computer vision machine learning engineer Seattle, WA
- machine learning software engineer Seattle, WA
- ai ml engineer Seattle, WA
- senior ml engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- machine learning engineer Seattle, WA
- data engineer machine learning Seattle, WA
- artificial intelligence - machine learning intern Seattle, WA
- machine learning intern Seattle, WA
- internship machine learning Seattle, WA