ML Engineer: Distributed Inference & Model Serving
ByteDance
A leading technology company in Seattle is seeking a Machine Learning Engineer for Model Serving Infrastructure. The ideal candidate will have at least 5 years of experience and strong programming skills in C/C++/CUDA. You will design and implement distributed inference infrastructure and collaborate with product teams. This position offers a competitive salary and benefits in a dynamic work environment. #J-18808-Ljbffr ByteDance
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Engineer: Distributed Inference & Model Serving in Seattle, WA vacancy
$175k - $280k
Sesame, located in Bellevue, Washington, is seeking a talented engineer to join our team focused on revolutionizing the way computers interact... ...with humans. The role involves optimizing machine learning models for a new consumer product category, working with state-of-the-...Suggested$175k - $280k
...Responsibilities Turbocharge our serving layer, consisting of a variety of LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost‑effective,... ...and custom kernels to speed up inference. Find ways to reduce model...SuggestedContract workFlexible hours$177.69k - $416.1k
Machine Learning Engineer-Model Serving Infrastructure Machine Learning Engineer-Model Serving Infrastructure... ...for the design and implementation of distributed inference infrastructure for feeds, ads and... ...-Design, High Performance Computing, ML Hardware Acceleration (e.g., GPU/RDMA...SuggestedFull timeTemporary workLocal area$200k - $300k
Member of Technical Staff — Model Optimization and Inference (New Grad) Seattle,... ...stack from model weights to serving infrastructure: quantization... ...posting is aimed at early-career engineers finishing or recently... ...For BS, MS, or PhD in CS, ML, or a related field — completed...SuggestedInternshipH1bWork at officeVisa sponsorship$198.36k - $416.1k
...Machine Learning Platform Engineer to develop and maintain... ...supports deep learning models for code development,... ...learning platform and serves as a foundation for recommendation... ...systems and distributed training of large-scale... ...developing key components of ML infrastructure and...SuggestedFull timeTemporary workLocal areaImmediate start$200.8k - $251k
...seeks a team member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a...Full time$168.6k - $244.2k
...Machine Learning Systems & Efficiency Engineer. This role focuses on advancing inference performance in image editing applications, requiring deep AI and ML expertise. Candidates should excel... ...PhD and significant experience in distributed inference, performance profiling,...- ...applications. This role focuses on model architecture, inference runtimes, and cost-effective ML solutions. Ideal candidates... ...artificial intelligence and distributed systems, significantly impacting... ...and a commitment to data-driven engineering. #J-18808-Ljbffr Adobe Inc.
$202.16k - $368.22k
...Infrastructures team oversees the distributed training,... ...framework, high-performance inference, and heterogeneous... ...for AI foundation models. Responsibilities Design... ...science, mathematics, engineering, or a related field,... ...Dola and Dreamnia — and serves enterprise customers...Temporary workInternshipLocal area$180k
...motivated, and focused on engineering excellence. This organization... ...engineer on the Imagine Model Team, you will develop cutting... ..., modeling, training, inference serving, and product integration, covering... ...working with large‑scale distributed machine learning systems....Temporary work$202.16k - $368.22k
...Multimodal Foundation Model) - Global Frontier Tech... ...stability. Context engineering and tool collaboration... ...settings. Business value: Serving content safety for... ...Strong understanding of distributed computing framework &... ...training/finetuning/inference; being familiar with PEFT...Temporary workLocal areaFlexible hoursShift work$135.2k - $306.4k
...Principal AI Agent / ML Software Engineer is a Senior Staff-level... ...workflows, scalable inference infrastructure, and... ...candidate combines deep distributed systems experience... ...Responsibilities Serve as a senior technical... ..., inference systems, model serving, AI workflow...Temporary workFlexible hoursOracle
Seattle, WA14 hours ago- Senior Machine Learning Engineer, User Signal & Ads... ...well every downstream ML model performs: better signals... ...embeddings, and online serving — and we close the... ...low‑latency, high‑QPS inference for real‑time bidding.... ...Experience with large‑scale / distributed model training and...Full timeLocal areaWork from home
$183.7k - $248.6k
...Learning Infrastructure Engineer to join our Vector Ads... ...that brings ML models from training into production... ...intersection of ML systems and distributed infrastructure,... ...infrastructure that serves ML models in real-time... ...model versioning, and inference optimization What we’...Work at officeRemote workRelocation package- Snap Inc. in the United States seeks a Principal Software Engineer to lead ML Inference platform efforts and shape the technical strategy for scalable deployment of ML models. You will design and scale core services, collaborate across teams to deliver high-impact solutions...
$213.3k - $272k
...ABOUT THIS ROLE We are seeking a Staff ML/LLM Ops Engineer to own the model lifecycle as infrastructure that... ...to production into standardized self‑serve tooling. The model portfolio this platform... ...Computer Vision / video model inference at scale (GPU serving, latency and cost...Full timeContract workWork at officeFlexible hours$200k - $250k
...Machine Learning Engineering Seattle, Washington... ...annotation pipelines, ML Infrastructure and... ...state‑of‑the‑art models into robust,... ...infrastructure to serve computer vision and... ...lifecycle, including distributed training... ..., and low‑latency inference services. Ensure high...Temporary workWork at officeLocal area- A leading software company in Seattle is seeking a Senior Machine Learning Systems & Efficiency Engineer to enhance inference performance and cost efficiency in image editing applications. The role requires expertise in AI, machine learning systems, and performance optimization...
$189.6k - $237k
Scale AI, Inc. in Seattle is seeking an experienced ML platform engineer to build, profile and optimize our training and inference framework for large language models. You will collaborate with Scale's ML teams to accelerate research and develop the next generation of...Full time$164k - $313.3k
...Senior Machine Learning (ML) Systems & Efficiency Engineer to join our R&D team... ...improvements in inference performance, latency... ...the intersection of model architecture,... ...with experience in distributed inference, multimodal... ...Responsibilities Inference & Serving Optimization: Design...- ...architectures, combining rigorous engineering with learning systems proven in... ...We are seeking a Senior / Staff ML Systems Engineer to architect and build the distributed infrastructure that powers large... ...that support data processing, model training, evaluation, and post-processing...Local area
- Field AI in Irvine is seeking a Senior / Staff ML Systems Engineer to architect and build distributed infrastructure that supports large-scale machine learning... ..., ensuring scalable systems for data processing and model training. Join our innovative team to solve real-world...
$150.7k - $284.4k
...family of creative generative AI models coming to Adobe products that... ...experiences. We are hiring a Sr. ML Services Engineer role to help achieve our Enterprise... ..., the AI superhighway for inference and train that will manage and serve a collection of ML models in a highly...Temporary work$202.16k - $368.22k
...resume. Building a next-generation big model as a service platform to serve hundreds of LLMs based applications.... ...offline training/finetuning, online inference, model management, and resource... ...ideally with experience with scalable ML systems and real-world deployment, feedback...Temporary workInternshipLocal area- Unity is seeking a Senior Machine Learning Infrastructure Engineer to join our Vector Ads team in Bellevue, WA. You'll design and maintain real-time ML model serving infrastructure that powers Unity's global advertising platform, processing billions of requests daily. The...
- ...reliable on-demand, logistics engine for delivery! We're... ...and improve the models that power DoorDash's three... ...processing and causal inference models that impact millions... ...find out more on our ML blog here We’re... ...of industry experience serving in a tech lead role M....Full timeTemporary workWork at officeLocal areaRemote work
$228.96k - $315.36k
...edge machine learning modeling techniques across high... ...offline training to online serving and monitoring Design,... ..., and deploy scalable ML solutions and systems... ...applications in large distributed systems Ability to... ...Science, Mathematics, Engineering, or a closely related...Work experience placementLocal area$184.5k
...parental leave, a flexible work model (with some pretty cool... ...Senior Machine Learning Engineer role is part of the Distribution & Supply team which sits within... ...problems into clear ML‑driven solutions, selecting... ...workloads or large‑scale batch inference, including clear, well‑...Local areaFlexible hours$201.3k - $302.2k
...Machine Learning Platform Engineer, Machine Learning... ...Join us in building the ML platform that enables... ...between datasets, training, model serving, and evaluation. We're... ..., TensorRT) or inference optimization Contributions... ...Understanding of distributed training, model parallelism...Relocation- ...technologies company serving the U.S. military, intelligence... ..., we need a platform engineering group that provides a... ...to turn experimental models into reliable services... ...to production inference. Influence architecture... ...Solid understanding of distributed systems (consensus, fault...Contract workTemporary workWork at officeRemote workVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Engineer: Distributed Inference & Model Serving. Be the first to apply!
Related searches
- graduate machine learning engineer Seattle, WA
- data scientist machine learning engineer Seattle, WA
- machine learning engineer Seattle, WA
- ai ml engineer Seattle, WA
- machine learning software engineer Seattle, WA
- senior ml engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- computer vision machine learning engineer Seattle, WA
- data engineer machine learning Seattle, WA
- machine learning Seattle, WA