Graduate ML Engineer: Orchestration & Online Model Serving
ByteDance
ByteDance is building a Data-AML-Engine Orchestration platform to power online model serving across TikTok and other ByteDance products. You will contribute to orchestration, scheduling, and resource management systems connecting heterogeneous compute with production ML workloads.
Join a team focused on scalable infrastructure—enabling low latency, high availability, and efficient GPU usage while tackling challenging distributed systems problems across multiple clusters and services.
#J-18808-LjbffrVacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the Graduate ML Engineer: Orchestration & Online Model Serving in San Jose, CA vacancy
- ...ByteDance is hiring for a Data-AML-Engine Orchestration role in Seattle. You will contribute to large-scale ML infrastructure powering online model serving across ByteDance products including TikTok, focusing on orchestration, scheduling, and resource management. The...OnlineFor graduates
ByteDance
Seattle, WA13 hours ago $177.69k - $416.1k
Machine Learning Engineer-Model Serving Infrastructure Machine Learning Engineer... ...and scalability of online inference servers - Responsible... ...High Performance Computing, ML Hardware Acceleration (e.g.,... ...ago Machine Learning Engineer Graduate (TikTok E-Commerce - Conversational...OnlineFor graduatesFull timeTemporary workLocal area- ...Responsibilities The Data-AML-Engine Orchestration team builds large-scale... ...infrastructure that powers online model serving across ByteDance products,... ...with production ML workloads. Responsibilities... ...individuals to join our team. As a graduate, you will get opportunities...OnlineFor graduatesInternship
ByteDance
San Jose, CA13 hours ago - ...Responsibilities The Data-AML-Engine Orchestration team builds large-scale... ...infrastructure that powers online model serving across ByteDance products,... ...with production ML workloads.You will work on... ...individuals to join our team. As a graduate, you will get opportunities...OnlineFor graduatesInternship
ByteDance
Seattle, WA13 hours ago $174.72k - $295.68k
...We are seeking Machine Learning Engineers with strong expertise in generative modeling and large-scale deep learning systems... ...under an agent's actions, and serving as a learned simulator for... ...equivalent experience. Open to recent graduates. Strong experience in...For graduatesFull time$195.2k - $262.2k
...enterprises from data and model training through to production... ...building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization,... ...reliable rollout, reward-serving, checkpointing, and experiment...Full timeTemporary workImmediate startRemote work$202.16k - $368.22k
...team in 2027. As a graduate, you will get opportunities... ...next-generation big model as a service platform to serve hundreds of LLMs... .../finetuning, online inference, model management... ..., and resource orchestration. Manage a huge number... ...experience with scalable ML systems and real-...OnlineFor graduatesTemporary workInternshipLocal area$184.05k - $262.93k
...Surfaces Moments is a ML team within the... ...Machine Learning Engineer, you will help shape... ..., large language models, and production-... ...recommendations that serve millions of... ...execute, and interpret online experiments and A/... ...data pipelines and orchestration workflows using...OnlineRemote jobFull timeFlexible hoursSpotify
New York, NY9 hours ago$173k - $253.5k
...endless opportunity to serve the varied needs of... ...Search & Personalization ML team is Instacart’s engine for state-of-the-art... ...Ranking Backbone Models: Multi-task/multi-objective... ...practices: online experiments, long-horizon... ...communication abilities.\ ~ Graduate degree (Masters or...OnlineFor graduatesPermanent employmentFull timeTemporary workWork at officeRemote workWork from homeFlexible hours$174.72k - $295.68k
...and is not limited to: LLM model fine tuning, PTQ, QAT, on-... ...-offs.Develop PTQ and QAT orchestration workflows.Serve as the primary interface... ...industry experience. Open to new graduates.Strong understanding of... ...programming and software engineering skills.Ability to work...For graduatesFull time$200k - $240k
...world for all. The AI Engineering Team is chartered... ...on Large Language Models (LLMs) and agentic... ...-scale pipelines, serve models with... ...evaluation frameworks, and orchestration tools that unlock... ...a Senior or Staff ML Systems Engineer -... ...offline and online evaluation of LLMs...OnlineRemote workWorldwide- ...Applied Machine Learning Engineer focused on Fraud &... ...operate production ML decision systems... ...scoring, feature quality, online/offline consistency, model deployment,... ...into low-latency model serving, decision APIs, and... ...feature stores, workflow orchestration, and model-serving...OnlineFull timeLocal area
Block
United States9 hours ago $205k - $235k
...EY Growth Platforms AI ML Engineering Director will... ...analytics platform and serving the technical execution... ...analytics components. Lead model selection, feature... ...work experience; or a graduate degree and approximately... ...need assistance applying online or need to request an...OnlineFor graduatesFull timeFor contractorsWork experience placementSummer holidayFlexible hoursErnst & Young
New York, NYa month ago$205k - $235k
...EY Growth Platforms AI ML Engineering Director will... ...analytics platform and serving the technical execution... ...components. Lead model selection, feature design... ...work experience; or a graduate degree and approximately... ...want assistance applying online or need to request an...OnlineFor graduatesFull timeFor contractorsWork experience placementSummer holidayFlexible hoursErnst & Young Oman
Hoboken, NJ13 hours ago$251k - $310k
...collaborative group of machine learning (ML) engineers, software engineers, and ML research... ...generative and reconstructive ML algorithms, to model the real world, encompassing realistic... ...implement low-latency, high-throughput serving solutions for generative models and...Full timeRemote workWaymo
Remote9 hours ago$130k - $185k
...EY Growth Platforms AI ML Engineering Director will... ...analytics platform and serving the technical execution... ...components. Participate in model selection, feature... ...work experience; or a graduate degree and approximately... ...need assistance applying online or need to request an...OnlineFor graduatesFor contractorsWork experience placementSummer holidayFlexible hoursErnst & Young
Atlanta, GA15 days ago$128k - $256k
...computer vision, NLP and multimodality models and algorithms to protect our platform... ...and safety strategy. Collaborate with engineering teams to deploy machine learning models, design online model workflow, and implement serving pipelines at scale. Collaborate with...OnlineFor graduatesTemporary workLocal areaTikTok
San Jose, CA13 hours ago$129.96k - $246.24k
...commerce alliance team aims to serve merchants and creators in the... ...learning algorithms to model the real-time interests of creators... .... This role is open to graduates in applied machine learning,... ...recommendation system, search engine, online advertising, information retrieval...OnlineFor graduatesTemporary workLocal areaShift workTikTok USDS Joint Venture
Seattle, WA14 hours ago$128k - $316.8k
...TikTok Technology Machine Learning Engineer Graduate (TikTok Vertical Recommendation) - 202... ...innovate on production recommendation models serving hundreds of millions of users. We work... ...on large-scale user behavior data to online deployment.- Run and analyze A/B...OnlineFor graduatesTemporary workInternshipLocal areaTikTok
San Jose, CA13 hours ago- ...Machine Learning Engineer focused on Intelligent... ...build production ML systems that... ...product context, model outputs, and feedback... ...generation through serving, experimentation,... ..., feedback loops, online/offline consistency... ...infrastructure, workflow orchestration, experimentation...OnlineFull timeTemporary workLocal areaFlexible hours
Block
United States9 hours ago - ...357 Responsibilities The Data-AML-Engine Orchestration team builds large-scale machine learning infrastructure that powers online model serving across ByteDance products, including TikTok... ...compute infrastructure with production ML workloads.You will work on systems that...OnlineInternship
ByteDance
Seattle, WA1 day ago $147.6k - $274.2k
...Suite team, you will serve as a high-impact strategic... ..., such as customer orchestration, ensuring alignment across... ...& Operating Models: Design and operationalize... ...e.g., MBA or relevant graduate degree).Professional program... ...in relation to the online application process,...OnlineFor graduatesFull timeLocal areaRelocation package3 days per week$140k - $180k
...talented Machine Learning Engineer IV to join our ML inspection team. In... ...damage detection models while architecting the high-throughput serving infrastructure needed... ...Qualifications ~Graduate education (MS or PhD)... ...dealers buy and sell cars online. We are transforming...OnlineFor graduatesFull timeTemporary workWork experience placementLocal areaACV
Remote4 days ago- ...Costume Techniques, Sound Engineering, and various advanced... ...History, Conducting, Orchestration, Compositional... ...schedule (in-person and/or online). • Collaborate with... ...credit hours of discipline graduate coursework from an... ...diverse student body, serves first-generation college...OnlineFor graduatesFull timeSecond jobWork at officeRemote workWeekday work
Avila University
Kansas City, MOa month ago $184.5k - $230.7k
...Learning & Data Engineer to lead the design... ...of the internal ML-and-data platform... ...native pipelines, model-serving infrastructure, and... ...of container orchestration (Kubernetes/EKS),... ...engineering, offline/online parity, A/B... ...Desired: Graduate degree focused on...OnlineFor graduatesFull timeLocal areaRemote workWorldwideTwilio
Remotemore than 2 months ago- ...Holdings, is seeking a Machine Learning (ML) Engineer to serve on a potential contract supporting... ...deploying, and maintaining machine learning models and AI-enabled systems that support SOF... ...who are unable to utilize our online application system due to a disability....OnlineFull timeContract workWork at officeLocal areaVisa sponsorshipWork visaFlexible hours
Command Holdings
Remote9 hours ago - ...Apple is seeking an ML Infrastructure Engineer focused on ML user experience APIs and integration for on-device AI. You will develop new model authoring and conversion APIs that serve as entry points into Apple’s ML infrastructure and drive onboarding of popular models...
Socket.dev
Cupertino, CA14 hours ago - ...Inc. in the San Francisco Bay Area is looking for a Staff/Sr. Machine Learning Engineer to optimize inference for large foundation models and deliver production-grade solutions that serve millions of users in real time. You will collaborate closely with research and product...
$175k - $280k
Sesame, located in Bellevue, Washington, is seeking a talented engineer to join our team focused on revolutionizing the way computers interact... ...with humans. The role involves optimizing machine learning models for a new consumer product category, working with state-of-the-...$175k - $280k
...where computers truly come alive. Responsibilities Turbocharge our serving layer, consisting of a variety of LLM, speech, and vision models. Partner with ML infrastructure and training engineers to build a fast, cost‑effective, accurate, and reliable serving layer...Contract workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Graduate ML Engineer: Orchestration & Online Model Serving. Be the first to apply!
Related searches
- senior ml engineer San Jose, CA
- computer vision machine learning engineer San Jose, CA
- machine learning engineer San Jose, CA
- machine learning software engineer San Jose, CA
- business management graduate San Jose, CA
- entry level graduate San Jose, CA
- graduate assistant basketball San Jose, CA
- information technology graduate San Jose, CA
- new graduate software engineer San Jose, CA
- graduate student intern San Jose, CA