LLM Training Systems Engineer (Serverless, Multi-Tenant)
ByteDance
ByteDance's Volcano Ark team is seeking talented individuals to join the Data AML machine learning platform group. The role focuses on developing the Volcano Ark training system for post-training tasks such as SFT and RL, with emphasis on elastic, multi-tenant solutions across data centers and hardware. Strong programming skills and training framework experience are required. Successful candidates will contribute to reinforcement learning interfaces and scalable training performance. #J-18808-Ljbffr ByteDance
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the LLM Training Systems Engineer (Serverless, Multi-Tenant) in San Jose, CA vacancy
$128k - $256k
...platform launched by Volcano Engine. It is a leading platform... ...team. It provides training and inference systems for recommendation, advertising... ...Volcano Ark platform in a serverless manner. Design elastic training... ...solutions for complex multi-tenant training scenarios, supporting...TrainingTemporary workLocal area$224k - $356.5k
...we are building agentic systems that can reason about,... ...looking for exceptional engineers who are passionate... ...evaluation, debugging, training orchestration, and iteration... ....Strong agency in LLM-based systems, such as tool use, planning, multi-step workflows, code agents...TrainingFull time- ...San Jose seeks a Principal Software Engineer to lead ROCm validation across compute workloads and server-class systems. You will define testing strategy, build... .... Join a leadership role focused on multi-node validation, LLM training workloads, and performance...Training
$144k - $180k
...Aviation in San Jose seeks a Senior AI Systems Engineer to architect, deploy, and manage the critical... ...for large-scale AI model training and inference, ensuring robust, low-latency... ...compute, and implement monitoring across multi-cloud environments. The role carries a...Training$160k - $198k
...members.What You’ll DoAs a Senior AI Systems Engineer, you will architect, deploy,... ...for large-scale AI model training and inference. You will ensure... ...hardware utilization, managing multi-cloud compute scheduling alongside advanced LLM serving engines.Cross-Functional...TrainingLocal area- ...Applied Machine Learning Ark team in San Jose seeks engineers and researchers to advance LLM MaaS platforms. You will work across model serving... ...multimodal AI. You will contribute to end-to-end systems spanning training, inference, and evaluation in a fast-growing tech...Training
$190k - $237k
...members.What You’ll DoAs a Staff AI Systems Engineer, you will architect, deploy,... ...for large-scale AI model training and inference. You will ensure... ...hardware utilization, managing multi-cloud compute scheduling alongside advanced LLM serving engines.Cross-Functional...TrainingLocal area$150k - $350k
...edge generative AI to assist engineers in RTL design, simulation, and... ...We are seeking an ML Systems Engineer to optimize the performance... ...evaluation harnesses, and architect multi‑node clusters for training and inference that push the limits of LLM throughput and latency. Your...Training- ...service platform launched by Volcano Engine. It is a leading platform in China's... ...learning platform team. It provides training and inference systems for recommendation, advertising,... ...inference, and other workloads under strict multi-tenant isolation, improving overall...Training
$90k - $125k
...talented, passionate, and committed engineers, technologists, and business... ...:Supermicro islooking for a System Debug Engineer to support... ...equipment such as digital multi-meter and oscilloscopes, along... ...location, level, education, training, specific skills, years of experience...TrainingWork experience placementWorldwide$90k - $110k
...talented, passionate, and committed engineers, technologists, and business... ...is seeking talented System Engineer who can lead the technical... ...development of in-house multi-node server system products.... ...location, level, education, training, specific skills, years of experience...TrainingWorldwide$126.94k - $174.58k
...more at and on LinkedIn and X.System Architecture EngineerData... ...CAAbout the RoleAs a System Engineer, you will own the system development... ...PCB Layout: Lead and execute multi-layer PCB designs for high-... ..., experience, education, training, external market data, internal...TrainingPermanent employmentFull timeWork at officeDay shift$147.5k - $228.56k
...move industries forward.The Manager of Systems Engineering is responsible for understanding how Littelfuse... ...application notes, reference designs, training material, technical presentations,... ...and matrixed organizations is required.Multi-disciplinary and multi-industry...TrainingFull timeWorldwideFlexible hours$203.45k - $344.3k
...data and Digital World generation system, supporting large-scale model training, simulation and evaluation in the directions... ...4D scene reconstruction, including multi-view 3D reconstruction, Gaussian... ....Build a synthetic data production engine for perception, prediction,...TrainingFull time$132.4k - $217.6k
...motivated, creative and collaborative Staff Systems Engineer to lead systems engineering... ...opto-mechanical instrument that requires multi-engineering disciplinesStrong ability for... ...mentorship, promotional opportunities, training and development, tuition reimbursement,...TrainingFull timeTemporary workWork experience placementInternshipWorldwideFlexible hours- ...and progress made. Assist engineers with hardware design through... ...support customers Perform system integration and testing activities... ...desire to acquire on-the-job training. Ideal Candidate: ~... ...Adept at planning, prioritizing, multi-tasking, organizing and...TrainingFlexible hoursEarly shift
Tranzeal
Santa Clara, CA3 days ago $117.8k - $200.3k
...hands without us. KLA invents systems and solutions for the... ...expert teams of physicists, engineers, data scientists and problem-... ...ahead of established time frames.Multi-task - Ability to expeditiously... ...relevant education level or training. We are committed to complying...TrainingMinimum wageFull timeWork experience placementFlexible hours$144k - $180k
...What You’ll Do As a Senior AI Systems Engineer, you will architect, deploy, and... ...required for large-scale AI model training and inference. You will ensure... ...hardware utilization, managing multi-cloud compute scheduling alongside advanced LLM serving engines. Cross-...TrainingLocal area$132.4k - $251.6k
...Technology (AST) is seeking an Sr Principal Systems Engineer / ICT Lead who strives for excellence... ..., ability to work within and across multi-functional groups, organizational boundaries... ...s work experience, location, education/training, and key skills.Hired applicants may be...TrainingTemporary workWork experience placementWork at officeRemote workFlexible hours$195k - $285k
...compute. As a Principal Hardware Design Engineer, you will be a cornerstone of our hardware... ...Unit) to solve the industry's most massive LLM inference challenges.Required... ...knowledge, skills, experience, education, and training. We also offer incentive opportunities that...Training3 days per week$184k - $287.5k
We are looking for a Senior System Software Engineer, Software Defined Networking to design, build... ...workloads — including hyperscale multi-node training, inference, cloud gaming, and cloud... ...Design and develop next-generation multi-tenant cloud SDN control and data plane...TrainingFull time$150.98k - $218.62k
...and on LinkedIn and X.Staff System Architecture and Design EngineerData... ...CAAbout the RoleAs a System Engineer, you will own the system... ...ResponsibilitiesDesign, develop, and optimize multi-kW intelligent system... ..., experience, education, training, external market data,...TrainingPermanent employmentFull timeWork at officeShift workDay shift- ...- Financial Foundation LLM San Jose - United States... ...ML‑driven risk systems for fast‑growing Latin‑... ...closely with product, engineering and regional business teams... .... Foundation Model Pre-training : Design and implement... ...and scaling experiments. Multi-source Sequence Modeling...TrainingLocal areaOverseasFlexible hours
- ByteDance's Volcano Ark MaaS platform invites talented engineers to advance large-model inference systems across China and internal products. You will optimize... ..., working on disaggregated inference, KV Cache, and multi-node deployments. Bachelor's/Master's in CS and...
$150k - $230k
...advanced AI, recommendation systems, and adtech.Recognized by... ...hands-on Machine Learning Engineer to drive the post-training of our large language models... ...code.RequirementsHands-on LLM post-training experience. You... ...training (function calling, multi-step planning).Publications...TrainingFull timeLocal areaWork from home$202k - $344k
....Department Introduction The Systems Integration Group (SIG) designs... ...and maintainability. Mentor engineers and represent the team in... ...and protocol analyzers. Strong multi-functional interpersonal skills... ...and relevant education or training. The pay scale is subject to...TrainingFull timeLocal areaImmediate start$185k - $254k
...Materials is a global leader in materials engineering solutions used to produce virtually... ...later stages of completion.Ensures that all systems engineering projects and programs... ...completion.Develops personnel to include training and career development, manages the performance...TrainingFull time$250k - $300k
Performance/ Benchmark Engineer - NVIDIA GPU SystemsNVIDIA GPU Systems / AI Inference / Performance EngineeringOverview... ..., memory bandwidth, and multi-GPU scaling.Strong scripting and automation... ...inference workloads, distributed training, or large-scale GPU clusters....Training$82k - $133k
...seek talented, passionate, and committed engineers, technologists, and business leaders to... ...being a part of our "Super Story". The System Engineer will be responsible for reporting... ...and participation in team meetings, training sessions, and other on-site activities are...TrainingWork at officeWorldwide$190k - $230k
Cerebras Systems builds the world's largest AI chip, 56 times larger... ...to deliver industry-leading training and inference speeds; over 10... ...OpenAI recently announced a multi-year partnership with Cerebras... ...for a versatile Electrical Engineer who thrives at the bench—diagnosing...TrainingContract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Training Systems Engineer (Serverless, Multi-Tenant). Be the first to apply!
Related searches
- system engineer remote San Jose, CA
- senior windows systems engineer San Jose, CA
- systems engineer intern San Jose, CA
- senior linux systems engineer San Jose, CA
- ground systems engineer San Jose, CA
- advanced systems engineer San Jose, CA
- system verification engineer San Jose, CA
- wireless systems engineer San Jose, CA
- senior staff systems engineer San Jose, CA
- mission system engineer San Jose, CA