Senior Research Scientist - Machine Learning System San Jose Regular

Senior Research Scientist - Machine Learning System

Location: San Jose

Team: Technology

Employment Type: Regular

Job Code: A103221A

Responsibilities

• Develop and maintain massively distributed ML training and inference systems worldwide, providing high-performance, highly reliable, and scalable solutions for LLM/AIGC/AGI.
• Design and build large-scale heterogeneous systems that integrate GPUs, NPUs, RDMA, and storage, ensuring stable and reliable operation.
• Develop and optimize LLM inference frameworks.
• Perform GPU and CUDA performance optimization to create an industry-leading, high-performance LLM inference engine.
• Collaborate with a global team across the United States, China, and Singapore to drive unified project direction and decision-making.

Qualifications

• Minimum: Bachelor's degree or above in computer/electronics/automation/software, etc.
• Proficient in C/C++, algorithms and data structures, and familiar with Python.
• Understand the basic principles of deep learning algorithms, neural network architecture, and deep learning training frameworks such as PyTorch.
• Preferred: Proficient in GPU high‑performance computing optimization on CUDA, in-depth understanding of computer architecture, parallel computing optimization, memory access optimization, low-bit computing, etc.
• Familiar with TensorRT‑LLM, ORCA, VLLM, etc.
• Knowledge of LLM models and experience in accelerating LLM model optimization.

Job Information

The base salary range for this position in San Jose is $212,800 - $387,600 annually.

Compensation may vary outside of this range based on qualifications, skills, competencies, and experience. Base pay is one part of the total package, which may also include discretionary bonuses, incentives, and restricted stock units.

Benefits may vary depending on employment nature and location. Employees receive medical, dental, and vision insurance; a 401(k) savings plan with company match; paid parental leave; short‑term and long‑term disability coverage; life insurance; wellbeing benefits; 10 paid holidays per year; 10 paid sick days per year; and 17 days of paid personal time (prorated upon hire with increasing accruals by tenure).

Equal Opportunity

Qualified applicants with arrest or conviction records will be considered in accordance with federal, state, and local laws, including the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act. Criminal history may affect duties such as unsupervised contact with clients or colleagues, handling confidential information, and exercising sound judgment.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs, or other protected reasons. Assistance is available at