Software Engineer, ML System Architecture

Overview

Software Engineer, ML System Architecture

Responsibilities

• Responsible for the design and development of Machine Learning infrastructure for LLM/AIGC, etc.
• Build a super large machine learning system integrating GPUs, RDMA networking, and high-performance storage.
• Address technical problems to ensure high stability and availability of the system.
• Organize and coordinate multiple teams to complete system construction (Data center, network, computing, storage, resource teams).

Qualifications

• Minimum: Proficient in 1 to 2 programming languages (C++/Go/Python/Shell) in a Linux environment.
• Understanding of distributed systems with experience in large-scale ML systems design, development, and maintenance.
• Familiar with Kubernetes architecture and system-level development and tuning.
• Strong logical analysis, ability to abstract and split business logic; good communication and self-drive.
• Preferred: Experience with ML infrastructure for large model training and inference; experience in AI Infrastructure, HW/SW Co-Design, HPC, ML hardware architecture (GPU, accelerators, networking).

About Doubao (Seed)

Founded in 2023, the ByteDance Doubao (Seed) Team pioneers advanced AI foundation models. Our goal is to lead in cutting-edge research and drive technological and societal progress. Research areas span deep learning, reinforcement learning, language, vision, audio, AI Infra and AI Safety, with labs and positions across China, Singapore, and the US.

Why Join ByteDance

ByteDance values creativity and authentic expression. Our diverse global teams work to create value for communities and users. We cultivate curiosity, humility, and an "Always Day 1" mindset to achieve meaningful breakthroughs for our people, company, and users.

Diversity & Inclusion

ByteDance is committed to an inclusive space where employees are valued for their skills, experiences and perspectives. We celebrate diverse voices and aim to reflect the communities we reach.

Reasonable Accommodation

ByteDance provides reasonable accommodations in recruitment for candidates with disabilities, pregnancy, sincerely held religious beliefs or other protected reasons. If you need assistance, please reach out at

Job Information

Compensation: The base salary range for this position in the selected city is $129,960 - $246,240 annually. Total Package may include discretionary bonuses, incentives, and RSUs. Benefits include medical/dental/vision, 401(k) with company match, parental leave, disability coverage, life insurance, wellbeing benefits, and paid time off. Benefits vary by location and employment type. Company reserves the right to modify benefits at any time.