Senior Software Engineer, AI Infra Compute
$212.8k - $387.6kByteDance
Responsibilitie
About the team: Compute division focuses on building large-scale and highly available cloud infrastructure, which supports both public cloud products (like VolcEngine ECS service) and ByteDance internal products. Compute-US team focuses on the development and research of ByteDance compute infrastructure platform. Responsibilities - Design and implement prototypes of key technologies or products. - Design and implement core feature improvements. - Research and follow trends from industry companies, open-source communities and academia. - Review design and implementation and ensure it is aligned with long term vision and roadmap. Qualification Minimum Qualifications 1. BS or above degree in Computer Science or related technical field or equivalent practical experience. 2. 3 years experience as a senior development engineer. 3. 3 years experience of building large-scale cloud infrastructure. 4. Good communication, self-motivation, engineering practice, and working collaboratively in cross-functional teams. 5. Deep understanding of cloud infrastructure or AI infrastructure. 6. Familiar with at least one of the areas below: GPU Infra (GPU cluster management, job scheduling, collective communication libraries, etc; Machine learning frameworks and engines, like training frameworks, Inference engines (vLLM, SGLang, etc), Server hardware platform technologies (next-gen CPU, DPU, GPU, CXL, etc.) Preferred Qualifications 1. Experience of building industry-leading public-cloud platforms such as AWS/Azure/GCP. 2. Experience of academic publications. Job Information [For Pay Transparency]Compensation Description (Annually) The base salary range for this position in the selected city is $212800 - $387600 annually.Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.
Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).
The Company reserves the right to modify or change these benefits programs at any time, with or without notice.
For Los Angeles County (unincorporated) Candidates:
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment. About U Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join ByteDance Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. Reasonable Accommodation ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, AI Infra Compute in San Jose, CA vacancy
- ...Advanced Micro Devices is seeking a Senior Cloud Engineer in San Jose, CA. This role involves providing technical support for AMD’s cloud infrastructure... ...collaborating across global teams. A Bachelor's degree in Computer Science is required. This position offers a vibrant and...Senior
$166k - $244k
Senior Software Engineer, Infra, Vertex Gemini API+ Serving - Sunnyvale, CA, USA. About the job Google's software... ...models and technology on the Vertex AI platform, bridging the gap between... ...or networks, or experience with compute technologies, storage or hardware architecture...SeniorFull time$174k - $252k
Senior Software Engineer, ML Infrastructure, Core Infra corporate_fare Google place Sunnyvale, CA, USA Apply Qualifications... ...retrieval, distributed computing, large‑scale system design, networking... ...and scaling. The Cloud Applied AI (AAI) powers business growth with...SeniorFull timeTemporary work$174k - $252k
...Senior Software Engineer, Google Cloud Compute Infrastructure Benefits for this role include: Health, dental, vision, life, disability insurance Retirement... ...deploy, maintain, and enhance software solutions. The AI and Infrastructure team is redefining what’s possible....SeniorFull timeTemporary workWorldwide$175k - $210k
...combines autonomous machines, advanced software, and human expertise to help... ...Role We are looking for a Senior Software Engineer to design, develop, and deploy computer vision systems that turn continuous... ..., audio classification, or edge AI inference. ~ Strong ML...SeniorFull timeRelocation$152k - $241.5k
...container, GPU, and systems engineers, and apply machine learning or... ...prediction) within existing software workflows. Qualifications 5+... ...Engineering, Mathematics, Physics, Computer Science, or equivalent... ...Opportunity Employer NVIDIA uses AI tools in its recruiting...Senior$153k - $242k
...CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave... ...to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave... ...Learn more at About the Role As a Senior Software Engineer within our Compute Architecture...SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours$184k - $287.5k
...are looking for an experienced software professional to contribute to... ...of Python APIs for numerical computing. In the last decade, Python... ...language for practitioners in AI, data science and HPC,... ...Science, Applied Math, Electrical Engineering or related field (or equivalent...Senior$181.1k - $318.4k
Cupertino, California, United States Software and Services People at Apple... ...found it. The Apple Service Engineering (ASE) team builds and... ...Service Engineering (ASE)'s Compute team is seeking an experienced... ...opportunities to solve problems through AI‑assisted automation,...SeniorRelocation$166k - $244k
Senior Software Engineer, AI/ML GenAI, Google Cloud Compute Infrastructure Google Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent practical experience. 5 years of experience programming in Python or C++. 3 years of experience with ML infrastructure (e.g., model...SeniorFull time$174k - $255k
Senior Software Engineer, Networking Switch Infra corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent practical experience... ...distributed systems or networks, or experience with compute technologies, storage or hardware architecture. Experience...SeniorFull time$156k - $387.6k
...Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling) Location: San Jose Team: Infrastructure Employment Type: Regular... ...of online containers and offline jobs daily, including AI and LLM workloads. The team is dedicated to building cutting...SeniorTemporary workLocal areaOverseas$174k - $252k
Senior Software Engineer, Infrastructure, Infra Spanner corporate_fare Google place Sunnyvale, CA, USA Bachelor’s degree or equivalent practical experience... ...Preferred qualifications: Master's degree or PhD in Computer Science or a related technical field. Experience...SeniorFull time$272k - $431.25k
...We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA to join our Hardware Infrastructure team. As an Engineer, you... ...organization. Qualifications BS or similar background in Computer Science or related area (or equivalent experience). 15+...$262k - $365k
Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving... ...related concepts (language modeling, computer vision). Preferred... ...push technology forward. Applied AI builds conversational agents deployed...SeniorFull time$170k - $192k
...Ayar Labs in San Jose, CA is seeking a Sr. Engineer for Research Software & Modeling Infrastructure. The role involves designing and maintaining data schemas, building data pipelines, and integrating AI tools into workflows. Candidates should have a Bachelor's degree in...Senior- ...General Motors is looking for a Senior ML Infrastructure Engineer to build robust compute platforms for AI validation. This role emphasizes driving efficiency and maximizing GPU utilization while improving platform reliability. You will collaborate with engineers to shape...Senior
- A leading technology company is seeking a Senior Software Engineer to optimize compute infrastructure through novel AI strategies. This role involves kernel debugging, designing tests, and providing technical mentorship. The ideal candidate has at least 5 years of Linux...Senior
- A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates...SeniorFull time
$230k - $250k
...Technical Staff in Sunnyvale, CA. This role involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a Master’s degree in Computer Science and experience with containerization tools like Docker and...Senior$207k - $307k
A leading tech company in Sunnyvale, CA is seeking a Software Engineer to lead the design and architecture of customer-facing systems. Applicants... ...in software development, focusing on distributed systems and AI/ML applications. You will drive project outcomes, implement...SeniorFull time$212.8k
...Software Engineer - AI Agent Infra Location: San Jose Team: Technology Employment Type: Regular Job Code: A154953A Responsibilities... ...Minimum Qualifications - Bachelor's degree or above in Computer Science or a related field. - Proficiency in at least one...Temporary workLocal area- A leading technology firm is seeking an experienced AI/ML Research Lead in Milpitas, California. This role requires a PhD and significant experience in research focusing on analog in-memory computing and deep learning. Responsibilities include leading circuit research,...Senior
$165k - $242k
...Senior Platform Engineer II, Compute Services Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators...SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours$143k - $197.44k
...fleet for more than 2,200 days. WeRide.ai is looking for a Software Engineer to build powerful and efficient world-leading cloud infra platforms for autonomous driving,... ...system. Requirements: ~ BS, MS, PhD in Computer Science / Engineering, Statistics or other...Senior$153k - $222k
...Machine Learning Engineer Applied Intuition, Inc. is... ...the future of physical AI. Founded in 2017 and now... ...to join the Data & ML infra group. This role will work... ..., training frameworks, compute, evaluation, and... ...degree in Computer Science, Software Engineering, or...SeniorFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift$212.8k - $387.6k
...Senior Software Engineer - Developer Infrastructure Location: San Jose Team... ...backend design and development infra experience to join our team.... ...: Bachelor degree in computer science or a related... ...Preferred Qualifications: AI applications development experience...SeniorTemporary workLocal area- A global technology leader is looking for an experienced SRE software engineer in Cupertino, California, to build and enhance compute infrastructure for Apple's services. The role involves developing AI-powered tooling, automating deployment, and ensuring that services...Senior
$175k - $290k
...investment in ours. The Role: Software Infrastructure Engineer, Senior Staff The role requires... .... As part of the software Infra team, you will be... ...you will bring: Minimum: Computer Science, Engineering, Math... ...experience. Work experience at an AI compute/subsystem company....SeniorFull timeWork experience placementRemote work$165k - $242k
...Senior Software Engineer, Data Center Infrastructure Tooling CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers... ...breakthroughs and turn compute into capability. Founded... ...and operations, and other infra teams the ability to plan...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, AI Infra Compute. Be the first to apply!
Related searches
- software developer internship no experience San Jose, CA
- federal - software developer San Jose, CA
- software engineer contract San Jose, CA
- part time software developer San Jose, CA
- software engineer healthcare San Jose, CA
- network software engineer San Jose, CA
- ngo software engineer San Jose, CA
- software development engineer aws San Jose, CA
- software developer internship San Jose, CA
- software developer intern San Jose, CA


