Senior Software Engineer, AI Infra Compute
$212.8k - $387.6kByteDance
Responsibilitie
About the team: Compute division focuses on building large-scale and highly available cloud infrastructure, which supports both public cloud products (like VolcEngine ECS service) and ByteDance internal products. Compute-US team focuses on the development and research of ByteDance compute infrastructure platform. Responsibilities - Design and implement prototypes of key technologies or products. - Design and implement core feature improvements. - Research and follow trends from industry companies, open-source communities and academia. - Review design and implementation and ensure it is aligned with long term vision and roadmap. Qualification Minimum Qualifications 1. BS or above degree in Computer Science or related technical field or equivalent practical experience. 2. 3 years experience as a senior development engineer. 3. 3 years experience of building large-scale cloud infrastructure. 4. Good communication, self-motivation, engineering practice, and working collaboratively in cross-functional teams. 5. Deep understanding of cloud infrastructure or AI infrastructure. 6. Familiar with at least one of the areas below: GPU Infra (GPU cluster management, job scheduling, collective communication libraries, etc; Machine learning frameworks and engines, like training frameworks, Inference engines (vLLM, SGLang, etc), Server hardware platform technologies (next-gen CPU, DPU, GPU, CXL, etc.) Preferred Qualifications 1. Experience of building industry-leading public-cloud platforms such as AWS/Azure/GCP. 2. Experience of academic publications. Job Information [For Pay Transparency]Compensation Description (Annually) The base salary range for this position in the selected city is $212800 - $387600 annually.Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.
Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).
The Company reserves the right to modify or change these benefits programs at any time, with or without notice.
For Los Angeles County (unincorporated) Candidates:
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment. About U Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join ByteDance Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. Reasonable Accommodation ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, AI Infra Compute in San Jose, CA vacancy
- Advanced Micro Devices is seeking a Senior Cloud Engineer in San Jose, CA. This role involves providing technical support for AMD’s cloud infrastructure... ...collaborating across global teams. A Bachelor's degree in Computer Science is required. This position offers a vibrant and...Senior
$152k - $241.5k
...NVIDIA has been transforming computer graphics, PC gaming, and accelerated... ...the unlimited potential of AI to define the next era of... ...container, GPU, and systems engineers. When useful, you will apply... .../prediction) inside existing software workflows. What we need to...SeniorRemote work$181.1k - $318.4k
...Senior Software Engineer - Compute People at Apple don't just build products — they craft the kind of experience that has revolutionized entire industries... ...offers unique opportunities to solve problems through AI-assisted automation, including building and leveraging AI...SeniorRelocation$184k - $287.5k
NVIDIA Corporation is looking for a Senior System Software Engineer focusing on DevOps and Infrastructure Automation in Santa Clara, California. Candidates... ...and CI/CD tools. The role involves designing and managing AI infrastructure, with a focus on reliability, performance,...SeniorRemote job$184k - $287.5k
...foundation models (GR00T), and compute, we strive to bring general... ...hand-in-hand across multiple engineering and research teams to enable... ...PyTorch) and proficiency in modern software development practices (... ...fields. Publications in top‑tier AI conferences or contributions...Senior$156k - $387.6k
...Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling) Location: San Jose Team: Infrastructure Employment Type: Regular... ...of online containers and offline jobs daily, including AI and LLM workloads. The team is dedicated to building cutting...SeniorTemporary workLocal areaOverseas$166k - $244k
Senior Software Engineer, AI/ML GenAI, Google Cloud Compute Infrastructure Google Sunnyvale, CA, USA Apply Bachelor ’s degree or equivalent practical experience. 5 years of experience programming in Python or C++. 3 years of experience with ML infrastructure (e.g., model...SeniorFull time$174k - $255k
Senior Software Engineer, Networking Switch Infra corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent practical experience... ...distributed systems or networks, or experience with compute technologies, storage or hardware architecture. Experience...SeniorFull time$170.6k - $261.3k
...team: The AV ML Infra team at GM builds... ...unique demands of AI and ML innovation,... ...productivity of ML engineers, and drive the... ...pipelines. ML Compute: Streamlines andoptimizeslarge... ...: As a Senior AI/ML Full-... ...build end-to-end software products , owning...SeniorLocal areaWork from homeFlexible hours$272k - $431.25k
...Principal Ai And Ml Infra Software Engineer, Gpu Clusters We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA... ...What we need to see: ~ BS or similar background in Computer Science or related area (or equivalent experience). ~1...$262k - $365k
Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving... ...related concepts (language modeling, computer vision). Preferred... ...push technology forward. Applied AI builds conversational agents deployed...SeniorFull time$182k - $242k
CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave... ...to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave... .... Learn more at About the Role As a Senior Software Engineer within our Compute Architecture...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeRemote workFlexible hours- A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates...SeniorFull time
$230k - $250k
...Technical Staff in Sunnyvale, CA. This role involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a Master’s degree in Computer Science and experience with containerization tools like Docker and...Senior$212.8k
...Software Engineer - AI Agent Infra Location: San Jose Team: Technology Employment Type: Regular Job Code: A154953A Responsibilities... ...Minimum Qualifications - Bachelor's degree or above in Computer Science or a related field. - Proficiency in at least one...Temporary workLocal area$165k - $242k
...Senior Platform Engineer II, Compute Services Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators...SeniorPermanent employmentTemporary workCasual workWork at officeRemote workFlexible hours$207k - $307k
A leading tech company in Sunnyvale, CA is seeking a Software Engineer to lead the design and architecture of customer-facing systems. Applicants... ...in software development, focusing on distributed systems and AI/ML applications. You will drive project outcomes, implement...SeniorFull time- ...leading automotive firm in California is seeking a Senior ML Infrastructure Engineer to build and scale robust Compute platforms for Simulation workflows. This high-... ...will focus on scalability and driving efficiency in AI infrastructure. The ideal candidate must have 4+...Senior
- A leading technology firm is seeking an experienced AI/ML Research Lead in Milpitas, California. This role requires a PhD and significant experience in research focusing on analog in-memory computing and deep learning. Responsibilities include leading circuit research,...Senior
$153k - $222k
...the future of physical AI. Founded in 2017 and now... ...both infrastructure engineers with expertise in machine... ...to join the Data & ML infra group. This role will work... ..., training frameworks, compute, evaluation, and... ...degree in Computer Science, Software Engineering, or equivalent...SeniorFull timeFor contractorsFor subcontractorCasual workWork at officeRemote workDay shift$212.8k - $387.6k
...development services that enable engineers to deliver high-quality... ...systems enabling software development streamline... ...design and development infra experience to join our... ...: - Bachelor degree in computer science or a related... ...Preferred Qualifications: - AI applications...SeniorTemporary workLocal area- ...Software Infrastructure Engineer, Senior Staff At d-Matrix, we are focused on unleashing... ...the potential of generative AI to power the transformation... .... As part of the software Infra team, you will be... ...bring: Minimum: Computer Science, Engineering, Math...SeniorWork experience placementRemote work3 days per week
- A global technology leader is looking for an experienced SRE software engineer in Cupertino, California, to build and enhance compute infrastructure for Apple's services. The role involves developing AI-powered tooling, automating deployment, and ensuring that services...Senior
$165k - $242k
...Senior Software Engineer, Data Center Infrastructure Tooling CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers... ...breakthroughs and turn compute into capability. Founded... ...and operations, and other infra teams the ability to plan...SeniorTemporary workFlexible hours- Cadence in San Jose, California is seeking a skilled AI Systems Engineer to lead the development and support of AI infrastructure. The role... ...years of technical experience, focusing on high-performance computing or AI systems. The position offers a salary range of $136,50...Senior
$175k - $290k
...investment in ours. The Role: Software Infrastructure Engineer, Senior Staff The role requires... .... As part of the software Infra team, you will be... ...you will bring: Minimum: Computer Science, Engineering, Math... ...experience. Work experience at an AI compute/subsystem company....SeniorFull timeWork experience placementRemote work$156k - $387.6k
...Cloud Acceleration Engineer – DPU & AI Infra Location: San Jose Team: Infrastructure Employment... ...) team is building the foundational computing infrastructure for ByteDance and... ...development, and research of next-generation software-hardware technologies across compute,...Temporary workLocal area$170k - $240k
...reliably. We employ modern AI techniques to organize... ...Previously led the Stripe engineering team that launched Banking... ...for our Founding Platform / Infra Engineer – a strong software engineer first. You can design... ...our infrastructure — from compute and storage to networking...Contract workWork at officeRemote work$272k - $431.25k
NVIDIA Corporation seeks a Principal AI and ML Infra Software Engineer in Santa Clara, California, to enhance the efficiency of AI/ML research on... ...systems, programming, and a strong educational background in Computer Science. NVIDIA offers a competitive salary range of $27...$152k - $241.5k
...gaming, and high-performance computing. Our success depends on reliable... ...infrastructure. As an engineer on our team, you will play a... ...offers an outstanding mix of core software engineering, data management,... ...existing vacancy. NVIDIA uses AI tools in its recruiting...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, AI Infra Compute. Be the first to apply!
Related searches
- graduate software developer San Jose, CA
- rust software engineer San Jose, CA
- senior software design engineer San Jose, CA
- software engineer student San Jose, CA
- software engineer amazon San Jose, CA
- software developer positions San Jose, CA
- software engineer full time San Jose, CA
- software qa engineer San Jose, CA
- new graduate software engineer San Jose, CA
- junior software developer San Jose, CA

