Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, AI Infra Compute

$212.8k - $387.6k

ByteDance

Responsibilitie

About the team: Compute division focuses on building large-scale and highly available cloud infrastructure, which supports both public cloud products (like VolcEngine ECS service) and ByteDance internal products. Compute-US team focuses on the development and research of ByteDance compute infrastructure platform. Responsibilities - Design and implement prototypes of key technologies or products. - Design and implement core feature improvements. - Research and follow trends from industry companies, open-source communities and academia. - Review design and implementation and ensure it is aligned with long term vision and roadmap.

Qualification

Minimum Qualifications 1. BS or above degree in Computer Science or related technical field or equivalent practical experience. 2. 3 years experience as a senior development engineer. 3. 3 years experience of building large-scale cloud infrastructure. 4. Good communication, self-motivation, engineering practice, and working collaboratively in cross-functional teams. 5. Deep understanding of cloud infrastructure or AI infrastructure. 6. Familiar with at least one of the areas below: GPU Infra (GPU cluster management, job scheduling, collective communication libraries, etc; Machine learning frameworks and engines, like training frameworks, Inference engines (vLLM, SGLang, etc), Server hardware platform technologies (next-gen CPU, DPU, GPU, CXL, etc.) Preferred Qualifications 1. Experience of building industry-leading public-cloud platforms such as AWS/Azure/GCP. 2. Experience of academic publications.

Job Information

[For Pay Transparency]Compensation Description (Annually)

The base salary range for this position in the selected city is $212800 - $387600 annually.


Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.


Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).


The Company reserves the right to modify or change these benefits programs at any time, with or without notice.


For Los Angeles County (unincorporated) Candidates:


Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:


1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;


2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and


3. Exercising sound judgment.

About U

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.


As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.


Diversity & Inclusion


ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, AI Infra Compute in San Jose, CA vacancy
  • Advanced Micro Devices is seeking a Senior Cloud Engineer in San Jose, CA. This role involves providing technical support for AMD’s cloud infrastructure...  ...collaborating across global teams. A Bachelor's degree in Computer Science is required. This position offers a vibrant and... 
    Senior

    Advanced Micro Devices

    San Jose, CA
    4 days ago
  • $152k - $241.5k

     ...NVIDIA has been transforming computer graphics, PC gaming, and accelerated...  ...the unlimited potential of AI to define the next era of...  ...container, GPU, and systems engineers. When useful, you will apply...  .../prediction) inside existing software workflows. What we need to... 
    Senior
    Remote work

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $181.1k - $318.4k

     ...Senior Software Engineer - Compute People at Apple don't just build products — they craft the kind of experience that has revolutionized entire industries...  ...offers unique opportunities to solve problems through AI-assisted automation, including building and leveraging AI... 
    Senior
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $184k - $287.5k

    NVIDIA Corporation is looking for a Senior System Software Engineer focusing on DevOps and Infrastructure Automation in Santa Clara, California. Candidates...  ...and CI/CD tools. The role involves designing and managing AI infrastructure, with a focus on reliability, performance,... 
    Senior
    Remote job

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...foundation models (GR00T), and compute, we strive to bring general...  ...hand-in-hand across multiple engineering and research teams to enable...  ...PyTorch) and proficiency in modern software development practices (...  ...fields. Publications in top‑tier AI conferences or contributions... 
    Senior

    NLP PEOPLE

    Santa Clara, CA
    5 days ago
  • $156k - $387.6k

     ...Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling) Location: San Jose Team: Infrastructure Employment Type: Regular...  ...of online containers and offline jobs daily, including AI and LLM workloads. The team is dedicated to building cutting... 
    Senior
    Temporary work
    Local area
    Overseas

    ByteDance

    San Jose, CA
    4 days ago
  • $166k - $244k

    Senior Software Engineer, AI/ML GenAI, Google Cloud Compute Infrastructure Google Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent practical experience. 5 years of experience programming in Python or C++. 3 years of experience with ML infrastructure (e.g., model... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    2 days ago
  • $174k - $255k

    Senior Software Engineer, Networking Switch Infra corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor’s degree or equivalent practical experience...  ...distributed systems or networks, or experience with compute technologies, storage or hardware architecture. Experience... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    2 days ago
  • $170.6k - $261.3k

     ...team: The AV ML Infra team at GM builds...  ...unique demands of AI and ML innovation,...  ...productivity of ML engineers, and drive the...  ...pipelines. ML Compute: Streamlines andoptimizeslarge...  ...: As a Senior AI/ML Full-...  ...build end-to-end software products , owning... 
    Senior
    Local area
    Work from home
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $272k - $431.25k

     ...Principal Ai And Ml Infra Software Engineer, Gpu Clusters We are seeking a Principal AI and ML Infra Software Engineer, GPU Clusters at NVIDIA...  ...What we need to see: ~ BS or similar background in Computer Science or related area (or equivalent experience). ~1... 

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $262k - $365k

    Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving...  ...related concepts (language modeling, computer vision). Preferred...  ...push technology forward. Applied AI builds conversational agents deployed... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    5 days ago
  • $182k - $242k

    CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave...  .... Learn more at About the Role As a Senior Software Engineer within our Compute Architecture... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    4 days ago
  • A leading technology company in California is looking for a Senior Software Engineer to develop cutting-edge AI and ML solutions. Responsibilities include writing and testing code, collaborating through design and code reviews, and contributing to documentation. Candidates... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    3 days ago
  • $230k - $250k

     ...Technical Staff in Sunnyvale, CA. This role involves designing resilient software features for cloud-based AI inference, leveraging AWS tools and services. Candidates should have a Master’s degree in Computer Science and experience with containerization tools like Docker and... 
    Senior

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $212.8k

     ...Software Engineer - AI Agent Infra Location: San Jose Team: Technology Employment Type: Regular Job Code: A154953A Responsibilities...  ...Minimum Qualifications - Bachelor's degree or above in Computer Science or a related field. - Proficiency in at least one... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    5 days ago
  • $165k - $242k

     ...Senior Platform Engineer II, Compute Services Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators... 
    Senior
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    1 day ago
  • $207k - $307k

    A leading tech company in Sunnyvale, CA is seeking a Software Engineer to lead the design and architecture of customer-facing systems. Applicants...  ...in software development, focusing on distributed systems and AI/ML applications. You will drive project outcomes, implement... 
    Senior
    Full time

    Google Inc.

    Sunnyvale, CA
    2 days ago
  •  ...leading automotive firm in California is seeking a Senior ML Infrastructure Engineer to build and scale robust Compute platforms for Simulation workflows. This high-...  ...will focus on scalability and driving efficiency in AI infrastructure. The ideal candidate must have 4+... 
    Senior

    General Motors

    Sunnyvale, CA
    4 days ago
  • A leading technology firm is seeking an experienced AI/ML Research Lead in Milpitas, California. This role requires a PhD and significant experience in research focusing on analog in-memory computing and deep learning. Responsibilities include leading circuit research,... 
    Senior

    Hewlett Packard Enterprise Development LP

    Milpitas, CA
    4 days ago
  • $153k - $222k

     ...the future of physical AI. Founded in 2017 and now...  ...both infrastructure engineers with expertise in machine...  ...to join the Data & ML infra group. This role will work...  ..., training frameworks, compute, evaluation, and...  ...degree in Computer Science, Software Engineering, or equivalent... 
    Senior
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    4 days ago
  • $212.8k - $387.6k

     ...development services that enable engineers to deliver high-quality...  ...systems enabling software development streamline...  ...design and development infra experience to join our...  ...: - Bachelor degree in computer science or a related...  ...Preferred Qualifications: - AI applications... 
    Senior
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    4 days ago
  •  ...Software Infrastructure Engineer, Senior Staff At d-Matrix, we are focused on unleashing...  ...the potential of generative AI to power the transformation...  .... As part of the software Infra team, you will be...  ...bring: Minimum: Computer Science, Engineering, Math... 
    Senior
    Work experience placement
    Remote work
    3 days per week

    d-Matrix

    Santa Clara, CA
    5 days ago
  • A global technology leader is looking for an experienced SRE software engineer in Cupertino, California, to build and enhance compute infrastructure for Apple's services. The role involves developing AI-powered tooling, automating deployment, and ensuring that services... 
    Senior

    Apple Inc.

    Cupertino, CA
    3 days ago
  • $165k - $242k

     ...Senior Software Engineer, Data Center Infrastructure Tooling CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers...  ...breakthroughs and turn compute into capability. Founded...  ...and operations, and other infra teams the ability to plan... 
    Senior
    Temporary work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    1 day ago
  • Cadence in San Jose, California is seeking a skilled AI Systems Engineer to lead the development and support of AI infrastructure. The role...  ...years of technical experience, focusing on high-performance computing or AI systems. The position offers a salary range of $136,50... 
    Senior

    Cadence

    San Jose, CA
    4 days ago
  • $175k - $290k

     ...investment in ours. The Role: Software Infrastructure Engineer, Senior Staff The role requires...  .... As part of the software Infra team, you will be...  ...you will bring: Minimum: Computer Science, Engineering, Math...  ...experience. Work experience at an AI compute/subsystem company.... 
    Senior
    Full time
    Work experience placement
    Remote work

    MixMode

    Santa Clara, CA
    4 days ago
  • $156k - $387.6k

     ...Cloud Acceleration Engineer – DPU & AI Infra Location: San Jose Team: Infrastructure Employment...  ...) team is building the foundational computing infrastructure for ByteDance and...  ...development, and research of next-generation software-hardware technologies across compute,... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    4 days ago
  • $170k - $240k

     ...reliably. We employ modern AI techniques to organize...  ...Previously led the Stripe engineering team that launched Banking...  ...for our Founding Platform / Infra Engineer – a strong software engineer first. You can design...  ...our infrastructure — from compute and storage to networking... 
    Contract work
    Work at office
    Remote work

    GrabJobs

    San Jose, CA
    2 days ago
  • $272k - $431.25k

    NVIDIA Corporation seeks a Principal AI and ML Infra Software Engineer in Santa Clara, California, to enhance the efficiency of AI/ML research on...  ...systems, programming, and a strong educational background in Computer Science. NVIDIA offers a competitive salary range of $27... 

    NVIDIA Corporation

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...gaming, and high-performance computing. Our success depends on reliable...  ...infrastructure. As an engineer on our team, you will play a...  ...offers an outstanding mix of core software engineering, data management,...  ...existing vacancy.  NVIDIA uses AI tools in its recruiting... 
    Senior

    NVIDIA

    Santa Clara, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, AI Infra Compute. Be the first to apply!