Software Architect, GPU System
Full-time
ByteDance
Responsibilities
- Define the architecture and multi-year technical roadmap for GPU system software across driver, runtime, firmware-interface, management, observability, and reliability layers.
- Set technical priorities and standards for accelerator enablement, compatibility, performance, serviceability, and maintainability.
- Own end-to-end integration from architecture and pre-silicon planning through bring-up, qualification, general availability, fleet monitoring, and sustained operation.
- Lead cross-functional execution across silicon, firmware, kernel, compiler, library, machine-learning framework, server, network, storage, validation, and production teams.
- Resolve system-level tradeoffs involving APIs, resource management, memory and interconnect topology, telemetry, recovery, security, and workload performance.
- Contribute hands-on through prototypes, critical-path code, design reviews, performance analysis, and high-severity failure investigations.
- Define release and reliability criteria covering qualification, regressions, fault containment, automated repair, and fleet health.
- Mentor engineers and communicate technical decisions to specialist and executive audiences.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience.
- At least 5 years of hands-on experience in GPU, accelerator, kernel, firmware, runtime, or data-center system software.
- Technical leadership experience on complex hardware/software programs and demonstrated success leading a major program from concept through production.
- Deep understanding of accelerator architecture, memory hierarchy, interconnects, operating systems, device management, and production reliability.
- Experience coordinating dependencies and technical decisions across multiple engineering teams and organizational boundaries.
- Strong coding, design-review, performance-analysis, and system-debugging capabilities with continued hands-on contribution.
- Preferred experience with a major GPU computing stack and its kernel driver, runtime, libraries, tooling, and fleet-management interfaces.
- Preferred experience defining platform APIs or hardware/software contracts across multiple accelerator generations.
- Knowledge of distributed accelerator workloads, collective communication, topology-aware placement, and large-scale serviceability.
- Track record of mentoring senior engineers and building alignment amid conflicting priorities, ownership, or technical evidence.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Architect, GPU System in San Jose, CA vacancy
$152k - $241.5k
NVIDIA is seeking an innovative and highly motivated engineer with deep expertise in systems software to join our GPU Software team. In this role, you will help design and develop key components of our production GPU kernel drivers and embedded software, shaping products...SuggestedFull time$186.2k - $316.5k
...hands without us. KLA invents systems and solutions for the... ...brightest research scientists, software engineers, application development... ...exciting role you will design and architect next-generation High... ...hardware, networking, storage, GPU acceleration, virtualization,...SuggestedMinimum wageFull timeWork experience placementFlexible hours$152k - $241.5k
NVIDIA is seeking a motivated architect to work with a team in... ...edge silicon processes. This GPU memory architecture team creates... ...vehicles, AI, gaming, mobile systems. What you will be doing: Developing... ...which consider software interfaces to the GPU. Debugging...SuggestedFull timeWork experience placement$184k - $287.5k
...reinvented itself. Our invention of the GPU sparked the growth of the PC gaming market... ...NVIDIA GPUs excel.We are seeking a GPU System Architect who will architect and design multi-GPU... ...architecture experience, and practical hardware-software co-design expertise.What you will be...SuggestedFull timeWorldwide$224k - $356.5k
We are now looking for a GPU System Performance Architect:The NVIDIA Architecture group is looking for extraordinary computer architects with a real... ...and analyze the interactions between hardware and software in large-scale data center deployments of GPU-accelerated...SuggestedFull timeWork experience placement$184k - $287.5k
NVIDIA is searching for a highly motivated, creative engineer to join the GPU Software team. As a GPU/SOC system software engineer, you will work with a team of very dedicated software and hardware engineers involving a wide variety of technologies. As someone who is hardworking...Full time$184k - $287.5k
NVIDIA is seeking a Senior System SW Engineer with expertise in systems software, GPU drivers, embedded software, and platform security. You will provide technical... ...through production.What you’ll be doing:Architect, design, implement, and verify security and systems...Full time$152k - $241.5k
...to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving... ...creative and highly motivated engineer with expertise in boot software to join the SOC System Software organization. This position offers the...Full time$152k - $241.5k
...Performance Computing and Visualization. The GPU, our invention, serves as the visual... ...HPC clustersGood understanding of computer system architecture, HW-SW interactions and operating systems principles (aka systems software fundamentals)Implement micro-benchmarks in...Full time$184k - $287.5k
...era of computing. An era in which our GPU acts as the brains of computers, robots... ...for a dedicated engineer for the Senior Systems Software Engineer role, focusing on GPU Performance... ...compute, and systems specialists to architect, build, and optimize large-scale performance...Full timeRemote work$184k - $287.5k
As a Senior Software Architect in the GPU Networking Architecture team, you will define Software Defined Networking (SDN) architectural solutions... ...modern data center, such as distributed AI and deep learning systems, Networking Operating Systems, Virtualization, Storage,...Full time$224k - $356.5k
We are building innovative server systems for GPU accelerated applications, such as Deep Learning. Data Center SW team architects and develops the end to end software and firmware stack for these systems. We are looking for a Senior Software Architect who has deep expertise...Full timeRemote workShift work- ...Senior Systems Software Engineer – GPU Performance at Scale We are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing on GPU Performance at Scale. The position will drive innovation in AI and GPU computing. What You’ll Be Doing...
$186.2k - $273.07k
...inspection, metrology, and analytics systems detect and monitor defects... ...(MACH) division is KLA's software powerhouse, responsible for... ...exciting role you will design and architect next-generation High... ...hardware, networking, storage, GPU acceleration, virtualization,...Minimum wageWork experience placement- ...NVIDIA Corporation seeks a GPU System Architect to design multi-GPU scale-up and scale-out systems for AI and HPC datacenters. You will architect... ...-on system-level fabric experience with practical hardware-software co-design across compute, memory and communication layers,...
- ...NVIDIA Corporation is seeking a senior software architect and engineer to design and ship an Always-On GPU profiling service. You will lead architecture across system software, drivers, and CUDA, delivering low-overhead, scalable profiling for ML workloads. The role...
$320k
NVIDIA data center systems, such as DGX and HGX, have become core to NVIDIA... ...optimized NVIDIA AI and HPC software stack. We’re looking for a strong technical architect to own the end-to-end architecture... ...and Visualization. The GPU, our invention, serves as the visual...Full timeShift work- ...NVIDIA is seeking a Sr. Principal Systems Software Engineer in the Apache Spark Acceleration group. You will work on GPU-accelerated data processing and multi-node deployments to reduce costs and latency in ETL workloads. The role focuses on developing Java, Scala...
$124k - $195.5k
...bring together GPUs, CPUs, networking, systems, and software to solve some of the world’s most... ...System Software Engineer to join NVIDIA’s GPU Performance and Power Management Software... ...support.Collaborate with GPU architects and hardware designers to define and implement...Full timeInternship$224k - $356.5k
...bring together GPUs, CPUs, networking, systems, and software to solve some of the world’s most... ...System Software Engineer to join NVIDIA’s GPU Performance and Power Management Software team. You will be responsible for architecting production software for performance states...Full timeRemote work$152k - $241.5k
...computing. An era in which our GPU acts as the brains of... ...to become part of a dynamic software team with rigorous production... ...instrumentation requirements from GPU architects who research next-gen... ...:Experience with chip and/or system simulationStrong scripting skills#LI...Full time- ...NVIDIA Corporation in Santa Clara, CA, is seeking a Senior Systems Software Engineer for the Apache Spark Acceleration group to advance GPU-accelerated data processing in enterprise environments. You will enable native C++ execution of Spark operations on CUDA, develop...
$184.7k - $324.8k
...Sr Software Architect Perception Systems Cupertino, California, United States Machine Learning and AI Apple is where individual imaginations gather... ...ML workloads across heterogeneous compute (e.g., CPU, GPU, Neural Engine) with predictable latency. ~* Defining the...Relocation$152k - $241.5k
...legacy of innovation that’s fueled by great technology—and amazing people. NVIDIA is looking for an experienced Senior Software and System Architect to join our Networking Software Architecture group. Nvidia's Architecture group consists of world-class architects responsible...Full timeRemote work$124k - $195.5k
NVIDIA is looking for a passionate and dedicated SW & System Architect to join our SW Architecture group. The position includes researching new technologies with focus on architecture definition of groundbreaking technologies in different domains - networking, security...Full timeRemote work$224k - $356.5k
We are looking for a Senior System Software Architect to help build NVIDIA Halos, our full-stack safety platform for physical AI: autonomous vehicles, humanoids, industrial robots, and intelligent machines that sense, decide, and act in the real world. This role sits at...Full time- ...technology that moves the world forward.THE ROLE: We are building next-generation systems software for AMD GPUs with Rust as a core technical direction. The work spans compilers, runtimes, low-level GPU software, firmware, developer tooling, and methods for improving the...Local area
$272k - $431.25k
We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for GPU firmware and GPU system software, working directly with engineering teams of key CSP / hyperscale customers to ensure they can reliably manage, update,...Full timeRemote work$184k - $287.5k
...We are seeking software engineers to work on next-generation high-... ...high-speed IO applications a GPU or high-performance computing... ...collaborating closely with hardware architects, silicon designers, and... ...algorithms, a solid foundation of systems software with emphasis on OS...- ...experience. At least 5 years of hands-on Linux kernel or operating-system engineering experience with technical leadership and depth in... ...success setting technical direction for a major systems-software program and delivering it through multiple teams or product generations...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Architect, GPU System. Be the first to apply!
Related searches
- software architect San Jose, CA
- .net software architects (remote) San Jose, CA
- application architect San Jose, CA
- ultimate software San Jose, CA
- software qa San Jose, CA
- embedded software San Jose, CA
- software sales San Jose, CA
- bank software San Jose, CA
- software sales representative San Jose, CA
- software intern San Jose, CA



