Distinguished Software Architect - Deep Learning and HPC Communications

We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver communication libraries like NCCL, NVSHMEM, and UCX for Deep Learning and HPC. We are looking for a Distinguished Software Architect to help co‑design our next generation data center platforms. Data‑center scale GPU clusters rely on high‑speed interconnects (NVLink, PCIe) and networking (Infiniband, Ethernet). Efficient communication between GPUs directly impacts end‑to‑end application performance. What You Will Be Doing Research new communication technologies (e.g., expand the GPUDirect technology portfolio) and design new features for our communication libraries Propose innovative solutions in hardware and software for our next‑gen platforms, co‑designing with GPU, Networking, and SW architects to ensure seamless integration with software stacks Inspire changes based on quantitative data from proof‑of‑concepts or detailed technical analysis/modeling Drive the adoption of new communication technologies across application verticals Keep up with the latest DL research and collaborate with diverse teams, including DL researchers and customers What We Need To See PHD in Computer Science, Computer Engineering, or a related field, or strong equivalent experience; 15+ years of relevant experience in academia or industry Expertise in HPC, parallel programming models (MPI, SHMEM), at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC), computer and system architecture, GPU architecture, and CUDA Deep understanding of high‑performance networking: Infiniband, Ethernet, network design, topologies, debug, and performance analysis Strong knowledge of ML/DL fundamentals and how they tie to communications, parallel algorithms, fault tolerance, resiliency, performance analysis, and optimizations for large‑cluster parallel applications; experience developing applications using DL frameworks (PyTorch, TensorFlow) Programming fluency with C or C++ for systems software development Flexibility to work and communicate effectively across different HW/SW teams and time zones Ways To Stand Out From The Crowd Industry‑recognized leadership in HPC/DL communications with a history of patents, publications, conference talks, and keynotes relevant to this role Influential role in industry standards (e.g., MPI, OpenSHMEM) and open‑source software (e.g., PyTorch, UCX, Open MPI) Compensation and Benefits Your base salary range is USD 320,000–488,750, depending on location, experience, and comparable positions. You will also be eligible for equity and benefits. Applications will be accepted until June 16, 2026. Equal Opportunity Employer NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. We do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. #J-18808-Ljbffr NVIDIA AI