Senior HPC Performance Engineer
$148k - $287.5kNVIDIA
NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver libraries like NCCL, NVSHMEM, UCX for Deep Learning and HPC. We are looking for a motivated Performance engineer to influence the roadmap of our communication libraries. The DL and HPC applications of today have a huge compute demand and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! This is an outstanding opportunity for someone with HPC and performance background to advance the state of the art in this space. Are you ready for to contribute to the development of innovative technologies and help realize NVIDIA's vision?
What you will be doing:
- Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.
- Study the interaction of our libraries with all HW (GPU, CPU, Networking) and SW components in the stack
- Evaluate proof-of-concepts, conduct trade-off analysis when multiple solutions are available
- Triage and root-cause performance issues reported by our customers
- Collect a lot of performance data; build tools and infrastructure to visualize and analyze the information
- Collaborate with a very dynamic team across multiple time zones
What we need to see:
- M.S. (or equivalent experience) or PHD in Computer Science, or related field with relevant performance engineering and HPC experience
- 3+ yrs of experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM)
- Experience conducting performance benchmarking and triage on large scale HPC clusters
- Good understanding of computer system architecture, HW-SW interactions and operating systems principles (aka systems software fundamentals)
- Implement micro-benchmarks in C/C++, read and modify the code base when required
- Ability to debug performance issues across the entire HW/SW stack. Proficient in a scripting language, preferably Python
- Familiar with containers, cloud provisioning and scheduling tools (Kubernetes, SLURM, Ansible, Docker)
- Adaptability and passion to learn new areas and tools. Flexibility to work and communicate effectively across different teams and timezones
Ways to stand out from the crowd:
- Practical experience with Infiniband/Ethernet networks in areas like RDMA, topologies, congestion control
- Experience debugging network issues in large scale deployments
- Familiarity with CUDA programming and/or GPUs
- Experience with Deep Learning Frameworks such PyTorch, TensorFlow
- ...proactivelyRemotely deploy and configure large-scale HPC clusters for AI workloads using... ...feed clear requirements back to other engineering teams on simplification, stability, and... ..., from GPU architectures to hardware performance optimizationStrong understanding of Linux...SeniorPerformanceWork at officeLocal areaRemote workFlexible hours
$184k - $287.5k
NVIDIA Math Libraries team is looking for a senior engineer to join our development efforts in the area of kernel generation for AI and HPC, specifically targeting matrix... ...designing, and implementing high quality and performance numerical dense linear algebra software...SeniorPerformanceFull timeRemote work$152k - $241.5k
...Artificial Intelligence, High-Performance Computing and Visualization.... ...intelligence. We’re looking for a Senior SRE to join our Compute Farm... ...they integrate cleanly with HPC schedulers, storage, and... ...or Ruby. ~ Mentored other engineers and influenced technical direction...SeniorPerformanceFull time$255k - $340k
...home day is currently Tuesday.Hardware Engineering at Lambda is responsible for building and... ...lead for integrating OEM and white-label HPC AI/ML, general purpose compute, storage,... ...and deployment, quality, compatibility, performance, and scalability of new systems.Serve as...SeniorPerformanceWork at officeLocal areaWork from homeFlexible hours$184k - $287.5k
...solutions to enable runs of demanding high performance computing, and computationally intensive... ...-gen distributed storage services for HPC workloads, optimizing both performance... ...degree in Computer Science, Electrical Engineering or related field or equivalent experience...SeniorPerformanceFull time$138k - $206k
...minimizing energy consumption and maximizing performance. To achieve this goal, we collaborate closely with both hardware and software engineers to identify and address the unique... ...cost-based compilation ~ Background in HPC, distributed systems, or NUMA-aware programming...SeniorPerformanceLive inWork at officeFlexible hours- ...Description Job Description Role: - Senior Site Reliability Engineer - AI platform services Location:... ...correlation. " Troubleshoot performance and availability issues affecting training... ..., ML infrastructure, or large-scale HPC-like service environments. "...SeniorPerformance
- ...Sales Engineer DDN powers the world's most demanding data workloadsfrom... ..., you'll architect high-performance storage solutions that enable... ...storage for AI/ML training, HPC simulations, data analytics,... ...Clear career progression: SE ? Senior SE ? Principal Architect...SeniorPerformanceInternshipFlexible hours
$175k - $231k
...years.About the TeamThe Thermal Engineering team's work is essential to... ...cycle and maintain the performance and reliability of advanced defense... ...the RoleWe are looking for a Senior Thermal Engineer in Costa... ...management of expeditionary AI/HPC data centers—air-transportable...SeniorPerformanceFull timeWork experience placementImmediate start$150k - $300k
...operations. Responsibilities • Monitor health, performance, and availability of large-scale GPU... ...'s degree in Computer Science, Computer Engineering, Software Engineering, Information... ...administration, SRE, DevOps, cloud operations, HPC, or infrastructure operations. •...PerformanceNight shift- ...General Information Job Title Senior Site Reliability Engineer, Unix Job ID 19554... ...environments and are comfortable investigating performance, availability, configuration,... ...to deepen your experience with HPC and grid computing environments, including...SeniorPerformanceWork at officeRemote workAfternoon shiftEarly shift
$168k - $258.75k
...scientists, researchers and engineers can advance their ideas. At its... ...can be. We are looking for a Senior Hardware System Validation... ...quality from both functional and performance perspectives. Designing... ...systems (e.g., Lustre) on AI/HPC Datacenter scale infrastructure...SeniorPerformanceFull time$152k - $241.5k
...at NVIDIA! We’re looking for an AI Developer Technology Engineer to push the limits of performance at the intersection of AI, high-performance computing,... ...experts to analyze, optimize, and scale complex AI and HPC workloads for modern CPU and GPU architectures. Profiling...SeniorPerformanceFull time$152k - $179k
...Job Description Job Description Senior DDR/LPDDR Memory Validation Engineer Location: Santa Clara, CA | Candidates must currently reside in California... ...of Edge AI, operating at the intersection of high-performance hardware and real-world software deployment....SeniorPerformanceFull time$184k - $287.5k
...looking for an experienced Compiler Optimization Engineer for an exciting role in our Compute Compiler... ...you enjoy. See your efforts in action as HPC and DL developers use features and optimizations to achieve the best performance of their applications. If this sounds like a...SeniorPerformanceFull time$168k - $264.5k
...on the world.NVIDIA is now looking for a Senior Signal Integrity Engineer to join our Packaging and Systems team!... ...speed interconnect solutions for demanding HPC and AI applications, where signal integrity is critical to performance, scale, and reliability!What you’ll be...SeniorPerformanceFull time$184k - $287.5k
...accelerated computing platform has revolutionized HPC and AI, and we have built the cuQuantum... .... This role will be part of an engineering team developing, scaling, and optimizing... ...you are passionate about developing high-performance software and want to help us build...SeniorPerformanceFull timeRemote work$133k - $173k
...reimagining how work gets done. Engineers define intent, author precise... ...your place here.Electrical Senior Engineer - Cables &... ...and executing test plans and performing hands-on laboratory validation... ...InfiniBand technologies, or AI/HPC networking environments is a...SeniorPerformance$213k - $237k
...About the role Muon Space is seeking a Senior FPGA Engineer specialized in onboard networking, cryptography and security to design... ...architecture of our next-generation spacecraft, to join our High Performance Compute (HPC) team. You'll define how data moves across the...SeniorPerformancePermanent employmentFull timeTemporary workWork at officeRemote workFlexible hoursNight shift3 days per week$184k - $287.5k
We are looking for software engineers to contribute to the design and development of libraries... ...for unstructured sparsity in DL and HPC. Around the world, leading commercial and... ...data centers powered by GPUs and high-performance linear algebra libraries. Applications of...SeniorPerformanceFull time- ..., we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-accelerated... ...EXPERIENCE:Background in GPU performance engineering, HPC, distributed systems, networking, operating systems, or...SeniorPerformance
$152k - $241.5k
We are looking for a Senior Software Engineer to join our team enabling CUDA Math Libraries on new and... ...and must deliver functionality and performance on every target.In this role, you will... ...maintenance, and performance optimization of HPC software using C++ and Python.Strong...SeniorPerformanceFull timeRemote work- ...Senior Manager, Sales Engineering AI / GPU Cloud (NeoCloud) Mirantis, an IREN company, is the Kubernetes... ...cluster, model the real TCO, prove performance, and de-risk a customer's move onto... ...preferred Experience selling GPU cloud, HPC, or specialized infrastructure...SeniorPerformance
- ...deployment of compute, network, and storage infrastructure for AI and HPC environments. Validate rack elevations, port maps, cable... ..., and physical connectivity before cluster handoff. Perform detailed cable validation across Ethernet, InfiniBand, management...SeniorPerformanceRemote job
$135k - $160k
...Description Job Description We are seeking a highly motivated Senior Analog Engineer to join our Analog Design team. In this role, you will be... ...design, simulation, verification, and development of high-performance analog and mixed-signal integrated circuits for automotive...SeniorPerformance- ...Senior Signal Integrity EngineerAt Nexthop AI, we are searching for an experienced Signal Integrity Engineer to own the high-speed channel design of our next-generation switch platforms... ...sign-off at design release, and link-performance debug through EVT and DVT.Set high-...SeniorPerformanceWork at office
$184k - $287.5k
NVIDIA is seeking a Senior Software Engineer to join our DSX team to build and operate the tooling that... ...measures real training and inference performance, and produces evidence customers and... ...ideally for large-scale compute, cloud, or HPC environments.Strong programming skills...SeniorPerformanceFull timeRemote work$180k - $301k
SI/PI Senior Engineer/ManagerCategoryProcess Technology DevelopmentLocationSan Jose, CAExperienceMore than... .... This role is critical in delivering high-performance solutions for consumer, automotive, datacenter and enterprise HPC products.The successful candidate will...SeniorPerformanceTemporary work$184k - $287.5k
...developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU,... ...looking for a motivated Deep Learning engineer to bring advanced communication... ...GPUDirect -- for scaling Deep Learning and HPC applications. Your customers will have diverse...SeniorPerformanceFull timeRemote work$224k - $356.5k
...best talent.NVIDIA is hiring a Senior Software Architect in the Agent Harness & Runtime Engineering team to build foundational... ...execution, data/ETL pipelines, HPC, cloud, Kubernetes, and GPU compute... ...for reliability, scalability, performance, resource utilization, and...SeniorPerformanceFull timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior HPC Performance Engineer. Be the first to apply!
- senior fpga design engineer Santa Clara, CA
- international tax senior Santa Clara, CA
- senior sales Santa Clara, CA
- senior director Santa Clara, CA
- senior network engineer remote Santa Clara, CA
- senior manager legal Santa Clara, CA
- senior manager engineering Santa Clara, CA
- senior account executive Santa Clara, CA
- senior staff systems engineer Santa Clara, CA
- senior electrical designer Santa Clara, CA





