Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior HPC Performance Engineer

$148k - $287.5k
Full-time

NVIDIA

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver libraries like NCCL, NVSHMEM, UCX for Deep Learning and HPC. We are looking for a motivated Performance engineer to influence the roadmap of our communication libraries. The DL and HPC applications of today have a huge compute demand and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! This is an outstanding opportunity for someone with HPC and performance background to advance the state of the art in this space. Are you ready for to contribute to the development of innovative technologies and help realize NVIDIA's vision?

What you will be doing:

  • Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.
  • Study the interaction of our libraries with all HW (GPU, CPU, Networking) and SW components in the stack
  • Evaluate proof-of-concepts, conduct trade-off analysis when multiple solutions are available
  • Triage and root-cause performance issues reported by our customers
  • Collect a lot of performance data; build tools and infrastructure to visualize and analyze the information
  • Collaborate with a very dynamic team across multiple time zones

What we need to see:

  • M.S. (or equivalent experience) or PHD in Computer Science, or related field with relevant performance engineering and HPC experience
  • 3+ yrs of experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM)
  • Experience conducting performance benchmarking and triage on large scale HPC clusters
  • Good understanding of computer system architecture, HW-SW interactions and operating systems principles (aka systems software fundamentals)
  • Implement micro-benchmarks in C/C++, read and modify the code base when required
  • Ability to debug performance issues across the entire HW/SW stack. Proficient in a scripting language, preferably Python
  • Familiar with containers, cloud provisioning and scheduling tools (Kubernetes, SLURM, Ansible, Docker)
  • Adaptability and passion to learn new areas and tools. Flexibility to work and communicate effectively across different teams and timezones

Ways to stand out from the crowd:

  • Practical experience with Infiniband/Ethernet networks in areas like RDMA, topologies, congestion control
  • Experience debugging network issues in large scale deployments
  • Familiarity with CUDA programming and/or GPUs
  • Experience with Deep Learning Frameworks such PyTorch, TensorFlow
The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. You will also be eligible for equity and [benefits]( NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior HPC Performance Engineer in Santa Clara, CA vacancy
  •  ...proactivelyRemotely deploy and configure large-scale HPC clusters for AI workloads using...  ...feed clear requirements back to other engineering teams on simplification, stability, and...  ..., from GPU architectures to hardware performance optimizationStrong understanding of Linux... 
    Senior
    Performance
    Work at office
    Local area
    Remote work
    Flexible hours

    Lambda Labs

    San Jose, CA
    3 days ago
  • $184k - $287.5k

    NVIDIA Math Libraries team is looking for a senior engineer to join our development efforts in the area of kernel generation for AI and HPC, specifically targeting matrix...  ...designing, and implementing high quality and performance numerical dense linear algebra software... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  • $152k - $241.5k

     ...Artificial Intelligence, High-Performance Computing and Visualization....  ...intelligence. We’re looking for a Senior SRE to join our Compute Farm...  ...they integrate cleanly with HPC schedulers, storage, and...  ...or Ruby. ~ Mentored other engineers and influenced technical direction... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    9 days ago
  • $255k - $340k

     ...home day is currently Tuesday.Hardware Engineering at Lambda is responsible for building and...  ...lead for integrating OEM and white-label HPC AI/ML, general purpose compute, storage,...  ...and deployment, quality, compatibility, performance, and scalability of new systems.Serve as... 
    Senior
    Performance
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda Labs

    San Jose, CA
    3 days ago
  • $184k - $287.5k

     ...solutions to enable runs of demanding high performance computing, and computationally intensive...  ...-gen distributed storage services for HPC workloads, optimizing both performance...  ...degree in Computer Science, Electrical Engineering or related field or equivalent experience... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $138k - $206k

     ...minimizing energy consumption and maximizing performance. To achieve this goal, we collaborate closely with both hardware and software engineers to identify and address the unique...  ...cost-based compilation ~ Background in HPC, distributed systems, or NUMA-aware programming... 
    Senior
    Performance
    Live in
    Work at office
    Flexible hours

    Samsung Semiconductor

    San Jose, CA
    18 days ago
  •  ...Description Job Description Role: - Senior Site Reliability Engineer - AI platform services Location:...  ...correlation. " Troubleshoot performance and availability issues affecting training...  ..., ML infrastructure, or large-scale HPC-like service environments. "... 
    Senior
    Performance

    Applab Systems Inc

    Santa Clara, CA
    21 days ago
  •  ...Sales Engineer DDN powers the world's most demanding data workloadsfrom...  ..., you'll architect high-performance storage solutions that enable...  ...storage for AI/ML training, HPC simulations, data analytics,...  ...Clear career progression: SE ? Senior SE ? Principal Architect... 
    Senior
    Performance
    Internship
    Flexible hours

    DDN Storage

    Santa Clara, CA
    1 day ago
  • $175k - $231k

     ...years.About the TeamThe Thermal Engineering team's work is essential to...  ...cycle and maintain the performance and reliability of advanced defense...  ...the RoleWe are looking for a Senior Thermal Engineer in Costa...  ...management of expeditionary AI/HPC data centers—air-transportable... 
    Senior
    Performance
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Mountain View, CA
    4 days ago
  • $150k - $300k

     ...operations. Responsibilities • Monitor health, performance, and availability of large-scale GPU...  ...'s degree in Computer Science, Computer Engineering, Software Engineering, Information...  ...administration, SRE, DevOps, cloud operations, HPC, or infrastructure operations. •... 
    Performance
    Night shift

    Institute of Foundation Models

    Sunnyvale, CA
    19 days ago
  •  ...General Information Job Title Senior Site Reliability Engineer, Unix Job ID 19554...  ...environments and are comfortable investigating performance, availability, configuration,...  ...to deepen your experience with HPC and grid computing environments, including... 
    Senior
    Performance
    Work at office
    Remote work
    Afternoon shift
    Early shift

    Synopsys, Inc.

    Sunnyvale, CA
    3 days ago
  • $168k - $258.75k

     ...scientists, researchers and engineers can advance their ideas. At its...  ...can be. We are looking for a Senior Hardware System Validation...  ...quality from both functional and performance perspectives. Designing...  ...systems (e.g., Lustre) on AI/HPC Datacenter scale infrastructure... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    10 days ago
  • $152k - $241.5k

     ...at NVIDIA! We’re looking for an AI Developer Technology Engineer to push the limits of performance at the intersection of AI, high-performance computing,...  ...experts to analyze, optimize, and scale complex AI and HPC workloads for modern CPU and GPU architectures. Profiling... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    9 days ago
  • $152k - $179k

     ...Job Description Job Description Senior DDR/LPDDR Memory Validation Engineer Location: Santa Clara, CA | Candidates must currently reside in California...  ...of Edge AI, operating at the intersection of high-performance hardware and real-world software deployment.... 
    Senior
    Performance
    Full time

    Certified Employment Group

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...looking for an experienced Compiler Optimization Engineer for an exciting role in our Compute Compiler...  ...you enjoy. See your efforts in action as HPC and DL developers use features and optimizations to achieve the best performance of their applications. If this sounds like a... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • $168k - $264.5k

     ...on the world.NVIDIA is now looking for a Senior Signal Integrity Engineer to join our Packaging and Systems team!...  ...speed interconnect solutions for demanding HPC and AI applications, where signal integrity is critical to performance, scale, and reliability!What you’ll be... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...accelerated computing platform has revolutionized HPC and AI, and we have built the cuQuantum...  .... This role will be part of an engineering team developing, scaling, and optimizing...  ...you are passionate about developing high-performance software and want to help us build... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $133k - $173k

     ...reimagining how work gets done. Engineers define intent, author precise...  ...your place here.Electrical Senior Engineer - Cables &...  ...and executing test plans and performing hands-on laboratory validation...  ...InfiniBand technologies, or AI/HPC networking environments is a... 
    Senior
    Performance

    Dell Technologies

    Santa Clara, CA
    17 hours ago
  • $213k - $237k

     ...About the role Muon Space is seeking a Senior FPGA Engineer specialized in onboard networking, cryptography and security to design...  ...architecture of our next-generation spacecraft, to join our High Performance Compute (HPC) team. You'll define how data moves across the... 
    Senior
    Performance
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    Night shift
    3 days per week

    Muon Space

    San Jose, CA
    4 days ago
  • $184k - $287.5k

    We are looking for software engineers to contribute to the design and development of libraries...  ...for unstructured sparsity in DL and HPC. Around the world, leading commercial and...  ...data centers powered by GPUs and high-performance linear algebra libraries. Applications of... 
    Senior
    Performance
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ..., we advance your career. THE ROLE:We are looking for a Senior GPU Inference Performance Engineer to own end-to-end performance analysis of GPU-accelerated...  ...EXPERIENCE:Background in GPU performance engineering, HPC, distributed systems, networking, operating systems, or... 
    Senior
    Performance

    AMD

    Santa Clara, CA
    5 days ago
  • $152k - $241.5k

    We are looking for a Senior Software Engineer to join our team enabling CUDA Math Libraries on new and...  ...and must deliver functionality and performance on every target.In this role, you will...  ...maintenance, and performance optimization of HPC software using C++ and Python.Strong... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...Senior Manager, Sales Engineering AI / GPU Cloud (NeoCloud) Mirantis, an IREN company, is the Kubernetes...  ...cluster, model the real TCO, prove performance, and de-risk a customer's move onto...  ...preferred Experience selling GPU cloud, HPC, or specialized infrastructure... 
    Senior
    Performance

    Mirantis

    San Jose, CA
    2 days ago
  •  ...deployment of compute, network, and storage infrastructure for AI and HPC environments. Validate rack elevations, port maps, cable...  ..., and physical connectivity before cluster handoff. Perform detailed cable validation across Ethernet, InfiniBand, management... 
    Senior
    Performance
    Remote job

    Vailexa

    Santa Clara, CA
    20 hours ago
  • $135k - $160k

     ...Description Job Description We are seeking a highly motivated Senior Analog Engineer to join our Analog Design team. In this role, you will be...  ...design, simulation, verification, and development of high-performance analog and mixed-signal integrated circuits for automotive... 
    Senior
    Performance

    Renesas Electronics

    San Jose, CA
    9 days ago
  •  ...Senior Signal Integrity EngineerAt Nexthop AI, we are searching for an experienced Signal Integrity Engineer to own the high-speed channel design of our next-generation switch platforms...  ...sign-off at design release, and link-performance debug through EVT and DVT.Set high-... 
    Senior
    Performance
    Work at office

    Nexthop AI

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

    NVIDIA is seeking a Senior Software Engineer to join our DSX team to build and operate the tooling that...  ...measures real training and inference performance, and produces evidence customers and...  ...ideally for large-scale compute, cloud, or HPC environments.Strong programming skills... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $180k - $301k

    SI/PI Senior Engineer/ManagerCategoryProcess Technology DevelopmentLocationSan Jose, CAExperienceMore than...  .... This role is critical in delivering high-performance solutions for consumer, automotive, datacenter and enterprise HPC products.The successful candidate will... 
    Senior
    Performance
    Temporary work

    MediaTek

    San Jose, CA
    3 days ago
  • $184k - $287.5k

     ...developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU,...  ...looking for a motivated Deep Learning engineer to bring advanced communication...  ...GPUDirect -- for scaling Deep Learning and HPC applications. Your customers will have diverse... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  • $224k - $356.5k

     ...best talent.NVIDIA is hiring a Senior Software Architect in the Agent Harness & Runtime Engineering team to build foundational...  ...execution, data/ETL pipelines, HPC, cloud, Kubernetes, and GPU compute...  ...for reliability, scalability, performance, resource utilization, and... 
    Senior
    Performance
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior HPC Performance Engineer. Be the first to apply!