Principal Software Engineer, Rack-Scale System Software — CSP Engagements
$272k - $431.25kNVIDIA
## Principal Software Engineer, Rack-Scale System Software — CSP EngagementsApplylocations: US, CA, Santa Clara: US, TX, Austin: US, OR, Remote: US, CA, Remotetime type: Full timeposted on: Posted 2 Days Agojob requisition id: JR2020316We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for rack-scale system SW/FW, working with CSP engineering teams to ensure they can deploy, monitor, and operate these systems reliably at fleet scale. In this role, you will collaborate with NVIDIA's cross-functional rack-scale system SW/FW engineering teams with dedicated CSP-facing technical leadership. Your focus is on the system-level software that manages, monitors, and recovers the rack as a whole — fabric management, GPU/NVSwitch error handling and recovery, health telemetry APIs, firmware update orchestration, and SW-driven serviceability. You will drive work streams with CSP engineering teams to build shared understanding of the architecture, incorporate their operational feedback, and ensure integration readiness.**What you'll be doing:*** Drive rack-scale SW/FW architecture alignment across CSP engagements — including fabric management software, link health monitoring, GPU/NVSwitch error handling, SW/FW serviceability features (e.g., hot-plug support, component isolation, firmware-driven recovery), and multi-component firmware orchestration* Drive technical work streams with CSP engineering teams on rack-scale system software — ensuring they deeply understand fabric management, NVSwitch behavior, error handling and recovery policies, health telemetry APIs, and SW/FW-controlled recovery operation* Capture and synthesize CSP engineering feedback on rack-scale system software — health monitoring APIs, SW-driven serviceability workflows, firmware update orchestration, and error recovery behavior — champion that feedback into NVIDIA's architecture decisions* Collaborate with multi-functional teams to ensure customer operational requirements are reflected in system software and firmware development* Identify cross-CSP patterns in rack-scale SW/FW issues, error handling behavior, and system configuration practices — drive documentation, tooling, and test strategy improvements as a result* Collaborate with execution teams on left-shift strategy — ensuring customer-side SW/FW integration work is identified early and completed ahead of hardware availability* Make critical technical decisions on rack-scale system SW/FW tradeoffs and mitigate execution risks through early engagement with CSP engineering teams**What we need to see:*** 15+ years of experience in system software, platform firmware, or large-scale distributed systems engineering. BS or MS in Computer Science, Electrical Engineering, or related field (or equivalent experience)* Deep understanding of rack-scale system software challenges: multi-component coordination, error propagation, health monitoring, and serviceability / reliability* Experience with fabric management software, cluster management, or system-level orchestration frameworks. Familiarity with firmware architectures and update lifecycle management (multi-component update sequencing, rollback, recovery)* Understanding of error handling and recovery design patterns in distributed systems — fault isolation, retry policies, graceful degradation* Experience with health monitoring and telemetry systems: health scoring, event correlation, API design for fleet-level observability* Understanding of GPU or accelerator system software (drivers, device management, power management) is a strong plus* Customer obsession — genuine passion for understanding how CSPs operate sophisticated systems at fleet scale and simplifying their experience* Proven success providing technical leadership across organizational boundaries and influencing system software design without direct authority. Strong communication — ability to translate complex system software architecture into actionable mentorship for customer engineering teams**Ways to stand out from the crowd:*** Experience with NVIDIA NVSwitch, NVOS, or GPU fabric management software* Background in system software for large-scale clusters at a hyperscaler (cluster management, fleet orchestration, health platforms)* Experience crafting error handling and recovery frameworks for multi-component systems (hundreds or thousands of coordinating devices)* Familiarity with GPU or accelerator fleet operations — driver lifecycle, firmware rollout strategies, health-based scheduling* Understanding of how system software decisions impact serviceability, availability, and operational cost at fleet scaleNVIDIA’s invention of the GPU in 1999 fueled the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern deep learning — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and establish teams with the most thoughtful people in the world. Are you ready to change the next generation of computing? Join us at the forefront of technological advancement.NVIDIA data center systems, such as DGX and HGX, have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. These platforms bring together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 431,250 USD.You will also be eligible for equity and benefits.
#J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Principal Software Engineer, Rack-Scale System Software — CSP Engagements in Santa Clara, CA vacancy
$272k - $431.25k
We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for rack-scale system SW/FW, working with CSP engineering teams to ensure they can deploy, monitor, and operate these systems reliably at fleet scale. In this role...SuggestedFull timeRemote workShift work$272k - $431.25k
We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal... ...for GPU firmware and GPU system software, working directly... ...GPU firmware at fleet scale. You will drive work streams... ...multiple GPUs in a rack-scale systemUnderstanding...SuggestedFull timeRemote work$272k - $431.25k
We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for fleet-scale reliability, working directly... ...enables you to distinguish systemic architectural gaps from... ...expertise in multi-NUMA, rack-scale system software and...SuggestedFull time$272k - $431.25k
...lasting impact on the world.At NVIDIA, as a Principal Rack Scale Systems Infrastructure Engineer, you will build and guide the development of software systems. These systems support our... ...integration APIs for internal deployments and CSP environments.Bridge hardware and...SuggestedFull timeRemote workShift work$184k - $287.5k
NVIDIA is seeking a Senior Systems Software test (lead) Engineer to join our Cloud Service Provider (CSP) Engagements team, focusing on ML software stack validation for Datacenter... ...deep technical expertise from cluster to rack scale full-stack validation with customer-facing...SuggestedFull timeLocal area$184k - $287.5k
NVIDIA is seeking a Senior Software Engineer to join our CSP Engagements team, focusing on system software for Datacenter products such as GB200. This role combines deep... ..., and performance optimization for large-scale data center environments.Collaborate with AE, FAE...Full time- ...NVIDIA Gruppe is seeking a Principal Software Engineer for the CSP Engagements team in Santa Clara, California. The role involves being the technical focal point for rack-scale system software and firmware, ensuring reliable deployment and operation of complex systems...
$272k - $431.25k
NVIDIA is seeking a strategic and technically proficient Principal Software Engineer to join the Data Center Systems and Software CSP engagements team. As a leader and technologist, you will play a pivotal role contributing significantly to the architecture and development...Full timeShift work$184k - $287.5k
...developing advanced multi-rack, multi-tenant AI/ML... ...NVIDIA seeks a Senior Software Engineer for our CSP (Cloud Service Provider) Engagements team to focus on the cloud... ...record debugging large-scale, cloud-native stacks... ...experience in distributed systems (Go, Rust, C/C++ or...Full timeRemote work$220k - $280k
...NASDAQ: ALAB) provides rack-scale AI infrastructure... ...the company’s COSMOS software suite to unify diverse... ...into cohesive, flexible systems that deliver end-to-... ...— we need a senior engineering leader to build and scale... ...hands‑on technical engagement with OEM customers...Contract workFlexible hours$248k - $391k
...impact on the world.Join our team in Santa Clara to lead engineers building rack-scale infrastructure software that makes complex hardware manageable and... ...delivery of control planes, lifecycle orchestration, system health, and recovery capabilities, working across hardware...Full time- ...Technical Program Manager for the CSP Engagements team, focused on deep technical engagement... .... This role demands experience in systems and embedded software, leading datacenter software... ...and collaboration across multiple engineering teams, ensuring alignment on technical...
$168k - $258.75k
...Manager to join the CSP Engagements team, focused on... ...generation datacenter systems such as Vera Rubin... ...and embedded software leaders—including software engineering managers, technical... ...successful large‑scale deployment of NVIDIA... ...‑based server and rack‑scale platforms....Full time$272k - $431.25k
...clusters so that many accelerators feel like a single system at datacenter scale. As large language models rapidly outgrow the memory and... ...of cutting-edge LLM workloads.We are seeking a Principal Systems Engineer to define the vision and roadmap for memory management...Full timeLocal areaRemote work$136k - $218.5k
...customer-facing hardware engineers to work directly with Cloud Scale Providers (CSP’s) deploying next... ...centric Data Centers. The HW Systems Engineer is front-and-... ...and Vera Rubin NVL72 racks, at our largest customers... ...at the hardware, software and application level,...Full time$184k - $287.5k
NVIDIA is seeking a Senior Firmware Engineer to join our CSP Engagements team, focusing on system software for Datacenter products such as GB200. This role combines deep... ..., and performance optimization for large-scale data center environments.Collaborate with AE, FAE...Full time$184k - $287.5k
...cutting‑edge hardware and software innovation to deliver... ...of forward‑thinking engineers tackling some of the... ...searching for a Senior Systems Software Engineer with... ...technical problems at large scale and help shape how AI... ...GTC), while actively engaging with upstream groups (...Full timeRemote work$169.8k - $254.6k
...Technologies, Inc.Job Area:Engineering Group, Engineering... ...Qualcomm Data Center AI System Hardware and Validation... ...Engineering team develops rack-level AI inference... ...will partner with SoC, software/firmware, rack-level system... ...Qualcomm rack-scale designs within a matrixed...Work experience placementWork at officeWork from home$224k - $356.5k
...our diagnostic systems need to evolve... ...technical leader to engineer and propel... ...Service Provider (CSP) deployments,... ...involve hardware and software tools to... ...performance at scale across ODM and... ...communication skills to engage with technical... ...across rack-level or cluster...Full time- ...We are at the forefront of software and hardware innovation, pushing... ...for the company's server systems and rack-level product lines. Serves... ...Ecosystem (L10-L12)Design and scale the L10-L12 partner network... ...in Supply Chain, Business, Engineering, or related; 5+ years in demand...
- Qualcomm Technologies, Inc. seeks a System Hardware and Validation Technical Lead to drive rack-scale hardware and validation efforts for next-gen AI data center systems. You will partner with SoC, software/firmware, and rack-level design teams to plan, track, and execute...
$184k - $287.5k
...the world.We are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing on GPU Performance at Scale. At NVIDIA, this role is uniquely positioned... ...and develop new, leading solutions. Engage with HPC, OS, CPU, GPU compute, and systems...Full timeRemote work- ...Senior Systems Software Engineer – GPU Performance at Scale We are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing... ...for NVIDIA GPUs, CPUs, and networking hardware. Engage early with HW/FW/SW/platform internal and customer teams...
$131k - $175k
...artificial intelligence, and software-defined networking to... ...awards, such as Best Engineering Team, Best Company for... ...Work With As a Senior Rack Solution Engineer at Arista... ..., to deliver rack-scale solutions for the world... ...rack layouts and cabling systems, including fiber/copper...Remote workFlexible hours$170.5k - $315.49k
...Join a team building the software and platforms developers... ...deliver performance at scale.The Senior AI Developer Advocate for rack scale serves as the primary... .... Strong hands on engineering across Kubernetes and distributed... ...and customer sites.• Engage upstream in the...Full timeLocal areaImmediate startShift work- ...NVIDIA Corporation is looking for a Senior Software Engineer to join the CSP Engagements team in Santa Clara, California. This role involves designing and... ...C++ and Python are essential, along with a strong understanding of complex system architectures. #J-18808-Ljbffr...
- Google LLC in Sunnyvale, CA, is seeking a Staff Software Engineer for Google Cloud AI to help design and build large-scale distributed systems and AI-powered cloud services. The role emphasizes leadership across multi‑discipline teams and the ability to drive architecture...
- ...required to bring industry-leading scale-up and scale-out solutions to... ..., and high-performance AI/HPC systems.Working across silicon, firmware, software, platform engineering, validation, and ecosystem... ...technologies that enable large-scale AI racks, accelerator clusters, and...
- NVIDIA Corporation in Santa Clara, CA seeks a CSP HW Systems Engineer to work with cloud providers deploying next-generation AI data-center racks (Vera-Rubin, Grace-Blackwell). You will coordinate across architectures to optimize high-performance servers and lead cross-...
- ...Technical Program Manager to join their CSP Engagements team in Santa Clara, California. This role... ...NVIDIA’s next-generation datacenter systems. The ideal candidate will have a strong background in systems or embedded software, with at least 10 years of experience in...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Engineer, Rack-Scale System Software — CSP Engagements. Be the first to apply!
Related searches
- principal software engineer Santa Clara, CA
- senior principal software engineer Santa Clara, CA
- systems engineering technician Santa Clara, CA
- director systems engineering Santa Clara, CA
- senior windows systems engineer Santa Clara, CA
- system design engineer Santa Clara, CA
- ground systems engineer Santa Clara, CA
- system engineer contract Santa Clara, CA
- system performance engineer Santa Clara, CA
- software system engineer Santa Clara, CA


