Director, Rack Scale Software Architecture
$320kNVIDIA
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.NVIDIA has a rapidly expanding ecosystem of data center platform & node designs. From single node HGX/DGX systems all the way up to large multi-node NVLink domain rack architectures. These designs have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. Each bringing together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. We're searching for a highly technical, motivated manager to lead & manage the team responsible for rack-scale system software architecture. From firmware, kernel drivers, operating systems, networking, fabrics and associated user mode drivers + manageability software. You will work with component leads internally and engage with industry leading hyperscalar / cloud service providers on taking these products to market.What you’ll be doing:Drive the software end-to-end architecture for NVIDIA's rack-scale productsMaintain deep understanding of the product portfolio and roadmap; translate forward-looking plans into clear, formal software requirements that anchor execution across the organization.Ensure high quality & reliable software; serving as a trusted architectural partner to teams requiring guidance or oversight.Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap.Using strong communication skills, present the team vision to senior NVIDIA and external leaders.Provide technical leadership and career mentorship to the teamMake key technical decisions even when faced with ambiguityWhat we need to see:BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience.15+ overall years of experience in the area of System architecture and design with 8+ yrs of proven experience in managementDeep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface.Proven leadership skills and strong ownership on past projects involving a large scale sophisticated code basePrevious experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAsPossess strong managerial, problem solving and critical thinking skills.Comfortable operating in highly matrixed organizations while holding a leadership positionKnown for your strong interactive, verbal and written communications skillsWays to stand out from the crowd:Knowledge of large-scale cloud and cluster level deployment and management systems. Experience with designing robust, resilient and performant scale-up fabricsDemonstrated track record of leading data center products across the entire lifecycle, spanning inception, pre-silicon development, post-silicon bring-up, manufacturing, and deployment.Strong understanding of networking technology & protocols (e.g. Ethernet, Infiniband). Familiarity with CXL, UCIE and other C2C technology architectures. Knowledge in storage and networking technologies.We are widely considered to be one of the technology world’s most desirable employers, and as a result have some of the most forward-thinking and hardworking people in the world working for us. So if you're clever, creative, and driven, we'd love to have you join the team.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.You will also be eligible for equity and benefits.Applications for this job will be accepted at least until August 26, 2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa Clara; US, TX, Austin; US, Remote; US, NC, Durham; US, CO, BoulderType: Full time
$320k
...way up to large multi-node NVLink domain rack architectures. These designs have become core to... ...and a fully optimized NVIDIA AI and HPC software stack. We're searching for a highly motivated... ...-to-end architecture for NVIDIA's rack-scale productsMaintain deep understanding of...SoftwareFull timeShift work- ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-... ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high... ...bring-up.Influence future hardware/software co-design through ML model enablement and...Software
- ...times larger than GPUs. This architecture allows Cerebras to deliver industry... ..., to deploy 750 megawatts of scale, transforming key workloads... ...liquid cooling, high-density racks)Supply chain & long-lead... ...of hardware, real estate, and software scaling demands.Clear, structured...SoftwareContract workRemote work
- ...connectivity technologies. This Director-level role is... ...industry-leading scale-up and scale-out solutions... ...across silicon, firmware, software, platform engineering,... ...enable large-scale AI racks, accelerator clusters,... ...data center system architectures. You will lead a...Software
- ...and govern applications in any architecture, from on-premises to the public cloud. Our cloud, software, and hardware solutions enable... ...customers faster, reliably, and at scale. At F5, we believe our... ...AI Enterprise Firewall, Top-of-Rack hardware). Success in this role...SoftwareFull timeLocal areaFlexible hours
- ...partner companies HYPERLUME Software Engineering, IT, Sales & Business... ...the role We are seeking a Senior Director, AI Interface Architecture to own interconnection architecture linking XPUs across node, rack, and cluster scales so that large-scale LLM training and...Software
$272k - $431.25k
We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for rack-scale system SW/FW, working with CSP engineering teams to... ...to build shared understanding of the architecture, incorporate their operational feedback,...SoftwareFull timeRemote workShift work$272k - $431.25k
...on the world.At NVIDIA, as a Principal Rack Scale Systems Infrastructure Engineer, you will build and guide the development of software systems. These systems support our upcoming... ...Be Doing:Define the complete software architecture for rack-scale infrastructure products and...SoftwareFull timeRemote workShift work$168k - $258.75k
...the lifecycle of the latest AI systems at scale, from datacenter design and requirements... ...leaders across multiple hardware and software teams, helping us work together to build... ...NVIDIA engineers and develop reference architectures to advise customers and partners.What you...SoftwareFull timeRemote work$180k - $230k
...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-... ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high... ...own the schedule, implementation, and software integration of hardware changes. You will...Software$163k - $236k
...engineers, and setting the development pace for software systems and infrastructure.Drive project... ...new process improvements and facilitate scaling for program teams. Contribute to... ...Edge programs that include new NPIs, Edge architecture, and features/functions to deliver new...SoftwareTemporary workWorldwide$240k - $333k
...team operational visibility.Drive critical architecture decisions, proactively mitigate... ...development lifecycle.Experience leading software programs and technical initiatives across... ...record of driving operational excellence and scale across the complete software development...Software- ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-... ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high... ...CerebrasPeople who are serious about software make their own hardware. At Cerebras, we...Software
- ...foundational industries. Our architecture and approach is based... ...advantages for scale: photons don't feel heat... ...the algorithms and software needed to make these systems... ...real. Job Summary:The Director, Platform & System... ...specifications across form factor, rack design, connectivity,...SoftwareFull timeContract workLocal areaRemote workShift work
$207k - $300k
...Hill Climbing engines while upholding project-wide software and system design standards.Build and scale robust machine learning infrastructure and platforms... ...systems.Define and own the overarching testing architecture and reliability standards to guarantee high availability...Software$169k - $338k
...OfficeRole SummaryThe (USA) Director, Technical Program Management... ...resource optimization across large-scale initiatives. The Director... ...across system design, the software development lifecycle, cloud infrastructure, scalable architecture, and enterprise solutions.A track...SoftwareFull timeTemporary workPart time- ...highly skilled Technical Program Manager (TPM) to lead Training at Scale Programs for AMD Instinct products. In this role, you will... ...customers. PREFERRED EXPERIENCE: Deep understanding of AMD ROCm software stack and hands-on experience with AI training frameworks. Proven...Software
- ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-... ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high... ...CerebrasPeople who are serious about software make their own hardware. At Cerebras, we...Software
$219k - $351k
...a memory-bandwidth business. As models scale past what any single GPU can hold — KV caches... ...weights spill beyond HBM, and new architectures change the rules of what "model state" even... ...SSD tiers and Samsung Cognos, AI memory software that moves model state intelligently...SoftwareWork at officeRemote workFlexible hours$208k - $327.75k
...validate enterprise AI factory reference architectures. This role sits at the intersection of... ...computing, networking, storage, and AI software into repeatable blueprints that... ...HPC, or cloud-native infrastructure from rack-scale systems through full data center deployments...SoftwareFull time$2,500 per month
...frontier intelligence. We co-design chips, racks, software, and manufacturing to deliver best-in-... ...test development—from early architecture and test strategy through factory deployment... ...FATP partners to deploy, validate, and scale manufacturing test processes globally....SoftwareContract workWork at officeRelocation package$163k - $236k
...data center automation, infrastructure software, electrical/mechanical infrastructure (switchyards... ..., gensets), server hall infrastructure (rack power products, liquid cooling, ML... ...everything our users see online is the architecture built by the Technical Infrastructure...SoftwareInterim role$200k - $322k
...Group (SCG) sits at the intersection of architecture, silicon, systems, and manufacturing — where... ...drives real-world product outcomes at scale. We are hiring a Senior TPM who doesn't... ...risks across silicon, systems, and software, and they drive alignment across engineering...SoftwareFull time3 days per week- ...Company Recognized provider of enterprise software support services Industry... ...overseeing enterprise data governance and architecture. The successful candidate will be expected... ...aspect of the position is to evaluate and scale emerging technologies that support digital...Software
- ...highly visible technical leadership role, you will drive the architecture of complex rack-scale systems that power hyperscale and cloud computing... ...edge technologies spanning silicon, hardware, firmware, software, thermal, mechanical, power, and system-level design....Software
$275k - $310k
...market demand for geo-distributed, high-scale, high-performance workloads. Join the... ...precision-engineered, distributed, cloud-native architecture. Even better, it’s 100% open source.... ...in a $150M+ ARR enterprise B2B Software company. Industry Expertise: Deep understanding...SoftwareH1bWork at officeLocal areaVisa sponsorshipFlexible hours2 days per week3 days per week$278k - $325k
...is currently TuesdayBusiness Technology at Lambda builds and scales the internal systems that power our business. We partner across... ...side of the table.Technical Fluency: Fluent enough in systems architecture, integrations, and data flows to challenge a technical plan, spot...Contract workWork at officeLocal areaWork from homeFlexible hoursShift work- ...times larger than GPUs. This architecture allows Cerebras to deliver industry... ..., to deploy 750 megawatts of scale, transforming key workloads... ..., cabling vendors, and rack integrators to coordinate infrastructure... ...server firmware, switch software OS, and PDU firmwareStrong...Software
$163k - $253k
...Datacenter (DC), and AI-optimized storage architectures. As AI/ML workloads explode, storage has... ...translation layers (FTL), and hardware-software co-design engineered specifically to... ...Datacenter NVMe SSD Specifications and scale seamlessly within high-performance computing...SoftwareLocal areaFlexible hours- ...NVIDIA Corporation is seeking a Principal Rack Scale Systems Infrastructure Engineer in Santa Clara, California. In this role, you will define software architecture for rack-scale infrastructure products and mentor engineers while collaborating with hardware teams....Software
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Director, Rack Scale Software Architecture. Be the first to apply!
- senior applications manager Santa Clara, CA
- IT software development manager Santa Clara, CA
- software manager Santa Clara, CA
- senior software development manager Santa Clara, CA
- embedded software manager Santa Clara, CA
- application manager Santa Clara, CA
- director of software Santa Clara, CA
- application engineering manager Santa Clara, CA
- director software engineering Santa Clara, CA
- senior software manager Santa Clara, CA


