Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Director, Rack Scale Software Architecture

$320k

NVIDIA

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.NVIDIA has a rapidly expanding ecosystem of data center platform & node designs. From single node HGX/DGX systems all the way up to large multi-node NVLink domain rack architectures. These designs have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. Each bringing together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. We're searching for a highly technical, motivated manager to lead & manage the team responsible for rack-scale system software architecture. From firmware, kernel drivers, operating systems, networking, fabrics and associated user mode drivers + manageability software. You will work with component leads internally and engage with industry leading hyperscalar / cloud service providers on taking these products to market.What you’ll be doing:Drive the software end-to-end architecture for NVIDIA's rack-scale productsMaintain deep understanding of the product portfolio and roadmap; translate forward-looking plans into clear, formal software requirements that anchor execution across the organization.Ensure high quality & reliable software; serving as a trusted architectural partner to teams requiring guidance or oversight.Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap.Using strong communication skills, present the team vision to senior NVIDIA and external leaders.Provide technical leadership and career mentorship to the teamMake key technical decisions even when faced with ambiguityWhat we need to see:BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience.15+ overall years of experience in the area of System architecture and design with 8+ yrs of proven experience in managementDeep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface.Proven leadership skills and strong ownership on past projects involving a large scale sophisticated code basePrevious experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAsPossess strong managerial, problem solving and critical thinking skills.Comfortable operating in highly matrixed organizations while holding a leadership positionKnown for your strong interactive, verbal and written communications skillsWays to stand out from the crowd:Knowledge of large-scale cloud and cluster level deployment and management systems. Experience with designing robust, resilient and performant scale-up fabricsDemonstrated track record of leading data center products across the entire lifecycle, spanning inception, pre-silicon development, post-silicon bring-up, manufacturing, and deployment.Strong understanding of networking technology & protocols (e.g. Ethernet, Infiniband). Familiarity with CXL, UCIE and other C2C technology architectures. Knowledge in storage and networking technologies.We are widely considered to be one of the technology world’s most desirable employers, and as a result have some of the most forward-thinking and hardworking people in the world working for us. So if you're clever, creative, and driven, we'd love to have you join the team.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.You will also be eligible for equity and benefits.Applications for this job will be accepted at least until August 4, 2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa Clara; US, TX, Austin; US, Remote; US, NC, Durham; US, CO, BoulderType: Full time

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Director, Rack Scale Software Architecture in Santa Clara, CA vacancy
  • $320k

     ...way up to large multi-node NVLink domain rack architectures. These designs have become core to...  ...and a fully optimized NVIDIA AI and HPC software stack. We're searching for a highly motivated...  ...-to-end architecture for NVIDIA's rack-scale productsMaintain deep understanding of... 
    Software
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...times larger than GPUs. This architecture allows Cerebras to deliver industry...  ..., to deploy 750 megawatts of scale, transforming key workloads...  ...liquid cooling, high-density racks)Supply chain & long-lead...  ...of hardware, real estate, and software scaling demands.Clear, structured... 
    Software
    Contract work
    Remote work

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  •  ...connectivity technologies. This Director-level role is...  ...industry-leading scale-up and scale-out solutions...  ...across silicon, firmware, software, platform engineering,...  ...enable large-scale AI racks, accelerator clusters,...  ...data center system architectures. You will lead a... 
    Software

    AMD

    San Jose, CA
    4 days ago
  • $200k - $250k

     ...Labs (NASDAQ: ALAB) provides rack-scale AI infrastructure through...  ...technologies with the company’s COSMOS software suite to unify diverse...  ...to deploy tailored architectures to meet their unique infrastructure...  ...seeking a Global Benefits Director to join our People team in San... 
    Software
    Local area
    Flexible hours

    Asteralabs

    San Jose, CA
    3 days ago
  • $272k - $431.25k

    We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for rack-scale system SW/FW, working with CSP engineering teams to...  ...to build shared understanding of the architecture, incorporate their operational feedback,... 
    Software
    Full time
    Remote work
    Shift work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $208k - $333.5k

     ...productivity of thousands of NVIDIA's software engineers worldwide. The cloud hosts a...  ...product roadmaps and requirements primarily Rack Scale AI Products.Finding Optimum Solutions...  ...systems, data centers and cloud architecture, as well as excellent communication and... 
    Software
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

     ...on the world.At NVIDIA, as a Principal Rack Scale Systems Infrastructure Engineer, you will build and guide the development of software systems. These systems support our upcoming...  ...Be Doing:Define the complete software architecture for rack-scale infrastructure products and... 
    Software
    Full time
    Remote work
    Shift work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $180k - $230k

     ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high...  ...own the schedule, implementation, and software integration of hardware changes. You will... 
    Software

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $133.2k - $185k

     ...Astera Labs (NASDAQ: ALAB) provides rack-scale AI infrastructure through purpose-built connectivity...  ...technologies with the company’s COSMOS software suite to unify diverse components into...  ...enabling customers to deploy tailored architectures to meet their unique infrastructure... 
    Software
    Full time
    Local area
    Flexible hours

    Astera Labs

    San Jose, CA
    13 hours ago
  • $168k - $258.75k

     ...the lifecycle of the latest AI systems at scale, from datacenter design and requirements...  ...leaders across multiple hardware and software teams, helping us work together to build...  ...NVIDIA engineers and develop reference architectures to advise customers and partners.What you... 
    Software
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $160k - $200k

     ...Astera Labs (NASDAQ: ALAB) provides rack‑scale AI infrastructure through purpose‑built connectivity...  ...technologies with the company’s COSMOS software suite to unify diverse components into...  ...enabling customers to deploy tailored architectures to meet their unique infrastructure... 
    Software
    Flexible hours
    Shift work

    Astera Labs

    San Jose, CA
    1 day ago
  • $120k - $275k

     ...silicon to systems including hardware and software to train and run the largest ML...  ...are looking for a Senior Platform TPM, Rack-Scale AI Systems to drive design-phase execution...  ...cross‑functional execution across rack architecture, accelerator board design, power delivery... 
    Software
    Full time
    Contract work
    Work experience placement
    Local area
    Remote work
    Monday to Friday
    Flexible hours

    Jobr

    Mountain View, CA
    5 days ago
  • $192k - $278k

     ...submitting CLs, diving into technical details/architecture, and supporting product areas demand for...  ...-challenging projects.Experience in software development or programming. Should be...  ...of an on-demand computing environment at scales the world has not yet seen. Beyond solid... 
    Software

    Google

    Sunnyvale, CA
    3 days ago
  •  ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high...  ...CerebrasPeople who are serious about software make their own hardware. At Cerebras, we... 
    Software

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $180k - $250k

     ...Labs (NASDAQ: ALAB) provides rack-scale AI infrastructure through...  ...technologies with the company’s COSMOS software suite to unify diverse...  ...to deploy tailored architectures to meet their unique infrastructure...  ...Astera Labs is seeking a Director of Product Marketing to lead... 
    Software
    Worldwide
    Flexible hours

    jobr.pro

    San Jose, CA
    3 days ago
  •  ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high...  ...CerebrasPeople who are serious about software make their own hardware. At Cerebras, we... 
    Software

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  •  ...highly skilled Technical Program Manager (TPM) to lead Training at Scale Programs for AMD Instinct products. In this role, you will...  ...customers. PREFERRED EXPERIENCE: Deep understanding of AMD ROCm software stack and hands-on experience with AI training frameworks. Proven... 
    Software

    AMD

    San Jose, CA
    3 days ago
  •  ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high...  ...CerebrasPeople who are serious about software make their own hardware. At Cerebras, we... 
    Software

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $208k - $327.75k

     ...validate enterprise AI factory reference architectures. This role sits at the intersection of...  ...computing, networking, storage, and AI software into repeatable blueprints that...  ...HPC, or cloud-native infrastructure from rack-scale systems through full data center deployments... 
    Software
    Full time

    Nvidia

    Santa Clara, CA
    9 hours ago
  •  ...of technology. We are at the forefront of software and hardware innovation, pushing the...  ...planning for the company's server systems and rack-level product lines. Serves as the...  ...ResponsibilitiesSupply Chain Ecosystem (L10-L12)• Design and scale the L10-L12 partner network (CMs, ODMs,... 
    Software

    d-Matrix

    Santa Clara, CA
    9 hours ago
  • $168k - $258.75k

     ...Group (SCG) sits at the intersection of architecture, silicon, systems, and manufacturing — where...  ...drives real-world product outcomes at scale. This is not a coordination role. It is...  ...layer across silicon, systems, software, operations, and product. Catch misalignments... 
    Software
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...are looking for highly motivated Senior Software Engineers to join our Fabric Networking team with a targeted focus on NVLink Rack-Scale Systems Stability & Reliability. In this...  ...production environments.Collaborate with architecture, hardware, firmware, software, and... 
    Software
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $211k - $286k

     ...support Go To Market strategy Vehicle EE Architecture trend definition for next 1 and 2...  ...Major Tier-1s Understand about the SDV(Software define Vehicle ) and EE architecture trend...  ...Over-the-Air (OTA) updates and feature scaling. Safety & Security Integration: Ensure all... 
    Software
    Temporary work
    Work experience placement

    MediaTek

    San Jose, CA
    4 days ago
  • $164.5k - $305.5k

     ...world of technology. Cadence InfoSec is seeking a Director of Software Security to lead the strategy, architecture, and execution of secure software development...  ...management, identity, and access controls Build and scale AppSec program across all product lines Define... 
    Software
    Shift work

    Cadence Design Systems

    San Jose, CA
    3 days ago
  • $100k

     ...solutions must evolve to unify innovations in software models, compilers, platforms, networking...  ...role owns the technical strategy and architecture behind Tenstorrent’s core business...  ...work.Motivated by building systems that scale cleanly and stay reliable under change.What... 
    Software
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    4 days ago
  • $240k

     ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high...  ...automated test frameworks and execute software validation using Python, Java, and Selenium... 
    Software

    Cerebras Systems

    Sunnyvale, CA
    4 days ago
  • $180k - $200k

     ...powered IT management and cybersecurity software, serving Managed Service Providers (MSPs...  ...intersection of product strategy, technical architecture, and organizational influence. This role...  ...Kaseya’s competitive differentiation at scale. Role & Responsibilities Define the long... 
    Software
    Worldwide

    Kaseya Careers

    Sunnyvale, CA
    1 day ago
  • $165.2k - $223.6k

     ...challenging technology problems, and build architecturally sound, high-quality components to...  ...innovative self-starter. You will be a software expert with deep knowledge in server firmware...  ...do so for several years to come. The scale of AWS, combined with an understanding... 
    Software
    Internship
    Local area
    Flexible hours

    AmazonWebServices

    Cupertino, CA
    1 day ago
  •  ...Together, we advance your career. Customer Program Manager - Rack Scale CPU SolutionsTHE POSITIONAMD is seeking a highly driven and technically...  ....Foster strong working relationships across engineering, architecture, product management, customer engineering, and executive... 

    AMD

    Santa Clara, CA
    9 hours ago
  • $364k

    Lead the multi-year silicon system architecture roadmap for future Tensor SoCs. Establish...  ...and IP innovations have explicit software sponsorship.Lead and scale a multi-disciplinary,...  ...system security blocks).As Senior Director of the Chipset and System-on-a-Chip... 
    Software
    Full time

    Google

    Mountain View, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Director, Rack Scale Software Architecture. Be the first to apply!