Director, Rack Scale Software Architecture
$320kNVIDIA
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.NVIDIA has a rapidly expanding ecosystem of data center platform & node designs. From single node HGX/DGX systems all the way up to large multi-node NVLink domain rack architectures. These designs have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. Each bringing together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. We're searching for a highly technical, motivated manager to lead & manage the team responsible for rack-scale system software architecture. From firmware, kernel drivers, operating systems, networking, fabrics and associated user mode drivers + manageability software. You will work with component leads internally and engage with industry leading hyperscalar / cloud service providers on taking these products to market.What you’ll be doing:Drive the software end-to-end architecture for NVIDIA's rack-scale productsMaintain deep understanding of the product portfolio and roadmap; translate forward-looking plans into clear, formal software requirements that anchor execution across the organization.Ensure high quality & reliable software; serving as a trusted architectural partner to teams requiring guidance or oversight.Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap.Using strong communication skills, present the team vision to senior NVIDIA and external leaders.Provide technical leadership and career mentorship to the teamMake key technical decisions even when faced with ambiguityWhat we need to see:BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience.15+ overall years of experience in the area of System architecture and design with 8+ yrs of proven experience in managementDeep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface.Proven leadership skills and strong ownership on past projects involving a large scale sophisticated code basePrevious experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAsPossess strong managerial, problem solving and critical thinking skills.Comfortable operating in highly matrixed organizations while holding a leadership positionKnown for your strong interactive, verbal and written communications skillsWays to stand out from the crowd:Knowledge of large-scale cloud and cluster level deployment and management systems. Experience with designing robust, resilient and performant scale-up fabricsDemonstrated track record of leading data center products across the entire lifecycle, spanning inception, pre-silicon development, post-silicon bring-up, manufacturing, and deployment.Strong understanding of networking technology & protocols (e.g. Ethernet, Infiniband). Familiarity with CXL, UCIE and other C2C technology architectures. Knowledge in storage and networking technologies.We are widely considered to be one of the technology world’s most desirable employers, and as a result have some of the most forward-thinking and hardworking people in the world working for us. So if you're clever, creative, and driven, we'd love to have you join the team.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.You will also be eligible for equity and benefits.Applications for this job will be accepted at least until August 26, 2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa Clara; US, TX, Austin; US, Remote; US, NC, Durham; US, CO, BoulderType: Full time
- ...of very large ones. Serving frontier-scale models on that kind of architecture pushes the hardest engineering problems out of the die and into the rack: how many thousands of devices are... ...None of it can be settled apart from software: how a model is partitioned across devices...Software
$162.6k - $244k
...Validation Engineering team develops rack-level AI inference solutions... ...‑generation Qualcomm rack‑scale designs within a matrixed... ...management/telemetry. Drive firmware/software/hardware co‑design execution,... ...and readiness reviews (architecture, schematic/layout, SI/PI,...SoftwareWork experience placementWork at officeWork from home- ...Technologies seeks a Principal Systems Development Engineer to architect and deliver L11 rack-scale AI solutions. You will own system-level architecture across compute, mechanical, thermal, software, and diagnostics, delivering repeatable, manufacturable racks. Based at Round...Software
- ...visionary and highly technical Director of Instinct Stack Architecture to lead architecture... ...hardware, firmware, system software, security, reliability, serviceability... ...accelerator, HPC, large-scale system architecture, or... ...CPU, SoC, accelerator, or rack-scale platform programs....Software
$166k - $250k
...Services****Reports to**: Senior Director, Technical Services **Why... ..., strong technical architecture is critical to successful transformation... ...reusable patterns, and scaling proven practices through cross... ...within a B2B SaaS, cloud software, systems integration, or enterprise...SoftwareFull time$166k - $250k
...Services Reports to : Senior Director, Technical Services Why... ..., strong technical architecture is critical to successful transformation... ...reusable patterns, and scaling proven practices through... ...teams within a B2B SaaS, cloud software, systems integration, or enterprise...SoftwareRemote work$200k
...application, and governance layers - to design architectures that survive a rigorous security review.... ...what it takes to run, observe, and scale distributed systems in the real world.... ...pipelines, and you know how enterprise software actually gets deployed. Bonus points...SoftwareShift work- ...Both use a hybrid-electric architecture that takes off like a helicopter... ...to full-rate production and scaling toward large autonomous... ...Texas. The Opportunity As Director of Hardware, you will own... ...will work closely with flight, software, manufacturing, and supply...SoftwarePermanent employmentContract workLocal areaRelocation package
- ...using Isilon's and NetApp's software suites to ensure optimal performance... ...of NetApp storage architectures to ensure efficient data management... ...strategies to proactively scale storage and compute resources... ...center activities, including racking and initial installation of servers...Software
$230k - $290k
...everything possible. The Senior Director - Autonomous Labs Architect is responsible for defining the architectural blueprint and enterprise patterns required to scale autonomous labs across Danaher,... ..., data layers, AI agents, software platforms, and external partner...SoftwareFull timeRemote workWork from homeFlexible hours- ...customers across the Americas to deliver large-scale Oracle, Salesforce, and cloud-led... ...high-growth clients. You will lead the architectural definition of their entire Lead-to-Cash... ...renewals. You aren't just implementing software; you are re-engineering the commercial engine...Software
- Director of AI Platforms, Texas Institute for Electronics 1 day ago... ...agility of a startup with the scale of a national initiative. Our... ...integration, chiplet‑based architectures, and multi‑component microsystems... ...Define and lead the software architecture and implementation...SoftwareFor contractorsWork at officeMonday to FridayFlexible hoursShift work
- ...means rethinking the fundamental architecture of inference compute. The... ...become more efficient as they scale. This architecture will... ...-site position. Reports To : Director of Technical Program Management... ...substrate, board, firmware, and software teams; surface risks early and...SoftwareFull time
$150k - $170k
Director, HR Service Delivery Location: Dallas, TX; New York, NY; Charlotte... ...implementation partners, software vendors, and third‑party... ...Proven success leading large-scale Oracle HCM implementations, enhancements... ...of enterprise systems architecture, integrations, APIs, data...SoftwareFull time$240k - $333k
...II, Foundational Enterprise Architecture Capabilities Advanced Experience... ...primary focus on owning and scaling our Foundational EA... ...of Corporate Engineering's software landscape across all functional... ...the Alphabet Inc. board of directors or its delegate, the terms of...Software- ...industry regulations. Manage traceability and fidelity for large-scale billing migrations, ensuring minimal variance in bill-to-bill... ...and process efficiency. Ensure stakeholder alignment and architectural consensus across finance, accounting, IT and broader cross-functional...SoftwareWork experience placementFlexible hours
$159.2k - $215.3k
...Utility Computing) designs silicon and software that accelerates innovation. Customers choose... ...servers. As a member of the Cloud-Scale Machine Learning Acceleration team you’ll... ...help us trail-blaze new technologies and architectures, while ensuring high design quality and...SoftwareFlexible hours- ...prevent problem recurrence. Design, write, and deploy software to improve the availability, scalability, and... ...products and services. Design and develop designs, architectures, standards, and methods for large-scale distributed systems. Facilitate service capacity planning...SoftwareTemporary workWork experience placementFlexible hoursNight shift
$129.3k - $177.8k
...leadership role that combines decision science, AI engineering, and software architecture while leading a small team of engineers. Key... ...workflows, ensuring recommendations can be deployed and governed at scale. Evaluation and experimentation - Build rigorous evaluation...SoftwareFull timeTemporary workWork at officeRemote workWork from homeHome officeMonday to Friday- ...security products. You will contribute tothe architecture to improve scalability, operability,... ...for provisioning, maintaining, and scaling our production services within server farms... ...multiple stakeholders, network, hardware and software that relate toscaling and performance.•...SoftwareFull timeFlexible hours
$179.9k - $243.4k
...You'll join a diverse team of software, hardware, and network engineers... ...infrastructure solutions that enable at-scale deployment of the latest liquid-cooled racks into our data centers. We are... ...for AWS liquid cooling architectures, integrating multiple technologies...SoftwareFlexible hours- ...to change that. Our modular, software defined robotic solutions... ...systems that learn, adapt and scale at RobCo, you are not just joining... ...extraordinary.” Regional Director - Commercial “Having been at... ...a scalable modular hardware architecture with intelligent software that...SoftwareFull timeInternshipLive outWork at officeImmediate startRemote workFlexible hours
$114.6k - $234.6k
...that are both innovative and deployable at scale. This role ensures new designs are... ...Development & Integration Lead integration of rack-level hardware platforms for data center... ...is enabled at deployment Partner with software/data teams to support monitoring and...SoftwareTemporary workFlexible hours- ...understanding of Foundation Models (FMs), reasoning architectures, and the mechanics underpinning modern... ...FMs, wiring deterministic software systems to non-deterministic LLM reasoning... ...RAG & Pipeline Integration: Build and scale production RAG pipelines across structured...Software
- ...design and development of advanced, scalable, and secure reference architectures across all Cloud Platforms. You will lead cross-functional... ..., enabling efficient cloud adoption and governance at scale.Key ResponsibilitiesReference Architecture Development (Primary...
- AMD is seeking a visionary Director of Instinct Stack Architecture to lead architecture strategy, technical direction, and cross-functional execution... ...architectural alignment across hardware, firmware, system software, security, reliability, platform management, and...Software
- ...platforms who can own end-to-end system architecture and confidently communicate with senior... ...architecture decisions across large-scale distributed systems . Key Responsibilities... ...Required Skills ~10+ years in software engineering with 3+ years in architecture...Software
- ...in New York City, Take-Two Interactive Software, Inc. is a leading developer, publisher,... ...toward identity-centric, automated network architectures.We are seeking a highly experienced and... ...Network Security:Architect, deploy, and scale global Zero Trust Network Access (ZTNA)...SoftwareCasual workFlexible hoursShift work
- ...documentation by the use of CAD software for fabrication and... ...installations • Operate small and large scale office printers/plotters • Utilize labeling software for rack and field wiring purposes... ...interpret electronic schematics and architectural blueprints • Ability to...SoftwareWork at office
- ...ecosystems, and contributing to scalable mobile architectures. What You'll Do Build and... ..., and user experience across hardware/software integration layers. Debug and resolve... ...Experience building or maintaining large-scale consumer applications. How We Work...SoftwareWork experience placementWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Director, Rack Scale Software Architecture. Be the first to apply!
- embedded software manager Austin, TX
- senior applications manager Austin, TX
- director of software Austin, TX
- application engineering manager Austin, TX
- software manager Austin, TX
- senior software development manager Austin, TX
- director software engineering Austin, TX
- application services manager Austin, TX
- application manager Austin, TX
- senior software manager Austin, TX


