Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distinguished Engineer - Data Center System Software Architect

$320k

NVIDIA Gruppe

Overview

NVIDIA data center systems, such as DGX and HGX, are core to our enterprise and cloud offerings. We seek a technical architect to define end‑to‑end architecture of these products at the system software level, covering firmware, kernel drivers, OS, and user mode drivers, and to work with internal leads and cloud service providers.

Responsibilities

  • Serve as the primary technical point of contact for major customers, leading discussions, defining KPIs, gathering requirements, and addressing complex technical queries.
  • Lead technical innovation and strategic collaborations with major hyperscalers to architect next‑generation data center products.
  • Align NVIDIA’s roadmap with customer requirements through direct engagement.
  • Develop and drive adoption of new technologies and protocols.
  • Make critical technical decisions in ambiguous situations, mitigating risks through left‑shift strategies.

Qualifications

  • Deep expertise in scalable and performant server system architecture, focusing on SW/HW interfaces.
  • Extensive experience with complex system software for accelerators (GPUs, DPUs, FPGAs).
  • Mastery of system firmware (SBIOS, OpenBMC), embedded systems, and Linux kernel internals.
  • Proficiency in out‑of‑band and in‑band management architectures, device management protocols (MCTP, PLDM, SPDM, RDE), and system management protocols (Redfish, IPMI).
  • Extensive knowledge of networking technologies and protocols (TCP/IP, Ethernet, InfiniBand, advanced switching and routing).
  • Experience collaborating with platform security experts to balance security and ease of use.
  • Demonstrated success leading complex, cross‑functional projects to completion, demonstrating influence without direct authority.
  • Experience implementing left‑shift strategy to de‑risk program execution.
  • BS or MS in Computer Science, Electrical Engineering, or related field (or equivalent experience).
  • 20+ years in system architecture and design.

Additional Qualifications

  • Knowledge of cloud and cluster‑level deployment and management systems. Participation in standards bodies such as OCP and DMTF.
  • Familiarity with NVIDIA HPC programming models and libraries (CUDA, cuDNN, DOCA).
  • Knowledge of enterprise storage architectures and distributed parallel processing paradigms.

Compensation & Benefits

Base salary range: $320,000 – $488,750 USD, based on location and experience.

Eligible for equity and benefits.

Application Period

Applications accepted until May 27, 2026.

EEO Statement

NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

#J-18808-Ljbffr

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Distinguished Engineer - Data Center System Software Architect in Santa Clara, CA vacancy
  • $320k

    NVIDIA data center systems, such as DGX and HGX, have become core to NVIDIA's...  ...optimized NVIDIA AI and HPC software stack. We’re looking for a strong technical architect to own the end-to-end architecture...  ...Computer Science, Electrical Engineering or related field (or... 
    Suggested
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    6 days ago
  • $320k

    NVIDIA is looking for a Distinguished Engineer to act as a senior technical leader...  ...large-scale production systems are reliable,...  ...Cloud resources. We combine software engineering, systems engineering...  ...researchers and customers.This role centers on the operational... 
    Suggested
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    8 days ago
  • $262k - $364k

     ...projects, anchoring the architecture and engineering roadmap of common software for Accelerator platforms.Design,...  ...with hardware.Experience with data center servers and AI platforms.Preferred...  ...distributed computing, large-scale system design, networking and data storage... 
    Suggested
    Worldwide

    Google

    Sunnyvale, CA
    7 days ago
  • $152k - $241.5k

     ...looking for an experienced Senior Software and System Architect to join our Networking Software Architecture...  ...company shaping the future of data-centers technologies. Does this sound like...  ...in Computer Science, Computer Engineering, or Electrical Engineering (or equivalent... 
    Suggested
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    8 days ago
  • $124k - $195.5k

     ...looking for a passionate and dedicated SW & System Architect to join our SW Architecture group. The...  ...focused company shaping the future of data-centers technologies.What you will be doing:...  ...architects, application and field engineers and moreWork with high profile customers... 
    Suggested
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    8 days ago
  • $224k - $356.5k

    We are looking for a Senior System Software Architect to help build NVIDIA Halos, our full-stack safety...  ...train deep neural networks in the data center on the NVIDIA DGX, and then...  ...integrity softwareUse GenAI and AI-assisted engineering tools to accelerate debugging, test... 
    Full time

    Nvidia

    Santa Clara, CA
    7 days ago
  •  ...and optimize GPU runtime and system software, identifying and evaluating...  ...and motivated GPU software architect with broad and deep...  ...problems, especially in modern data centers with large scale deployments...  ...Computer Science, Computer Engineering, or equivalent. LOCATION... 

    Advanced Micro Devices, Inc.

    San Jose, CA
    4 days ago
  • $218.4k

     ...System Software Architect, Linux Kernel and Operating System Location: San Jose Team: Technology...  .... Mentor senior and developing engineers, improve design and debugging...  ...Experience enabling new server silicon or data-center platforms from pre-silicon planning... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    19 hours ago
  • $208k - $327.75k

    ## Senior System Software Architect, Enterprise Reference ArchitecturesApplylocations: US, CA, Santa...  .... The ideal candidate brings deep data center architecture experience, strong product...  ...Management, Product Architects, Engineering, Solution Architecture, Program Management... 

    NVIDIA Corporation

    Santa Clara, CA
    4 days ago
  • $218.4k

     ...About the TeamWe are a systems software team building the foundational software for large-scale...  ...validation. We value rigorous engineering, clear interfaces, measurable performance...  ...the low-level GPU software stack for data-center computing. You will connect accelerator... 
    Temporary work
    Local area

    ByteDance

    San Jose, CA
    10 hours ago
  • $250k - $300k

     ...Description Principal AI Inference Systems Software Architect Job Title: Principal AI Inference...  ...and PCIe . Join our world-class engineering team and be part of shaping the future...  ...individual who deeply understands AI data center and edge AI inference workloads, model... 
    Ongoing contract
    Local area

    CyberCoders

    San Jose, CA
    7 days ago
  • $195k - $225k

     ...Staff Data Center Solutions ArchitectJob Summary: As...  ...Data Center Solutions Architect on the Supermicro DCBBS...  ...design and build the software that connects...  ...integrating AI Cloud Systems monitoring and application...  ...closely with electrical engineering, infrastructure, and... 

    Super Micro Computer

    San Jose, CA
    4 days ago
  • $140k - $300k

     ...Rewards, and Great Careers. Distinguished Engineer – Data Center Network Architecture &...  ...network architecture, software-defined networking, network...  ...will be responsible for architecting hyperscale-inspired...  ...networking, network operating systems, automation frameworks, and... 
    Hourly pay
    Work experience placement
    Local area

    Government Employees Insurance Company

    Palo Alto, CA
    2 days ago
  • $186.2k - $273.07k

     ...technologies like AI, data centers, automotive and electronic...  ..., and analytics systems detect and monitor defects...  ...) division is KLA's software powerhouse, responsible...  ...scientists, software engineers, apps engineers and process...  ...you will design and architect next-generation High... 
    Minimum wage
    Work experience placement

    KLA

    Milpitas, CA
    1 day ago
  • $231.44k - $282.88k

     ...computing platforms for the 21st century. As a datacenter system software architect, you’ll play a leading role in designing and implementing...  ...datacenters, spanning software and hardware architecture and engineering. Unlike in many larger companies, SiFive engineers work... 
    Work experience placement

    SiFive, Inc.

    Santa Clara, CA
    4 days ago
  •  ...GEICO seeks a Distinguished Engineer to define and lead the next generation of data center networking powering our Private Cloud, Platform Engineering...  ...and AI/ML initiatives. You will architect hyperscale-inspired network platforms with software-defined, automated, API-driven... 

    GEICO

    Palo Alto, CA
    19 hours ago
  • $186.2k - $273.07k

     ...technologies like AI, data centers, automotive and electronic...  ..., and analytics systems detect and monitor defects...  ...) division is KLA’s software powerhouse, responsible...  ...scientists, software engineers, apps engineers and process...  ...you will design and architect next-generation High... 
    Minimum wage
    Full time
    Work experience placement

    KLA-Tencor

    Milpitas, CA
    2 days ago
  •  ...Robotaxi applications, the complexity of our software systems is growing significantly. We're looking for a Distinguished Software Architect to help define how our software...  ...simulation, training and inference, product engineering and Robotaxi teams. You'll work... 
    Work at office
    Immediate start
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours
    Shift work

    Wayve

    Sunnyvale, CA
    19 hours ago
  • $262k - $364k

     ...leadership for high-impact accelerator software projects and own architecture and engineering roadmaps. Design, develop,...  ...into workflows. ~ Experience architecting and writing software that...  ...hardware. ~ Experience with data center servers and AI platforms. ~ Preferred... 
    Full time

    Google

    Sunnyvale, CA
    9 days ago
  • $233k

    Distinguished Technologist/Strategist, Enterprise ArchitectThis role has...  ...protect, analyze, and act on their data and applications wherever...  ..., presales and enterprise architect team members.Key ResponsibilitiesMeet...  ...of service provider data centers.Maintain awareness of... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work
    Work from home

    Hewlett Packard Enterprise

    San Jose, CA
    6 days ago
  •  ...Staff Software Engineer - Distributed Systems Architect ~ Full-time VMware is the industry-leading virtualization software company. Our technologies...  ...profitable. By virtualizing infrastructure—from the data center to the cloud to mobile devices—we enable IT to... 
    Full time
    Local area

    vmware

    Palo Alto, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA is looking for a brilliant Software & Systems Architect to join the NIC Software/Firmware Architecture...  ...of a team crafting the upcoming data-center DPU generation with hardware and...  ...Need to See:B.Sc. or M.Sc. in Computer Engineering, Computer Science, Electrical... 
    Full time

    Nvidia

    Santa Clara, CA
    8 days ago
  •  ...contribute, and revolutionize AI silicon and system.DescriptionWe are looking for a world-class Machine Learning System Software Architect to join our SoC team at Baidu’s Sunnyvale...  ...with system and application software engineers to ensure optimization of the entire hardware... 
    Work at office

    Baidu

    Sunnyvale, CA
    6 days ago
  •  ...NVIDIA Gruppe is seeking a Principal Software Engineer for the CSP Engagements team in Santa Clara, California. The role involves being the technical focal point for rack-scale system software and firmware, ensuring reliable deployment and operation of complex systems... 

    NVIDIA Gruppe

    Santa Clara, CA
    4 days ago
  • $152k - $241.5k

    We are seeking software engineers to work on next-generation graphics and computing products. Our...  ...algorithms, a proven foundation of systems software with emphasis on OS fundamentals...  ...will assess new hardware features and architect manufacturing diagnostic tests using... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  •  ...Oracle is seeking a seasoned systems software leader to drive architecture for large-scale platform software, firmware integration, and fleet automation. You will influence silicon/board roadmaps, champion reliability, performance, and cost efficiency at hyperscale, and... 

    Oracle

    Santa Clara, CA
    4 days ago
  •  ...NVIDIA AI seeks an experienced architect to design and deliver CUDA features, partnering with multiple teams to drive core software projects. You will evangelize innovations and align...  ...models forward. The role requires deep systems software expertise, a strong C... 

    NVIDIA AI

    Santa Clara, CA
    4 days ago
  •  ...ASML US, LLC is seeking a Principle Software Engineer to own the software roadmap and drive cross-functional system design across hardware, firmware, OS, desktop and web layers. You will lead a team of junior architects, champion best practices, and ensure robust, scalable... 

    ASML US, LLC

    San Jose, CA
    3 days ago
  • $262.5k - $394k

     ...Software Data Architect, PostgreSQL Database - Ai & Data Platforms (AiDP)...  ...Platforms (AiDP) is IS&T's engine for AI-powered innovation....  ...technologies, distributed systems, and storage engineering, helping...  ...petabytes of data across our data centers worldwide and impacting the... 
    Worldwide
    Relocation

    Apple Inc.

    Sunnyvale, CA
    4 days ago
  • $273k - $369.5k

     ....Job OverviewIntuit runs on data — every TurboTax return, every...  ...reason over.We're hiring a Distinguished Engineer to own the technical vision...  ...that feeds GenOS and other AI systems.Executive visibility. You'll...  ...-wide AI and data ambitions.Architect the next generation of the... 
    Worldwide

    Intuit

    Mountain View, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distinguished Engineer - Data Center System Software Architect. Be the first to apply!