Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distinguished Engineer - Data Center System Software Architect

$320k

NVIDIA

NVIDIA data center systems, such as DGX and HGX, have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. These platforms bring together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. We’re looking for a strong technical architect to own the end-to-end architecture of these products, at the system software level.

Including firmware, kernel drivers, operating systems, and user mode drivers. You will work with component leads internally and engage with industry leading cloud service providers on taking these products to market.

What you’ll be doing:

  • Serve as the primary technical point of contact for major customers, leading technological discussions, defining KPIs, gathering requirements, and addressing complex technical queries.

  • As a system software architect, lead technical innovation and strategic collaborations with major hyperscalers to architect next-generation data center products.

  • Align NVIDIA's roadmap with major customers' requirements through direct engagement.

  • Develop and drive adoption of new technologies and protocols.

  • Make critical technical decisions in ambiguous situations, mitigating risks through left-shift strategies.

What we need to see:

  • Deep expertise in scalable and performant server system architecture, focusing on SW/HW interfaces.

  • Extensive experience with complex system software for accelerators (GPUs, DPUs, FPGAs).

  • Mastery of system firmware (SBIOS, OpenBMC), embedded systems, and Linux kernel internals.

  • Proficiency in Out-of-Band and In-Band management architectures, device management protocols (e.g., MCTP, PLDM, SPDM, RDE) and system management protocols (Redfish, IPMI).

  • Extensive knowledge of networking technologies and protocols, including TCP/IP, Ethernet, InfiniBand, as well as advanced switching and routing concepts

  • Experience collaborating with platform security experts to define tradeoffs between security and ease of use.

  • Demonstrated success in leading complex, cross-functional projects to completion, showcasing the ability to influence and achieve results without direct authority in large-scale, collaborative environments. Demonstrable experience in implementing left shift strategy to de-risk program execution.

  • BS or MS degree in Computer Science, Electrical Engineering or related field (or equivalent experience).

  • 20+ years in the area of System architecture and design.

Ways to stand out from the crowd:

  • Knowledge of cloud and cluster level deployment and management systems. Participation and contributions in standards bodies such as OCP and DMTF.

  • Familiarity with NVIDIA HPC programming models and libraries (CUDA, cuDNN, DOCA)

  • Knowledge of enterprise storage architectures and distributed parallel processing paradigms

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative, passionate and self-motivated, we want to hear from you!

NVIDIA’s invention of the GPU in 1999 fueled the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern deep learning — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and establish teams with the most thoughtful people in the world. Are you ready to change the next generation of computing? Join us at the forefront of technological advancement.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.

You will also be eligible for equity and benefits ( .

Applications for this job will be accepted at least until May 27, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Distinguished Engineer - Data Center System Software Architect in Santa Clara, CA vacancy
  • $320k

     ...and HPC. We are looking for a Distinguished Software Architect to help co-design our next generation data center platforms. DL and HPC...  ...Computer Science, Computer Engineering or related field or strong equivalent...  ..., UCX, UCC), computer and system architecture, GPU... 
    Suggested
    Work experience placement

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $152k - $241.5k

     ...is looking for an experienced Senior Software and System Architect to join our Networking Software...  ...focused company shaping the future of data-centers technologies. Does this sound like a...  ...solution architects, application and field engineers Working with high profile... 
    Suggested
    Remote work

    NVIDIA

    Santa Clara, CA
    11 hours ago
  • $208k - $327.75k

     ...Group is seeking a Senior System Architect to define, design, and validate...  ..., storage, and AI software into repeatable blueprints...  ...ideal candidate brings deep data center architecture experience, strong...  ...Management, Product Architects, Engineering, Solution Architecture,... 
    Suggested

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $231.44k - $282.88k

     ...highest performance and most data-intensive applications in...  ...learning, automotive, data center, mobile, and consumer. With...  ...st century. As a datacenter system software architect, you'll play a leading role...  ...hardware architecture and engineering. Unlike in many larger companies... 
    Suggested
    Work experience placement

    SiFive

    Santa Clara, CA
    3 days ago
  • $122.65k - $283.91k

     ...Salesforce CPQ Solution Architect NTT DATA is seeking an experienced Salesforce CPQ Solution Architect...  ...handoff to downstream financial systems Delivery & Stakeholder Engagement...  ..., cloud, security, connectivity, data centers and application services. Our consulting... 
    Suggested
    Work at office
    Remote work
    Monday to Friday
    Flexible hours
    Shift work
    Weekend work

    Sierra Systems, An Ntt Data Company

    Santa Clara, CA
    1 day ago
  • $230k - $315k

     ...are redefining cybersecurity. As a Distinguished Engineer on the Enterprise DLP team, you...  ...technical leader responsible for architecting and scaling the data platform that underpins our industry...  ...is to establish the standards and systems necessary to process and analyze massive... 
    Full time
    Work at office

    Palo Alto Networks

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...is seeking a Senior System Architect: Heterogeneous EDA Systems...  ...waste. We need an engineer to develop and build...  ...in real-time. It will distinguish between hardware...  ...infrastructure instability, and software defects. What you'...  ...the NVIDIA DCGM (Data Center GPU Manager) and... 

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $104.9k - $184.92k

     ...our mission, our AI-enabled systems are changing the way militaries...  ...Artificial Intelligence Center (LAIC) team is seeking an individual...  ...strong working knowledge in software engineering, Python, C++, and STAR.OS...  ..., AI/ML development and data curation and data pipelines.... 
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office
    Remote work
    Relocation
    Flexible hours
    Shift work
    3 days per week

    Lockheed Martin Corporation

    Sunnyvale, CA
    2 days ago
  • $184k - $287.5k

     ...responsible for building a scalable and modular software stack that powers advanced driver-assistance systems across a diverse range of product lines and OEMs....  ...looking for a highly motivated Senior Systems Software Engineer with a strong foundation in software architecture... 

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...Machine Learning System Software Architect Sunnyvale, CA Do you want to be part of the AI revolution? Do you want to think out of the box...  .... Engage with system and application software engineers to ensure optimization of the entire hardware/software stack... 
    Work at office

    Baidu

    Sunnyvale, CA
    4 days ago
  • $184k - $287.5k

     ...NVIDIA is looking for a brilliant Software & Systems Architect to join the NIC Software/Firmware Architecture...  ...of a team crafting the upcoming data-center DPU generation with hardware and...  ...See: ~ B.Sc. or M.Sc. in Computer Engineering, Computer Science, Electrical Engineering... 

    NVIDIA

    Santa Clara, CA
    1 day ago
  •  ...Software Engineer - Data Center Emulator Location: On-site, Santa Clara, CA Overview: Seeking an experienced contract software engineer to...  ...and build a web-based data center emulation platform. This system will serve as a shared infrastructure for development, testing... 
    Contract work
    For contractors
    Immediate start

    Diverse Lynx

    Santa Clara, CA
    11 hours ago
  • $162k - $242k

     ...Senior Software Engineer - Data Lake & BI Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential...  ...surface performance data across every data center in our global infrastructure—turning...  ...of experience building distributed systems, data platforms, or cloud services.... 
    Temporary work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    11 hours ago
  • $224k - $356.5k

     ...are building innovative server systems for GPU accelerated applications, such as Deep Learning. Data Center SW team architects and develops the end to end software and firmware stack for these systems...  ...You will work with world class engineering teams, product management,... 
    Shift work

    NVIDIA

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...As a Senior Software Architect in the GPU Networking Architecture team, you...  ...fields related to the modern data center, such as distributed AI and deep learning systems, Networking Operating Systems...  ...Science, Electrical or Computer Engineering (or equivalent experience).... 

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...scaling Deep Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software....  ...grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the... 

    NVIDIA

    Santa Clara, CA
    11 hours ago
  •  ...Software Engineer - Data Infrastructure Services Sunnyvale, CA / Bellevue, WA CoreWeave is The Essential...  ...operator in order to manage data systems. You know your way around a Linux...  ...lunch each day in our office and data center locations ~ A casual work environment... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    11 hours ago
  • $165k - $242k

     ...Senior Software Engineer, Data Center Infrastructure Tooling CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave...  ...product scope. Integrations with internal/external systems and data sources that feed infrastructure planning, ensuring... 
    Temporary work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    11 hours ago
  • $308k

    Distinguished Software Engineer - NVLink Fusion Software page is loaded Distinguished...  ...expanding ecosystem of data center platform & node designs. From single node HGX/DGX systems all the way up to large multi...  ...highly motived, technical architect to champion work across... 
    Full time
    Second job
    Shift work

    NVIDIA Corporation

    Santa Clara, CA
    3 days ago
  • $147.4k - $272.1k

     ...Systems Integration Engineer - Data Center HWE As a highly adaptable Systems Integration Engineer, your primary responsibility is to provide robust...  ...multiple programs. Deploy proof of concept hardware, software setup, and/or piloting of new hardware for use at scale... 
    Remote work
    Relocation

    Apple

    Sunnyvale, CA
    11 hours ago
  •  ...Requirements: Bachelor's degree in Engineering or technical field. Preferred: Electrical/Mechanical Engineering or Computer Science. 2+ years in design/applications engineering (electrical hardware/interconnect solutions). Experience in... 
    Work at office

    Macpower Digital Assets Edge

    Santa Clara, CA
    2 days ago
  • $179.06k - $198.95k

     ...hesity is a leader in AI‑powered data security and management,...  ...recover data across data centers, edge, and cloud using capabilities...  ...recovery at scale. Senior Software Engineer - M365 SaaS Team The M365...  ...large‑scale distributed systems. Self‑starter with strong analytical... 
    Hourly pay
    Full time
    Work at office
    Flexible hours

    Cohesity Inc.

    Santa Clara, CA
    2 days ago
  • $256k - $356k

    Google Inc. is looking for a Principal Engineer in Sunnyvale, CA, to lead innovative solutions for data center operations and AI infrastructure challenges. The ideal candidate will possess a Master's degree and 15 years of relevant experience, focusing on driving technical... 
    Full time

    Google Inc.

    Sunnyvale, CA
    4 days ago
  • A network solutions provider is seeking a full-time Network Support Engineer to manage and troubleshoot network issues, both remote and onsite. You will work closely with sales and R&D to deliver effective solutions and support. The position requires a Bachelor's degree... 
    Full time
    Remote work

    Asiacom Americas Inc

    Santa Clara, CA
    1 day ago
  • A leading technology company is seeking a Senior Software Architect to innovate server systems for deep learning applications. This role involves leading software activities and system architecture design, requiring deep expertise in server performance and collaboration... 

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...NVIDIA is seeking a motivated system architect to define future aspects of...  ...disciplinary, working with software, ASIC design, verification,...  ...art while making the best engineering trade-offs. What you...  ...optimal designs for future data center workloads. Develop and enhance... 
    Work experience placement
    Night shift

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $220.2k - $330.4k

     ...Inc. Job Area: Engineering Group, Engineering Group Systems Engineering General...  ...Mission Qualcomm Data Center team is developing High...  ...that includes hardware, software, reference designs, user...  ...hiring a Rack Systems Architect to define and deliver rack... 
    Work experience placement
    Work from home

    Qualcomm

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...NVIDIA is seeking a System Architect to lead rack-level and platform pathfinding for our next...  ...mechanical, electrical, SI/PI, networking, and data center teams to deliver high-performance,...  ...we need to see: ~ BS in Electrical Engineering, Mechanical Engineering, Computer... 

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...scientists, researchers and engineers can advance their ideas. At...  ...to work in the world! At the center of NVIDIA's culture are our...  ...be. We are looking for a Systems Architect to lead and drive power solutions...  ...partners. Experience in data center, client, or... 
    Temporary work

    NVIDIA

    Santa Clara, CA
    11 hours ago
  • $166.52k - $249.5k

     ...Principal System Architect Marvell's semiconductor solutions...  ...blocks of the data infrastructure that connects...  ...architecture for data center SuperPod AI Infrastructure...  ...Science, Electrical Engineering or related fields and...  ..., including hardware-software co-optimization (GPUs/... 
    Permanent employment
    Work experience placement
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distinguished Engineer - Data Center System Software Architect. Be the first to apply!