Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distinguished Engineer - Data Center System Software Architect

$320k

NVIDIA

NVIDIA data center systems, such as DGX and HGX, have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. These platforms bring together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. We’re looking for a strong technical architect to own the end-to-end architecture of these products, at the system software level. Including firmware, kernel drivers, operating systems, and user mode drivers.

What You’ll Be Doing

  • Serve as the primary technical point of contact for major customers, leading technological discussions, defining KPIs, gathering requirements, and addressing complex technical queries.
  • Lead technical innovation and strategic collaborations with major hyperscalers to architect next-generation data center products.
  • Align NVIDIA's roadmap with major customers' requirements through direct engagement.
  • Develop and drive adoption of new technologies and protocols.
  • Make critical technical decisions in ambiguous situations, mitigating risks through left-shift strategies.

What We Need to See

  • Deep expertise in scalable and performant server system architecture, focusing on SW/HW interfaces.
  • Extensive experience with complex system software for accelerators (GPUs, DPUs, FPGAs).
  • Mastery of system firmware (SBIOS, OpenBMC), embedded systems, and Linux kernel internals.
  • Proficiency in Out-of-Band and In-Band management architectures, device management protocols (e.g., MCTP, PLDM, SPDM, RDE) and system management protocols (Redfish, IPMI).
  • Extensive knowledge of networking technologies and protocols, including TCP/IP, Ethernet, InfiniBand, as well as advanced switching and routing concepts.
  • Experience collaborating with platform security experts to define tradeoffs between security and ease of use.
  • Demonstrated success in leading complex, cross-functional projects to completion, showcasing the ability to influence and achieve results without direct authority in large-scale, collaborative environments.
  • Demonstrable experience in implementing left shift strategy to de-risk program execution.
  • BS or MS degree in Computer Science, Electrical Engineering or related field (or equivalent experience).
  • 20+ years in system architecture and design.

Ways to Stand Out From the Crowd

  • Knowledge of cloud and cluster level deployment and management systems.
  • Participation and contributions in standards bodies such as OCP and DMTF.
  • Familiarity with NVIDIA HPC programming models and libraries (CUDA, cuDNN, DOCA).
  • Knowledge of enterprise storage architectures and distributed parallel processing paradigms.

Base salary range: $320,000 - $488,750 USD per year. Eligible for equity and benefits.

We are an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Distinguished Engineer - Data Center System Software Architect in Santa Clara, CA vacancy
  • $320k

    NVIDIA data center systems, such as DGX and HGX, have become core to NVIDIA's...  ...optimized NVIDIA AI and HPC software stack. We’re looking for a strong technical architect to own the end-to-end architecture...  ...Computer Science, Electrical Engineering or related field (or... 
    Suggested
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $320k

     ...is seeking a strong technical architect to own the end-to-end architecture of NVIDIA data center systems, including firmware, kernel...  ...The role focuses on leading engineering efforts for DGX and HGX platforms...  ...with complex system software for accelerators (GPUs, DPUs,... 
    Suggested
    Shift work

    Segment (Twilio)

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

     ...looking for an experienced Senior Software and System Architect to join our Networking Software Architecture...  ...company shaping the future of data-centers technologies. Does this sound like...  ...in Computer Science, Computer Engineering, or Electrical Engineering (or equivalent... 
    Suggested
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  • $262k - $364k

     ...projects, anchoring the architecture and engineering roadmap of common software for Accelerator platforms.Design,...  ...with hardware.Experience with data center servers and AI platforms.Preferred...  ...distributed computing, large-scale system design, networking and data storage... 
    Suggested
    Worldwide

    Google

    Sunnyvale, CA
    4 days ago
  • $224k - $356.5k

    We are looking for a Senior System Software Architect to help build NVIDIA Halos, our full-stack safety...  ...train deep neural networks in the data center on the NVIDIA DGX, and then...  ...integrity softwareUse GenAI and AI-assisted engineering tools to accelerate debugging, test... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $124k - $195.5k

     ...looking for a passionate and dedicated SW & System Architect to join our SW Architecture group. The...  ...focused company shaping the future of data-centers technologies.What you will be doing:...  ...architects, application and field engineers and moreWork with high profile customers... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  • $320k

    NVIDIA is looking for a Distinguished Engineer to act as a senior technical leader...  ...large-scale production systems are reliable,...  ...Cloud resources. We combine software engineering, systems engineering...  ...researchers and customers.This role centers on the operational... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...and optimize GPU runtime and system software, identifying and evaluating...  ...and motivated GPU software architect with broad and deep...  ...problems, especially in modern data centers with large scale deployments...  ...Computer Science, Computer Engineering, or equivalent. LOCATION... 

    Advanced Micro Devices, Inc.

    San Jose, CA
    1 day ago
  • $208k - $327.75k

    ## Senior System Software Architect, Enterprise Reference ArchitecturesApplylocations: US, CA, Santa...  .... The ideal candidate brings deep data center architecture experience, strong product...  ...Management, Product Architects, Engineering, Solution Architecture, Program Management... 

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $250k - $300k

     ...Description Principal AI Inference Systems Software Architect Job Title: Principal AI Inference...  ...and PCIe . Join our world-class engineering team and be part of shaping the future...  ...individual who deeply understands AI data center and edge AI inference workloads, model... 
    Ongoing contract
    Local area

    CyberCoders

    San Jose, CA
    4 days ago
  • $140k - $300k

     ...Rewards, and Great Careers. Distinguished Engineer – Data Center Network Architecture &...  ...network architecture, software-defined networking, network...  ...will be responsible for architecting hyperscale-inspired...  ...networking, network operating systems, automation frameworks, and... 
    Hourly pay
    Work experience placement
    Local area

    Government Employees Insurance Company

    Palo Alto, CA
    4 days ago
  • $186.2k - $273.07k

     ...technologies like AI, data centers, automotive and electronic...  ..., and analytics systems detect and monitor defects...  ...) division is KLA's software powerhouse, responsible...  ...scientists, software engineers, apps engineers and process...  ...you will design and architect next-generation High... 
    Minimum wage
    Work experience placement

    KLA

    Milpitas, CA
    3 days ago
  • $231.44k - $282.88k

     ...computing platforms for the 21st century. As a datacenter system software architect, you’ll play a leading role in designing and implementing...  ...datacenters, spanning software and hardware architecture and engineering. Unlike in many larger companies, SiFive engineers work... 
    Work experience placement

    SiFive, Inc.

    Santa Clara, CA
    1 day ago
  •  ...Robotaxi applications, the complexity of our software systems is growing significantly. We're looking for a Distinguished Software Architect to help define how our software...  ...simulation, training and inference, product engineering and Robotaxi teams. You'll work... 
    Work at office
    Immediate start
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours
    Shift work

    Wayve

    Sunnyvale, CA
    2 days ago
  • $233k

    Distinguished Technologist/Strategist, Enterprise ArchitectThis role has...  ...protect, analyze, and act on their data and applications wherever...  ..., presales and enterprise architect team members.Key ResponsibilitiesMeet...  ...of service provider data centers.Maintain awareness of... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work
    Work from home

    Hewlett Packard Enterprise

    San Jose, CA
    3 days ago
  •  ...Staff Software Engineer - Distributed Systems Architect ~ Full-time VMware is the industry-leading virtualization software company. Our technologies...  ...profitable. By virtualizing infrastructure—from the data center to the cloud to mobile devices—we enable IT to... 
    Full time
    Local area

    vmware

    Palo Alto, CA
    3 days ago
  • $157.49k - $262.49k

    NTT DATA strives to hire exceptional, innovative and passionate...  ...seeking a Salesforce CPQ Solution Architect to join our team in Santa...  ...to downstream financial systems Delivery & Stakeholder Engagement...  ...security, connectivity, data centers and application services. our... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Santa Clara, CA
    5 days ago
  •  ...contribute, and revolutionize AI silicon and system.DescriptionWe are looking for a world-class Machine Learning System Software Architect to join our SoC team at Baidu’s Sunnyvale...  ...with system and application software engineers to ensure optimization of the entire hardware... 
    Work at office

    Baidu

    Sunnyvale, CA
    3 days ago
  • $184k - $287.5k

    NVIDIA is looking for a brilliant Software & Systems Architect to join the NIC Software/Firmware Architecture...  ...of a team crafting the upcoming data-center DPU generation with hardware and...  ...Need to See:B.Sc. or M.Sc. in Computer Engineering, Computer Science, Electrical... 
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  •  ...NVIDIA Gruppe is seeking a Principal Software Engineer for the CSP Engagements team in Santa Clara, California. The role involves being the technical focal point for rack-scale system software and firmware, ensuring reliable deployment and operation of complex systems... 

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $152k - $241.5k

    We are seeking software engineers to work on next-generation graphics and computing products. Our...  ...algorithms, a proven foundation of systems software with emphasis on OS fundamentals...  ...will assess new hardware features and architect manufacturing diagnostic tests using... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $273k - $369.5k

     ....Job OverviewIntuit runs on data — every TurboTax return, every...  ...reason over.We're hiring a Distinguished Engineer to own the technical vision...  ...that feeds GenOS and other AI systems.Executive visibility. You'll...  ...-wide AI and data ambitions.Architect the next generation of the... 
    Worldwide

    Intuit

    Mountain View, CA
    1 day ago
  • $262.5k - $394k

     ...Software Data Architect, PostgreSQL Database - Ai & Data Platforms (AiDP)...  ...Platforms (AiDP) is IS&T's engine for AI-powered innovation....  ...technologies, distributed systems, and storage engineering, helping...  ...petabytes of data across our data centers worldwide and impacting the... 
    Worldwide
    Relocation

    Apple Inc.

    Sunnyvale, CA
    1 day ago
  • $184k - $287.5k

     ...intelligence.NVIDIA is looking for a Datacenter System Architect to help define & design products for...  ...with counterparts from silicon, software, networking, operations, and other...  ...roadmaps are aligned to our needsWork across engineering and operations teams to define and... 
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago
  • Oracle is seeking a seasoned systems software leader to drive architecture for large-scale platform software, firmware integration, and fleet automation. You will influence silicon/board roadmaps, champion reliability, performance, and cost efficiency at hyperscale, and... 

    Oracle

    Santa Clara, CA
    2 days ago
  • NVIDIA AI seeks an experienced architect to design and deliver CUDA features, partnering with multiple teams to drive core software projects. You will evangelize innovations and align...  ...models forward. The role requires deep systems software expertise, a strong C... 

    NVIDIA AI

    Santa Clara, CA
    1 day ago
  • $135k - $180k

    Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI is a Physical AI company...  ...pioneering AI-based virtual driver software for factory-built autonomous trucks....  ...our data secure through multiple data centers and AWS regionsRequired Skills:MS in Computer... 
    Full time

    Plus.ai

    Santa Clara, CA
    2 days ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger...  ...a hands-on Infrastructure Engineer to join our team and support...  ...:3-5+ years of experience in data center, lab, or infrastructure engineering...  ...in a lab or R&D hardware/software environmentThis is a unique opportunity... 
    Remote work

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $184k - $287.5k

     ...scaling Deep Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software.DL...  ...grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    5 days ago
  • $184k - $287.5k

     ...scientists, researchers, and engineers, empowering them to...  ...Infiniband, NVLink, and Ethernet systems will continue to be at the...  ...motivated and experienced Senior Software Architect specializing in Ethernet...  ...networking features across data center, telco, or edge networks.... 
    Full time

    Nvidia

    Santa Clara, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distinguished Engineer - Data Center System Software Architect. Be the first to apply!