Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distinguished Engineer - Data Center System Software Architect

$320k

Nvidia

NVIDIA data center systems, such as DGX and HGX, have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. These platforms bring together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. We’re looking for a strong technical architect to own the end-to-end architecture of these products, at the system software level.Including firmware, kernel drivers, operating systems, and user mode drivers. You will work with component leads internally and engage with industry leading cloud service providers on taking these products to market.What you’ll be doing:Serve as the primary technical point of contact for major customers, leading technological discussions, defining KPIs, gathering requirements, and addressing complex technical queries.As a system software architect, lead technical innovation and strategic collaborations with major hyperscalers to architect next-generation data center products.Align NVIDIA's roadmap with major customers' requirements through direct engagement.Develop and drive adoption of new technologies and protocols.Make critical technical decisions in ambiguous situations, mitigating risks through left-shift strategies.What we need to see:Deep expertise in scalable and performant server system architecture, focusing on SW/HW interfaces.Extensive experience with complex system software for accelerators (GPUs, DPUs, FPGAs).Mastery of system firmware (SBIOS, OpenBMC), embedded systems, and Linux kernel internals.Proficiency in Out-of-Band and In-Band management architectures, device management protocols (e.g., MCTP, PLDM, SPDM, RDE) and system management protocols (Redfish, IPMI).Extensive knowledge of networking technologies and protocols, including TCP/IP, Ethernet, InfiniBand, as well as advanced switching and routing conceptsExperience collaborating with platform security experts to define tradeoffs between security and ease of use.Demonstrated success in leading complex, cross-functional projects to completion, showcasing the ability to influence and achieve results without direct authority in large-scale, collaborative environments. Demonstrable experience in implementing left shift strategy to de-risk program execution.BS or MS degree in Computer Science, Electrical Engineering or related field (or equivalent experience).20+ years in the area of System architecture and design.Ways to stand out from the crowd:Knowledge of cloud and cluster level deployment and management systems. Participation and contributions in standards bodies such as OCP and DMTF.Familiarity with NVIDIA HPC programming models and libraries (CUDA, cuDNN, DOCA)Knowledge of enterprise storage architectures and distributed parallel processing paradigmsNVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. We have some of the most forward-thinking and hardworking people on the planet working for us. If you're creative, passionate and self-motivated, we want to hear from you!NVIDIA’s invention of the GPU in 1999 fueled the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern deep learning — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and establish teams with the most thoughtful people in the world. Are you ready to change the next generation of computing? Join us at the forefront of technological advancement.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.You will also be eligible for equity and benefits.Applications for this job will be accepted at least until August 3, 2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa ClaraType: Full time

Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Distinguished Engineer - Data Center System Software Architect in Santa Clara, CA vacancy
  • $152k - $241.5k

     ...is looking for an experienced Senior Software and System Architect to join our Networking Software...  ...focused company shaping the future of data‑centers technologies. What you will be doing...  ...solution architects, application and field engineers Working with high‑profile customers... 
    Suggested

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $320k

     ...and HPC. We are looking for a Distinguished Software Architect to help co-design our next generation data center platforms. DL and HPC...  ...Computer Science, Computer Engineering or related field or strong equivalent...  ..., UCX, UCC), computer and system architecture, GPU... 
    Suggested
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    2 days ago
  • $224k - $356.5k

    We are looking for a Senior System Software Architect to help build NVIDIA Halos, our full-stack safety...  ...train deep neural networks in the data center on the NVIDIA DGX, and then...  ...integrity softwareUse GenAI and AI-assisted engineering tools to accelerate debugging, test... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $262k - $364k

     ...projects, anchoring the architecture and engineering roadmap of common software for Accelerator platforms.Design,...  ...with hardware.Experience with data center servers and AI platforms.Preferred...  ...distributed computing, large-scale system design, networking and data storage... 
    Suggested
    Worldwide

    Google

    Sunnyvale, CA
    1 day ago
  • $184k - $287.5k

     ...is seeking a Senior System Architect: Heterogeneous EDA Systems...  ...waste. We need an engineer to develop and build...  ...in real-time. It will distinguish between hardware...  ...infrastructure instability, and software defects. What you'...  ...the NVIDIA DCGM (Data Center GPU Manager) and... 
    Suggested

    NVIDIA

    Santa Clara, CA
    5 days ago
  •  ...scaling Deep Learning and HPC. We're seeking a Senior Software Architect to help co‑design next‑gen data center platforms and scalable communications software....  ...grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the... 

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $224k - $356.5k

     ...are building innovative server systems for GPU accelerated applications, such as Deep Learning. Data Center SW team architects and develops the end to end software and firmware stack for these systems...  ...You will work with world class engineering teams, product management,... 
    Shift work

    Segment (Twilio)

    Santa Clara, CA
    3 days ago
  • $272k - $431.25k

    ## Principal Software Architect, Networking AIApplylocations: US, CA, Santa Claratime type: Full...  ...Networking to build the future of AI data-centers. This role is tailored for those...  ...and networking* Bachelor’s degree in Engineering or equivalent experience* Strong expertise... 

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $75k - $95k

     ...IT Support Engineer (AI Infra & Data Center Operations Support) Location: San Jose, CA, United States Job Type: Full-Time Schedule: 8 hours/day...  ...and next-generation AI infrastructure operations and system transition. The selected candidate will work closely... 
    Full time
    For contractors
    Work at office

    SK C and C USA, Inc.

    San Jose, CA
    5 days ago
  • $184k - $287.5k

    As a Senior Software Architect in the GPU Networking Architecture team, you will...  ...fields related to the modern data center, such as distributed AI and deep learning systems, Networking Operating Systems...  ..., Electrical or Computer Engineering (or equivalent experience).... 

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

     ...NVIDIA is looking for a brilliant Software & Systems Architect to join the NIC Software/Firmware Architecture...  ...of a team crafting the upcoming data-center DPU generation with hardware and...  ...See: ~ B.Sc. or M.Sc. in Computer Engineering, Computer Science, Electrical Engineering... 

    NVIDIA

    Santa Clara, CA
    4 days ago
  • $195k - $225k

     ...across energy, manufacturing, data center construction, and cloud...  ...motivated Electrical Design Engineer to act as the primary technical...  ...large-scale power distribution systems are designed for safety, compliance...  ...Proficiency with engineering software (AutoCAD, Revit, ETAP, SKM)... 
    Temporary work
    Work at office

    Crusoe

    Sunnyvale, CA
    20 days ago
  • $157.49k - $262.49k

    Req ID:372346NTT DATA strives to hire exceptional, innovative and passionate individuals...  ...seeking a Salesforce CPQ Solution Architect to join our team in Santa Clara, California...  ...AI, cloud, security, connectivity, data centers and application services. our consulting... 
    Temporary work
    Work at office
    Remote work
    Monday to Friday
    Flexible hours
    Shift work
    Weekend work

    NTT DATA

    Santa Clara, CA
    2 days ago
  • $186.2k - $316.5k

    ## Senior HPC Software & Systems ArchitectApplylocations: Milpitas, CAtime type: Full timeposted on: Posted Yesterdayjob requisition id...  ...% of sales back into R&D. Our expert teams of physicists, engineers, data scientists and problem-solvers work together with the world... 
    Minimum wage
    Work experience placement
    Flexible hours

    KLA-Belgium

    Milpitas, CA
    2 days ago
  • $272k - $431.25k

    Principal System Software Engineer - Data Center MODS page is loaded## Principal System Software Engineer - Data Center MODSlocations: US, CA, Santa...  ...Center MODS organization seeks a Principal Engineer to architect and scale next-generation L10 and L11 diagnostic systems... 

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  •  ...this role, the Senior Engineer will assist the Lead Project...  ...clients, contractors, architects, and other project...  ...of engineering software. · Ability to perform...  ...emergency power supply system (EPSS), stand-by power...  ...commercial, life sciences, data centers, hospitals (OSHPD),... 
    Contract work
    For contractors
    Work at office
    Local area

    Alfatech

    San Jose, CA
    11 days ago
  • $323k

     ...outstanding and visionary Lead Architect to drive the...  ...exploration of next-generation system architectures and...  ...infrastructure across data center and networking domains...  ..., Hyperscalers needs, software ecosystems, and...  ...system architects and engineering teams to translate long... 
    Work at office
    Local area
    Remote work

    ARM

    San Jose, CA
    4 days ago
  •  ...experiences-from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture...  ...seeking a hands-on System Architect to lead the end-to-end...  ...hardware, firmware, software, and operational aspects...  ...will collaborate with engineering leads, product managers... 

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    1 day ago
  •  ...Micron Technology in San Jose, California, seeks a System Architect to lead performance modeling and analysis for next‑generation memory architectures across AI, server, data center, and mobile platforms. You will build and validate timing-approximate and cycle-accurate... 

    Micron Memory Malaysia Sdn Bhd

    San Jose, CA
    1 day ago
  • $184k - $287.5k

     ...scientists, researchers and engineers can advance their ideas. At...  ...to work in the world! At the center of NVIDIA's culture are our...  ...be. We are looking for a Systems Architect to lead and drive power solutions...  ...partners. Experience in data center, client, or... 
    Temporary work

    NVIDIA

    Santa Clara, CA
    1 day ago
  • $200k - $220k

     ...energy, manufacturing, data center construction, and...  ...Energy as a Senior Data Engineer, an early and pivotal...  ...unique opportunity to architect and build the foundational...  ...and implement the systems that make those pipelines...  ...Engineering Teams: Partner with software engineers, data... 
    Full time
    Temporary work

    Crusoe Energy Systems

    Sunnyvale, CA
    1 day ago
  • $184k - $287.5k

    Senior Data Center Performance Engineer - Benchmarking and Optimization page is loaded## Senior Data Center...  ...designs. From single node HGX/DGX systems all the way up to large multi-node NVLink...  ...a fully optimized NVIDIA AI and HPC software stack. We are searching for a highly... 

    NVIDIA Corporation

    Santa Clara, CA
    1 day ago
  • $146k - $286k

    Micron is seeking a System Architect to lead performance modeling and analysis of next‑generation...  ...memory architectures for AI, server, data center, and mobile platforms. In this role,...  ...paradigms, partnering with internal engineering teams and external customers to shape... 
    Local area

    Micron Technology, Inc.

    San Jose, CA
    1 day ago
  • $184k - $287.5k

     ...responsible for building a scalable and modular software stack that powers advanced driver-assistance systems across a diverse range of product lines and OEMs....  ...looking for a highly motivated Senior Systems Software Engineer with a strong foundation in software architecture... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...contribute, and revolutionize AI silicon and system.DescriptionWe are looking for a world-class Machine Learning System Software Architect to join our SoC team at Baidu’s Sunnyvale...  ...with system and application software engineers to ensure optimization of the entire hardware... 
    Work at office

    Baidu

    Sunnyvale, CA
    1 hour ago
  •  ...TekWissen is seeking an onsite 1st shift Systems Design Engineer for a global semiconductor client in Austin. You will debug HW/SW, monitor...  ...Linux scripting, GPU/firmware debugging, and experience with data center platforms. Collaboration with OEMs and vendors is... 
    Day shift

    Tekwissen

    Santa Clara, CA
    1 day ago
  • $72.96k - $115.2k

     ...What this Job Entails: The Data Center Engineer III will be heavily involved in the design of the datacenter collocations, infrastructure hardware, and provide technical consultations. The incumbent will build/create all drawings for datacenter POP’s and develop/write... 
    Full time
    Temporary work
    Work at office
    Flexible hours

    Astreya

    Cupertino, CA
    3 days ago
  •  ...Data Center Engineering Lead (Contract) Department : Infrastructure, Planning & Process (IPP) Company...  ...Center Engineering Lead (Contract) to architect and direct large-scale infrastructure...  ...alignment: Partner with Cloud Platform, SPT (System Product Teams), Facilities,... 
    Contract work

    SproutsAI

    Santa Clara, CA
    3 days ago
  • $182k - $242k

     ...more at . What You’ll Do The Data Engineering Team builds and operates the...  ..., scalable lakehouse systems, and high‑quality datasets that...  ...modeling expertise with strong software engineering skills across...  ...day in our office and data center locations A casual work environment... 
    Permanent employment
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    3 days ago
  • $2,000 per month

     ...-design chips, racks, software, and manufacturing to...  ...and staffed by leading engineers, Etched is redefining...  ...infrastructure. As a Data Center Engineer at Etched, you...  ...software teams to bring systems online faster, keep...  ...network connectivity. Architect and implement high-speed... 
    Work at office
    Relocation package
    Shift work

    ETCHED LLC

    San Jose, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distinguished Engineer - Data Center System Software Architect. Be the first to apply!