Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distinguished Engineer - Rack Scale Architecture

$320k

NVIDIA

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work.NVIDIA has a rapidly expanding ecosystem of data center platform & node designs. From single node HGX/DGX systems all the way up to large multi-node NVLink domain rack architectures. These designs have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. Each bringing together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. We're searching for a highly motivated, technical leader to drive the engineering roadmap and innovation for our rack system software architecture. From firmware, kernel drivers, operating systems, networking, fabrics and associated user mode drivers + manageability software. You will work with component leads internally and engage with industry leading hyperscalar / cloud service providers on taking these products to market.What you’ll be doing:Drive the software end-to-end architecture for NVIDIA's rack-scale productsMaintain deep understanding of the product portfolio and roadmap; translate forward-looking plans into clear, formal software requirements that anchor execution across the organization.Ensure high quality & reliable software; serving as a trusted architectural partner to teams requiring guidance or oversight.Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap.Work with business partners and vendors to shape their products to meet NVIDIA’s needs.Develop a roadmap of new technologies and protocols; drive their design and adoption.Mentor architects and engineering teams to grow them into future leaders.Make key technical decisions even when faced with ambiguityWhat we need to see:BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience.15+ years in the area of System architecture and designDeep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface.Strong understanding of networking technology & protocols (e.g. Ethernet, Infiniband)Previous experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAsExpertise in out-of-band and in-band management architectures.Knowledge of system management protocols such as Redfish and IPMI.Experience working with platform security experts to define tradeoffs between security and ease of use.Demonstrable experience in implementing left shift strategy to de-risk program execution. Excellent written and verbal communication skills.Ways to stand out from the crowd:Knowledge of large-scale cloud and cluster level deployment and management systems. Experience with designing robust, resilient and performant scale-up fabricsDemonstrated track record of leading data center products across the entire lifecycle, spanning inception, pre-silicon development, post-silicon bring-up, manufacturing, and deployment.Familiarity with CXL, UCIE and other C2C technology architectures. Knowledge in storage and networking technologies.We are widely considered to be one of the technology world’s most desirable employers, and as a result have some of the most forward-thinking and hardworking people in the world working for us. So if you're clever, creative, and driven, we'd love to have you join the team.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.You will also be eligible for equity and benefits.Applications for this job will be accepted at least until August 1, 2026.This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa Clara; US, RemoteType: Full time

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Distinguished Engineer - Rack Scale Architecture in Santa Clara, CA vacancy
  • $320k

     ...We are looking for a Distinguished Engineer to join NVIDIA's architecture organization and help define how future accelerated computing systems scale from a single processor to multi-die, multi-GPU, and multi-node platforms! In this role, we will rely on you to set long... 
    Suggested
    Full time
    Local area
    Shift work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $320k

    Join NVIDIA's Applied Power Architecture team and help define the...  ...across many domains. As a Distinguished Engineer, Power Architecture, you'll...  ...SoC, robotics SoC, or large-scale server SoC with significant...  ...cooling. This ranges from rack- and row-scale liquid or immersion... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $220.28k - $330k

     ..., cloud and AI, and carrier architectures, our innovative technology is...  ...switch ASICs—solutions engineered for hyperscale cloud environments...  ...solving some of the largest-scale data networking challenges...  ...excellence drives impact.As a Distinguished Engineer, you will be one of... 
    Suggested
    Permanent employment
    Internship
    Work at office
    Work from home

    Marvell

    Santa Clara, CA
    2 days ago
  • Distinguished Technologist, Distributed Systems & Agentic Query OptimizationThis...  ...architect and build large‑scale distributed systems,...  ...hands‑on technologist who shapes architecture, prototypes and ships high‑impact systems, mentors engineering teams, and helps define long‑... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise

    San Jose, CA
    3 days ago
  • $272k - $431.25k

    We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for rack-scale system SW/FW, working with CSP engineering teams...  ...to build shared understanding of the architecture, incorporate their operational feedback, and... 
    Suggested
    Full time
    Remote work
    Shift work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $320k

    Join NVIDIA's GPU memory architecture team and help define the DRAM and memory architecture of our Innovative silicon and systems across many domains. As a Distinguished Engineer, you'll develop the long-term technical strategy for Memory architecture including DRAM interfaces... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

     ...lasting impact on the world.At NVIDIA, as a Principal Rack Scale Systems Infrastructure Engineer, you will build and guide the development of software...  ....What You Will Be Doing:Define the complete software architecture for rack-scale infrastructure products and services,... 
    Full time
    Remote work
    Shift work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $342.7k

     ...TeamThe AI Platforms and Enablement team is the engine behind Cisco’s internal AI transformation. Our mission is to build and scale CIRCUIT, Cisco’s universal enterprise AI...  ...Program Management, Innovation & Advanced Architecture, and Strategy & Operations. Together, these... 
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Jose, CA
    3 days ago
  • $242.35k - $363k

     ...Across enterprise, cloud and AI, and carrier architectures, our innovative technology is enabling...  ..., generative AI fabrics, and global-scale networks that demand uncompromising performance.As a Senior Distinguished Engineer, you will be one of the most influential... 
    Permanent employment
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    2 days ago
  • $272k - $425.5k

    We are seeking a Distinguished Engineer of Production Silicon Diagnostics to elevate production ATPG and memory diagnostics into an outstanding...  ...capabilities, mentoring senior technical talent, and scaling high-impact teamsDeep expertise in ATPG diagnostics, memory... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $320k

     ...heart of our data centers is the ability to engineer integrated system designs in close...  ...products. We are seeking a Global Connectivity Distinguished Engineer to accelerate next-generation...  ...fiber infrastructure and global-scale AI deployments.What you’ll be doing:Participate... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $320k

    We are currently seeking a senior-level Engineer with distinguished expertise to join the Dynamo engineering team. As a Distinguished Engineer, you...  ...Dynamo to continue being a production-ready, data center-scale AI inferencing platform.Collaborate with diverse partner teams... 
    Full time
    Remote work
    Worldwide

    Nvidia

    Santa Clara, CA
    2 days ago
  • Senior Distinguished Technologist - Pre-Sales AI & Data Center Networking...  ...of innovation. Our Sales Engineering team empowers customers and...  ...Distinguished Technologist to lead architecture and solution design for AI/...  ...architecture playbooks to scale solutions internally and... 
    Full time
    Work experience placement
    Local area
    Immediate start
    Remote work
    Work from home

    Hewlett Packard Enterprise

    San Jose, CA
    4 days ago
  • Distinguished Technologist, Private Cloud AIThis role has been designed...  .../hybrid cloud. Strategy, Architecture & Design Lead AI architecture...  ...and agents and partner with engineering to take POCs into scalable,...  ...and optimize AI systems at scale and establish best practices... 
    Full time
    Work experience placement
    Work at office
    2 days per week

    Hewlett Packard Enterprise

    San Jose, CA
    3 days ago
  • $266.05k - $396k

     ...together across every function. Job Summary Distinguished Engineer - AI Infrastructure We are seeking a...  ...depth in AI/ML inferencing at scale and the distributed systems foundations...  ...problems into elegant, defensible architectures that teams rally behind. You drive consensus... 
    Work at office
    Local area
    Immediate start

    NetApp

    San Jose, CA
    21 hours ago
  • $285k - $355k

     ...across every function. Job Summary We are looking for a Distinguished Engineer (DE) reporting into Cloud Business Unit SVP&GM....  ...role will get the opportunity to work on building and scaling NetApp architecture and experience across all three major cloud services -... 
    Work at office
    Local area

    NetApp

    San Jose, CA
    21 hours ago
  • $273.2k - $384.8k

     ...product improvement. We are seeking a Distinguished Engineer to lead our most complex root cause...  ...immediate remediation and long-term architectural robustness.Institutionalize lessons learned...  ...in future generations.Utilize large-scale data analysis and AI-driven pattern... 
    Full time
    Temporary work
    Local area
    Immediate start
    Flexible hours

    CISCO Systems

    San Jose, CA
    4 days ago
  • $160k - $253k

     ...accelerated computing is the engine of artificial intelligence. Our...  ...ecosystem to power AI at scale. We are looking for a Senior...  ...focused on GPUs and scale-up architecture to join our growing accelerated...  ...server-level platforms, and rack-scale innovations that maximize... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $131k - $175k

     ...prestigious awards, such as Best Engineering Team, Best Company for...  ...You’ll Work With As a Senior Rack Solution Engineer at Arista,...  ...manufacturing engineers, to deliver rack-scale solutions for the world’s...  ...of next-generation rack architectures optimized for hyperscale data... 
    Remote work
    Flexible hours

    Arista Networks

    Santa Clara, CA
    4 days ago
  • $280.15k

     ...here.About the role:We’re looking for a Distinguished Engineer to set the technical vision and lead...  ...technical leader: defining long-term architecture, raising the bar on ML and systems excellence...  ...Lead the design and adoption of large-scale retrieval and ranking systems (e.g.,... 
    Temporary work
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    Palo Alto, CA
    4 days ago
  •  ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high...  ...RoleWe are hiring a Senior Performance Engineer to join our Product team. You are an... 
    Contract work
    Shift work

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $272k - $431.25k

     ...NVIDIA is seeking a Principal Engineer to drive the performance of large-scale AI training and post-training workloads across NVIDIA’s full hardware and...  ...sits at the intersection of distributed training, GPU architecture, systems software, deep learning frameworks, and... 
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $168k - $264.5k

     ...we ship. GDDR, LPDDR, and HBM are where architecture, silicon, packaging, and manufacturing collide...  ...hiring a Senior Memory Qualification Engineer inside the Silicon Co-Design Group who...  ...AI-driven workflow you built or scaled for memory characterization, margin analysis... 
    Full time
    Immediate start
    Flexible hours
    Shift work

    Nvidia

    Santa Clara, CA
    4 days ago
  • $136k - $218.5k

     ...work. The Silicon Co-Design Group is where architecture intent becomes silicon reality. We own...  ...not guess. They use your numbers. The engineers who do this well are rare. They think like...  ...in place.Background is in datacenter-scale or high-performance silicon and you know... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $193.3k - $261.5k

     ...We’re looking for a Senior SoC Modeling Engineer to join the team and deliver new functional...  ...models end-to-end, including model architecture, integration with other model or infrastructure...  ...improvements to help our models scale- Develop software which can be maintained... 
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    2 days ago
  • $210.16k - $271.98k

     ...Development EngineerHelp architect and deliver Dell's L11 rack-scale AI solutions: fully integrated racks that bring Dell...  ...' AI growth. As a Principal Systems Development Engineer, you'll own the system-level architecture and engineering of complete AI racks across compute,... 

    Dell Technologies

    Santa Clara, CA
    3 days ago
  • $209.77k - $314.3k

     ...connects our world. Across enterprise, cloud and AI, and carrier architectures, our innovative technology is enabling new possibilities....  ...to thrive, learn, and lead. Your Team, Your ImpactThe Distinguished Engineer, Memory Subsystem CoE is the senior-most technical... 
    Permanent employment
    Full time
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

     ...powered application is built. We are seeking a Sr. HPC Performance engineer to join our team of scientists and engineers passionate about...  ...and implement computationally performant features for large scale, CUDA-backed ML training frameworks, using low level acceleration... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...times larger than GPUs. This architecture allows Cerebras to deliver industry...  ..., to deploy 750 megawatts of scale, transforming key workloads...  ...Linux / Network Engineer to design, implement, and maintain...  ...with cabling vendors and server rack build teams to implement structured... 

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $190k - $230k

     ...AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-...  ...with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high...  ...are looking for a versatile Electrical Engineer who thrives at the bench—diagnosing... 
    Contract work
    Remote work

    Cerebras Systems

    Sunnyvale, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distinguished Engineer - Rack Scale Architecture. Be the first to apply!