Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Manager, Software Engineering - Rack Scale Systems Infrastructure

$248k - $391k
Full-time

NVIDIA

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world. Join our team in Santa Clara to lead engineers building rack-scale infrastructure software that makes complex hardware manageable and programmable. You will own delivery of control planes, lifecycle orchestration, system health, and recovery capabilities, working across hardware, firmware, networking, and operations teams to support customer deployments at rack and fleet scale. What you'll be doing:

  • Take ownership for the delivery of rack-scale infrastructure software within a cross-functional organizational structure. Coordinate commitments, address ownership gaps, and stay accountable for results from requirements to production adoption and support.
  • Translate business needs and evolving hardware roadmaps into release priorities and achievable plans. Balance staffing, dependencies, and technical risk across projects as priorities change.
  • Partner with architects and technical leads on control planes, lifecycle orchestration, health analysis, and recovery. Guide engineering tradeoffs and ensure a consistently high standard for reliability, security, and maintainability.
  • Build and develop the team through hiring, mentoring, and clear performance expectations. Grow technical leads and future managers, delegate important ownership, and balance work across the team.
  • Establish effective planning, validation, release, and issue triage practices. Use delivery and quality evidence to identify risks early, drive root-cause resolution of production issues, and improve how the team works.
  • Coordinate with firmware, platform, networking, quality assurance, security, and operations teams to deliver coordinated capabilities. Work directly with customers and partners to turn deployment feedback into product improvements.
  • Be responsible for the team's open-source delivery and support practices, including contribution review, issue triage, documentation, and release maintenance.
  • Communicate priorities, progress, and tradeoffs clearly to engineers, collaborators, and leadership. Make sound decisions in ambiguous situations and carry cross-team commitments through to completion.
What we need to see:
  • Bachelor's, master's, or doctoral degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience.
  • 12 or more overall years of engineering experience in systems software, platform software, server firmware, or data center infrastructure, including a minimum of 6 years managing software or firmware engineering teams.
  • Proven track record delivering production software across multiple programs in a matrix organization, aligning shared resources and dependencies while maintaining quality, release rigor, and effective production support.
  • Solid technical background in Linux, distributed systems, application programming interfaces, state machines, and failure handling. Familiarity with data center architecture, hardware-conscious orchestration, server manageability, firmware or operating system lifecycle, telemetry, and large-scale reliability.
  • Software development experience in Go, C++, or Rust, with the depth to review designs and code, guide debugging, and assess engineering quality.
  • Proven capability to guide distributed engineering groups, recruit and nurture engineers, cultivate technical leaders, assign significant responsibilities, and maintain a steady standard of performance.
  • Clear written and verbal communication, good judgment under ambiguity, and experience aligning engineering teams, customers, and partners on practical solutions.
Ways to stand out from the crowd:
  • Experience across the rack-scale systems lifecycle, from hardware bring-up and validation through provisioning, firmware and operating system updates, production operations, and recovery. Familiarity with NVIDIA GB200 or GB300 systems is a plus.
  • Experience with Kubernetes controllers or operators, declarative control planes, and simulation or fault injection to validate software before hardware is available.
  • Hands-on experience with baseboard management controller software, OpenBMC, embedded Linux, Python, and server debugging. Familiarity with Redfish or related standards for out-of-band management and device security, and with accelerated computing platforms using NVLink, Ethernet, or InfiniBand.
  • Built open-source infrastructure software used by external teams. Strong Rust experience and thoughtful use of artificial intelligence tools for development, testing, and debugging.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you! Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 248,000 USD - 391,000 USD. You will also be eligible for equity and [benefits](#). Applications for this job will be accepted at least until October 16, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Manager, Software Engineering - Rack Scale Systems Infrastructure in Santa Clara, CA vacancy
  • $272k - $431.25k

     ...The software behind autonomous vehicles, medical...  ...their underlying systems software can have...  ...and disciplined engineering across every...  ...technical engineering manager to lead the core...  ...work, then scale what succeeds across...  ..., or multi-agent infrastructure adopted across multiple... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

     ...At NVIDIA, as a Principal Rack Scale Systems Infrastructure Engineer, you will build and guide the development of software systems. These systems...  ...hardware into dependable, manageable, and programmable infrastructure...  ...environments. Mentor senior engineers and technical... 
    Suggested
    Full time
    Shift work

    Nvidia

    Santa Clara, CA
    16 hours ago
  • $175k - $287k

     ...platform. The manager will help guide...  ...across AI infrastructure and product-focused...  ...closely with engineering and product...  ...depth with broad systems thinking helping the team scale the platform...  ...improvements across the software development...  ...with senior management in... 
    Suggested
    Full time
    For contractors
    Work at office
    Flexible hours

    LinkedIn

    Mountain View, CA
    a month ago
  •  ...companies can hire, pay, and manage employees in 185+...  ..., stay compliant, and scale with confidence. With...  ...for a hands-on Senior Engineering Manager to lead a high...  ...reliable, and extensible systems using React, TypeScript...  ...Claude Code) to improve software development lifecycle... 
    Senior
    Work at office
    Local area
    Flexible hours
    Shift work

    hellopebl.com

    Palo Alto, CA
    2 days ago
  • $272k - $431.25k

     ...them. NVIDIA seeks a Senior Engineering Manager to define and drive...  ...and build innovative systems that improve...  ...0+ overall years of software engineering experience...  ...contribute to large-scale projects with external...  ...compiler or runtime infrastructure for deep learning frameworks... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    16 hours ago
  • $272k - $431.25k

     ...distributed teams and the systems they build into a...  ...capability work at scale creates one of the...  ...an RL Frameworks engineering team for the open-source tools and infrastructure that researchers,...  ...are looking for a Senior Software Engineering Manager to set strategy, build... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $272k - $431.25k

     ...NVIDIA is the engine of modern AI, and robotics...  ...leader and manager to head up Isaac...  ...arms and dexterous systems the perception,...  ...team of robotics software engineers; set direction...  ...and modern ML infrastructure, and how to...  ...Experience starting or scaling a product or team... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    16 hours ago
  • $217k - $326k

     ...customers at exabyte scale, with an...  ...developer productivity infrastructure related to...  ..., build systems, and containerized...  ...environments that engineers rely on daily...  ...build and test software. We're looking for a Senior Software Engineer...  ...engineering manager to shape the team... 
    Senior
    Work at office
    Local area
    Flexible hours

    Everpure, Inc.

    Santa Clara, CA
    3 days ago
  •  ...hardware and battery systems to intuitive...  ..., intelligent software, and next-...  ...transportation on a global scale. Commercial Software Engineering builds digital...  ...customers manage their...  ...vehicle data. This Senior Software Engineering...  ...Vehicle Data, Infrastructure, Security,... 
    Senior
    Full time
    Local area
    Work from home
    Relocation package

    General Motors

    Sunnyvale, CA
    4 days ago
  • $220k - $280k

     ...NASDAQ: ALAB) provides rack-scale AI infrastructure through purpose-...  ...company’s COSMOS software suite to unify diverse...  ...cohesive, flexible systems that deliver end-to...  ...— we need a senior engineering leader to build and...  ..., quality, product management, sales, and customer... 
    Senior
    Contract work
    Flexible hours

    SilverShoots

    San Jose, CA
    2 days ago
  • $184k - $287.5k

     ...is pivotal. You will manage the team responsible...  ...a multidisciplinary engineering team that owns GSP firmware...  ...-quality GPU driver software by establishing...  ...experience. ~ Strong systems-software background –...  ...computing. Today, our AI infrastructure powers global... 

    Jobleads-US

    Santa Clara, CA
    1 day ago
  • $213k - $237k

     ...About the Role Muon seeks a Senior Software Engineer to join our Simulation team. An ideal candidate...  ...language Familiarity with Linux systems administration and Docker containers...  ...rapid, flexible payload integration at scale. From climate monitoring to national security... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Muon Space

    San Jose, CA
    2 days ago
  • $213k - $237k

     ...About the role Muon seeks a Senior Software Engineer to join our Software Test...  ...of our software testing infrastructure. You will work with engineers...  ...with version control systems (e.g., Git) and continuous...  ...flexible payload integration at scale. From climate monitoring to... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours

    Muon Space

    San Jose, CA
    2 minutes ago
  • $196k - $217k

     ...About the role Muon seeks a Senior Software Engineer to join our Information Systems team. The ideal candidate is a self-motivated and versatile software engineer...  ...and rapid, flexible payload integration at scale. From climate monitoring to national security, Muon... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Muon Space

    San Jose, CA
    3 days ago
  • $263k - $395k

     ...the Director of Software Engineering for Core Platform...  ...metadata systems across our major...  ...performance resource management frameworks. Collaborating...  ...bulletproof infrastructure that impacts our...  ...global platform scale for years to...  ...engage credibly with senior engineers on... 
    Full time
    Work at office
    Flexible hours

    Everpure, Inc.

    Santa Clara, CA
    3 days ago
  • $237.5k - $286k

     ...Ethernet Scale-Up RTL Lead/Principal Engineer TylSemi, Inc. San...  ...Opportunity The AI infrastructure market is...  ...that makes AI/HPC systems actually work...  ...middle management. Remote-Friendly...  ...chiplet for HPC/rack-scale AI systems...  ...hardware, firmware, software, and system... 
    Remote work
    Shift work

    TylSemi, Inc.

    San Jose, CA
    3 days ago
  •  ...Ethernet Scale-Up RTL Lead/Principal Engineer Role Overview TYLsemi...  ...chiplet for HPC/rack-scale AI systems. We are seeking a...  ...offload, traffic management, congestion...  ...hardware, firmware, software, and system teams...  ...Opportunity The AI infrastructure market is... 
    Remote work
    Shift work

    TylSemi

    San Jose, CA
    3 days ago
  • $193.6k - $414.4k

     ...Oracle Cloud Infrastructure (OCI) is building...  ...newly created Senior Director...  ...the strategy, engineering, qualification...  ...and lifecycle management of the physical...  ...across platform software, media qualification...  ...at executive scale, partnering...  ...silicon and systems engineering teams... 
    Senior
    Temporary work
    Worldwide
    Flexible hours

    Oracle Corporation

    Santa Clara, CA
    2 days ago
  • $320k

     ...is seeking an engineering director to lead the software teams behind our...  ...cloud compute infrastructure. The...  ...networking, and system software are integrated...  ...storage, and rack-scale, liquid-cooled...  ...diversity manageable at scale. What...  ...services with senior engineers. ~... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  •  ...Senior Manager, Sales Engineering AI / GPU Cloud (NeoCloud) Mirantis...  ...-native AI infrastructure company, enabling...  ...sales bar as we scale headcount and deal...  ...72 / B200-class systems, Grace-Hopper...  ...training clusters. Software and platform...  ...power, cooling, rack density, and how... 
    Senior

    Mirantis

    San Jose, CA
    4 days ago
  • $45 - $60 per hour

     ...The Recommendation Infrastructure Team is...  ...recommendation components, systems, and platforms....  ...join one of our engineering teams where you will...  ...globalized large-scale recommendation...  ...Masters degree in Software Development, Computer...  ...handling and managing confidential information... 
    Hourly pay
    Work experience placement
    Internship
    Summer internship
    Local area
    Flexible hours

    TikTok

    San Jose, CA
    3 days ago
  •  ...Description We’re seeking a Senior Software Engineer to join our Infrastructure team within Platform....  ...to discover APIs, manage credentials, access interactive...  ...existing authorization system, covering Cognito-...  ...providers, and contribute to a platform that scales.... 
    Senior

    James Consultancy Services , LLC

    Mountain View, CA
    9 days ago
  • $140k - $200k

     ...to enable hyper-scaled deployments of Internet...  ...(LEO) space system that will fundamentally...  ...for EDA and HPC engineering workflows, including automated software deployment,...  ...configuration, and version management, and establish...  ...tool and infrastructure changes across development... 
    Senior
    Full time
    Work at office
    Immediate start
    Visa sponsorship
    Night shift

    E-Space

    Santa Clara, CA
    5 days ago
  • $240k - $265k

     ...About the role We are looking for a Senior Software Engineering Manager to lead the team responsible for...  ...that operates the flight and payload systems for on-orbit satellites. This team owns...  ..., flexible payload integration at scale. From climate monitoring to national... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Muon Space

    San Jose, CA
    4 days ago
  • $152k - $241.5k

     ...diagnostic applications and infrastructure to test every NVIDIA GPU....  ...before launch. As part of the Senior Software Engineer, AI Infrastructure...  ...agentic AI solutions—autonomous systems that reason, plan, and take...  ...ensure solutions perform at scale and meet enterprise standards... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $375k - $425k

     ...Chief Architect, AI Infrastructure & Memory Systems (VP/CTO) Job...  ..., storage, and software. Explore alternative...  ..., and systems engineering teams to develop...  ...directly with senior technical...  ...concepts to executive management and engineering...  ...and large-scale AI systems. ~... 
    Ongoing contract
    Local area

    CyberCoders

    San Jose, CA
    21 days ago
  • $224k - $356.5k

     ...AI to autonomous systems, and we continue...  ..., our team, Managed AI Research Superclusters...  ...), builds and scales the infrastructure, platforms, and...  ...researchers and engineers to develop the...  ...grow a team of software and systems engineers...  ..., including senior and staff-level... 
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $220.1k - $297.7k

     ...Amazon Traffic Engineering builds innovative managed compute and networking...  ...that empower Amazon Software Engineers to build...  ...available and easy to scale. We identify and...  ...support the foundational infrastructure capabilities tools...  .... As a Senior Manager you will own... 
    Senior
    Full time
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    a month ago
  • $182k - $226k

     ...Senior Full Stack Software Engineer San Jose, California, United States...  ...maintain software systems that collect, transform...  ...Engineering Manager. Primary Responsibilities...  ...CI/CD pipelines, infrastructure as code, and...  ...world's experts in scaling technologies for the... 
    Senior
    Temporary work

    Electric Hydrogen

    San Jose, CA
    1 day ago
  • $167.7k - $245.2k

     ...platform to keep their systems secure, available,...  ...We're looking for a Software Engineer who enjoys solving difficult...  ...~ Build a global-scale, security platform,...  ...from architecture, eng management, and product...  ...revolutionizing how data and infrastructure connect and protect organizations... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    3 days per week

    Cisco

    San Jose, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Manager, Software Engineering - Rack Scale Systems Infrastructure. Be the first to apply!