Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Manager, Software Engineering - Rack Scale Systems Infrastructure

$248k - $391k
Full-time

NVIDIA

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

Join our team in Santa Clara to lead engineers building rack-scale infrastructure software that makes complex hardware manageable and programmable. You will own delivery of control planes, lifecycle orchestration, system health, and recovery capabilities, working across hardware, firmware, networking, and operations teams to support customer deployments at rack and fleet scale.

What you'll be doing:

  • Take ownership for the delivery of rack-scale infrastructure software within a cross-functional organizational structure. Coordinate commitments, address ownership gaps, and stay accountable for results from requirements to production adoption and support.
  • Translate business needs and evolving hardware roadmaps into release priorities and achievable plans. Balance staffing, dependencies, and technical risk across projects as priorities change.
  • Partner with architects and technical leads on control planes, lifecycle orchestration, health analysis, and recovery. Guide engineering tradeoffs and ensure a consistently high standard for reliability, security, and maintainability.
  • Build and develop the team through hiring, mentoring, and clear performance expectations. Grow technical leads and future managers, delegate important ownership, and balance work across the team.
  • Establish effective planning, validation, release, and issue triage practices. Use delivery and quality evidence to identify risks early, drive root-cause resolution of production issues, and improve how the team works.
  • Coordinate with firmware, platform, networking, quality assurance, security, and operations teams to deliver coordinated capabilities. Work directly with customers and partners to turn deployment feedback into product improvements.
  • Be responsible for the team's open-source delivery and support practices, including contribution review, issue triage, documentation, and release maintenance.
  • Communicate priorities, progress, and tradeoffs clearly to engineers, collaborators, and leadership. Make sound decisions in ambiguous situations and carry cross-team commitments through to completion.

What we need to see:

  • Bachelor's, master's, or doctoral degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience.
  • 12 or more overall years of engineering experience in systems software, platform software, server firmware, or data center infrastructure, including a minimum of 6 years managing software or firmware engineering teams.
  • Proven track record delivering production software across multiple programs in a matrix organization, aligning shared resources and dependencies while maintaining quality, release rigor, and effective production support.
  • Solid technical background in Linux, distributed systems, application programming interfaces, state machines, and failure handling. Familiarity with data center architecture, hardware-conscious orchestration, server manageability, firmware or operating system lifecycle, telemetry, and large-scale reliability.
  • Software development experience in Go, C++, or Rust, with the depth to review designs and code, guide debugging, and assess engineering quality.
  • Proven capability to guide distributed engineering groups, recruit and nurture engineers, cultivate technical leaders, assign significant responsibilities, and maintain a steady standard of performance.
  • Clear written and verbal communication, good judgment under ambiguity, and experience aligning engineering teams, customers, and partners on practical solutions.

Ways to stand out from the crowd:

  • Experience across the rack-scale systems lifecycle, from hardware bring-up and validation through provisioning, firmware and operating system updates, production operations, and recovery. Familiarity with NVIDIA GB200 or GB300 systems is a plus.
  • Experience with Kubernetes controllers or operators, declarative control planes, and simulation or fault injection to validate software before hardware is available.
  • Hands-on experience with baseboard management controller software, OpenBMC, embedded Linux, Python, and server debugging. Familiarity with Redfish or related standards for out-of-band management and device security, and with accelerated computing platforms using NVLink, Ethernet, or InfiniBand.
  • Built open-source infrastructure software used by external teams. Strong Rust experience and thoughtful use of artificial intelligence tools for development, testing, and debugging.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 248,000 USD - 391,000 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 16, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Manager, Software Engineering - Rack Scale Systems Infrastructure in Santa Clara, CA vacancy
  • $272k - $431.25k

     ...At NVIDIA, as a Principal Rack Scale Systems Infrastructure Engineer, you will build and guide the development of software systems. These systems...  ...hardware into dependable, manageable, and programmable infrastructure...  ...environments.Mentor senior engineers and technical... 
    Suggested
    Full time
    Remote work
    Shift work

    Nvidia

    Santa Clara, CA
    20 hours ago
  • $175k - $287k

     ...platform. The manager will help guide...  ...across AI, infrastructure, and product-focused...  ...closely with engineering and product...  ...depth with broad systems thinking, helping the team scale the platform,...  ...across the software development lifecycle...  ...with senior management in... 
    Suggested
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  • $272k - $431.25k

     ...them. NVIDIA seeks a Senior Engineering Manager to define and drive...  ...and build innovative systems that improve...  ...0+ overall years of software engineering experience...  ...contribute to large-scale projects with external...  ...compiler or runtime infrastructure for deep learning frameworks... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $272k - $431.25k

     ...distributed teams and the systems they build into a...  ...capability work at scale creates one of the...  ...an RL Frameworks engineering team for the open-source tools and infrastructure that researchers,...  ...are looking for a Senior Software Engineering Manager to set strategy, build... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    1 day ago
  • $143k - $286k

     ...level execution of software and AI/ML systems, ensuring...  ....Oversee shared infrastructure, tooling, and ML...  ...efficiency.Mentor engineers, guide architectural...  ...standards.Manage stakeholder relationships...  ...StockSummaryThe Senior Manager,...  ...applications at massive scale. When we improve... 
    Senior
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    20 hours ago
  • $180k - $225k

     ...RoleWe are looking for a Senior Manager Software Engineering to join our team. This is...  ...reviews, and development of system-level performance...  ...world problems.You think at scale, connecting day-to-day efforts...  ...)Experience with cloud infrastructure (AWS) and Infrastructure-... 
    Senior
    Full time
    Work at office
    Local area

    Zscaler

    San Jose, CA
    4 days ago
  • $198k - $326k

     ...largest privately managed compute infrastructures in the world outside...  ...cloud providers. As a Senior Engineering Manager on the...  ...members, to large-scale data and analytics...  ...of our world-class software engineering organization...  ...highly distributed systems at massive scale,... 
    Senior
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  • $272k - $431.25k

    NVIDIA is the engine of modern AI, and robotics...  ...leader and manager to head up Isaac...  ...arms and dexterous systems the perception,...  ...team of robotics software engineers; set direction...  ...and modern ML infrastructure, and how to...  ...Experience starting or scaling a product or team... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    20 hours ago
  • $143k - $286k

     ...Segment: Home OfficeRole summary: The Senior Manager, Software Engineering, leads platform-level execution of software and AI/ML systems, ensuring alignment with strategic priorities...  ...milestones. This role oversees shared infrastructure, tooling, and frameworks to support... 
    Senior
    Full time
    Temporary work
    Part time
    Worldwide

    Walmart

    Sunnyvale, CA
    11 hours ago
  • $320k

     ...is seeking an engineering director to lead the software teams behind our...  ...cloud compute infrastructure. The...  ...networking, and system software are integrated...  ...storage, and rack-scale, liquid-cooled...  ...diversity manageable at scale.What...  ...services with senior engineers.A record... 
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $174k - $253k

     ...and test product or system development code....  ...by other engineers and provide feedback...  ...maintaining, or launching software products, and 1...  ...information at massive scale, and extend well...  ...you will manage project priorities...  ...by the Technical Infrastructure team to keep it running... 
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    3 days ago
  • $174k - $252k

     ...and test product or system development code....  ...by other engineers and provide feedback...  ...maintaining, or launching software products, and 1...  ...information at massive scale, and extend well...  ...you will manage project priorities...  ...solutions.The AI and Infrastructure team is redefining... 
    Senior
    Worldwide

    Google

    Sunnyvale, CA
    3 days ago
  • $224k - $356.5k

    NVIDIA is hiring engineers to scale up the introduction of next generation architecture into its EDA Infrastructure. We expect you to have a deep understanding of new...  ...introductions (NPIs), distributed systems, familiarity with software testing and deployment, and excellent... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $196.5k - $291.5k

     ...two-sided network at scale that connects hundreds...  ...exchanges and returns, and manage risk. We enable...  ...Summary:We’re looking for a Senior Engineering Manager to help shape...  ...manage individual software development projects....  ...large-scale distributed systems and familiarity with modern... 
    Senior
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    PayPal

    San Jose, CA
    3 days ago
  •  ...hardware and battery systems to intuitive...  ..., intelligent software, and next-...  ...transportation on a global scale. Commercial Software Engineering builds digital...  ...customers manage their...  ...vehicle data. This Senior Software Engineering...  ...Vehicle Data, Infrastructure, Security,... 
    Senior
    Full time
    Local area
    Work from home
    Relocation package

    General Motors

    Sunnyvale, CA
    20 hours ago
  • $224k - $356.5k

     ...looking for a top-tier Software Engineering Leader to join the...  ...the Network Operating System software that powers...  ...Release Software Build Infrastructure, packaging and...  ...software components.Scale engineering infrastructure...  ...proven experience as manager of Software Tools Engineering... 
    Full time

    Nvidia

    Santa Clara, CA
    20 hours ago
  • $212k - $265k

     ...transformation in the AI era? Join us at Zscaler.RoleAs the Senior Manager of Software Test Engineering for the Zero Trust Exchange organization at Zscaler,...  ..., you will lead a high-performing team in rapidly scaling the Zscaler Client Connector Portal service. In this San... 
    Senior
    Full time
    Work at office
    Local area

    Zscaler

    San Jose, CA
    3 days ago
  • $198k - $326k

     ...our world-class software engineering team, you will take...  ...next-generation infrastructure and platforms...  ...API design and systems design, and your...  ...performs at massive scale. LinkedIn has...  ...leadership and management within and outside...  ...level: Mid-Senior LevelIndustry: Internet
    Senior
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Sunnyvale, CA
    20 hours ago
  • $253.1k - $342.3k

    Amazon Traffic Engineering builds innovative managed compute and networking...  ...that empower Amazon Software Engineers to build...  ...available, and easy to scale. We identify and...  ...support the foundational infrastructure capabilities, tools...  ...technologies.As a Senior Manager, you will... 
    Senior
    Local area
    Flexible hours

    Amazon

    Sunnyvale, CA
    4 days ago
  • $272k - $431.25k

    We're looking for a Principal Software Engineer to join our CSP Engagements team as the technical focal point for rack-scale system SW/FW, working with CSP engineering teams to ensure...  ...is on the system-level software that manages, monitors, and recovers the rack as a whole... 
    Full time
    Remote work
    Shift work

    Nvidia

    Santa Clara, CA
    2 days ago
  • $242k - $398k

     ...Product Platform & Infrastructure team builds...  ...for an engineering leader to drive...  ...billion+ member scale with unprecedented...  ..., and Android.Manage a customer-...  ...plans for legacy systems.Improve the...  ....10+ years of software engineering experience...  ...managers and senior technical... 
    Senior
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Mountain View, CA
    3 days ago
  •  ...Senior Manager of Software Engineering When you mentor and advise multiple technical teams and move financial...  ...on NEO that leverage the firm's scale, data, and full-service advantage to...  ...-on practical experience delivering system design, application development, testing... 
    Senior

    JPMorgan Chase

    Palo Alto, CA
    1 day ago
  • $168k - $264.5k

     ...world.Join NVIDIA’s CAD Infrastructure team and be part of...  ...building a next-generation software platform for...  ...graphs at a trillion-edge scale. This is an ambitious endeavor, and we need engineers who thrive in a hands-...  ...architecture: you've built systems, not just contributed... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    20 hours ago
  • $174k - $252k

     ...and test product or system development code.Participate...  ...of experience with software development in one or...  ...developing large-scale infrastructure, distributed systems...  ...Experience with software engineering, machine learning and...  ...years of experience managing cross-functional or... 
    Senior

    Google

    Sunnyvale, CA
    4 days ago
  • $184k - $287.5k

     ...DriveOS is the software platform behind...  ...machines, combining system software,...  ...applications. Our Infrastructure and Tooling team makes the engineering environment behind...  ...re looking for a Senior Software Engineer...  ....Experience managing enterprise-scale CI/CD environments... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    4 days ago
  • $153.2k - $234.1k

     ...DescriptionRole OverviewAs a Senior Software Engineer on the Rendering Infrastructure team, you will build the systems that turn a GPU-accelerated...  ...reproducibly, at cluster scale, and against production-representative...  ..., GPU memory and resource management, acceleration structure... 
    Senior
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Sunnyvale, CA
    1 day ago
  • $119.8k - $234.7k

     ...than 25%Profession: Software EngineeringDiscipline...  ...Intelligence (AI) Infrastructure Engineering Systems team at Microsoft builds...  ...AI services at scale. You will help create...  ...and service lifecycle management. Working with AI...  ...solutions.Role Summary As a Senior or Principal... 
    Senior
    Ongoing contract
    Local area
    3 days per week

    Microsoft

    Mountain View, CA
    2 days ago
  • $160k - $240k

     ...mobile app, or withdraw money from the bank, we're involved. If you want to make an impact on a global scale, come make a difference at Fiserv.Job TitleSr. Manager, Software EngineeringAbout your role:At Fiserv, we are dedicated to transforming financial services... 
    Senior
    Full time

    Fiserv

    Sunnyvale, CA
    20 hours ago
  • $208k - $416k

     ...to define, build, and scale AI-powered content...  ...shopping platforms. As a Senior Director, you will...  ...technologies, and scalable engineering systems, delivering...  ...years of experience in software engineering, platform...  ...experience leading leaders (managing managers) and large... 
    Senior
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    3 days ago
  •  ...the da Vinci surgical system and Ion—have transformed...  ...worldwide.We’re a team of engineers, clinicians, and...  ...Position The multiport software group within Intuitive...  ...Sunnyvale, CA for a Software Manager with a focus on the...  ...the lifecycle of large-scale emulation features and... 
    Local area
    Immediate start
    Worldwide
    Flexible hours

    Intuitive Surgical

    Sunnyvale, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Manager, Software Engineering - Rack Scale Systems Infrastructure. Be the first to apply!