Director, System Software Engineering - Metropolis Accelerated and Inferencing Software
$320kNVIDIA Gruppe
Within NVIDIA's Edge AI, Metropolis, and Blueprints (EMB), this team is the execution engine behind NVIDIA’s Vision AI strategy—owning the full lifecycle from model onboarding to production deployment. We transform foundation models into real‑time, GPU‑accelerated video intelligence systems using DeepStream and VSS. Our focus includes scaling multimodal reasoning and enabling agentic development workflows. We follow through between production data and model improvement. This work positions NVIDIA as the default platform for Physical AI. NVIDIA is looking for a proven Director of Systems Engineering who is hands‑on with deep learning and comfortable reading/modeling code, not just running it. You bring strong intuition for modern architectures (e.g., transformers, diffusion, and VLMs); deep experience tuning on NVIDIA GPUs (kernels, memory, and latency/efficiency trade‑offs) / SOCs; and a consistent track record of delivering robust, low‑latency inference at scale. You have led teams that turn Accelerated Computing pipelines into reliable, measurable business impact for embedded and Enterprise platforms. You will work with a cohesive, high‑performing team that’s been built and refined over the past nine years. An individual well‑aligned with industry experts is a great fit for this role! What You'll Be Doing: Lead, encourage, and develop world‑class engineering and data teams decentralized across Europe, Asia, and the United States. Architect and operationalize NVIDIA’s end‑to‑end data inference acceleration strategy, powering inference and continuous performance improvements. Drive strategic implementations of TensorRT, VLLM, and other accelerated frameworks for inference solutions for Edge and Enterprise devices: Lead Accelerated Computing efforts and solutions for key Metropolis verticals. Set up Proofs of Readiness (PORs) and guide their implementations. Collaborate with major Metropolis OEMs and Partners to architect highly accelerated and optimized custom deep‑learning models and inference pipelines for their specific requirements. Offer direct customer support, including debugging, technical education, and handling customer inquiries for our Metropolis partner and customers. Responsible for drafting and finalizing SOWs with internal customers and partners. Performance Benchmarking: Orchestrate efforts to achieve leading performance results on industry benchmarks like MLPerf on various edge and Enterprise devices. Technical Leadership & Influence: Function as a technical leader for deep learning across multiple teams, giving oversight and building support. Apply customer insights to shape the composition and structure of upcoming SOC/GPU deep‑learning hardware. Scaling the Team: Strategically hiring to meet new demands while also mentoring and adjusting existing teams to new deep‑learning challenges. Represent Nvidia Deep Learning solutions in webinars, conferences, and partner events. What We Need to See: Bachelor’s and/or Master's in Computer Science/Electrical Engineering or equivalent experience. 15+ years of overall experience, with a minimum of 10+ years of significant involvement in machine learning/deep learning research or practical experience, coupled with 7+ years of leadership background. Over 10 years of validated industry expertise in the embedded software sector, holding technical leadership positions accountable for delivering outstanding production software within a multidimensional setting. Deep knowledge of GPU, CPU, and dedicated deep‑learning architecture fundamentals, and low‑level performance optimizations using heterogeneous computing. Hands‑on experience with VLMs, LLMs, or multimodal AI systems applied to perception, data triage, or automated labeling. Strong expertise in large‑scale data processing, systems building, or machine learning pipelines. Strong communication, careful planning, and technical leadership capabilities. Ways to Stand Out from the Crowd: PhD in a relevant field such as Spatial Computing & Awareness, Sim‑to‑Real Transfer, Human-to-Physical AI Interaction. Deep experience with CV, LLMs, VLMs, GenAI models, and standards. Technical thought leadership in production deployment of Smart Spaces, Physical AI, with a deep understanding of constraints and advancements of sensing, computing, and model architecture evolutions. Current experience leading and driving global teams across multiple continents and time zones. With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and versatile people in the world working with us, and our engineering teams are growing fast in some of the most impactful fields of our generation: Analytics, Data Science, and Edge AI. If you’re a creative engineer who enjoys autonomy and shares our passion for technology, we want to hear from you. The base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD – 488,750 USD. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until May 5, 2026. This posting is for an existing vacancy. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr
$320k
...devices, and more. Our software platforms are at... ...looking for an engineering leader who is... ...teams that turn Accelerated Computing pipelines... ...strategy, powering Inferencing and continuous... ...solutions for key Metropolis verticals. Set up... ...or multimodal AI systems applied to perception...Suggested$200k
...into robots, autonomous mobile systems, drones, and other embodied... ...exceptional architects and engineers to rethink how AI, sensing,... ...Overview We are looking for an Accelerator Runtime Lead to own the... ...role will lead the user-space software layer that loads compiled model...SuggestedFlexible hours$262k - $365k
AI Accelerator Reliability Uber Tech Lead Sunnyvale, CA, USA Required Qualifications... ...Computer Science, Electrical Engineering, Computer Engineering, a... ...in reliability engineering, systems engineering, hardware engineering, or software engineering with a focus on system...SuggestedWorldwide- Google Inc. is seeking a Senior Accelerators Systems Software Architect in Sunnyvale, CA, to lead high-impact projects and integrate Accelerators into data centers. Ideal candidates will have extensive experience in C++ programming, software design, and AI tools. This role...Suggested
$200k
...into robots, autonomous mobile systems, drones, and other embodied... ...of exceptional architects and engineers to rethink how AI, sensing,... ...Overview We are looking for an Accelerator Driver / Firmware Interface Lead to own the low‑level software boundary between Velaura’s AI...SuggestedFlexible hours$168k - $258.75k
...computer graphics, PC gaming, and accelerated computing for more than 25... ...with our partners, engineering, operations & field teams to... ...capable of explaining GPU, software and computing architectures... ...bringing accelerated computing systems to market Benefits Widely considered...$183k - $271k
...in Sunnyvale, CA is seeking a Lead Engineer for Silicon and Software Integration within Google Cloud. This... ...the future of AI/ML hardware acceleration, leading the integration of custom... ...computer architecture and embedded systems, with at least 8 years of experience...$184k - $287.5k
...implement next-generation NvSci software to enable seamless cross-... ...user applications, hardware acceleration libraries, and frameworks on... ...to improve APIs, simplify system architecture, enhance software... ...with hardware and firmware engineers to optimize performance and...$262k - $365k
Senior Accelerators Systems Software Architect, AI Transformation corporate_fare Google place Sunnyvale... ...Master’s degree or PhD in Engineering, Computer Science, or a related technical... ...approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant...Worldwide$184k - $287.5k
...Senior Software Engineer – GPU Cloud Infrastructure We are looking for a Senior Software Engineer... ...cloud, and will power NVIDIA’s GPU‑accelerated data centers worldwide. You will play... ...deployment, operations). Own and document system and software architecture, designs,...Worldwide$184k - $287.5k
...computer graphics, PC gaming, and accelerated computing for more than 25... ...their best work. The video software team is seeking someone... ...motivated and passionate about system software development. Come... ...Bachelor’s degree in Electrical Engineering or Computer Science (or...- ...NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara, California, to develop world-class GPU-accelerated AI inference serving software. This role involves contributing to feature development and optimizing software for deployment in production environments...
- ...You will work closely with engineering to understand the technical... ...data‑center architectures, accelerated computing, distributed inference... ...Hands‑on experience with AI inferencing workflows using NVIDIA or... ...technical competence—background in software development, AI...
$184k - $356.5k
...NVIDIA Gruppe is seeking a Senior System Software Engineer to join the Tegra system software group in Santa Clara. Ideal candidates will possess... ...for complex systems in the dynamic environment of AI and accelerated computing. Attractive compensation ranges from $184,000 to...$152k - $241.5k
...We are hiring senior engineers to work on the CUDA driver, a core... ...component of our platform for accelerating general purpose computation... ...programming model across a range of system configurations and hardware... ...incorporates strong system software programming skills, a...- ...Acceleration Kernel Developer Intern Santa Clara, California, United... ...to unify innovations in software models, compilers, platforms... ...with a team of highly skilled engineers to ensure that our software... ...indirect access to information, systems, or technologies subject to...Permanent employmentInternship
$120.5k - $243k
...Systems/Software Engineer III This role has been designed as ‘Hybrid’ with an expectation that you will work on average 2 days per week from... .... Our culture thrives on finding new and better ways to accelerate what’s next. We know varied backgrounds are valued and succeed...Work experience placementWork at officeLocal areaImmediate start2 days per week$136.5k - $276.5k
...Senior Systems Software Engineer This role has been designed as "Onsite" with an expectation that you will primarily work from an HPE office... .... Our culture thrives on finding new and better ways to accelerate what's next. We know varied backgrounds are valued and succeed...Work experience placementWork at office2 days per week- ...clusters have hundreds of wafer‑scale accelerator systems, thousands of high‑end servers, and several... ..., best‑practice, security‑first engineering. The cluster involves complex hardware... ...vertically integrated cluster‑management software stack – from bare‑metal deployment to...
- Senior Systems Software Engineer - GPU Performance at Scale We are looking for a dedicated engineer for the Senior Systems Software Engineer role... ...at scale. What We Need to See Proven understanding of accelerated computing software stacks (CUDA). Experience with modern cloud...
- ...We are hiring senior engineers to work on the CUDA driver and runtime... ...of our platform for accelerating general purpose computation... ...investigates bottlenecks in software or hardware and delivers features... ...programming model across a range of system configurations and hardware...
$124k - $195.5k
...been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique... ...NVIDIA is searching for a highly motivated, technical engineer to join the Tegra system‑on‑chip (SoC) software organization. You will work on key aspects of our...$120.5k - $243k
...System Software Engineer This role has been designed as ‘’Onsite’ with an expectation that you will primarily work from an HPE office. Who... .... Our culture thrives on finding new and better ways to accelerate what’s next. We know varied backgrounds are valued and succeed...Work experience placementWork at officeLocal areaImmediate start- ...sophisticated GPUs and NVIDIA proprietary software, GeForce NOW transforms the gaming... ...in service reliability, using strong SW engineer processes, superb tools, and influential... ...Services (SaaS; large scale distributed systems). Proven experience taking mobile and cloud...Local area
- We are now looking for a Senior System Software Engineer to work in our Tegra system software group. The best candidates will have excellent... ...sophisticated server products used in groundbreaking AI, HPC, and accelerated computing workloads. We have some of the best engineers in...
$124k - $195.5k
We are now hiring a System Software Engineer to join the NVIDIA's System Software group focusing on Data Center Server Platform Diagnostics.... ...products used in ground breaking of diverse AI, HPC, and accelerated computing workloads. We have some of the best engineers in...Immediate start- ...computer graphics, PC gaming, and accelerated computing for more than 25... ...supports 1,000+ chip design engineers by building tools and... ...and operate long shelf‑life systems spanning build automation, observability... ...runs as userspace software on bare‑metal Linux hosts (no...
- ...developers on NVIDIA AI server system (CPU, GPU, Memory, NIC, PCIe... ...for qualifying early system software and firmware stacks. What we... ...with AI tools for accelerating design and debug. Excellent... ...Degree or higher in Electrical Engineering, Computer Science, or equivalent...Early shift
$224k - $356.5k
...Analytics and Data Intelligence (ADI) organization is building next-generation GPU-accelerated data analytics, data science, and vector search systems. The Senior Systems Software Engineer will focus on performance architecture for GPU-accelerated structured data...$181.1k - $318.4k
...team of passionate and creative engineers dedicated to building technologies... ...of groundbreaking hardware, software, and design, and we are looking... ...seeking a versatile Sr. Software System Engineer with end-to-end expertise to accelerate the exploration of new concepts....Relocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Director, System Software Engineering - Metropolis Accelerated and Inferencing Software. Be the first to apply!
- senior software manager Santa Clara, CA
- IT software development manager Santa Clara, CA
- embedded software manager Santa Clara, CA
- application engineering manager Santa Clara, CA
- senior applications manager Santa Clara, CA
- application manager Santa Clara, CA
- director software engineering Santa Clara, CA
- senior software development manager Santa Clara, CA
- software manager Santa Clara, CA
- director of software Santa Clara, CA

