Principal Architect, AI Networking
$272k - $431.25kNVIDIA
US, CA, Santa Clara
US, TX, Austin
US, TX, Remote
US, CO, Remote
US, OR, Remote
Full time
JR2016101
An applied research team within NVIDIA’s Networking Systems & Software Architecture group is solving some of AI’s hardest infrastructure problems. The team builds systems-level software that moves data between GPUs, nodes, and storage at the speed modern AI demands—spanning low-level transport optimization, hardware-software co-design, and communication frameworks that plug directly into production AI stacks. The team's charter expands into emerging domains including quantum computing interconnects.
This Principal Architect role leads the research agenda and architectural direction for how NVIDIA’s AI systems communicate at scale—across GPUs, DPUs, NICs, and heterogeneous storage. It requires someone who defines project scope from scratch, publishes original work, and translates research breakthroughs into production-grade software that ships industry-wide!
What you will be doing:
Setting the long-term technical vision for distributed AI communication systems—GPU-to-GPU, GPU-to-storage, and cross-node data movement.
Conducting original research and prototyping next-generation networking solutions over RDMA, NVLink, and GPUDirect.
Driving hardware-software co-optimization with GPU, DPU, NIC, and network switch. Investigating fundamental bottlenecks in communication runtimes for large-scale AI workloads (KV cache transfer, disaggregated prefill/decode, model parallelism).
Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM.
Publishing findings, representing NVIDIA in industry forums and standards bodies, and mentoring senior engineers across the organization.
What we need to see:
15+ years in systems software and/or networking with deep expertise in high-performance networking (InfiniBand, RoCE, RDMA, NVLink), communication libraries (e.g. NIXL, NCCL, UCX, MPI, NVSHMEM), and GPU accelerated systems, with track record of defining and delivering complex, cross-team technical initiatives from research concept to production.
MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
Deep understanding of computer architecture, memory hierarchies, DMA engines, and OS-level networking.
Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns.
Proficiency in programming languages such as C, C++, Rust and Python.
Ways to stand out from the crowd:
Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements.
CUDA programming and NVIDIA GPU architecture expertise.
Proved experience influencing product strategy and technical roadmap at a senior level.
Major open-source contributions.
With competitive salaries and a comprehensive benefits package, NVIDIA is widely regarded as one of the most desirable technology employers in the world. Our teams are composed of some of the most forward‑thinking and driven engineers in the industry, and we continue to grow rapidly. If you are a senior data engineer passionate about building large‑scale, high‑impact data platforms, we’d love to hear from you.
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 272,000 USD – 431,250 USD.
You will also be eligible for equity and benefits ( .
Applications for this job will be accepted at least until November 3, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry.
Learn more about NVIDIA .
$272k - $431.25k
...Principal Architect For AI Systems CommunicationAn applied research team within NVIDIA's Networking Systems & Software Architecture group is solving some of AI's hardest infrastructure problems. The team builds systems-level software that moves data between GPUs, nodes...PrincipalNetwork$210k - $255k
...provider of advanced server, storage, and networking solutions for Data Center, Cloud... ...us.Job Summary:Supermicro is hiring a Principal AI Safety Engineer in Technology Enablement... ...You will work with Supermicro solution architects, factory engineering, cloud and enterprise...PrincipalNetworkWorldwide$200k - $275k
...Edge. ADI combines analog, digital, AI, and software technologies into solutions... ...Learn more at and on LinkedIn and X.Principal AI Accelerator Architect Lead Boston, MA; San Jose, CA Team:... ...processing and both analog and digital neural-network compute architectures. Hands-On...PrincipalNetworkPermanent employmentFull timeWork at officeDay shift$210.87k - $329.86k
...quality and first-time-right execution.We are seeking a senior AI Architect - Hardware Engineering to lead this transformation.The AI... ...high-growth markets. With a talented team and a strategic global network, Celestica helps its customers achieve competitive advantages....PrincipalNetworkTemporary workLocal areaWorldwideShift work$142.8k - $274.8k
...OneDrive, Skype, Teams and Xbox Live. We are seeking a Principal AI Performance Architect to help shape the next generation of Microsoft AI systems... ...study interactions across accelerator architecture, memory, networking, and systems software; evaluate trade-offs in...PrincipalNetworkOngoing contractWork at officeLocal areaWorldwide3 days per week$190.2k - $360.5k
...Enterprise Customer Experience Platform Principal Architect — Security, Privacy and Governance in Large-scale Enterprise Agentic-AI Solutions San Jose, CA (Hybrid, min. 3-4... ...authorization, secrets and credential mediation, network egress controls, runtime isolation, and...PrincipalNetworkFull timeTemporary workLocal areaWorldwide3 days per week$272k - $431.25k
...in a multi-generation orbital roadmap to speed up AI adoption. We are looking for a strong technical architect to own end-to-end system software architecture... ...orbit, duty cycle, NSA PHIPs security, post-quantum networking (CX9), inference SLAs — into actionable platform...PrincipalNetworkFull timeWork experience placementRemote work- ...healthcare and scientific discovery to powering AI and the technologies people rely on every... ....THE ROLE: We are seeking a seasoned SoC Architect with expertise or significant interest in... ...architecture teams in new directions, network with our world-class, patent-holding...PrincipalNetwork
- ...generation computing experiences—from AI and data centers, to PCs, gaming and embedded... ...is seeking a highly accomplished Principal Modeling Architect to join the Product Architecture and... ...LLMs, transformer variants, graph neural networks), datatypes, and scaling methodologies...PrincipalNetwork
$272k - $431.25k
...tapping into the unlimited potential of AI to define the next era of computing. An era... ...: Partner with application developers to architect and implement specialized communication... ...hardware specifications for next-generation networking, ensuring they meet the evolving demands...PrincipalNetworkFull time$272k - $431.25k
NVIDIA is seeking a Principal SoC Architect to join our architecture team and drive the next generation of Edge AI, Robotics, and Autonomous Driving platforms.NVIDIA is developing... ..., GMSL/Camera interfaces, Time-Sensitive Networking/TSN).Advanced Subsystems: Multimedia/...PrincipalNetworkFull time- Job Overview:At Arm, the High-Speed I/O Architect defines and designs innovative on-chip interconnect... ...mobile, automotive, datacenter, networking, and IoT, contributing to production-quality... ...10x mindset shapes life at Arm: Use of AI in Your ApplicationAt Arm, we embrace the...PrincipalNetworkWork at officeLocal areaShift work
$191.53k - $286.9k
...our world. Across enterprise, cloud and AI, and carrier architectures, our innovative... ...10-12 years of experience.Experience in architecting, designing and verifying complex... ...with Layer 2 / Layer 3 forwarding, QoS, networking protocols, datapath and traffic managementStrong...PrincipalNetworkPermanent employmentInternshipWork from home- ...is part of the rapidly growing Arm Cloud AI Business Unit where we enable deployment... ...CPUs built on Arm Neoverse in Cloud, AI and Networking markets! To enable our next-generation... ...hardware in these segments. Systems Solutions Architect will work with partners in the ecosystem...PrincipalNetworkWork experience placementWork at officeLocal area
- ...products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded... ...we advance your career. THE ROLE: We are seeking a Robotics AI Architect to define and scale next-generation Physical AI systems, with a...Principal
$164k - $231k
ResponsibilitiesMaxLinear is seeking a Principal Analog EDA Engineering Architect to join our team. In this role, you will focus on the following:Drive AI adoption in analog IC design to... ...to improve the world’s communication networks for everyone through our highly integrated...PrincipalNetworkWork experience placementLive in- ...Title: Principal AI Architect Location: United States (Santa Clara / New Jersey) Work Model: Hybrid Principal AI Architect, Financial Services (Americas) Role Summary Financial services is one of the most demanding environments in which...PrincipalTemporary work
$184k - $287.5k
We are now looking for a Senior AI Training Performance ArchitectNVIDIA is seeking a senior engineer who is obsessed with performance... ...of experience.Strong background in deep learning and neural networks, particularly in training.Solid understanding of computer architecture...NetworkFull time$184k - $287.5k
...Infrastructure, and Agentic AI - the biggest technology breakthroughs... ...seeking a visionary Product Architect with strong expertise in... ...flawless integration of networking, compute and storage ecosystemsWork... ...or AI infrastructure as a Principal Architect, Solutions Architect...NetworkFull time$200k - $250k
Job Title: Performance Modeling Architect - AI Memory SystemsJob Location: Santa Clara, CA, or Boston, MACompensation: $200K - $250K base... ...software memory access patterns to data distribution in the network and all the way down to on-device memory channels.Work day-to...NetworkNight shift$100k
...leading the industry on cutting-edge AI technology, revolutionizing... ...software models, compilers, platforms, networking, and semiconductors. Our diverse team... ...seeking an exceptional Senior Staff or Principal High-Speed Communication Architect to define the next generation of...NetworkPermanent employment$184k - $287.5k
NVIDIA is hiring an AI Hardware Architect to analyze and architect the next generation of Artificial Intelligence hardware. We are looking for... ...Understand and help drive implementation of bus protocols, networking protocols, memory access and security solutions across a...NetworkFull time$240k - $333k
...accelerators in collaboration with internal AI/ML research teams, software/systems teams... ...).Experience as the lead product or chip architect across multiple generations of complex... ...Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research...NetworkWorldwide$141k - $231k
Company DescriptionLinkedIn is the world's largest professional network, built to create economic opportunity for every member of the... ...that guide LinkedIn's growth and efficiency. We're hiring an AI Architect to design, build, and launch AI-powered features inside the business...NetworkFor contractorsWork at officeFlexible hours$280k - $300k
Physical IC Design Engineer (Senior, Staff or Principal level)Locations: San Jose, CA or Colorado... ...technologies that power next-generation AI, machine learning, cloud infrastructure,... ...products supporting AI, ML, networking, and data center applicationsBe part of a...PrincipalNetworkWork at officeRelocation package- ...is leading the industry on cutting-edge AI technology, revolutionizing performance expectations... ...software models, compilers, platforms, networking, and semiconductors. Our diverse team of... ...Hardware-Software Co-Designer: Driven to architect custom instruction set extensions and...PrincipalNetworkPermanent employment
$172k - $237k
...specifications, and orchestrate AI agents that execute at speed... ...place here.Firmware Senior Principal Systems Development Engineer... ...Development Engineer on our Network HW Engineering team in Santa... ...methodologiesProven ability to architect, develop, debug, and optimize...PrincipalNetwork- ...designed for the world’s most demanding AI workloads. We focus on first-principles... ...engineering across silicon, systems, and networking—where performance, scale, and execution are... ...You will work closely with customers to architect solutions that align with their business...PrincipalNetworkFull timeImmediate start
- Principal Software Engineer - AI ADCA10 Networks is accelerating its AI‑driven innovation across the ADC and GSLB product lines. We are seeking a highly experienced Sr. Staff Engineer to be part of the development of next‑generation AI‑aware traffic management and AI Gateway...PrincipalNetworkFull timeFor subcontractorLocal area
$272k - $431.25k
...people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our... ...and be part of a legacy of innovation! We are seeking a Principal SW Architect, Networking to build the future of AI data-centers. This role is tailored...PrincipalNetworkFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Architect, AI Networking. Be the first to apply!
- principal Santa Clara, CA
- principal architect Santa Clara, CA
- principal data scientist Santa Clara, CA
- senior principal scientist Santa Clara, CA
- senior principal cloud computing engineer Santa Clara, CA
- principal cloud computing engineer Santa Clara, CA
- IT network Santa Clara, CA
- network operations center engineer Santa Clara, CA
- networking Santa Clara, CA
- senior cloud network engineer Santa Clara, CA




