Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Architect, AI Networking

$272k - $431.25k

NVIDIA

An applied research team within NVIDIA’s Networking Systems & Software Architecture group is solving some of AI’s hardest infrastructure problems. The team builds systems-level software that moves data between GPUs, nodes, and storage at the speed modern AI demands—spanning low-level transport optimization, hardware-software co-design, and communication frameworks that plug directly into production AI stacks. The team's charter expands into emerging domains including quantum computing interconnects.This Principal Architect role leads the research agenda and architectural direction for how NVIDIA’s AI systems communicate at scale—across GPUs, DPUs, NICs, and heterogeneous storage. It requires someone who defines project scope from scratch, publishes original work, and translates research breakthroughs into production-grade software that ships industry-wide!What you will be doing:Setting the long-term technical vision for distributed AI communication systems—GPU-to-GPU, GPU-to-storage, and cross-node data movement.Conducting original research and prototyping next-generation networking solutions over RDMA, NVLink, and GPUDirect.Driving hardware-software co-optimization with GPU, DPU, NIC, and network switch. Investigating fundamental bottlenecks in communication runtimes for large-scale AI workloads (KV cache transfer, disaggregated prefill/decode, model parallelism).Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM.Publishing findings, representing NVIDIA in industry forums and standards bodies, and mentoring senior engineers across the organization.What we need to see:15+ years in systems software and/or networking with deep expertise in high-performance networking (InfiniBand, RoCE, RDMA, NVLink), communication libraries (e.g. NIXL, NCCL, UCX, MPI, NVSHMEM), and GPU accelerated systems, with track record of defining and delivering complex, cross-team technical initiatives from research concept to production.MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.Deep understanding of computer architecture, memory hierarchies, DMA engines, and OS-level networking.Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns.Proficiency in programming languages such as C, C++, Rust and Python.Ways to stand out from the crowd:Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements.CUDA programming and NVIDIA GPU architecture expertise.Proved experience influencing product strategy and technical roadmap at a senior level.Major open-source contributions.With competitive salaries and a comprehensive benefits package, NVIDIA is widely regarded as one of the most desirable technology employers in the world. Our teams are composed of some of the most forward‑thinking and driven engineers in the industry, and we continue to grow rapidly. If you are a senior data engineer passionate about building large‑scale, high‑impact data platforms, we’d love to hear from you.Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 431,250 USD.You will also be eligible for equity and benefits.Applications for this job will be accepted at least until April 27, 2026.This posting is for an existing vacancy.NVIDIA uses AI tools in its recruiting processes.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa Clara; US, TX, Austin; US, TX, Remote; US, CO, Remote; US, OR, RemoteType: Full time

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal Architect, AI Networking in Santa Clara, CA vacancy
  • $210k - $255k

     ...provider of advanced server, storage, and networking solutions for Data Center, Cloud...  ...us.Job Summary:Supermicro is hiring a Principal AI Safety Engineer in Technology Enablement...  ...You will work with Supermicro solution architects, factory engineering, cloud and enterprise... 
    Principal
    Network
    Worldwide

    Super Micro Computer

    San Jose, CA
    2 days ago
  • $200k - $275k

     ...Edge. ADI combines analog, digital, AI, and software technologies into solutions...  ...Learn more at and on LinkedIn and X.Principal AI Accelerator Architect Lead Boston, MA; San Jose, CA Team:...  ...processing and both analog and digital neural-network compute architectures. Hands-On... 
    Principal
    Network
    Permanent employment
    Full time
    Work at office
    Day shift

    Analog Devices

    San Jose, CA
    1 day ago
  • $210.87k - $329.86k

     ...quality and first-time-right execution.We are seeking a senior AI Architect - Hardware Engineering to lead this transformation.The AI...  ...high-growth markets. With a talented team and a strategic global network, Celestica helps its customers achieve competitive advantages.... 
    Principal
    Network
    Temporary work
    Local area
    Worldwide
    Shift work

    Celestica

    San Jose, CA
    4 days ago
  • $142.8k - $274.8k

     ...OneDrive, Skype, Teams and Xbox Live. We are seeking a Principal AI Performance Architect to help shape the next generation of Microsoft AI systems...  ...study interactions across accelerator architecture, memory, networking, and systems software; evaluate trade-offs in... 
    Principal
    Network
    Ongoing contract
    Work at office
    Local area
    Worldwide
    3 days per week

    Microsoft

    Mountain View, CA
    14 hours ago
  • $190.2k - $360.5k

     ...Enterprise Customer Experience Platform Principal Architect — Security, Privacy and Governance in Large-scale Enterprise Agentic-AI Solutions San Jose, CA (Hybrid, min. 3-4...  ...authorization, secrets and credential mediation, network egress controls, runtime isolation, and... 
    Principal
    Network
    Full time
    Temporary work
    Local area
    Worldwide
    3 days per week

    Adobe

    San Jose, CA
    6 days ago
  • $272k - $431.25k

     ...in a multi-generation orbital roadmap to speed up AI adoption. We are looking for a strong technical architect to own end-to-end system software architecture...  ...orbit, duty cycle, NSA PHIPs security, post-quantum networking (CX9), inference SLAs — into actionable platform... 
    Principal
    Network
    Full time
    Work experience placement
    Remote work

    NVIDIA

    Santa Clara, CA
    23 hours ago
  •  ...healthcare and scientific discovery to powering AI and the technologies people rely on every...  ....THE ROLE: We are seeking a seasoned SoC Architect with expertise or significant interest in...  ...architecture teams in new directions, network with our world-class, patent-holding... 
    Principal
    Network

    AMD

    San Jose, CA
    1 day ago
  •  ...generation computing experiences—from AI and data centers, to PCs, gaming and embedded...  ...is seeking a highly accomplished Principal Modeling Architect to join the Product Architecture and...  ...LLMs, transformer variants, graph neural networks), datatypes, and scaling methodologies... 
    Principal
    Network

    AMD

    San Jose, CA
    14 hours ago
  • $272k - $431.25k

     ...tapping into the unlimited potential of AI to define the next era of computing. An era...  ...: Partner with application developers to architect and implement specialized communication...  ...hardware specifications for next-generation networking, ensuring they meet the evolving demands... 
    Principal
    Network
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $272k - $431.25k

    NVIDIA is seeking a Principal SoC Architect to join our architecture team and drive the next generation of Edge AI, Robotics, and Autonomous Driving platforms.NVIDIA is developing...  ..., GMSL/Camera interfaces, Time-Sensitive Networking/TSN).Advanced Subsystems: Multimedia/... 
    Principal
    Network
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • Job Overview:At Arm, the High-Speed I/O Architect defines and designs innovative on-chip interconnect...  ...mobile, automotive, datacenter, networking, and IoT, contributing to production-quality...  ...10x mindset shapes life at Arm: Use of AI in Your ApplicationAt Arm, we embrace the... 
    Principal
    Network
    Work at office
    Local area
    Shift work

    ARM

    San Jose, CA
    2 days ago
  • $191.53k - $286.9k

     ...our world. Across enterprise, cloud and AI, and carrier architectures, our innovative...  ...10-12 years of experience.Experience in architecting, designing and verifying complex...  ...with Layer 2 / Layer 3 forwarding, QoS, networking protocols, datapath and traffic managementStrong... 
    Principal
    Network
    Permanent employment
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    23 hours ago
  •  ...is part of the rapidly growing Arm Cloud AI Business Unit where we enable deployment...  ...CPUs built on Arm Neoverse in Cloud, AI and Networking markets! To enable our next-generation...  ...hardware in these segments. Systems Solutions Architect will work with partners in the ecosystem... 
    Principal
    Network
    Work experience placement
    Work at office
    Local area

    ARM

    San Jose, CA
    4 days ago
  •  ...products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded...  ...we advance your career. THE ROLE: We are seeking a Robotics AI Architect to define and scale next-generation Physical AI systems, with a... 
    Principal

    AMD

    San Jose, CA
    3 days ago
  • $164k - $231k

    ResponsibilitiesMaxLinear is seeking a Principal Analog EDA Engineering Architect to join our team. In this role, you will focus on the following:Drive AI adoption in analog IC design to...  ...to improve the world’s communication networks for everyone through our highly integrated... 
    Principal
    Network
    Work experience placement
    Live in

    MaxLinear

    San Jose, CA
    14 hours ago
  •  ...Title: Principal AI Architect Location: United States (Santa Clara / New Jersey) Work Model: Hybrid Principal AI Architect, Financial Services (Americas) Role Summary Financial services is one of the most demanding environments in which... 
    Principal
    Temporary work

    VDart

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

    We are now looking for a Senior AI Training Performance ArchitectNVIDIA is seeking a senior engineer who is obsessed with performance...  ...of experience.Strong background in deep learning and neural networks, particularly in training.Solid understanding of computer architecture... 
    Network
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $184k - $287.5k

     ...Infrastructure, and Agentic AI - the biggest technology breakthroughs...  ...seeking a visionary Product Architect with strong expertise in...  ...flawless integration of networking, compute and storage ecosystemsWork...  ...or AI infrastructure as a Principal Architect, Solutions Architect... 
    Network
    Full time

    Nvidia

    Santa Clara, CA
    23 hours ago
  • $200k - $250k

    Job Title: Performance Modeling Architect - AI Memory SystemsJob Location: Santa Clara, CA, or Boston, MACompensation: $200K - $250K base...  ...software memory access patterns to data distribution in the network and all the way down to on-device memory channels.Work day-to... 
    Network
    Night shift

    CyberCoders

    Santa Clara, CA
    23 hours ago
  • $184k - $287.5k

    NVIDIA is hiring an AI Hardware Architect to analyze and architect the next generation of Artificial Intelligence hardware. We are looking for...  ...Understand and help drive implementation of bus protocols, networking protocols, memory access and security solutions across a... 
    Network
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $100k

     ...leading the industry on cutting-edge AI technology, revolutionizing...  ...software models, compilers, platforms, networking, and semiconductors. Our diverse team...  ...seeking an exceptional Senior Staff or Principal High-Speed Communication Architect to define the next generation of... 
    Network
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    23 hours ago
  • $240k - $333k

     ...accelerators in collaboration with internal AI/ML research teams, software/systems teams...  ...).Experience as the lead product or chip architect across multiple generations of complex...  ...Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research... 
    Network
    Worldwide

    Google

    Sunnyvale, CA
    2 days ago
  • $141k - $231k

    Company DescriptionLinkedIn is the world's largest professional network, built to create economic opportunity for every member of the...  ...that guide LinkedIn's growth and efficiency. We're hiring an AI Architect to design, build, and launch AI-powered features inside the business... 
    Network
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Sunnyvale, CA
    3 days ago
  • $280k - $300k

    Physical IC Design Engineer (Senior, Staff or Principal level)Locations: San Jose, CA or Colorado...  ...technologies that power next-generation AI, machine learning, cloud infrastructure,...  ...products supporting AI, ML, networking, and data center applicationsBe part of a... 
    Principal
    Network
    Work at office
    Relocation package

    CyberCoders

    San Jose, CA
    23 hours ago
  •  ...is leading the industry on cutting-edge AI technology, revolutionizing performance expectations...  ...software models, compilers, platforms, networking, and semiconductors. Our diverse team of...  ...Hardware-Software Co-Designer: Driven to architect custom instruction set extensions and... 
    Principal
    Network
    Permanent employment

    Tenstorrent

    Santa Clara, CA
    4 days ago
  • $172k - $237k

     ...specifications, and orchestrate AI agents that execute at speed...  ...place here.Firmware Senior Principal Systems Development Engineer...  ...Development Engineer on our Network HW Engineering team in Santa...  ...methodologiesProven ability to architect, develop, debug, and optimize... 
    Principal
    Network

    Dell Technologies

    Santa Clara, CA
    3 days ago
  •  ...designed for the world’s most demanding AI workloads. We focus on first-principles...  ...engineering across silicon, systems, and networking—where performance, scale, and execution are...  ...You will work closely with customers to architect solutions that align with their business... 
    Principal
    Network
    Full time
    Immediate start

    upscale-ai

    Santa Clara, CA
    6 days ago
  • Principal Software Engineer - AI ADCA10 Networks is accelerating its AI‑driven innovation across the ADC and GSLB product lines. We are seeking a highly experienced Sr. Staff Engineer to be part of the development of next‑generation AI‑aware traffic management and AI Gateway... 
    Principal
    Network
    Full time
    For subcontractor
    Local area

    A10 Networks

    San Jose, CA
    23 hours ago
  • $205k - $260k

     ...Astera Labs (NASDAQ: ALAB) provides rack-scale AI infrastructure through purpose-built connectivity solutions. By collaborating with...  ...used in the world's leading cloud service providers, server and network OEMs. This role requires RTL to GDS ownership across design... 
    Principal
    Network
    Flexible hours

    Astera Labs

    San Jose, CA
    3 days ago
  •  ...Engineering Lead (Physical Design OR STA)Principal Level up to $550k, Master Level up to $88...  ...and a passion for working on bleeding-edge AI and high-performance silicon? Have you...  ...building cutting edge ASICs in AI, HPC, networking, and storageCollaborate with highly experienced... 
    Principal
    Network

    CyberCoders

    San Jose, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Architect, AI Networking. Be the first to apply!