Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Architect, AI Networking

$272k - $431.25k

NVIDIA

An applied research team within NVIDIA's Networking Systems & Software Architecture group is solving some of AI's hardest infrastructure problems. The team builds systems-level software that moves data between GPUs, nodes, and storage at the speed modern AI demands-spanning low-level transport optimization, hardware-software co-design, and communication frameworks that plug directly into production AI stacks. The team's charter expands into emerging domains including quantum computing interconnects. What You Will Be Doing Setting the long-term technical vision for distributed AI communication systems - GPU-to-GPU, GPU-to-storage, and cross-node data movement. Conducting original research and prototyping next-generation networking solutions over RDMA, NVLink, and GPUDirect. Driving hardware-software co-optimization with GPU, DPU, NIC, and network switch. Investigating fundamental bottlenecks in communication runtimes for large-scale AI workloads (KV cache transfer, disaggregated prefill/decode, model parallelism). Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM. Publishing findings, representing NVIDIA in industry forums and standards bodies, and mentoring senior engineers across the organization. What We Need To See 15+ years in systems software and/or networking with deep expertise in high-performance networking (InfiniBand, RoCE, RDMA, NVLink), communication libraries (e.g. NIXL, NCCL, UCX, MPI, NVSHMEM), and GPU accelerated systems, with track record of defining and delivering complex, cross-team technical initiatives from research concept to production. MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field. Deep understanding of computer architecture, memory hierarchies, DMA engines, and OS-level networking. Understanding of ML systems concepts - transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns. Proficiency in programming languages such as C, C++, Rust and Python. Ways To Stand Out From The Crowd Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements. CUDA programming and NVIDIA GPU architecture expertise. Proved experience influencing product strategy and technical roadmap at a senior level. Major open-source contributions. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 431,250 USD. You will also be eligible for equity and benefits. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #J-18808-Ljbffr NVIDIA

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Principal Architect, AI Networking in Oregon, WI vacancy
  • $139.4k - $230k

     ...Projects, and a Growing Team! As a member of AI and Emerging Technology Architecture, you...  ...best-in-class solutions. As a Senior Architect, you will partner with Technology and...  ...of core ML algorithms and neural network architectures Familiarity with MLOps &... 
    Network
    Work experience placement
    Local area

    Travelers Insurance

    Madison, WI
    4 days ago
  • $152.07k - $202.76k

     ...Lumen is the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network...  ...The Role We are looking for a strategic and technical Principal Architect to design the new architecture evolution for Lumen Connect... 
    Principal
    Network
    Full time
    Temporary work
    Remote work

    Lumen

    Madison, WI
    4 days ago
  •  ...to shape the automation and Agentic AI strategy for strategic enterprise accounts...  ...matters. We're looking for a Principal UiPath Solution Architect who operates as both a hands-on technical...  ...decisions across infrastructure, network, and security for UiPath environments... 
    Principal
    Network
    Remote work
    Home office

    Naviant

    Verona, WI
    16 days ago
  • $126.2k - $264.1k

     ...are seeking a highly experienced Senior Principal Technical Program Manager (TPM) to lead complex...  ...supply chain processes, manufacturing networks, procurement, logistics, planning, and...  ...innovations to life-saving care. And with AI embedded across our products and services... 
    Principal
    Network
    Contract work
    Temporary work
    Flexible hours

    Oracle

    Madison, WI
    14 hours ago
  • $114.6k - $234.6k

     ...Description Designs, implements, and operates resilient L3/L4 network services across data centers and cloud environments with broader...  ...from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn... 
    Principal
    Network
    Temporary work
    Immediate start
    Flexible hours
    Shift work

    Oracle

    Madison, WI
    4 days ago
  • $104.5k - $234.6k

     ...architectural standards. Collaborates with stakeholders and networks externally to ensure work aligns with software architecture....  ...everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn... 
    Principal
    Network
    Temporary work
    Flexible hours
    Shift work

    Oracle

    Madison, WI
    2 days ago
  •  ...individuals experience the world around them. We bring together architects, planners, designers, and technical experts to solve complex...  ...bring our authentic selves to work every day.Our eight Employee Network Groups (Asian Pacific, Black, Hispanic/Latino(a), LGBTQ+,... 
    Network
    Contract work
    Work at office

    HDR

    Madison, WI
    2 days ago
  •  ...biohealth jobs, further strengthening its role within Catalent’s global biologics network and Wisconsin’s growing life sciences ecosystem.Position SummaryWe have an opportunity for a Principal Process Engineer - Manufacturing Sciences & Technology to join our team. This... 
    Principal
    Network
    Full time
    Local area
    Monday to Friday
    Flexible hours
    Shift work

    Catalent

    Madison, WI
    2 days ago
  • $108.85k - $155.51k

     ...individuals experience the world around them. We bring together architects, planners, designers, and technical experts to solve complex...  ...bring our authentic selves to work every day. Our eight Employee Network Groups (Asian Pacific, Black, Hispanic/Latino(a), LGBTQ+,... 
    Network
    Full time
    Contract work
    Temporary work
    Part time
    Work at office

    HDR

    Madison, WI
    1 day ago
  •  ...Licensed Architect / Project Architect Competitive Compensation + Full Benefits Are you a Licensed Architect looking for an opportunity...  ...discuss whether this role, or another opportunity within my network, aligns with your career goals. Please contact me at dante.... 
    Network

    gpac

    Madison, WI
    2 days ago
  • $155k

     ...Platform Architect | Permanent | No Sponsorship Available | Hybrid - Requires 3 days per week in Madison, WI ABOUT OUR CLIENT...  ...adoption of core platform services including compute, storage, networking, observability, and CI/CD tooling Architect shared platform... 
    Network
    Permanent employment
    3 days per week

    Creative Financial Staffing

    Madison, WI
    4 days ago
  • $118.4k

     ...experienced and strategic Lead Enterprise Architect to drive technology strategy and...  ...technologies such as Artificial Intelligence (AI), API management, Integration Architecture...  ...or the most complex systems, solutions, networks, infrastructure elements, or processes. Select... 
    Network
    For contractors
    Local area

    Highmark Health

    Madison, WI
    3 days ago
  • $104k - $147k

     ...you’ll feel at home here. Why This Role Matters As a Architect in the Food + Pharmaceutical Market you’ll play a key role in...  ...Assist with personnel needs identification including internal networking to identify others within Shive-Hattery who can be drawn upon... 
    Network
    Contract work
    Work at office

    Shive Hattery Group, Inc.

    Madison, WI
    16 days ago
  •  ...Workplaces in Financial Services & Insurance Principal Data Scientist Job Responsibilities...  ...records, and policy documentation. Architect modeling approaches that leverage modern...  ...probabilistic modeling. Partner with AI Engineering teams to productionize models... 
    Principal
    Remote work

    Sedgwick

    Madison, WI
    2 days ago
  • $91.2k - $127.75k

     ...hesitate to apply we'd love to hear from you." Role Overview The Principal Sales Representative is responsible for carrying out all sales...  ...agreed business goals. Plan and develop dealer/distributor network in specified territory according to the agreed market... 
    Principal
    Network
    Work at office
    Local area

    Wilbur-Ellis

    Madison, WI
    14 hours ago
  • $100k - $225k

     ...consulting field.We are seeking a Principal Technical Consultant to join...  ...custom software and AI solutions using Appian’s platform...  ...systems, partnering with Appian Architects and Technical Delivery...  ...stronger internal and external networks by planning social, educational... 
    Principal
    Network
    Work experience placement
    Local area
    Flexible hours

    Appian

    Madison, WI
    5 days ago
  •  ...thrive. From high-performance data centers driving the future of AI to dynamic commercial environments, your work will directly...  ...bring our authentic selves to work every day.Our eight Employee Network Groups (Asian Pacific, Black, Hispanic/Latino(a), LGBTQ+, People... 
    Network
    Contract work

    HDR

    Madison, WI
    2 days ago
  • We are seeking a talented and experienced Architect with 3-5 years post part 3 experience to join our team, working on an exciting high-end leisure development in Scotland. What We Offer Competitive salary, benchmarked against experience Employer pension contribution 30... 
    Work at office
    Monday to Friday

    David Carpenter Architect

    Oregon, WI
    3 days ago
  • $169.3k - $304.7k

     ...our cloud-native and Kubernetes services We are looking for a Principal Software Engineer with deep expertise in Kubernetes and cloud-...  ...Delivery : Scaling the world's biggest moments without a glitch. AI : Enabling our customers to build, secure, and scale AI apps on... 
    Principal
    Work experience placement
    Work at office

    Akamai

    Madison, WI
    1 day ago
  • $100k - $225k

     ...field. We are seeking a Principal Technical Consultant to join...  ...implement custom software and AI solutions using Appian's platform...  ..., partnering with Appian Architects and Technical Delivery Managers...  ...internal and external networks by planning social, educational... 
    Principal
    Network
    Work experience placement
    Local area
    Flexible hours

    Appian

    Madison, WI
    14 hours ago
  •  ...Principal It Project ManagerThe Wisconsin Foundation and Alumni Association (WFAA), the private fundraising and alumni relations organization...  ...through structured, consistent practices and emerging AI-assisted tools, please apply!This position can be hired as hybrid... 
    Principal
    Remote work
    Flexible hours

    Wisconsin Foundation and Alumni Association

    Madison, WI
    1 day ago
  • $94k - $128k

     ...Job SummaryEvery transformation needs an architect behind the scenes.At Alliant Energy, we're...  ...Security • Systems Integration • Network Architecture • Architecture Strategy • Cloud...  ...Planning (EAP) • Artificial Intelligence (AI)Our people are passionate about what they... 
    Network
    Full time
    Work experience placement
    Immediate start

    Alliant Energy

    Madison, WI
    3 days ago
  • $296.3k - $423.9k

     ...a global scale.? We are looking for a Principal Technical Lead Manager (TLM) to lead the...  ...Trajectory Generation team within the Embodied AI organization. This role combines deep...  ...complex and dynamic driving environments. Architect scalable training pipelinesusing large-... 
    Principal
    Full time
    Local area
    Remote work
    Work from home
    Relocation
    Relocation package
    Flexible hours

    General Motors

    Madison, WI
    2 days ago
  •  ...long-term improvementsBuild automation, tooling, guardrails, and AI-assisted solutions that make secure practices the easy pathBuild...  ...across multiple domains such as cloud, identity, endpoint, network, vulnerability management, or detection engineeringProficiency with... 
    Network
    Work at office
    Remote work
    Relocation

    State of Wisconsin Investment Board

    Madison, WI
    4 days ago
  • $114.6k - $234.6k

     ...various configurations of Exadata X11, and Exadata Expansion Rack. Exadata group also keeps looking into leading edge technology like AI vector Database. As a member of the software engineering division of Exadata, you will: Design and implement the database and... 
    Principal
    Temporary work
    Flexible hours

    Oracle

    Madison, WI
    4 days ago
  • $126.2k - $264.1k

     ...Job Description We are seeking an experienced Principal Data Center Facilities Development Manager to oversee the onsite construction...  ...everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers... 
    Principal
    Full time
    Temporary work
    For contractors
    Flexible hours

    Oracle

    Madison, WI
    4 days ago
  • $112.5k - $202.5k

     ...Are you excited about working with cutting-edge network technologies? Do you enjoy acting quickly to solve problems? Join our Network...  ...: Scaling the world's biggest moments without a glitch. AI : Enabling our customers to build, secure, and scale AI apps on... 
    Network
    Work experience placement
    Work at office

    Akamai

    Madison, WI
    4 days ago
  • $78k - $156k

     ...enterprise-wide Fiori, and preparing to launch Joule and SAP Business AI. If you're an SAP professional who wants to work with cutting-...  ...or ECC landscapes and cloud fundamentals (IaaS/PaaS concepts, networking, certificates, TLS).The base pay for this position is $78,000.00... 
    Network
    Work at office
    Local area
    Relocation package
    Shift work
    Night shift

    Abbott

    Madison, WI
    4 days ago
  • $71.2k - $158.2k

     ...our Nation's Veteran's, American Indians, and Alaska Natives. A Principal Consultant is an experienced consulting professional who has an...  ...everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers... 
    Principal
    Temporary work
    Work experience placement
    Local area
    Flexible hours

    Oracle

    Madison, WI
    4 days ago
  • 5+ years of experience in DevOps and/or software development and IT Operations 3+ years of project experience migrating and deploying cloud-based solutions. Hands-on implementation experience of Continuous Integration and Continuous Delivery in Azure DevOps (VSTS/TFS) Experience...

    RxCloud

    Oregon, WI
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Architect, AI Networking. Be the first to apply!