Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Factory Network Architect

Full-time

Runware

About Runware

Runware is the AI inference platform that builds and runs its own infrastructure, end to end. Our Sonic Inference Engine has served more than 20 billion requests for over 1 million developers and 500 million end users, with 400,000+ models behind a single integration, at up to 10x lower cost per token than traditional providers.

We are now building the AI Factory that runs it. The Sonic Inference Pod packs 1 MW of custom-designed compute into a 20-foot container with closed-loop, water-free cooling, sited wherever power exists. Pods are live in the US and Europe, and we are scaling to dozens of pods and tens of thousands of GPUs, all operated as one distributed fabric that reroutes traffic the moment a pod goes offline ( announcement ).

The network is what turns those pods into a supercomputer. That is the job.

The role

As AI Factory Network Architect, you will own the network architecture of Runware's AI supercomputer, from the NVLink domain inside a server to the optical links between pods on two continents. You will set the design, build the first systems with your own hands, and grow the team that runs them.

This is a hands-on leadership role, not a slide-deck role. You will specify the fabrics, validate them on real hardware, debug the first congestion collapse at 3 a.m., and then write the standard so it never happens again. You will work directly with our hardware, platform, and inference engineering teams, with NVIDIA and our optical and switching vendors, and with the site teams deploying pods.

Success means inference traffic flows across tens of thousands of GPUs at line rate, pods join the fabric in days rather than weeks, and a failure anywhere in the network is invisible to the developer calling our API.

What you'll do

  • Own the end-to-end network architecture for the AI Factory: the scale-up fabric (NVLink and NVSwitch domains), the scale-out fabric (InfiniBand and RoCE), the storage and management networks, and the pod-to-pod and inter-site backbone.
  • Design the optical layer: transceiver and cable selection, co-packaged and linear-drive optics evaluation, DWDM for pod-to-pod and metro links, and the link budgets and reliability targets behind them.
  • Define the reference network design for the Sonic Inference Pod so every new pod ships with a validated, repeatable fabric and joins the global network in days.
  • Build and bring up the first fabrics yourself: rail-optimized topologies, subnet manager and routing configuration, adaptive routing, congestion control, QoS, and GPUDirect RDMA tuning, measured against inference throughput and tail latency rather than synthetic benchmarks.
  • Work with the inference engine team so the Sonic Inference Engine's traffic patterns, from tensor- and pipeline-parallel collectives to KV-cache transfer and multi-node serving, drive topology and buffer decisions, not the other way round.
  • Run capacity planning and the vendor roadmap with NVIDIA, switch and optics suppliers, and carriers; negotiate technical specifications and lead evaluations of new fabric generations.
  • Set the operating standard: telemetry, link-health monitoring, failure-domain design, automated fault isolation, and runbooks that let a small team operate tens of thousands of ports.
  • Hire and lead a team of network engineers as the footprint grows, and act as the final technical escalation for fabric incidents across all sites.

Requirements

What we're looking for

  • 15+ years designing, building, and operating high-performance networks, with a significant part of that in HPC or AI supercomputers at the scale of thousands of GPUs or more.
  • Deep, hands-on InfiniBand experience: fabric design, subnet management, routing engines, adaptive routing, congestion control, and performance debugging at the port and queue-pair level.
  • Working knowledge of NVLink and NVSwitch domains and how scale-up and scale-out fabrics interact for multi-GPU and multi-node inference and training.
  • Optical networking depth: transceivers and cabling at 400G and 800G, link budgets, DWDM and coherent optics for inter-site links, and the operational realities of optics at scale (failure rates, cleaning, inventory).
  • Hands-on RDMA experience across InfiniBand and RoCE, including GPUDirect, NCCL and collective behaviour, PFC and ECN tuning, and the trade-offs between the two.
  • A track record of leading network teams through greenfield builds and production incidents, and of being the person engineers call when the fabric is doing something nobody understands.
  • Comfort automating everything: Python or Go, infrastructure as code, and telemetry pipelines rather than CLI sessions.
  • Clear writing and the ability to turn a design into a document that a site team on another continent can execute from.
  • Willingness to travel to pod sites in the US and Europe for bring-up and major changes.

Strong differentiators

  • Experience with NVIDIA Spectrum-X, Quantum-X800, or Blackwell-generation NVLink systems, or the equivalent from a hyperscaler's in-house stack.
  • Hands-on time with co-packaged optics, linear-drive pluggables, or photonic switching evaluations.
  • Experience designing networks for modular or containerized data centers, edge sites, or deployments with constrained power and space.
  • Background in inference-specific traffic patterns: disaggregated prefill and decode, KV-cache transfer, and multi-tenant serving across a shared fabric.
  • Contributions to SONiC, OpenFabrics, UEC, or similar open networking efforts.
  • Experience with sovereign or data-residency network designs, including inter-site encryption and segmentation.
  • Prior work at a GPU cloud, hyperscaler, national lab, or AI lab building its own supercomputer.

Benefits

Why Runware

You will design the network for an AI supercomputer that is being built right now, with the budget, the hardware, and the mandate to do it properly. Few network architects get to own a fabric from the first pod to the global backbone, with a direct line to the people deciding what the next pod looks like.

We're a remote-first collective, meeting in person twice a year to plan, brainstorm, celebrate wins, and enjoy some face-to-face time. We have core hours for cooperative working and calls, but outside of that your calendar is yours. Work the hours that let you perform at your peak while also building a healthy life.

Our release cycles are fast and intense, but they're followed by real downtime. After big pushes we expect the team to unplug, recharge, and come back ready and stronger than ever for the next leap.

  • Generous paid time off: vacation, sick days, public holidays
  • Meaningful stock options: share in the upside you create
  • Flexible hours: own your schedule outside core collaboration blocks
  • Family leave: paid maternity, paternity, and caregiver time
  • Company retreats: twice-yearly gatherings in inspiring locations
Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the AI Factory Network Architect in Palo Alto, CA vacancy
  •  ...Description About Runware Runware is the AI inference platform that builds and...  ...participating, and we are now building out a global network of pods across the US and Europe. We need...  ...is operated. The Role As Network Architect, you'll own the design, build, and... 
    Suggested
    Remote work
    Flexible hours

    Runware

    Palo Alto, CA
    9 days ago
  •  ...by building their digital core and unleashing the power of AI to create value at speed for organizations across industries...  ...FY26 revenue. Visit us at accenture.com.You Are:A successful Network Engineer Architect combines deep technical expertise with strong consulting and... 
    Suggested
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    Mountain View, CA
    2 days ago
  • $152k - $241.5k

    NVIDIA Networking has been a leader in high performance networking infrastructure for many years. The next unit...  .... We are looking for you, a Senior Networking Architect, to develop the next generation of network for AI. If you love researching new technologies, we'd love... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $142.8k - $274.8k

     ...implement future technical solutions that will manage and optimize the Cloud infrastructure. We are looking for a Principal AI Network Architect to join the team. #SCHIE Responsibilities Define the long-term architecture and technology roadmap for Microsoft's AI scale... 
    Suggested
    Ongoing contract
    Permanent employment
    Full time
    Work at office
    Local area
    Worldwide

    Microsoft

    Mountain View, CA
    3 days ago
  • $184k - $287.5k

    NVIDIA is looking for a dedicated Senior Networking Software Architect to join our team in Santa Clara. This outstanding opportunity allows you to develop the future of AI and data-center infrastructure by integrating NICs, GPUs, and network management into cohesive, high... 
    Suggested
    Full time

    Nvidia

    Santa Clara, CA
    1 day ago
  • $184k - $287.5k

    NVIDIA seeks a Senior Scale-Up Network System Architect to develop the next generation of NVLink-based scale-up networking for leading AI supercomputing platforms. You will develop the complete architecture of the interconnect that links GPUs within and between racks.... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  • $224k - $356.5k

    NVIDIA Networking has been a leader in high performance networking infrastructure for many years. The next...  ...are looking for you - a Networking Software Architect, to develop the next generation of networking protocols for AI.We are developing RDMA Transport protocols... 
    Full time

    Nvidia

    Santa Clara, CA
    2 days ago
  •  ...challenging assumptions and reimagining how work gets done. Engineers define intent, author precise specifications, and orchestrate AI agents that execute at speed and scale. AI is embedded throughout our development process, helping us move faster, learn quicker, and... 

    Dell Careers

    Santa Clara, CA
    23 days ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver...  ...with ultra high-speed inference.About the RoleAs a Network Systems Architect, you will define the scale out, and particularly scale-up network... 

    Cerebras Systems

    Sunnyvale, CA
    15 hours ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver...  ...-speed inference.About The RoleWe are seeking a Principal Network Security Architect to lead the design and evolution of the networks that connect... 

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  • $196k - $310.5k

     ...amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU...  ...you can make a lasting impact on the world.NVIDIA Enterprise Network Architecture team is seeking experienced candidates in the extensive... 
    Full time
    Work at office

    Nvidia

    Santa Clara, CA
    4 days ago
  • $184k - $287.5k

    NVIDIA is looking for an experienced Network Solutions Architect Engineer to help bring our next-generation AI networking platforms into production at customer data centers. Do you want to be part of a team that brings new AI hardware and software technologies to production... 
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    15 hours ago
  • $154.68k - $231.7k

     ...our world. Across enterprise, cloud and AI, and carrier architectures, our innovative...  ...platforms perform as promised, across compute, networking, and memory fabrics. Without it, Marvell...  ...for scale-up and scale-out workloads.• Architect rail-optimized, leaf-spine, fat-tree, and... 
    Permanent employment
    Internship
    Work from home

    Marvell

    Santa Clara, CA
    1 day ago
  • $228k - $273k

     ...Applications - Information Security /Full-time /HybridZoox's Network Security team architects and defends the digital borders of the company — from...  ...Security, or CISSPExperience experimenting with or deploying AI/ML-based security capabilities (e.g., anomaly detection,... 
    Full time
    Temporary work
    Remote work
    Relocation package

    Zoox

    Foster, CA
    2 days ago
  •  ...Job Description Job Description Zoox's Network Security team architects and defends the digital borders of the company, from corporate offices to...  ...Security, PCNSE, AWS Security Specialty Experience applying AI/ML to network or cloud security (anomaly detection,... 
    Temporary work
    Remote work
    Relocation package

    Zoox

    Foster, CA
    18 days ago
  •  ...Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milestone culture is built to...  ...for future hiring! Responsibilities: Assisting in critical network infrastructure environment maintenance tasks Conducting IDF commissioning... 
    Temporary work
    Local area
    Worldwide

    Milestone Technologies, Inc.

    Mountain View, CA
    2 days ago
  • $224k - $356.5k

     ...amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU...  ...we're powering the future of AI and computing! As a Principal Architect on our powerful team in Santa Clara, CA, you will manage the architecture... 
    Full time

    Nvidia

    Santa Clara, CA
    6 hours ago
  • Netris is leading the AI cloud networking space, seeking a senior product professional who bridges deep network engineering and product thinking. You will translate how networks are built and operated into requirements, designs, and UX decisions for the Netris platform.... 

    Netris

    Santa Clara, CA
    5 hours ago
  • $250k

     ...past 12 months. The organization has built the leading network automation platform for AI clouds, with 35+ live GPU cluster deployments globally,...  ...forwarding behaviour, and ASIC-level packet flow You will be architecting and validating high-scale data center network designs... 
    Permanent employment
    Flexible hours
    Santa Clara, CA
    more than 2 months ago
  •  ...emissions.Learn more about Accenture's Utilities Transmission & Distribution Practice here>> Role OverviewThe ArcGIS Utility Network Solution Architect will serve as the senior functional authority guiding our client team through the transformation of its legacy, geometric... 
    Live in
    Work at office
    Local area

    Accenture

    Mountain View, CA
    2 days ago
  •  ...within Accenture.We are looking for a Security Professional for our Security practice who is a recognized Palo Alto Networks network security architect. You have personally designed, deployed and troubleshot PAN-OS Next-Generation Firewalls, Prisma Access and Panorama... 
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    Mountain View, CA
    4 days ago
  • $160k - $170k

     ...USD Annually Description: Cloud Enterprise/Infrastructure Architects Santa Clara, CA Fulltime Roles & Responsibilities...  ...governance, resiliency and compliance solutions. Advise customers on AI-ready infrastructure and GPU platforms. Conduct executive... 
    Full time

    Judge Group, Inc.

    Santa Clara, CA
    1 day ago
  •  ...Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15 billion...  ...About the Role We are looking for a Network and Security Engineer to own the...  ...culture. At Applied Intuition, you will: Architect and build high-bandwidth network fabrics... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Remote work
    Day shift

    applied

    Sunnyvale, CA
    5 days ago
  •  ...an hour or Santa Clara, CA. This is onsite 5 days a week job with no option for remote or hybrid. Key Responsibilities: Wi-Fi Network Design & Implementation: Design and implement robust, scalable Wi-Fi solutions for campus-wide coverage, optimizing for... 
    For contractors
    Remote work

    Macpower Digital Assets Edge Private Limited

    Santa Clara, CA
    22 days ago
  • $150k

     ...Job Description Job Description Role: Network Architect Location: Bridgewater NJ or Plano, TX Fulltime – Salary ($150K PA) Don't stop profiles on salary Indent: PSL308526-15-1 Network Architect should focus on bringing the Best-in-Class Network Services... 
    Full time
    Shift work

    PeopleNTech LLC

    Santa Clara, CA
    22 days ago
  • $150k

     ...Description Role: - Infrastructure / Enterprise Architect Location: Bridgewater NJ or Plano, TX...  ...across cloud, data center, workplace, network, security, and infrastructure operations...  ..., operational transformation, and AI-enabled infrastructure services. This role... 
    Full time

    PeopleNTech LLC

    Santa Clara, CA
    22 days ago
  •  ...Job Description Job Description Job description: Network Support Engineer Position Overview: As a Network Support Engineer, you will be responsible for managing and troubleshooting network issues, and maintaining network hardware and software for our customers... 
    Full time
    Remote work

    Asiacom Americas Inc

    Santa Clara, CA
    15 days ago
  •  ...Job Description Company Description IT Management Corporation (ITMC) is a technology solutions provider specializing in networking, communications, cloud, cybersecurity, and managed services. Since 2009, we've helped organizations modernize their technology environments... 
    Local area

    IT Management Corp. dba 101 VOICE

    Santa Clara, CA
    25 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Factory Network Architect. Be the first to apply!