Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Factory Network Architect

Runware

About Runware Runware is the AI inference platform that builds and runs its own infrastructure, end to end. Our Sonic Inference Engine has served more than 20 billion requests for over 1 million developers and 500 million end users, with 400,000+ models behind a single integration, at up to 10x lower cost per token than traditional providers. We are now building the AI Factory that runs it. The Sonic Inference Pod packs 1 MW of custom-designed compute into a 20-foot container with closed-loop, water-free cooling, sited wherever power exists. Pods are live in the US and Europe, and we are scaling to dozens of pods and tens of thousands of GPUs, all operated as one distributed fabric that reroutes traffic the moment a pod goes offline (announcement). The network is what turns those pods into a supercomputer. That is the job. The role As AI Factory Network Architect, you will own the network architecture of Runware's AI supercomputer, from the NVLink domain inside a server to the optical links between pods on two continents. You will set the design, build the first systems with your own hands, and grow the team that runs them. This is a hands-on leadership role, not a slide-deck role. You will specify the fabrics, validate them on real hardware, debug the first congestion collapse at 3 a.m., and then write the standard so it never happens again. You will work directly with our hardware, platform, and inference engineering teams, with NVIDIA and our optical and switching vendors, and with the site teams deploying pods. Success means inference traffic flows across tens of thousands of GPUs at line rate, pods join the fabric in days rather than weeks, and a failure anywhere in the network is invisible to the developer calling our API. What you'll do Own the end-to-end network architecture for the AI Factory: the scale-up fabric (NVLink and NVSwitch domains), the scale-out fabric (InfiniBand and RoCE), the storage and management networks, and the pod-to-pod and inter-site backbone. Design the optical layer: transceiver and cable selection, co-packaged and linear-drive optics evaluation, DWDM for pod-to-pod and metro links, and the link budgets and reliability targets behind them. Define the reference network design for the Sonic Inference Pod so every new pod ships with a validated, repeatable fabric and joins the global network in days. Build and bring up the first fabrics yourself: rail-optimized topologies, subnet manager and routing configuration, adaptive routing, congestion control, QoS, and GPUDirect RDMA tuning, measured against inference throughput and tail latency rather than synthetic benchmarks. Work with the inference engine team so the Sonic Inference Engine's traffic patterns, from tensor- and pipeline-parallel collectives to KV-cache transfer and multi-node serving, drive topology and buffer decisions, not the other way round. Run capacity planning and the vendor roadmap with NVIDIA, switch and optics suppliers, and carriers; negotiate technical specifications and lead evaluations of new fabric generations. Set the operating standard: telemetry, link-health monitoring, failure-domain design, automated fault isolation, and runbooks that let a small team operate tens of thousands of ports. Hire and lead a team of network engineers as the footprint grows, and act as the final technical escalation for fabric incidents across all sites. Requirements What we're looking for 15+ years designing, building, and operating high-performance networks, with a significant part of that in HPC or AI supercomputers at the scale of thousands of GPUs or more. Deep, hands-on InfiniBand experience: fabric design, subnet management, routing engines, adaptive routing, congestion control, and performance debugging at the port and queue-pair level. Working knowledge of NVLink and NVSwitch domains and how scale-up and scale-out fabrics interact for multi-GPU and multi-node inference and training. Optical networking depth: transceivers and cabling at 400G and 800G, link budgets, DWDM and coherent optics for inter-site links, and the operational realities of optics at scale (failure rates, cleaning, inventory). Hands-on RDMA experience across InfiniBand and RoCE, including GPUDirect, NCCL and collective behaviour, PFC and ECN tuning, and the trade-offs between the two. A track record of leading network teams through greenfield builds and production incidents, and of being the person engineers call when the fabric is doing something nobody understands. Comfort automating everything: Python or Go, infrastructure as code, and telemetry pipelines rather than CLI sessions. Clear writing and the ability to turn a design into a document that a site team on another continent can execute from. Willingness to travel to pod sites in the US and Europe for bring-up and major changes. Strong differentiators Experience with NVIDIA Spectrum-X, Quantum-X800, or Blackwell-generation NVLink systems, or the equivalent from a hyperscaler's in-house stack. Hands-on time with co-packaged optics, linear-drive pluggables, or photonic switching evaluations. Experience designing networks for modular or containerized data centers, edge sites, or deployments with constrained power and space. Background in inference-specific traffic patterns: disaggregated prefill and decode, KV-cache transfer, and multi-tenant serving across a shared fabric. Contributions to SONiC, OpenFabrics, UEC, or similar open networking efforts. Experience with sovereign or data-residency network designs, including inter-site encryption and segmentation. Prior work at a GPU cloud, hyperscaler, national lab, or AI lab building its own supercomputer. Benefits Why Runware You will design the network for an AI supercomputer that is being built right now, with the budget, the hardware, and the mandate to do it properly. Few network architects get to own a fabric from the first pod to the global backbone, with a direct line to the people deciding what the next pod looks like. We're a remote-first collective, meeting in person twice a year to plan, brainstorm, celebrate wins, and enjoy some face-to-face time. We have core hours for cooperative working and calls, but outside of that your calendar is yours. Work the hours that let you perform at your peak while also building a healthy life. Our release cycles are fast and intense, but they're followed by real downtime. After big pushes we expect the team to unplug, recharge, and come back ready and stronger than ever for the next leap. Generous paid time off: vacation, sick days, public holidays Meaningful stock options: share in the upside you create Flexible hours: own your schedule outside core collaboration blocks Family leave: paid maternity, paternity, and caregiver time Company retreats: twice-yearly gatherings in inspiring locations Runware

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Factory Network Architect in New York, NY vacancy
  • $200k - $300k

    Hudson River Trading (HRT) is seeking an Ultra-Low Latency Network Architect to build, test, and optimize our global high-frequency trading infrastructure...  ...large scale L2/L3 topologies. Awareness and experience with AI inference networks is a plus but not requiredProficiency with... 
    Suggested
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    3 days ago
  • $112.5k - $202.5k

     ...platform and products to the world? Join our Network Planning team! The Network Platform...  ...includes global Fabrics supporting our newest AI infrastructure, core backbone networks,...  ...the best As a Senior Network Delivery Architect in Network Platform Planning, you will... 
    Suggested
    Work experience placement
    Work at office

    Akamai

    New York, NY
    2 days ago
  • Principal Network Architect Your work days are brighter here. We're obsessed with making hard work pay off, for our people, our customers, and the world around us. As a Fortune 500 company and a leading AI platform for managing people, money, and agents, we're shaping the... 
    Suggested
    Remote job
    Work at office
    Home office
    Flexible hours
    Shift work

    ClearanceJobs

    New York, NY
    2 days ago
  • $250k - $350k

    SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide....  ...SambaNova Systems is looking for a talented and motivated ASIC Network Architect to help us solve the most challenging and impactful problems... 
    Suggested
    Full time
    Temporary work
    Local area
    Worldwide
    Flexible hours

    SambaNova

    New York, NY
    2 days ago
  •  ...by building their digital core and unleashing the power of AI to create value at speed for organizations across industries...  ...FY26 revenue. Visit us at accenture.com.You Are:A successful Network Engineer Architect combines deep technical expertise with strong consulting and... 
    Suggested
    Work experience placement
    Live in
    Work at office
    Local area
    Remote work

    Accenture

    New York, NY
    10 hours ago
  • $176.6k - $239k

    Networking Solutions Architect Are you passionate about cloud computing with a special focus on networking and distributed systems? Do you have a unique...  ...software-defined networking, and networking for hyperscale AI workloads Provide subject matter expertise on networking... 
    Local area
    Flexible hours

    A W S

    New York, NY
    2 days ago
  • Senior Networking Specialist Solutions Architect Are you passionate about helping organizations achieve transformative business value through innovative networking...  ...technologies in domains such as Generative / Agentic AI, and data & analytics Amazon is an equal opportunity... 

    A W S

    New York, NY
    2 days ago
  •  ...visionary technical leader passionate about defining the future of AI infrastructure and squeezing every drop of performance out of...  ...advanced hardware accelerators at scale? We are seeking a Principal Architect to lead, shape, and execute our technical strategy for AI... 
    Temporary work
    Shift work

    EPAM Systems

    New York, NY
    2 days ago
  • $138.24k - $162.63k

     ...chokepoint. Trusted by more than 500 of the world's leading enterprises. For more information, visit aviatrix.ai. About the role: The Cloud Network Architect is a strategic, customer-facing technical role responsible for ensuring the success of enterprise customers operating... 
    Full time
    Temporary work
    Local area
    Flexible hours
    Day shift

    Aviatrix

    New York, NY
    3 days ago
  •  ...On-site in New York, NY Our client, an industry leader in applied AI, has an excellent opportunity for a Network Support Engineer to work on a 1-2/month opportunity. Work will be on-site in New York, NY. The Network Support Engineer will maintain reliable wired and... 
    Work at office

    Eliassen Group

    New York, NY
    17 days ago
  •  ...currently looking for a highly proactive and detail-oriented OCP Networking Architect to join one of our clients' teams . If you're looking for...  ...infrastructure and management support  ~ Knowledge of AI datacenter needs and requirements on hardware and firmware... 
    Permanent employment
    Full time

    TechBiz Global GmbH

    New York, NY
    4 days ago
  • $100k - $150k

     ...cloud architectures, and sophisticated Artificial Intelligence (AI) solutions, while embracing enterprise agile methodologies. Our...  ...WHAT YOU'LL DOBuild and scale resilient, low-latency enterprise network infrastructure across LAN, WAN, WLAN, and data center networks to... 
    Work experience placement

    Point72

    New York, NY
    10 hours ago
  • $60k - $75k

     ...Junior Network Deployment Technician - ResiBridge New York, New York, United States Fairstead is a purpose-driven real estate firm...  ...data-driven decision-making, and emerging technologies, including AI, to build scalable systems that support sustainable growth,... 
    Flexible hours
    Afternoon shift

    Fairstead

    New York, NY
    2 days ago
  • $70k - $85k

     ...data-driven decision-making, and emerging technologies, including AI, to build scalable systems that support sustainable growth,...  ...across the US. We design, build, and manage a cutting-edge hybrid network comprising fiber-optic technology and high-capacity wireless links... 
    Work at office
    Local area
    Remote work
    Night shift

    Fairstead ESC LLC

    New York, NY
    a month ago
  • $104k - $166k

     ...Peraton, you won't just support the mission-you'll help define it. Network Installer - Make an Impact Where It Matters Most We are looking...  ...to verify your identity. Use of artificial intelligence (AI) tools of any kind during Peraton interviews is strictly prohibited... 
    Contract work
    Temporary work
    Local area
    Shift work

    Peraton

    New York, NY
    2 days ago
  • $90 - $97 per hour

     ...Cloud Infrastructure VP/ Managing Enterprise Architect Location: New York, NY 10020 Contract:...  ...for near-term initiatives involving AI-driven development, modern data platforms...  ...Entra ID / Active Directory integration, network and security architecture, FSLogix profile... 
    Contract work
    Local area

    MatchPoint Solutions

    New York, NY
    2 days ago
  •  ...join our team! You will implement and support a diverse range of network solutions from on premises, hybrid, and cloud-based solutions...  ...of shares, et al. Protect your clients with the most robust AI based Cyber Security solutions. Qualifications: Previous experience... 
    Remote work

    PCPC

    New York, NY
    a month ago
  •  ...Analysis• Datawarehouse & Business Intelligence• Infrastructure & Network Services• Risk Management & Compliance• Business Continuity &...  ...(Vendor Management System)Job Description Job #198990 |Network Architect | OnX Enterprise Solutions (US) LTD | Network Analyst... 
    Permanent employment
    Contract work
    For contractors

    ProCom

    New York, NY
    4 days ago
  • Title: Senior Software Developer/Architect - Telecom & Cloud-Native SystemsWe are seeking a Senior Software Developer/Architect with expertise...  ...of a team responsible for the platform, infrastructure, and networking of Comcast’s Next-Generation Access Network, managing server... 
    Full time

    Cedent Consulting

    New York, NY
    4 days ago
  •  ...Services.Job DescriptionAt least 11 years of experience in technology consulting, enterprise architecture Experience in Cisco DC networks like Cisco Nexus Switching, network security, internet connectivity/infrastructure design and DC network migration is must.DC network... 
    Flexible hours

    Sonsoft

    New York, NY
    1 day ago
  • $160k - $190k

     ...and positions the Firm to provide a distinct and compelling value proposition. The Opportunity We are seeking an experienced Network Architect to define, evolve, and govern the firm’s enterprise network architecture across remote offices, data centers, Microsoft Azure,... 
    Permanent employment
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Manatt, Phelps & Phillips

    New York, NY
    2 days ago
  •  ...proud to deliver our services through global simplicity with trusted transparency.WHAT YOU WILL DO:We are seeking a Principal Architect for Network Services and Automation to lead next-generation automation capabilities across network provisioning, configuration... 

    EOS IT Solutions

    New York, NY
    10 hours ago
  • Assignment Requirements: Perform IP network device upgrades, review existing design and implement required changesReview current design and build new configuration with upgrade requirementAssemble, configure, install, and dispose of Cisco routers and switches following... 
    Contract work

    Cedent Consulting

    New York, NY
    4 days ago
  • $75 - $80 per hour

     ...Multi-Cloud Infrastructure and Security Architect  Location: New York, New York Duration...  .... Collaborate with traditional on-prem network and sysadmin teams to systematically migrate...  ...with curiosity for modern tooling and AI-assisted development Collaborative mindset... 
    Full time
    Contract work
    For contractors

    PTR Global

    New York, NY
    a month ago
  • Principal Network Services Architect At Leidos, we deliver innovative solutions through the efforts of our diverse and talented people who are dedicated to our customers' mission success. We empower our teams, contribute to our communities, and operate sustainable practices... 
    Remote job
    For contractors
    For subcontractor
    Work at office

    ClearanceJobs

    New York, NY
    2 days ago
  • Network Architect (Contract) Remote - Preferred: San Jose, CA / Austin, TX Long Term Contract We're seeking a seasoned Network Architect to design, implement, and optimize complex network solutions. The role requires deep expertise in cloud, on-prem, and hybrid network... 
    Remote job
    Long term contract
    Contract work

    AceStack LLC

    New York, NY
    2 days ago
  • Position :SENIOR LEVEL NETWORK ARCHITECT ROLE Location : Hybrid 3/2 NY City NY Duration: one year C2c rate: $70 - 75 .00/hr THIS POSITION WILL REQUIRE THE CONSULTANT TO WORK 3 DAYS ONSITE & 2 DAYS REMOTE Category Name Required Importance Experience Areas of Expertise... 
    Remote work

    Anveta

    New York, NY
    2 days ago
  • Cloud Network Architect Leidos delivers innovative solutions through a diverse, talented team dedicated to making the world safer, healthier, and more efficient through information technology, engineering, and science. Everything we do is built on a commitment to do the... 
    Remote job
    Contract work
    Flexible hours

    ClearanceJobs

    New York, NY
    2 days ago
  • Senior Network Architect -We are looking for seasoned senior network architect with CCNP/CCIE certification. Candidate should be willing to work in a hybrid mode (3 days from office in NYC). -Minimum 15+ yrs of relevant experience in enterprise network environment/customers... 
    Work at office

    SARIAN Co

    New York, NY
    2 days ago
  • $147k - $232k

     ...who support your development and help you turn your ambition into action. What you'll do Viasat is looking for an experienced network architect to lead design and architecture of our Government SATCOM orchestration and service delivery platforms! We are developing large... 
    Work at office

    ViaSat

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Factory Network Architect. Be the first to apply!