Senior Network Engineer (InfiniBand & HPC Architecture)

Senior Network Engineer (InfiniBand & HPC Architecture)

Location: Remote / Hybrid (US-Based)

Department: Global Technical Operations & Infrastructure

Reports To: Network Support Manager

Employment Type: Full-time

Target Base Salary: $185,000 – $200,000 / year + Equity Package (3-Year Vesting)

Position Overview

Axe Compute is seeking a senior-level InfiniBand & HPC Network Engineer to own, optimize, and troubleshoot the ultra-low-latency interconnect fabrics powering our 20,000+ GPU supercomputing infrastructure.

In this role, you will serve as the primary subject matter expert (SME) for high-speed fabric design, Subnet Manager tuning, optical diagnostics, and Tier-3/4 network escalations across multi-site data centers. You will work directly with our Network Support Manager, Storage Leads, and global NOC teams to ensure maximum throughput, non-blocking fabric topology, and zero packet drop across our GPU nodes and high-performance Weka/NVMe-oF storage arrays.

Key Responsibilities

• InfiniBand Fabric Governance & Optimization: Own operational health, topology design, Subnet Manager (OpenSM / UFM) tuning, Adaptive Routing, Congestion Control (CC), and firmware lifecycle for NDR/HDR Mellanox InfiniBand fabrics.
• Tier-3/4 Complex Escalations: Serve as the ultimate technical escalation point for fabric bottlenecks, link flap events, BER (Bit Error Rate) optical degradations, and latency spikes across active GPU training clusters.
• Storage Transport Optimization: Fine-tune RoCEv2 and InfiniBand transport parameters to guarantee sustained multi-terabit throughput between compute nodes, switch fabrics, and distributed storage systems.
• Telemetry & Automation Integration: Partner with Sr. Automation Engineers to stream gNMI, SNMP, and InfiniBand performance counters into Grafana dashboards, PagerDuty, and ServiceNow for automated alerting and root-cause suppression.
• Operational SOPs & Field Runbooks: Author step-by-step diagnostic and hot-swap runbooks for optical cables, transceivers, and switch modules for 24/7 global NOC teams (US & APAC) to execute during shift coverage.
• Vendor & OEM Escalation: Lead technical engagement with NVIDIA/Mellanox TAC, hardware OEMs, optical vendors, and data center smart hands during major incident root-cause analysis (RCA).

Qualifications & Technical Requirements

• Experience: 6+ years in enterprise data center networking, HPC interconnects, or ISP backbones, with 3+ years dedicated to high-speed InfiniBand fabric operations .
• InfiniBand Mastery: Deep expert command of NVIDIA/Mellanox InfiniBand architecture, Subnet Managers (UFM/OpenSM), ibdiagnet, ibstat, perfquery, and fabric topology validation.
• Enterprise Ethernet & Routing: Strong proficiency with BGP, EVPN-VXLAN, Spine-Leaf architectures, RoCEv2, L2/L3 switching, and optical transceiver diagnostics across Arista, Cisco, or Juniper platforms.
• Linux & Network Tooling: Advanced Linux CLI fluency (tcpdump, ethtool, ipmitool, dmesg, iperf3, lspci) for host-level HCA/NIC and driver debugging.
• Incident Leadership: Proven track record driving rapid MTTR during critical (P1/P2) network events on high-density compute infrastructure.

Preferred Qualifications

• Direct experience supporting multi-cluster GPU/AI training environments (NVIDIA H100/H200/B200 platforms).
• Certifications: NVIDIA Certified Professional/Expert (InfiniBand or Ethernet), Arista ACE, or CCNP/CCIE.
• Network automation experience using Python, Ansible, or Terraform for fabric configuration management.

Compensation & Benefits

• Base Salary Range: $185,000 – $200,000 / year
• Equity Incentive: 10,000 Stock Options (3-Year Vesting Schedule with 1-Year Cliff)
• Work Arrangement: Remote / Hybrid (US-Based)
• Benefits: Full health, dental, and vision insurance; 401(k); generous PTO; home office allowance.