Senior AI Network Engineer - AI Infrastructure
$220k - $350kLooking for a role with plenty of growth opportunities?
Join one of North America's fastest-growing AI infrastructure providers, delivering large-scale GPU cloud platforms for AI training, fine-tuning, and inference workloads. Backed by significant investment and advanced infrastructure expertise, the organization builds high-performance AI environments powered by NVIDIA GPUs, high-speed networking, storage, and Kubernetes.
This company is seeking a Senior AI Network Engineer to design, deploy, and optimize networking infrastructure for large-scale GPU clusters. The role offers the opportunity to solve complex HPC and AI networking challenges while supporting low-latency, high-bandwidth platforms built for next-generation AI workloads.
Ready to make a move? Get in touch and apply today!
Responsibilities:
- Design, deploy, and operate high-performance AI networking infrastructure supporting large-scale GPU clusters.
- Build and optimise low-latency Ethernet and InfiniBand fabrics for distributed AI training and inference workloads.
- Configure and support NVIDIA Spectrum switches, Cumulus Linux, and modern spine-leaf network architectures.
- Optimise network performance for RDMA, RoCE, GPUDirect RDMA, NCCL, and large-scale distributed training.
- Collaborate with platform, storage, Kubernetes, and infrastructure teams to maximise cluster performance and reliability.
- Develop network automation using Infrastructure-as-Code, CI/CD, and configuration management tools.
- Implement monitoring, telemetry, and observability across AI networking environments.
- Troubleshoot complex networking, hardware, and distributed systems issues across production GPU infrastructure.
- Support capacity planning, network scaling, and future infrastructure expansion.
Skills / Must Have:
- 5+ years of experience in Network Engineering supporting large-scale data centre, cloud, HPC, or AI infrastructure environments.
- Strong knowledge of spine-leaf networking and large-scale data centre architectures.
- Hands-on experience with NVIDIA Spectrum switches and Cumulus Linux.
- Deep understanding of Ethernet fabrics supporting AI and HPC workloads.
- Experience with RoCE, RDMA, InfiniBand, BGP, EVPN-VXLAN, MLAG, and modern routing protocols.
- Experience supporting GPU infrastructure and distributed AI training environments.
- Strong Linux systems knowledge and scripting experience using Python, Bash, or Ansible.
- Experience with automation, Infrastructure-as-Code, and network telemetry platforms.
Desirable Skills:
- Experience supporting NVIDIA H100, H200, B200, or Blackwell GPU deployments.
- Knowledge of NCCL, CUDA networking optimisation, GPUDirect RDMA, and distributed AI workloads.
- Experience with Kubernetes networking and cloud-native infrastructure.
- Familiarity with storage networking technologies including VAST, Weka, or BeeGFS.
- Background working within hyperscalers, GPU cloud providers, AI infrastructure companies, or HPC environments.
- Experience deploying multi-thousand GPU clusters.
Benefits:
- Competitive salary with annual bonus and equity opportunities.
- Opportunity to help build one of North America's fastest-growing AI infrastructure platforms.
- Work with cutting-edge NVIDIA GPU technology and hyperscale networking environments.
- High-impact engineering role with significant technical ownership.
- Collaborative engineering culture with minimal bureaucracy.
- Flexible working arrangements and excellent career progression.
Salary:
- $220,000 – $350,000 Base Salary
$126.2k - $264.1k
...large-scale distributed networking solutions for the... ...networking, multi-tenant Infrastructure-as-a-Service (IaaS), and... ...and can influence senior leadership in a positive... ...saving care. And with AI embedded across our products... ..., Electrical/Hardware Engineering or related field....SeniorTemporary workFlexible hours$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research... ...an AI infrastructure software engineer to join our team. You'll be instrumental... ...availability of AI systems.As a senior DGX Cloud AI Infrastructure...SeniorFull timeRemote work$178k - $321k
...function has an early but working AI-native capability: a multi-... ...the governed data and AI infrastructure everything else depends on.... ...it. This is a two-person engineering team: you deploy, debug, and... ...infrastructure-as-code, CI/CD, identity, networking, observability, and cost...Senior- Role Description The Cloud Enablement & Engineering Team at BlueCross BlueShield of Tennessee is hiring a Senior AI Infrastructure & Cloud Engineer. In this fully-remote role,... ...experience. ~Experience with enterprise network design including segmentation models,...SeniorFull timeLive inRemote work
$140k - $215k
Role Description CrowdStrike is looking for a Senior AI Infrastructure Engineer with expertise in Large Language Models (LLMs) Infrastructure and... ...all employees regardless of level or role. ~Employee Networks, geographic neighborhood groups, and volunteer opportunities...SeniorFull timeWork at office$132k - $182k
Role Description As a Senior AI Platform Engineer, Infrastructure Services, you will be tasked with taking ownership of our AI Gateway infrastructure (built on Kong AI Gateway), the system that authenticates, routes, rate-limits, and monitors AI coding assistant traffic...SeniorFull timeLocal areaWork from homeHome officeFlexible hours- ...Mirantis is the Kubernetes-native AI infrastructure company, enabling... ...Mirantis empowers platform engineering teams to deliver composable,... ...of core infrastructure and network engineering, you will sustain... ...related incidents. Act as a senior escalation point for operational...SeniorFull timeRemote work
- Oracle in the United States is seeking a senior engineer to design, build, and scale bare-metal provisioning systems powering millions... ...servers worldwide. You will develop highly reliable and secure infrastructure, tackle complex distributed systems challenges, and help...SeniorWorldwide
$151.3k - $283.8k
...technological advancements such as cloud, AI, and network security. While driving the... ...implementation of emerging technologies within cloud infrastructure.Who We Look For1.Education: Master’s or Ph.D. degree in Computer Engineering, Electronic Engineering,...SeniorFull timeRelocation package$200k - $322k
...deep learning ignited modern AI — the next era of computing.... ...to join us today.Design-for-X Engineering at NVIDIA works on groundbreaking... ....What you'll be doing:As a senior member in our team, you will... ...cycles as part of the AI Infrastructure requirements at an org-wide level...SeniorFull time$175k - $215k
...-focused investment bank. Our team of senior professionals delivers a wide array of... ...Technology team is seeking a Data and AI Infrastructure Engineer to build secure, scalable platforms and... ..., private endpoints, Key Vault, and network segmentation; DevSecOps practices: secrets...Senior$220k - $350k
...with the ultimate goal of enabling human life on Mars.SR AI ENGINEER, PLATFORM INFRASTRUCTURE, SPECIAL PROGRAMSAs an AI Engineer, Platform... ...including NVIDIA drivers, CUDA, NCCL, InfiniBand/RoCE networking.Experience with PXE boot, cloud-init, squashfs, or other...SeniorPermanent employmentTemporary workImmediate startWeekend work$100k - $200k
Nscale is seeking a Senior Network Engineer for AI Infrastructure to ensure the operational health of their high-speed interconnects. With 5+ years of experience in network engineering, you'll be responsible for maintaining and optimizing large-scale Infiniband and RoCE...SeniorRemote work$119.8k - $234.7k
...MicrosoftOverviewMicrosoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft’s expanding Cloud Infrastructure... ...Platform Systems Engineering (PSE) team is seeking a Senior AI Network Systems Engineer to drive the architecture, integration,...SeniorOngoing contractWork at officeLocal areaWorldwide3 days per week- ...Focus Build secure AI inference platforms running in trusted environments Integrate enclave-based compute into ML infrastructure Hardening model serving pipelines against data leakage Tech Kubernetes GPU clusters Confidential computing Rust / Go...SeniorFull time
$190k - $260k
...an artificial intelligence (AI) powered technology stack purpose... ...world models - depends on infrastructure that turns thousands of hours... ...throughput. We are looking for engineers who make model training fast:... ...bottlenecks across storage, network, CPU preprocessing, and GPU...SeniorTemporary workWork at officeVisa sponsorship- ...To support the management of expansive AI ecosystems, the full-time Senior AI Infrastructure Engineer will lead technical operations, service reliability, and platform engineering efforts in a remote environment, focusing on NVIDIA GPU infrastructure and Kubernetes operations...SeniorFull timeRemote work
- ...Job Description Job Description AI Infrastructure Engineer Redstone Arsenal/Huntsville, AL At IPT Associates (IPTA), we enjoy solving real-world problems with technology. We work closely with our customers, teammates, experts, and partners to come up with practical...Senior
$125k
Overview:We are seeking a highly skilled Senior Network Engineer to support a large-scale enterprise network modernization and data center... ...decommissioning, network cutovers, and Cisco ACI-integrated infrastructure migrations within a production environment.The ideal...SeniorContract work- ...accessible financial infrastructure platforms in the industry... ...building a dedicated AI Compute and... ...This team sits within engineering leadership and owns the... ...You will join a small, senior, high-impact team working... ...fundamentals across Linux, networking, storage, containers,...SeniorLocal areaRemote work
- ...Senior AI Infrastructure Engineer Austin, Texas, United States; Reston, Virginia, United States Seekr is building the infrastructure that powers... ...platforms. ~ Knowledge of distributed computing, networking, storage systems, cloud-native architectures, and infrastructure...SeniorWork experience placementFlexible hours
- ...United States Digital Space LLC in the United States is seeking a Senior Systems Engineer to help build the AI Gateway layer — a core infrastructure project that connects models, providers, and a global network. You will move from rough product ideas to production-ready...Senior
$120 - $130 per hour
...seeking a highly experienced Network Engineer to perform a comprehensive... ...optimization of its enterprise network infrastructure.This role is intended for a... ...• Experience serving as the Senior escalation point for complex... ...of Artificial Intelligence (AI): We may use Artificial...SeniorContract workTemporary workInterim roleImmediate startRemote work- A leading AI research firm in San Francisco seeks a Staff Infrastructure Engineer to identify and resolve infrastructure bottlenecks and design large-scale systems for AI training. The ideal candidate has over 3 years of experience in infrastructure engineering and strong...Senior
$169.78k - $351k
...efficient, user-oriented autonomous fleet. About The Role We are seeking an experienced and mission-driven Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization to lead the performance tuning, deployment, and resource scheduling of cutting-edge AI...SeniorFull time- ...Building and operating robust network infrastructure, the full-time Senior Network Infrastructure Engineer will design and manage public and private networks for a remote... ...networking, BGP routing, and automation using AI. Key Responsibilities: Design, build, validate...SeniorFull timeRemote work
$155k - $180k
Role Description The Senior AI Infrastructure Engineer will serve as a technical cornerstone of VideoAmp's AI Infra team, driving the design and execution of agentic workflow systems that bridge VideoAmp's platform APIs and AI-powered customer experiences. This is a high...SeniorFull timeSummer holidayWork at officeFlexible hours$174.72k - $295.68k
...forefront of innovation, integrating advanced AI and autonomous driving technologies into... ...connectivity.As a core member of our AI Infrastructure team, you will be responsible for... ...or higher in Computer Science, Software Engineering, Artificial Intelligence, or related fields...SeniorFull timeOverseas- Ll Oefentherapie is inviting adaptable engineers to join their innovative team in Austin, Texas. The role focuses on developing GPU infrastructures for AI/ML workloads, requiring extensive experience in systems engineering and a profound understanding of computer systems...Senior
- Dover Networks LLC in the United States is seeking a senior software engineer to support our AI infrastructure team. You will build and maintain the foundation for customer AI capabilities, ensuring access to high-quality LLMs across the inference stack. The role emphasizes...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Network Engineer - AI Infrastructure. Be the first to apply!
- ai engineer United States
- ai research engineer United States
- machine learning ai engineer United States
- senior ai engineer United States
- ai ml engineer United States
- ai prompt engineer United States
- ai engineer remote United States
- ai developer United States
- cisco ccnp network engineer United States
- principal network engineer United States






