Senior AI Network Engineer - AI Infrastructure
$220k - $350kLooking for a role with plenty of growth opportunities?
Join one of North America's fastest-growing AI infrastructure providers, delivering large-scale GPU cloud platforms for AI training, fine-tuning, and inference workloads. Backed by significant investment and advanced infrastructure expertise, the organization builds high-performance AI environments powered by NVIDIA GPUs, high-speed networking, storage, and Kubernetes.
This company is seeking a Senior AI Network Engineer to design, deploy, and optimize networking infrastructure for large-scale GPU clusters. The role offers the opportunity to solve complex HPC and AI networking challenges while supporting low-latency, high-bandwidth platforms built for next-generation AI workloads.
Ready to make a move? Get in touch and apply today!
Responsibilities:
- Design, deploy, and operate high-performance AI networking infrastructure supporting large-scale GPU clusters.
- Build and optimise low-latency Ethernet and InfiniBand fabrics for distributed AI training and inference workloads.
- Configure and support NVIDIA Spectrum switches, Cumulus Linux, and modern spine-leaf network architectures.
- Optimise network performance for RDMA, RoCE, GPUDirect RDMA, NCCL, and large-scale distributed training.
- Collaborate with platform, storage, Kubernetes, and infrastructure teams to maximise cluster performance and reliability.
- Develop network automation using Infrastructure-as-Code, CI/CD, and configuration management tools.
- Implement monitoring, telemetry, and observability across AI networking environments.
- Troubleshoot complex networking, hardware, and distributed systems issues across production GPU infrastructure.
- Support capacity planning, network scaling, and future infrastructure expansion.
Skills / Must Have:
- 5+ years of experience in Network Engineering supporting large-scale data centre, cloud, HPC, or AI infrastructure environments.
- Strong knowledge of spine-leaf networking and large-scale data centre architectures.
- Hands-on experience with NVIDIA Spectrum switches and Cumulus Linux.
- Deep understanding of Ethernet fabrics supporting AI and HPC workloads.
- Experience with RoCE, RDMA, InfiniBand, BGP, EVPN-VXLAN, MLAG, and modern routing protocols.
- Experience supporting GPU infrastructure and distributed AI training environments.
- Strong Linux systems knowledge and scripting experience using Python, Bash, or Ansible.
- Experience with automation, Infrastructure-as-Code, and network telemetry platforms.
Desirable Skills:
- Experience supporting NVIDIA H100, H200, B200, or Blackwell GPU deployments.
- Knowledge of NCCL, CUDA networking optimisation, GPUDirect RDMA, and distributed AI workloads.
- Experience with Kubernetes networking and cloud-native infrastructure.
- Familiarity with storage networking technologies including VAST, Weka, or BeeGFS.
- Background working within hyperscalers, GPU cloud providers, AI infrastructure companies, or HPC environments.
- Experience deploying multi-thousand GPU clusters.
Benefits:
- Competitive salary with annual bonus and equity opportunities.
- Opportunity to help build one of North America's fastest-growing AI infrastructure platforms.
- Work with cutting-edge NVIDIA GPU technology and hyperscale networking environments.
- High-impact engineering role with significant technical ownership.
- Collaborative engineering culture with minimal bureaucracy.
- Flexible working arrangements and excellent career progression.
Salary:
- $220,000 – $350,000 Base Salary
$126.2k - $264.1k
...large-scale distributed networking solutions for the... ...networking, multi-tenant Infrastructure-as-a-Service (IaaS), and... ...and can influence senior leadership in a positive... ...saving care. And with AI embedded across our products... ..., Electrical/Hardware Engineering or related field....SeniorTemporary workFlexible hours$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research... ...an AI infrastructure software engineer to join our team. You'll be instrumental... ...availability of AI systems.As a senior DGX Cloud AI Infrastructure...SeniorFull timeRemote work$1,000 per month
...empowering our employees, encouraging innovative solutions and recognizing great performance.POSITION SUMMARY:The Senior AI Cloud Infrastructure Engineer is responsible for owning the intake, provisioning, and operational delivery of enterprise AI platforms within the...SeniorFull timeCasual workWork at officeLocal areaWeekend workAfternoon shift$178k - $321k
...function has an early but working AI-native capability: a multi-... ...the governed data and AI infrastructure everything else depends on.... ...it. This is a two-person engineering team: you deploy, debug, and... ...infrastructure-as-code, CI/CD, identity, networking, observability, and cost...Senior$229.9k - $262.4k
...Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,...SeniorFull timePart timeLocal area- Role Description The Cloud Enablement & Engineering Team at BlueCross BlueShield of Tennessee is hiring a Senior AI Infrastructure & Cloud Engineer. In this fully-remote role,... ...experience. ~Experience with enterprise network design including segmentation models,...SeniorFull timeLive inRemote work
- Oracle's Cloud Infrastructure team invites an experienced engineer to design, develop, test, and operate cloud‑native AI‑first platform services. You will partner with SREs, security, and backend teams to drive safe operational outcomes and implement scalable automation...Senior
- Role Description As a Senior AI Platform Engineer, Infrastructure Services, you will be tasked with taking ownership of our AI Gateway infrastructure (built on Kong AI Gateway), the system that authenticates, routes, rate-limits, and monitors AI coding assistant traffic...SeniorFull timeLocal areaWork from homeHome officeFlexible hours
- Oracle in the United States is seeking a senior engineer to design, build, and scale bare-metal provisioning systems powering millions... ...servers worldwide. You will develop highly reliable and secure infrastructure, tackle complex distributed systems challenges, and help...SeniorWorldwide
- ...Job Description Job Description AI Infrastructure Engineer Redstone Arsenal/Huntsville, AL At IPT Associates (IPTA), we enjoy solving real-world problems with technology. We work closely with our customers, teammates, experts, and partners to come up with practical...Senior
- ...and what is delivered. Our AI-native platform, Air Enterprise... ...are seeking an experienced Senior AI Engineer specializing in AI security... ...failures, and build the infrastructure necessary to deploy capable... ...across Kubernetes, AWS, networking, storage, and compute. Implement...SeniorFull timeWork at officeRemote work
$190k - $260k
...an artificial intelligence (AI) powered technology stack purpose... ...world models – depends on infrastructure that turns thousands of hours... ...throughput. We are looking for engineers who make model training fast:... ...bottlenecks across storage, network, CPU preprocessing, and GPU...SeniorTemporary workWork at officeVisa sponsorshipFlexible hours$175k - $215k
...-focused investment bank. Our team of senior professionals delivers a wide array of... ...Technology team is seeking a Data and AI Infrastructure Engineer to build secure, scalable platforms and... ..., private endpoints, Key Vault, and network segmentation; DevSecOps practices: secrets...Senior$151.3k - $283.8k
...technological advancements such as cloud, AI, and network security. While driving the... ...implementation of emerging technologies within cloud infrastructure.Who We Look For1.Education: Master’s or Ph.D. degree in Computer Engineering, Electronic Engineering,...SeniorFull timeRelocation package$184k - $287.5k
AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical...SeniorFull timeRemote work$169.8k - $355.4k
...applications, tools, networks etc.Only Oracle brings together the data, infrastructure, applications, and expertise... ...saving care. And with AI embedded across our... ....Build and lead the engineering organization responsible... ...risks, and results to senior OCI leadership....SeniorTemporary workFlexible hours$220k - $350k
...with the ultimate goal of enabling human life on Mars.SR AI ENGINEER, PLATFORM INFRASTRUCTURE, SPECIAL PROGRAMSAs an AI Engineer, Platform... ...including NVIDIA drivers, CUDA, NCCL, InfiniBand/RoCE networking.Experience with PXE boot, cloud-init, squashfs, or other...SeniorPermanent employmentTemporary workImmediate startWeekend work- ...A tech company specializing in AI infrastructure is seeking a Software Engineer to build a scalable compute platform for its generative video models. The ideal candidate will have over 5 years of experience in MLOps or AI infrastructure management, along with strong Python...Senior
- ...accessible financial infrastructure platforms in the industry... ...building a dedicated AI Compute and... ...This team sits within engineering leadership and owns the... ...You will join a small, senior, high-impact team working... ...fundamentals across Linux, networking, storage, containers,...SeniorLocal areaRemote work
$180k - $240k
...logistics operations. About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI... ...parallelism techniques across H100/A100 clusters. Networking & Hardware Tuning: Optimize low-level communication (e.g...SeniorOdd jobWork at office- ...Senior AI Infrastructure Engineer Austin, Texas, United States; Reston, Virginia, United States Seekr is building the infrastructure that powers... ...platforms. ~ Knowledge of distributed computing, networking, storage systems, cloud-native architectures, and infrastructure...SeniorPermanent employmentWork experience placementFlexible hours
$166k - $220k
...powered by Lattice OS, an AI-powered operating system that... ...vision, sensor fusion, and networking technology to the military... ...ABOUT THE TEAM CorpTech Infrastructure Engineering builds and operates the... ...JOB We’re looking for a Senior AI Infrastructure Engineer...SeniorFull timeWork experience placementImmediate start- A leading AI research firm in San Francisco seeks a Staff Infrastructure Engineer to identify and resolve infrastructure bottlenecks and design large-scale systems for AI training. The ideal candidate has over 3 years of experience in infrastructure engineering and strong...Senior
- ...a direct and meaningful impact. As a Senior Lead Infrastructure Engineer at JPMorganChase within the Corporate... ...mitigation actionsUses enterprise-authorized AI capabilities within the work... ...Plans, designs, deploys, and configures network solutions/fabrics for the Wide Area...SeniorRemote workShift work
- ...Building and operating robust network infrastructure, the full-time Senior Network Infrastructure Engineer will design and manage public and private networks for a remote... ...networking, BGP routing, and automation using AI. Key Responsibilities: Design, build, validate...SeniorFull timeRemote work
- Ll Oefentherapie is inviting adaptable engineers to join their innovative team in Austin, Texas. The role focuses on developing GPU infrastructures for AI/ML workloads, requiring extensive experience in systems engineering and a profound understanding of computer systems...Senior
- RELX seeks an experienced engineer to design, build, and scale AI-driven infrastructure and governance for GenAI products within the AI Infrastructure and Governance team. You will help ensure reliable model capacity, governance, and collaboration across engineering and...Senior
- AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into production-ready products. You will join a fast-paced engineering... ...building customer-facing APIs, scaling inference infrastructure, and partnering with researchers. You’ll work across the...Senior
- Cloudflare is seeking a Senior Systems Engineer to build AI Gateway at the edge, enabling high-volume model... ...with reliable, observable infrastructure. You will prototype across the stack... ...and automation across Cloudflare’s global network. #J-18808-Ljbffr Worky LtdSenior
- OpenAI is seeking an experienced software engineer to join the GPT Infrastructure team and help build an automated inference optimization platform that scales research prototypes into production‑ready solutions. You will design durable APIs and control‑plane services, integrate...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Network Engineer - AI Infrastructure. Be the first to apply!
- ai ml engineer United States
- ai prompt engineer United States
- senior ai engineer United States
- ai research engineer United States
- machine learning ai engineer United States
- ai developer United States
- ai engineer United States
- ai engineer remote United States
- senior network engineer remote United States
- network engineer contract United States



