Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Network Engineer - AI Infrastructure

$220k - $350k
Full-time

Looking for a role with plenty of growth opportunities?

Join one of North America's fastest-growing AI infrastructure providers, delivering large-scale GPU cloud platforms for AI training, fine-tuning, and inference workloads. Backed by significant investment and advanced infrastructure expertise, the organization builds high-performance AI environments powered by NVIDIA GPUs, high-speed networking, storage, and Kubernetes.

This company is seeking a Senior AI Network Engineer to design, deploy, and optimize networking infrastructure for large-scale GPU clusters. The role offers the opportunity to solve complex HPC and AI networking challenges while supporting low-latency, high-bandwidth platforms built for next-generation AI workloads.

Ready to make a move? Get in touch and apply today!

Responsibilities:

  • Design, deploy, and operate high-performance AI networking infrastructure supporting large-scale GPU clusters.
  • Build and optimise low-latency Ethernet and InfiniBand fabrics for distributed AI training and inference workloads.
  • Configure and support NVIDIA Spectrum switches, Cumulus Linux, and modern spine-leaf network architectures.
  • Optimise network performance for RDMA, RoCE, GPUDirect RDMA, NCCL, and large-scale distributed training.
  • Collaborate with platform, storage, Kubernetes, and infrastructure teams to maximise cluster performance and reliability.
  • Develop network automation using Infrastructure-as-Code, CI/CD, and configuration management tools.
  • Implement monitoring, telemetry, and observability across AI networking environments.
  • Troubleshoot complex networking, hardware, and distributed systems issues across production GPU infrastructure.
  • Support capacity planning, network scaling, and future infrastructure expansion.

Skills / Must Have:

  • 5+ years of experience in Network Engineering supporting large-scale data centre, cloud, HPC, or AI infrastructure environments.
  • Strong knowledge of spine-leaf networking and large-scale data centre architectures.
  • Hands-on experience with NVIDIA Spectrum switches and Cumulus Linux.
  • Deep understanding of Ethernet fabrics supporting AI and HPC workloads.
  • Experience with RoCE, RDMA, InfiniBand, BGP, EVPN-VXLAN, MLAG, and modern routing protocols.
  • Experience supporting GPU infrastructure and distributed AI training environments.
  • Strong Linux systems knowledge and scripting experience using Python, Bash, or Ansible.
  • Experience with automation, Infrastructure-as-Code, and network telemetry platforms.

Desirable Skills:

  • Experience supporting NVIDIA H100, H200, B200, or Blackwell GPU deployments.
  • Knowledge of NCCL, CUDA networking optimisation, GPUDirect RDMA, and distributed AI workloads.
  • Experience with Kubernetes networking and cloud-native infrastructure.
  • Familiarity with storage networking technologies including VAST, Weka, or BeeGFS.
  • Background working within hyperscalers, GPU cloud providers, AI infrastructure companies, or HPC environments.
  • Experience deploying multi-thousand GPU clusters.

Benefits:

  • Competitive salary with annual bonus and equity opportunities.
  • Opportunity to help build one of North America's fastest-growing AI infrastructure platforms.
  • Work with cutting-edge NVIDIA GPU technology and hyperscale networking environments.
  • High-impact engineering role with significant technical ownership.
  • Collaborative engineering culture with minimal bureaucracy.
  • Flexible working arrangements and excellent career progression.

Salary:

  • $220,000 – $350,000 Base Salary
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Senior AI Network Engineer - AI Infrastructure in United States vacancy
  • $126.2k - $264.1k

     ...large-scale distributed networking solutions for the...  ...networking, multi-tenant Infrastructure-as-a-Service (IaaS), and...  ...and can influence senior leadership in a positive...  ...saving care. And with AI embedded across our products...  ..., Electrical/Hardware Engineering or related field.... 
    Senior
    Temporary work
    Flexible hours

    Oracle Corporation

    Austin, TX
    6 hours ago
  • $184k - $287.5k

    Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research...  ...an AI infrastructure software engineer to join our team. You'll be instrumental...  ...availability of AI systems.As a senior DGX Cloud AI Infrastructure... 
    Senior
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    6 hours ago
  • $1,000 per month

     ...empowering our employees, encouraging innovative solutions and recognizing great performance.POSITION SUMMARY:The Senior AI Cloud Infrastructure Engineer is responsible for owning the intake, provisioning, and operational delivery of enterprise AI platforms within the... 
    Senior
    Full time
    Casual work
    Work at office
    Local area
    Weekend work
    Afternoon shift

    NewRez

    Coppell, TX
    4 days ago
  • $178k - $321k

     ...function has an early but working AI-native capability: a multi-...  ...the governed data and AI infrastructure everything else depends on....  ...it. This is a two-person engineering team: you deploy, debug, and...  ...infrastructure-as-code, CI/CD, identity, networking, observability, and cost... 
    Senior

    OKX

    San Jose, CA
    2 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    1 day ago
  • Role Description The Cloud Enablement & Engineering Team at BlueCross BlueShield of Tennessee is hiring a Senior AI Infrastructure & Cloud Engineer. In this fully-remote role,...  ...experience. ~Experience with enterprise network design including segmentation models,... 
    Senior
    Full time
    Live in
    Remote work

    BlueCross BlueShield of Tennessee

    Remote
    27 days ago
  • Oracle's Cloud Infrastructure team invites an experienced engineer to design, develop, test, and operate cloud‑native AI‑first platform services. You will partner with SREs, security, and backend teams to drive safe operational outcomes and implement scalable automation... 
    Senior

    Oracle

    Kansas City, MO
    1 day ago
  • Role Description As a Senior AI Platform Engineer, Infrastructure Services, you will be tasked with taking ownership of our AI Gateway infrastructure (built on Kong AI Gateway), the system that authenticates, routes, rate-limits, and monitors AI coding assistant traffic... 
    Senior
    Full time
    Local area
    Work from home
    Home office
    Flexible hours

    SentinelOne

    Remote
    a month ago
  • Oracle in the United States is seeking a senior engineer to design, build, and scale bare-metal provisioning systems powering millions...  ...servers worldwide. You will develop highly reliable and secure infrastructure, tackle complex distributed systems challenges, and help... 
    Senior
    Worldwide

    Oracle

    Austin, TX
    1 day ago
  •  ...Job Description Job Description AI Infrastructure Engineer Redstone Arsenal/Huntsville, AL   At IPT Associates (IPTA), we enjoy solving real-world problems with technology. We work closely with our customers, teammates, experts, and partners to come up with practical... 
    Senior

    Interactive Process Technology LLC

    Huntsville, AL
    27 days ago
  •  ...and what is delivered. Our AI-native platform, Air Enterprise...  ...are seeking an experienced Senior AI Engineer specializing in AI security...  ...failures, and build the infrastructure necessary to deploy capable...  ...across Kubernetes, AWS, networking, storage, and compute. Implement... 
    Senior
    Full time
    Work at office
    Remote work

    Air

    Pittsburgh, PA
    5 days ago
  • $190k - $260k

     ...an artificial intelligence (AI) powered technology stack purpose...  ...world models – depends on infrastructure that turns thousands of hours...  ...throughput. We are looking for engineers who make model training fast:...  ...bottlenecks across storage, network, CPU preprocessing, and GPU... 
    Senior
    Temporary work
    Work at office
    Visa sponsorship
    Flexible hours

    Kodiak

    Mountain View, CA
    1 day ago
  • $175k - $215k

     ...-focused investment bank. Our team of senior professionals delivers a wide array of...  ...Technology team is seeking a Data and AI Infrastructure Engineer to build secure, scalable platforms and...  ..., private endpoints, Key Vault, and network segmentation; DevSecOps practices: secrets... 
    Senior

    PJT Partners

    New York, NY
    5 days ago
  • $151.3k - $283.8k

     ...technological advancements such as cloud, AI, and network security. While driving the...  ...implementation of emerging technologies within cloud infrastructure.Who We Look For1.Education: Master’s or Ph.D. degree in Computer Engineering, Electronic Engineering,... 
    Senior
    Full time
    Relocation package

    Tencent

    Palo Alto, CA
    6 hours ago
  • $184k - $287.5k

    AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical... 
    Senior
    Full time
    Remote work

    Nvidia

    Austin, TX
    1 day ago
  • $169.8k - $355.4k

     ...applications, tools, networks etc.Only Oracle brings together the data, infrastructure, applications, and expertise...  ...saving care. And with AI embedded across our...  ....Build and lead the engineering organization responsible...  ...risks, and results to senior OCI leadership.... 
    Senior
    Temporary work
    Flexible hours

    Oracle Corporation

    Nashville, TN
    6 hours ago
  • $220k - $350k

     ...with the ultimate goal of enabling human life on Mars.SR AI ENGINEER, PLATFORM INFRASTRUCTURE, SPECIAL PROGRAMSAs an AI Engineer, Platform...  ...including NVIDIA drivers, CUDA, NCCL, InfiniBand/RoCE networking.Experience with PXE boot, cloud-init, squashfs, or other... 
    Senior
    Permanent employment
    Temporary work
    Immediate start
    Weekend work

    SpaceX

    Palo Alto, CA
    4 days ago
  •  ...A tech company specializing in AI infrastructure is seeking a Software Engineer to build a scalable compute platform for its generative video models. The ideal candidate will have over 5 years of experience in MLOps or AI infrastructure management, along with strong Python... 
    Senior

    HeyGen

    San Francisco, CA
    13 hours ago
  •  ...accessible financial infrastructure platforms in the industry...  ...building a dedicated AI Compute and...  ...This team sits within engineering leadership and owns the...  ...You will join a small, senior, high-impact team working...  ...fundamentals across Linux, networking, storage, containers,... 
    Senior
    Local area
    Remote work

    Kraken

    United States
    3 days ago
  • $180k - $240k

     ...logistics operations. About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI...  ...parallelism techniques across H100/A100 clusters. Networking & Hardware Tuning: Optimize low-level communication (e.g... 
    Senior
    Odd job
    Work at office

    Gatik AI

    Santa Clara, CA
    2 days ago
  •  ...Senior AI Infrastructure Engineer Austin, Texas, United States; Reston, Virginia, United States Seekr is building the infrastructure that powers...  ...platforms. ~ Knowledge of distributed computing, networking, storage systems, cloud-native architectures, and infrastructure... 
    Senior
    Permanent employment
    Work experience placement
    Flexible hours

    seekr

    Austin, TX
    1 day ago
  • $166k - $220k

     ...powered by Lattice OS, an AI-powered operating system that...  ...vision, sensor fusion, and networking technology to the military...  ...ABOUT THE TEAM CorpTech Infrastructure Engineering builds and operates the...  ...JOB We’re looking for a Senior AI Infrastructure Engineer... 
    Senior
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Costa Mesa, CA
    5 days ago
  • A leading AI research firm in San Francisco seeks a Staff Infrastructure Engineer to identify and resolve infrastructure bottlenecks and design large-scale systems for AI training. The ideal candidate has over 3 years of experience in infrastructure engineering and strong... 
    Senior

    Jobleads-US

    San Francisco, CA
    2 days ago
  •  ...a direct and meaningful impact. As a Senior Lead Infrastructure Engineer at JPMorganChase within the Corporate...  ...mitigation actionsUses enterprise-authorized AI capabilities within the work...  ...Plans, designs, deploys, and configures network solutions/fabrics for the Wide Area... 
    Senior
    Remote work
    Shift work

    JP Morgan Chase

    Plano, TX
    6 hours ago
  •  ...Building and operating robust network infrastructure, the full-time Senior Network Infrastructure Engineer will design and manage public and private networks for a remote...  ...networking, BGP routing, and automation using AI. Key Responsibilities: Design, build, validate... 
    Senior
    Full time
    Remote work

    Virtual Vocations Inc

    United States
    4 days ago
  • Ll Oefentherapie is inviting adaptable engineers to join their innovative team in Austin, Texas. The role focuses on developing GPU infrastructures for AI/ML workloads, requiring extensive experience in systems engineering and a profound understanding of computer systems... 
    Senior

    Ll Oefentherapie

    Austin, TX
    2 days ago
  • RELX seeks an experienced engineer to design, build, and scale AI-driven infrastructure and governance for GenAI products within the AI Infrastructure and Governance team. You will help ensure reliable model capacity, governance, and collaboration across engineering and... 
    Senior

    RELX

    Raleigh, NC
    3 days ago
  • AssemblyAI is hiring a Software Engineer to turn cutting-edge AI research into production-ready products. You will join a fast-paced engineering...  ...building customer-facing APIs, scaling inference infrastructure, and partnering with researchers. You’ll work across the... 
    Senior

    AssemblyAI

    New York, NY
    4 days ago
  • Cloudflare is seeking a Senior Systems Engineer to build AI Gateway at the edge, enabling high-volume model...  ...with reliable, observable infrastructure. You will prototype across the stack...  ...and automation across Cloudflare’s global network. #J-18808-Ljbffr Worky Ltd
    Senior

    Worky Ltd

    Austin, TX
    5 days ago
  • OpenAI is seeking an experienced software engineer to join the GPT Infrastructure team and help build an automated inference optimization platform that scales research prototypes into production‑ready solutions. You will design durable APIs and control‑plane services, integrate... 
    Senior

    OpenAI

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Network Engineer - AI Infrastructure. Be the first to apply!