Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Principal Back-End Network Engineer, AI Infrastructure

Nscale

Nscale is the GPU cloud engineered for AI. We provide cost‑effective, high‑performance infrastructure for AI start‑ups and large enterprise customers. Nscale enables AI‑focused companies to achieve superior results by reducing the complexity of AI development. Our GPU cloud bolsters technical capabilities and directly supports strategic business outcomes, including cost management, rapid innovation, and environmental responsibility. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As an Nscaler, you’ll build trust through openness and transparency, where everyone is inspired to do their best work. If you join our team, you’ll be contributing to building the technology that powers the future. About The Role The Network Operations and Engineering teams at Nscale operate some of the most demanding networking environments in the industry, supporting tightly coupled GPU clusters where network performance directly impacts customer outcomes. We’re looking for a Principal Network Engineer – AI Infrastructure to provide technical leadership across Nscale’s high‑speed networking domain. This role is focused on owning the reliability, scalability, and long‑term evolution of our Infiniband and RDMA‑based network fabrics. You will operate as a technical authority, influencing architecture, standards, and operational practices across teams while tackling the most complex network challenges in the platform. What You’ll Be Doing Owning the technical direction and operational strategy for Nscale’s AI interconnect networks Designing, reviewing, and evolving large‑scale Infiniband and RoCE fabric architectures to support future growth and workload demands Acting as the senior escalation point for the most complex network incidents, guiding deep technical investigations and systemic fixes Driving cross‑team initiatives to improve fabric reliability, performance predictability, and operational maturity Defining standards for hardware configuration, congestion control, routing, firmware lifecycle management, and change safety Partnering with SRE, Compute Platform, and Network Architecture teams to influence end‑to‑end system design Mentoring senior and mid‑level network engineers, raising the bar for operational rigor and technical excellence Driving measurable improvements in uptime, latency consistency, capacity efficiency, and incident reduction About You (Skills / Qualifications) 12+ years of experience in network engineering, with deep focus on HPC, AI, or hyperscale data centre networking Expert‑level operational and architectural experience with Infiniband and/or large‑scale RoCE fabrics Deep understanding of RDMA internals, congestion management, and fabric‑level failure modes Strong expertise in modern data centre routing and control planes (BGP, OSPF, ECMP) Proven ability to debug and resolve cross‑layer issues spanning hardware, firmware, kernel, and application communication libraries Demonstrated ability to lead complex technical initiatives across teams without direct authority A systems‑level mindset, balancing performance, reliability, scalability, and operational cost Nice to Have Extensive experience with NVIDIA/Mellanox networking platforms in production AI or HPC environments Deep familiarity with distributed training frameworks and GPU communication patterns Experience designing network observability systems for high‑cardinality, high‑throughput environments Prior experience influencing platform or infrastructure strategy at scale What We Can Offer You Highly competitive package (base + equity) with reviews every 12 months. Join the fastest‑growing tech startup, your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting‑edge AI. Expect a dynamic progression plan tailored to your ambitions. Grow by trying new things, leading, challenging the status quo, and owning your impact, always with our full support. Equal Opportunities Statement We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio‑economic backgrounds. If there’s anything we can do to accommodate your specific situation, please let us know. The responsibilities outlined in this job description are not exhaustive and are intended to provide a general overview of the position. The employee may be required to perform additional duties, tasks, and responsibilities as assigned by management, consistent with the skills and qualifications required for the role. #J-18808-Ljbffr Nscale

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Principal Back-End Network Engineer, AI Infrastructure in Houston, TX vacancy
  • Nscale is seeking a Principal Network Engineer - AI Infrastructure in Houston, Texas, to lead technical direction in high-speed networking environments. This role involves owning the reliability and scalability of Infiniband and RDMA-based networks, tackling complex challenges... 
    Principal
    Senior

    Nscale

    Houston, TX
    3 days ago
  •  ...a leader in 503A/503B operations. The Principal Cloud Infrastructure Architect will define the enterprise cloud...  ...cloud-native environments, and embed AI capabilities into the infrastructure while leading a high‑performing engineering team. #J-18808-Ljbffr Empower... 
    Principal

    Empower Pharmacy

    Houston, TX
    3 days ago
  •  ...healthcare together. Position Summary The Principal Cloud Infrastructure Architect is a senior leadership role responsible for...  ...-as-Code standards, embed AI and machine learning capabilities...  ...fabric, and lead a high‑performing engineering team. As we scale Azure as our... 
    Principal
    Work at office
    Shift work

    Empower Pharmacy

    Houston, TX
    3 days ago
  •  ...Overview Position Summary The Senior Platform & Infrastructure Engineer is the principal technical contributor...  ..., and operationalizing AI and agentic automation...  ..., ensuring the compute, networking, identity, and cloud platforms...  .../agent outputs to front-end applications, enabling... 
    Senior
    Shift work

    Nexus Health Systems

    Houston, TX
    3 days ago
  • Senior IT Infrastructure Engineer Belmont Village Senior Living seeks a Senior IT Infrastructure Engineer to serve as the technical lead for our Microsoft...  ..., administering and governing Microsoft Copilot, AI agents, intelligent automation solutions, and related AI‑enabled... 
    Senior
    Full time
    Temporary work

    Belmont Village Senior Living

    Houston, TX
    1 day ago
  • ON.energy is building the power infrastructure that makes the AI era possible. As AI demand surges past what the grid and traditional data...  ...building the future. We’re looking for a Principal Compliance Engineer with deep expertise in regulatory requirements, codes... 
    Principal
    Local area

    ON.energy

    Houston, TX
    1 day ago
  • $250k - $350k

     ...transactions. As a senior‑level individual...  ...for a self-directed engineer who excels at...  ...Look Like Execute end-to-end technical integrations...  ...to deep-dive into infrastructure and resolve...  ...capital and is backed by some of the largest...  ..., we leverage AI-driven tools to assist... 
    Senior
    Immediate start
    Remote work
    Work from home

    Hopper

    Houston, TX
    3 days ago
  • $250k - $300k

     ...world gets built. At Accenture Infrastructure & Capital Projects, you’ll do...  ...act bold - project managers, engineers, technologists, and...  ...with digital innovation and AI. Together, we’re transforming...  ...act as a trusted advisor to senior client stakeholders (VP, SVP,... 
    Senior
    Live in
    Work at office
    Local area
    Remote work
    Flexible hours

    Accenture

    Houston, TX
    1 day ago
  • Senior Power Electronics Engineer - Energy Infrastructure Projects Houston, Texas, United States ON.energy is building the power infrastructure that makes the AI era possible. As AI demand surges past what the grid and traditional data centers can support, ON.energy provides... 
    Senior
    Local area

    On.Energy

    Houston, TX
    3 days ago
  •  ...world gets built. At Accenture Infrastructure & Capital Projects, you’ll...  ...act bold - project managers, engineers, technologists, and...  ...with digital innovation and AI. Together, we’re transforming...  ...act as a trusted advisor to senior client stakeholders (VP, SVP,... 
    Senior
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Accenture Infrastructure and Capital Projects, LLC

    Houston, TX
    3 days ago
  • $150k - $215k

    Nscale is seeking a Principal Network Engineer - AI Infrastructure to lead the technical direction of high-speed networking environments. You will oversee the reliability and scalability of Infiniband and RDMA fabrics, driving technical initiatives and mentoring engineers... 
    Senior

    Nscale

    Houston, TX
    20 hours ago
  •  ...Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large...  ...About The Role (Job Purpose) The Network Engineering Team is...  ...ongoing operation of all front-end networking services that underpin... 

    Nscale

    Houston, TX
    3 days ago
  •  ...how the world gets built. At Accenture Infrastructure & Capital Projects, you’ll do exactly that...  ...big and act bold - project managers, engineers, technologists, and strategists who blend...  ...experience with digital innovation and AI. Together, we’re transforming how capital... 
    Senior
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work

    Accenture Infrastructure and Capital Projects, LLC

    Houston, TX
    3 days ago
  • $146.5k - $228k

     ...intersection of machine learning, data engineering, and distributed systems,...  ...Overview We’re seeking a Senior Software Engineer with deep...  ...work on cutting‑edge generative AI and metadata enrichment...  ...Partner with Data Science, Infrastructure, ML Engineering, and Product... 
    Senior
    Local area
    Worldwide
    Home office
    Flexible hours

    Scribd

    Houston, TX
    3 days ago
  • $302k - $335k

     ...enterprise-grade AI platforms that power...  ...? As AI Infrastructure Director , you’ll...  ...closely with Cloud Engineering, AI Engineering, and...  ...on landing zones, networking, subscription governance...  ...least 5 years in senior leadership roles managing...  ...the low and high end of the salary... 
    Contract work
    Work at office
    Worldwide
    Flexible hours

    Kirkland & Ellis

    Houston, TX
    1 day ago
  • $150k - $215k

    Principal Observability Platform Engineer - Nscale About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale...  ...owning complex systems end to end. Experience with... 
    Principal
    Flexible hours

    Nscale

    Houston, TX
    3 days ago
  • Sungrow USA is hiring an Infrastructure Engineer to architect, deploy, and manage core IT infrastructure across data centers and cloud environments. You will drive modernization, capacity planning, and hybrid cloud initiatives while ensuring uptime, security, and automation... 
    Senior

    Sungrow

    Houston, TX
    3 days ago
  • ON.energy is building the power infrastructure that makes the AI era possible. As AI demand surges past what the grid and traditional data...  ...companies building the future. We are seeking a Senior Mechanical Engineering Manager with strong experience in structural... 
    Senior
    Local area

    ON.energy

    Houston, TX
    3 days ago
  • $107.2k - $183k

     ...Center Mission Critical Group is seeking a Civil Structural Engineer to join the team. Join us for a fulfilling engineering role where...  ...in design of structures in commercial and critical infrastructure environments Demonstrated proficiency in preparation of structural... 
    Principal
    Senior
    Work at office
    Remote work

    Enercon Services, Inc.

    Houston, TX
    3 days ago
  • Nexus Health Systems is seeking a Senior Platform & Infrastructure Engineer in Houston, Texas. This role is pivotal in designing AI solutions and managing hybrid infrastructure. The ideal candidate has over 10 years of experience in infrastructure engineering, familiarity... 
    Senior

    Nexus Health Systems

    Houston, TX
    3 days ago
  • $100.8k - $170k

    SiriusXM Radio, Inc. is looking for a Senior Software Engineer in Houston, Texas. The successful...  ...candidate will enhance platform tooling and infrastructure, supporting internal teams in...  ...cloud infrastructure, and integrating AI technologies to improve developer productivity... 
    Senior

    SiriusXM Radio, Inc.

    Houston, TX
    3 days ago
  • Nscale is seeking a Senior Workflow Engineer to design, build, and own the data infrastructure, applications, and workflows that power our AI‑driven operating model. This senior, hands‑on role influences Infrastructure, Product, Finance, and more, delivering trusted data... 
    Senior

    Nscale

    Houston, TX
    3 days ago
  • $94.28k - $191.95k

     ...relevant experience and skills, seniority and performance, market and...  ...their business needs. It delivers end‑to‑end services and solutions leveraging...  ...from strategy and design to engineering, all fueled by its market‑leading capabilities in AI, generative AI, cloud and data,... 
    Senior
    Full time
    Local area

    Capgemini

    Houston, TX
    3 days ago
  •  ...What We Do at Anno.ai Anno.ai is a...  ...defense, technology, engineering, and operations....  ...Overview As a Senior Full-Stack Engineer...  ...collaborate closely with infrastructure, data, product,...  ...to support end-to-end workflows...  ...distributed systems and network-level interactions... 
    Senior
    Remote work

    GrabJobs

    Houston, TX
    20 hours ago
  • $45 - $57.97 per hour

     ...Operations IT Solution Specialist/Senior Full Stack Developer for a 12...  .... Collaborate with DevOps & infrastructure teams on application...  ...Science, Information Technology, Engineering, or a related field. 5+ years...  .... Experience using AI tools for co‑development is a... 
    Senior
    Contract work
    Remote work

    Kelly

    Houston, TX
    2 days ago
  •  ...global energy industry. Engineering & Technology About...  ...integration Cloud and platform infrastructure, data services, and developer tooling AI‑assisted analytics,...  ...Duties Own features end to end: analyze requirements...  ..., including Principal Technical Professional... 
    Senior
    Full time
    Part time
    Work from home
    Worldwide
    Shift work

    MyPetroCareer.com

    Houston, TX
    3 days ago
  •  ...Datacenters That Make Sense is seeking a Lead Infrastructure & Networking expert in Houston, TX. This hybrid...  ...supporting next-generation AI, hyperscale, and cloud environments....  ...Cisco, Arista, Juniper), and a hands-on engineering approach. An attractive compensation... 

    Submer - Datacenters That Make Sense

    Houston, TX
    3 days ago
  • Principal or Senior Principal, Anthropic AI Solutions (Central Region) AI Systems & Platforms, Anthropic Business Unit Please note: This role is not eligible...  ...most of emerging technologies. By combining design, engineering, and analytics expertise, we build what’s next. Our... 
    Principal
    Senior
    Temporary work
    Work at office
    Local area

    Slalom

    Houston, TX
    3 days ago
  •  ...a Lead Analyst - Real Estate Technology Infrastructure (Operations). This high-impact, field‑forward...  ...operational technology (OT), enterprise networking, and smart building environments across...  ...Strong problem‑solving skills with an AI‑forward, efficiency‑driven mindset.... 
    Contract work
    Remote work

    Brilliant®

    Houston, TX
    3 days ago
  • Hines is seeking an Infrastructure Program Manager in Houston, Texas. In this hybrid role, you will lead the execution of infrastructure...  ...and internal teams. You will oversee implementations across networking, servers, and other infrastructure while ensuring alignment with... 

    Hines

    Houston, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Principal Back-End Network Engineer, AI Infrastructure. Be the first to apply!