Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal AI Infrastructure Engineer

Full-time

Highrise AI

About Highrise AI

Highrise AI is a GPU-native infrastructure platform built for modern AI workloads. Designed for developers and enterprises operating in performance-critical and security-sensitive environments, Highrise delivers scalable GPU compute across dedicated clusters, managed cloud, and confidential environments.

Highrise combines bare-metal performance with full-stack orchestration, API-driven access, and hardware-enforced isolation to support training, fine-tuning, and production-scale deployment of AI models. From reserved GPU capacity to enterprise-grade confidential compute, Highrise provides flexible infrastructure models tailored to the needs of builders operating at scale.

Beyond infrastructure, Highrise integrates disciplined operations, advanced automation, and on-site engineering expertise to sustain high uptime and predictable performance across deployments. These capabilities extend beyond Highrise-owned fleets: through managed services, Highrise also operates third-party GPU hardware on behalf of customers and partners, applying the same operational standards to infrastructure it does not own.

Highrise is a subsidiary of Hut 8 Corp., an energy infrastructure platform. Hut 8 integrates power, digital infrastructure, and compute at scale. Highrise serves as the compute and operations layer—designing, deploying, and operating next-generation GPU clusters from commissioning through production.

ROLE OVERVIEW

We are seeking a senior, hands-on AI Cluster Integration Engineer to bring large-scale GPU compute clusters from physical installation to validated, commercially ready production. Working alongside a team of senior infrastructure engineers, this person will own critical elements of cluster bring-up, bare-metal provisioning, advanced systems configuration, performance optimization, and acceptance testing.

After deployment, the engineer will provide Tier 3 technical escalation and sustained performance support for operating clusters. The focus is on compute-platform readiness and workload performance rather than primary ownership of network switch and fabric configuration.

KEY RESPONSIBILITIES

Cluster Bring-Up and Systems Integration

  • Lead technical bring-up of materially complete, racked, powered, and cabled AI clusters through production readiness and customer handoff.
  • Establish and validate system baselines across BIOS/BMC, firmware, GPU drivers, operating systems, and cluster software stacks.
  • Deploy and optimize automated bare-metal provisioning, imaging, node configuration, and lifecycle workflows at scale.
  • Configure and troubleshoot advanced Linux and GPU systems, including kernel, driver, accelerator, and host-level performance settings.
  • Integrate and validate Kubernetes and Slurm environments in partnership with platform, networking, and operations engineers.

Performance Engineering and Acceptance

  • Execute NVIDIA Field Diagnostics, L11/L12 validation, burn-in, stability, and hardware health qualification procedures.
  • Run and analyze NCCL collective communication tests, GPU benchmarks, and distributed workload performance at node, rack, and cluster scale.
  • Troubleshoot GPU, NVLink/NVSwitch, PCIe, RDMA, and InfiniBand/Ethernet performance issues, partnering with network engineers on fabric-related remediation.
  • Identify configuration bottlenecks and optimize throughput, latency, scaling efficiency, and cluster reliability.
  • Own technical acceptance criteria, test evidence, defect tracking, remediation verification, and readiness recommendations for commercial service.

Tier 3 Operations and Reliability

  • Serve as a senior escalation point for complex production incidents involving compute nodes, GPU software, provisioning, scheduling, and degraded performance.
  • Perform deep root cause analysis, coordinate vendor engineering escalations, and lead corrective actions for recurring or systemic issues.
  • Support fleet-level upgrades, configuration changes, cluster expansions, and post-maintenance validation with appropriate change controls.
  • Develop diagnostic tooling, automation, runbooks, and operational handoff material for SRE, NOC, and site support teams.

Cross-Functional Execution

  • Work closely with infrastructure engineering, site operations, OEMs, and software/platform teams to resolve cross-stack issues and meet delivery milestones.
  • Provide concise technical status, benchmark findings, risks, and acceptance recommendations to engineering leadership and stakeholders.

ABOUT YOU

Education and Experience

  • Bachelor's degree in computer science, engineering, or a related field, or equivalent practical experience.
  • 8+ years of hands-on Linux systems engineering, HPC, cloud, or large-scale infrastructure experience, including senior-level troubleshooting.
  • Proven experience bringing GPU or HPC clusters into production and qualifying systems against performance and reliability targets.
  • Strong expertise in Linux, automation (Python/Bash/Ansible), bare-metal provisioning, configuration management, and systems diagnostics.
  • Hands-on experience with NVIDIA GPU platforms, NCCL, Field Diagnostics, and multi-node performance testing.
  • Practical experience with Kubernetes and Slurm; familiarity with high-speed Ethernet, InfiniBand/RDMA, and parallel or distributed storage.

Core Competencies

  • Deep technical curiosity and the ability to isolate difficult problems across hardware, firmware, operating systems, and distributed workloads.
  • Strong ownership of outcomes, with a systematic approach to testing, documentation, root cause analysis, and continuous improvement.
  • Comfortable collaborating with highly experienced peer engineers while driving independent technical decisions and execution.
  • Clear communication with engineering leadership, vendors, site personnel, and customer-facing stakeholders.

ABOUT THE WORK ENVIRONMENT

This is a full-time, engineering role supporting large-scale AI compute infrastructure across multiple sites. Travel to data centers for cluster commissioning, acceptance, and complex troubleshooting will be required. Flexibility to assist with critical incidents or maintenance activities outside regular business hours is expected. This role is hybrid or remote depending on location. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

WHAT MAKES HIGHRISE A GREAT PLACE TO WORK

At Highrise, you will directly influence the performance, reliability, and production readiness of large-scale AI clusters, work alongside experienced infrastructure engineers, and help define the technical standards for a growing global AI infrastructure platform.

At Highrise, you will have the opportunity to:

  • Work with bright, driven peers from a range of educational and professional backgrounds including software development, energy, engineering, entrepreneurship, investment banking, private equity, and management consulting
  • Design and pitch new products, services, and other initiatives to a leadership team consisting of serial entrepreneurs and seasoned executives and backed by a board of directors consisting of industry veterans of energy, finance, and government
  • Debate ideas and alternatives in a truly meritocratic setting where the learning curve is steep and the lessons come from both senior and junior members of the team
  • Build a lifelong network of friends and professional connections at the cutting-edge intersection of technology, energy, and infrastructure
Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the Principal AI Infrastructure Engineer in Remote vacancy
  • $179.13k - $234.1k

     ...Learn more at Position Overview We are seeking a high-performing, hands-on Principal Engineer to lead the development of reliable integrations and next-generation AI platform capabilities for Avaya Infinity™. In this role, you will bridge the gap between... 
    Principal
    Full time
    For contractors
    Work at office
    Remote work
    Visa sponsorship

    Avaya

    Remote
    2 days ago
  • $221.2k - $387.1k

     ...Company Description It all started when engineer Fred Luddy wrote code that automated a tedious...  ...work. Today, ServiceNow is the AI control tower for business reinvention. Our...  ...customer service, and field service. As Principal Forward Deployed Engineer, you are the lead... 
    Principal
    Full time
    Work at office
    Immediate start
    Remote work
    Flexible hours

    ServiceNow

    Remote
    17 days ago
  • $250k - $300k

     ...happens. Summary of Position We are seeking a Principal II Data & AI Platform Engineer to serve as one of the most senior hands-on technical...  ...drive technical decisions for AI architecture, agent infrastructure, and integration with our Databricks ecosystem while... 
    Principal
    Full time
    Part time
    Work experience placement
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    Teladoc Health

    Remote
    2 days ago
  • $135k - $178k

     ...of dollars each year to community organizations.As our Principal AI & Cloud Security Engineer, you'll play a critical role in shaping how we...  ...direction for AI and cloud security, helping development, infrastructure, and security teams build innovative solutions that are... 
    Principal
    Full time
    Remote work

    Banner Bank

    Salem, OR
    2 days ago
  • $164.6k - $282.2k

     ...everyone. From advanced data analytics and AI to cybersecurity, we use innovative...  .... Connecting. Growing together.As a Principal AI/ML Platform Engineer on the UnitedHealth Group (UHG)...  ...a degree10+ years of experience in infrastructure, DevOps, SRE, or ML platform engineering... 
    Principal
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    Eden Prairie, MN
    1 day ago
  • $133k - $180k

     ...individual contributor in the software engineering career framework, providing enterprise technical...  ...on leading and expanding responsible AI use across the organization. Sets...  ...than one career level (associate, senior, principal, etc.). The actual title and base pay offered... 
    Principal
    Temporary work
    Work experience placement
    Summer work
    Casual work
    Internship
    Seasonal work
    Work at office
    Work from home
    Work visa
    Flexible hours

    Compeer Financial

    Mankato, MN
    a month ago
  • $103.2k - $128.9k

     ...Purpose Lead the design, development, and deployment of advanced AI and machine learning solutions supporting Honda’s automotive R&D...  ..., and digital twins—owning solutions end-to-end and mentoring engineers while partnering with CAE, CAD, manufacturing, and data platform... 
    Principal
    Full time
    Temporary work
    Work experience placement
    Work at office
    Work from home
    Relocation package

    Honda Dev. and Mfg. of Am.,LLC

    Raymond, OH
    more than 2 months ago
  •  ...About the Role Matter Health is seeking a hands-on, mission-driven AI Automation Workflow Specialist to join our Information...  ...the team's intake process and collaborate with the AI Platform Engineer and requesting-team leadership to define priorities • Use approved... 
    Principal
    Full time
    Remote work

    Matter Health

    Memphis, TN
    1 day ago
  • $229k - $412k

     ...security with the world’s most advanced AI-native platform. We work on large scale...  ...governing its evolution, including traffic engineering strategy, capacity planning, and demand...  ...direction for network automation and infrastructure-as-code (Terraform, Ansible, CI/CD, GitOps... 
    Principal
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    California
    a month ago
  • We are looking for an AI Solution/Principal Engineer to join a team building a sovereign, multi-tenant agentic AI platform along with the applied...  ..., agent workflows, voice and document systems, and the infrastructure that turns "it seems better" into evidence someone can... 
    Principal

    EPAM Systems

    United States
    2 days ago
  • Senior AI Infrastructure Engineer, Physical Infrastructure Costa Mesa, California, United States ABOUT THE TEAM CorpTech Infrastructure Engineering builds and operates the foundational infrastructure that powers Company at large. We give engineers, researchers... 

    Calance

    Costa Mesa, CA
    2 days ago
  • $197.3k - $225.1k

     ...Job Description AI Engineer 4 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation...  .... Our investments in technology infrastructure and world-class talent — along with our...  ...standards are met Mentor Principal and Senior Associates on scalable design... 
    Full time
    Part time
    Local area

    Capital One

    McLean, VA
    9 days ago
  •  ...Job Description This is a hands-on engineering and technical leadership position. You will...  ...move fluidly between  building production infrastructure, architecting multi-tenant isolation,...  ...per-engagement cost attribution including AI spend.   Delivery Pipelines, Security... 
    Principal
    Remote work

    Phizenix

    Abbeville, GA
    22 days ago
  •  ...and next steps. Our partner is looking for a Sr Ethernet AI Network Engineer based in the United States. As a Senior Ethernet AI Network...  ...computing (HPC) environments. You will ensure network infrastructure can support demanding distributed training workloads, high... 
    Full time
    Remote work

    Jobgether

    Remote
    7 days ago
  •  ...repeatable workflows, and measurable business outcomes across Sales, Engineering, Operations, Marketing, and Finance. We do not need someone who...  ...; we need a hands-on contributor who can identify where AI creates real value, build or guide early solutions, choose the... 
    Principal
    Remote work
    Day shift

    C3 Technology Advisors

    Byron Center, MI
    a month ago
  •  ...beyond limits, you’ll feel right at home here. Key Responsibilities Deploy, validate, and support Ethernet fabrics used for AI and HPC cluster environments. Troubleshoot L1 through L4 issues involving optics, transceivers, cabling, link bring-up, VLANs,... 
    Full time

    Vailexa

    Remote
    9 days ago
  • $238.2k - $322.2k

     ...Our Engineering organization is scaling its AI Engineering capabilities under new leadership, creating an opportunity to shape the next generation of AI at Rapid7. We’re looking for Senior Principal AI Engineers to define and influence the technical direction of our LLM... 
    Principal
    Full time
    Work experience placement
    Local area
    Remote work

    Rapid7

    California
    10 days ago
  • $77.73k - $108.27k

     ...Job Summary The AI Infrastructure Consulting Engineer – Converged Compute & Storage is responsible for designing, implementing, validating, and supporting high-performance infrastructure solutions that enable enterprise artificial intelligence and machine learning workloads... 
    Full time
    Local area
    Shift work
    Weekend work

    CDW

    Remote
    15 days ago
  • $138k - $189k

     ...strategies and enable real transformation to produce sustainable business results. Join our team and create your future.The AI Infrastructure Engineer will build, integrate, and operate production platform capabilities that support Huron's governed use of AI. Working in... 
    Full time
    Flexible hours

    Huron

    Remote
    20 days ago
  • $200k - $230k

     ...AI Infrastructure Engineer [Tooling] About Tessera Labs Tessera Labs is redefining how enterprises adopt and operationalize Artificial Intelligence. Backed by Foundation Capital and led by a world-class founding team, we build multi-agent AI systems that automate complex... 
    Full time

    Tessera Labs

    Remote
    14 days ago
  • $175.8k - $293k

     ...Basic Information Job Name Principal Innovator - USA (B) Country...  ...advantage. We’re looking for a Principal AI Engineer to architect, build, and harden the...  ...foundation (model lifecycle, experimentation, infrastructure) through shared services (agent... 
    Principal

    BMC Software

    Santa Clara, CA
    2 days ago
  •  ...To support the development of AI agents, the full-time AI Infrastructure Engineer will design, build, and maintain tooling and services for deploying AI systems in production environments, utilizing Python or Go and Kubernetes, while working remotely in the U.S. Key responsibilities... 
    Full time
    Remote work

    Virtual Vocations Inc

    United States
    2 days ago
  • $184k - $287.5k

    AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical... 
    Full time
    Remote work

    Nvidia

    Austin, TX
    2 days ago
  •  ...Cloud Infrastructure Remote Full-time Principal (8+ yrs) Principal Cloud Architect 5,000 - 10,000 USD About the Role & Mission As a Principal Cloud Architect...  ...topology blueprints Advise enterprise CTOs and VPs of Engineering Lead complex database cutovers with zero downtime... 
    Principal
    Full time
    Remote work

    Coralswift

    San Francisco, CA
    5 days ago
  • $180k - $235k

     ...Intelligence and Data Science team to explore the frontiers of applied AI in wellness, fashion, and retail. You’ll build intelligent...  ..., and decision automation. We’re looking for a hands-on AI Engineer who loves to build. You’ll design and deploy bespoke, high-... 
    Principal
    Full time

    ALO

    Remote
    2 days ago
  • $212k - $407k

     ...their greatest potential. Title and Summary Senior Principal AI Engineer- AI Center of ExcellenceOur Purpose: Mastercard powers...  ...Excellence is seeking a Senior Principal AI Engineer – AI Infrastructure to serve as a technical expert and thought leader for Mastercard... 
    Principal
    Full time
    Part time
    Immediate start
    Worldwide
    Flexible hours

    Mastercard

    Remote
    16 days ago
  •  ...Enterprise Risk Management needs. Abrigo is looking for a Principal Applied AI Engineer to shape how we build and operate AI capabilities across...  ...outcomes that improve developer productivity, infrastructure delivery, and operational effectiveness. This position can... 
    Principal
    Remote work
    Flexible hours

    Abrigo

    Austin, TX
    2 days ago
  •  ...Company Intro At Toloka AI we create data that powers leading GenAI models and...  ...from doctors and lawyers to physicists and engineers - and boast one of the most diverse global...  ...and more. About position The Principal AI Solutions Engineer is Toloka's most senior... 
    Principal
    Full time
    Contract work
    For contractors
    Remote work
    Worldwide
    Flexible hours

    Toloka

    Miami, FL
    2 days ago
  • $152k - $287.5k

     ...NVIDIA is looking for an outstanding, passionate, and dedicated Senior AI Infrastructure Engineer to join our DGX Cloud group. This engineering role will design, build and maintain large-scale production systems with high efficiency and availability using a combination... 
    Full time

    NVIDIA

    Remote
    2 days ago
  • $230k - $280k

     ...growth, product-led tech company is looking for a Principal Data Platform Engineer to lead the buildout of a modern, scalable...  ...massive data challenges and shaping the infrastructure that supports real-time analytics and AI/ML at scale, this role is for you. As the... 
    Principal
    Remote work

    Harnham

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal AI Infrastructure Engineer. Be the first to apply!