Principal AI Infrastructure Engineer - Highrise AI
Hut 8
Highrise AI is a GPU-native infrastructure platform built for modern AI workloads. Designed for developers and enterprises operating in performance-critical and security-sensitive environments, Highrise delivers scalable GPU compute across dedicated clusters, managed cloud, and confidential environments.
Highrise combines bare-metal performance with full-stack orchestration, API-driven access, and hardware-enforced isolation to support training, fine-tuning, and production-scale deployment of AI models. From reserved GPU capacity to enterprise-grade confidential compute, Highrise provides flexible infrastructure models tailored to the needs of builders operating at scale.
Beyond infrastructure, Highrise integrates disciplined operations, advanced automation, and on-site engineering expertise to sustain high uptime and predictable performance across deployments. These capabilities extend beyond Highrise-owned fleets: through managed services, Highrise also operates third-party GPU hardware on behalf of customers and partners, applying the same operational standards to infrastructure it does not own.
Highrise is a subsidiary of Hut 8 Corp., an energy infrastructure platform. Hut 8 integrates power, digital infrastructure, and compute at scale. Highrise serves as the compute and operations layer—designing, deploying, and operating next-generation GPU clusters from commissioning through production.
ROLE OVERVIEWWe are seeking a senior, hands-on AI Cluster Integration Engineer to bring large-scale GPU compute clusters from physical installation to validated, commercially ready production. Working alongside a team of senior infrastructure engineers, this person will own critical elements of cluster bring-up, bare-metal provisioning, advanced systems configuration, performance optimization, and acceptance testing.
After deployment, the engineer will provide Tier 3 technical escalation and sustained performance support for operating clusters. The focus is on compute-platform readiness and workload performance rather than primary ownership of network switch and fabric configuration.
KEY RESPONSIBILITIES Cluster Bring-Up and Systems Integration- Lead technical bring-up of materially complete, racked, powered, and cabled AI clusters through production readiness and customer handoff.
- Establish and validate system baselines across BIOS/BMC, firmware, GPU drivers, operating systems, and cluster software stacks.
- Deploy and optimize automated bare-metal provisioning, imaging, node configuration, and lifecycle workflows at scale.
- Configure and troubleshoot advanced Linux and GPU systems, including kernel, driver, accelerator, and host-level performance settings.
- Integrate and validate Kubernetes and Slurm environments in partnership with platform, networking, and operations engineers.
- Execute NVIDIA Field Diagnostics, L11/L12 validation, burn-in, stability, and hardware health qualification procedures.
- Run and analyze NCCL collective communication tests, GPU benchmarks, and distributed workload performance at node, rack, and cluster scale.
- Troubleshoot GPU, NVLink/NVSwitch, PCIe, RDMA, and InfiniBand/Ethernet performance issues, partnering with network engineers on fabric-related remediation.
- Identify configuration bottlenecks and optimize throughput, latency, scaling efficiency, and cluster reliability.
- Own technical acceptance criteria, test evidence, defect tracking, remediation verification, and readiness recommendations for commercial service.
- Serve as a senior escalation point for complex production incidents involving compute nodes, GPU software, provisioning, scheduling, and degraded performance.
- Perform deep root cause analysis, coordinate vendor engineering escalations, and lead corrective actions for recurring or systemic issues.
- Support fleet-level upgrades, configuration changes, cluster expansions, and post-maintenance validation with appropriate change controls.
- Develop diagnostic tooling, automation, runbooks, and operational handoff material for SRE, NOC, and site support teams.
- Work closely with infrastructure engineering, site operations, OEMs, and software/platform teams to resolve cross-stack issues and meet delivery milestones.
- Provide concise technical status, benchmark findings, risks, and acceptance recommendations to engineering leadership and stakeholders.
- Bachelor's degree in computer science, engineering, or a related field, or equivalent practical experience.
- 8+ years of hands-on Linux systems engineering, HPC, cloud, or large-scale infrastructure experience, including senior-level troubleshooting.
- Proven experience bringing GPU or HPC clusters into production and qualifying systems against performance and reliability targets.
- Strong expertise in Linux, automation (Python/Bash/Ansible), bare-metal provisioning, configuration management, and systems diagnostics.
- Hands-on experience with NVIDIA GPU platforms, NCCL, Field Diagnostics, and multi-node performance testing.
- Practical experience with Kubernetes and Slurm; familiarity with high-speed Ethernet, InfiniBand/RDMA, and parallel or distributed storage.
- Deep technical curiosity and the ability to isolate difficult problems across hardware, firmware, operating systems, and distributed workloads.
- Strong ownership of outcomes, with a systematic approach to testing, documentation, root cause analysis, and continuous improvement.
- Comfortable collaborating with highly experienced peer engineers while driving independent technical decisions and execution.
- Clear communication with engineering leadership, vendors, site personnel, and customer-facing stakeholders.
This is a full-time, engineering role supporting large-scale AI compute infrastructure across multiple sites. Travel to data centers for cluster commissioning, acceptance, and complex troubleshooting will be required. Flexibility to assist with critical incidents or maintenance activities outside regular business hours is expected. This role is hybrid or remote depending on location. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
WHAT MAKES HIGHRISE A GREAT PLACE TO WORKAt Highrise, you will directly influence the performance, reliability, and production readiness of large-scale AI clusters, work alongside experienced infrastructure engineers, and help define the technical standards for a growing global AI infrastructure platform.
At Highrise, you will have the opportunity to:
- Work with bright, driven peers from a range of educational and professional backgrounds including software development, energy, engineering, entrepreneurship, investment banking, private equity, and management consulting
- Design and pitch new products, services, and other initiatives to a leadership team consisting of serial entrepreneurs and seasoned executives and backed by a board of directors consisting of industry veterans of energy, finance, and government
- Debate ideas and alternatives in a truly meritocratic setting where the learning curve is steep and the lessons come from both senior and junior members of the team
- Build a lifelong network of friends and professional connections at the cutting-edge intersection of technology, energy, and infrastructure
- ...About Highrise AI Highrise AI is a GPU-native infrastructure platform built for modern AI workloads. Designed for developers... ...automation, and on-site engineering expertise to sustain high uptime... ...ROLE OVERVIEW We are seeking a principal-level, hands-on AI Network Engineer...PrincipalFull timeRemote workFlexible hoursNight shift
- ...About Highrise AI Highrise AI is a GPU-native infrastructure platform built for modern AI workloads. Designed for developers and enterprises operating in... ...disciplined operations, advanced automation, and on-site engineering expertise to sustain high uptime and predictable...SuggestedFull timeRemote workFlexible hoursShift workNight shift
- ...About Highrise AI Highrise AI is a GPU-native infrastructure platform built for modern AI workloads. Designed for developers... ...automation, and on-site engineering expertise to sustain high uptime... ...ROLE OVERVIEW We are seeking a principal-level, hands-on AI Systems Engineer...PrincipalFull timeRemote workFlexible hoursNight shift
$135k - $178k
...of dollars each year to community organizations.As our Principal AI & Cloud Security Engineer, you'll play a critical role in shaping how we... ...direction for AI and cloud security, helping development, infrastructure, and security teams build innovative solutions that are...PrincipalFull timeRemote work$204k - $337k
...realize their greatest potential.Title and SummaryPrincipal AI Platform Engineer - AI Center of ExcellenceWho is Mastercard?Mastercard... ...all.Overview:The AI Center of Excellence is seeking a Principal AI Infrastructure Engineer to build and scale next-generation...PrincipalFull timePart timeWorldwideFlexible hours$164.6k - $282.2k
...everyone. From advanced data analytics and AI to cybersecurity, we use innovative... .... Connecting. Growing together.As a Principal AI/ML Platform Engineer on the UnitedHealth Group (UHG)... ...a degree10+ years of experience in infrastructure, DevOps, SRE, or ML platform engineering...PrincipalMinimum wageFull timeWork experience placementWork at officeLocal areaRemote work$139.7k - $232.9k
...Principal AI Platform Engineer page is loaded## Principal AI Platform Engineerremote type: Remote Eligible, USAlocations: Remote, USAtime type: Full timeposted on: Posted Yesterdayjob requisition id: R90667# Role SummaryThe Principal AI Platform Engineer serves as a senior...PrincipalWork experience placementRemote work- ...platform for the company. The platform will allow engineering and business teams to use generative AI with proprietary source code, product documentation... ...platform deployed in Parallel Wireless-controlled infrastructure. - Partner with engineering, product, support, IT,...PrincipalFull timeLocal areaFlexible hours
- ...Everything We Do. About the Role Matter Health is seeking a Principal AI Platform Engineer to build and lead the technical foundation for our... ...orchestration and runtime technologies, RAG and vector infrastructure, MCP or comparable integration and context-sharing frameworks...PrincipalFull timeContract workRemote work
$133k - $180k
...individual contributor in the software engineering career framework, providing enterprise technical... ...on leading and expanding responsible AI use across the organization. Sets... ...than one career level (associate, senior, principal, etc.). The actual title and base pay offered...PrincipalFull timeTemporary workWork experience placementSummer workCasual workInternshipSeasonal workWork at officeWork from homeWork visaFlexible hours$103.2k - $128.9k
...Purpose Lead the design, development, and deployment of advanced AI and machine learning solutions supporting Honda’s automotive R&D... ..., and digital twins—owning solutions end-to-end and mentoring engineers while partnering with CAE, CAD, manufacturing, and data platform...PrincipalFull timeTemporary workWork experience placementWork at officeWork from homeRelocation package$184k - $287.5k
AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical...Full timeRemote work- ...repeatable workflows, and measurable business outcomes across Sales, Engineering, Operations, Marketing, and Finance. We do not need someone who... ...; we need a hands-on contributor who can identify where AI creates real value, build or guide early solutions, choose the...PrincipalRemote workDay shift
$215k - $350k
We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering...WorldwideHome office- ...kJob Description A growing fintech company focused on modern financial services and trading technology is looking for an AI Infrastructure Engineer to build and operate the platform supporting its next generation of AI-powered financial workflows. The company combines...Full timeWork from home
$150k - $170k
...affiliated experts from academia, industry, and government, offer our clients exceptional breadth and depth of expertise.The AI HPC Infrastructure Engineer owns the operation, performance, and growth of a hybrid high-performance computing (HPC) and AI/GPU infrastructure...Work experience placementLocal areaRemote workWorldwide$229k - $412k
...security with the world’s most advanced AI-native platform. We work on large scale... ...governing its evolution, including traffic engineering strategy, capacity planning, and demand... ...direction for network automation and infrastructure-as-code (Terraform, Ansible, CI/CD, GitOps...PrincipalPermanent employmentWork experience placementWork at officeLocal areaRemote work$112.7k - $193.2k
...work better for everyone. From advanced data analytics and AI to cybersecurity, we use innovative approaches to solve... ...Connecting. Growing together.As an Experienced z System ISV Infrastructure Software Engineer within Optum Technology's Z Systems Application Hosting team...PrincipalMinimum wageFull timeWork experience placementWork at officeLocal areaRemote workWeekend work- ...Company Intro At Toloka AI we create data that powers leading GenAI models and... ...from doctors and lawyers to physicists and engineers - and boast one of the most diverse global... ...and more. About position The Principal AI Solutions Engineer is Toloka's most senior...PrincipalFull timeFor contractorsRemote workWorldwideFlexible hours
$263.6k - $395.4k
...creative, productive, and happy. The Role We build AI products, and the quality of our evaluations sets the ceiling... ...quickly we can improve them. We are looking for an engineer to build the infrastructure and tooling that make high-quality AI evaluation possible...Work at officeLocal areaRemote workFlexible hours$147.2k - $210.3k
...technical development academies to help build your skills and capabilities.SummaryGainwell Technologies is seeking a highly skilled AI Engineer to design, develop, and deploy advanced AI solutions, including Generative AI (GenAI), across our healthcare technology platforms...PrincipalFull timeRemote workFlexible hours$180k - $200k
...exceptional place to work! Role Overview We are looking for a Principal AI Engineer to guide a distributed team of developers in building... ...with vector/graph databases, embeddings, or other LLM infrastructure. Preferred Qualifications A portfolio or examples...PrincipalFull timeWork at officeRemote work$254k - $407k
...realize their greatest potential.Title and SummarySenior Principal AI Engineer- AI Center of ExcellenceOur Purpose:Mastercard powers economies... ...Excellence is seeking a Senior Principal AI Engineer - AI Infrastructure to serve as a technical expert and thought leader for...PrincipalFull timePart timeWorldwideFlexible hours$228k - $342k
.... As a Fortune 500 company and a leading AI platform for managing people, money, and... ...together product leaders, machine learning engineers, and full-stack builders to create... ...Engineering, but brighter.About the RoleAs a Principal/Senior AI Engineer in Agent Factory, you...PrincipalFull timeWork at officeRemote workHome officeFlexible hours$149.3k - $298.7k
...colleagues serve people in more than 160 countries.The Opportunity A hands-on software engineering leadership role accountable for building production-grade agentic systems on Abbott's enterprise AI Platform. This role turns business and product requirements into reliable...PrincipalShift work$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research. This team focuses on developing tools... .... We are seeking an AI infrastructure software engineer to join our team. You'll be instrumental in...Full timeRemote work- Job DescriptionPosition Summary: The AI CoE Principal Software Engineer will report to the Sr. Director, AI Center of Excellence, in the Technology Department. This role is the most senior individual contributor on the team and the technical owner of the enterprise AI...PrincipalRemote work
$133.6k - $222.6k
...SummaryLPL Financial is seeking a highly technical and hands-on AI engineering leader to help design, build, and deploy next-generation AI... ...log in or create an account to apply to this position. Principals only. EOE.Information on Interviews:LPL will only communicate...PrincipalFull timeWork from home$77.6k - $176k
Enterprise Cybersecurity AI Infrastructure EngineerThe Opportunity: Are you technically inclined... ...As a Cybersecurity AI Infrastructure Engineer, you will operate as a hands-on... ...scanning, infrastructure policy, service-principal isolation, and Unity Catalog grants to...Full timeContract workPart timeLocal areaRemote work- Principal Architect - PBM Modernization & AI EngineeringThe Principal Architect - PBM Modernization & AI Engineering is a senior architecture leader responsible for designing and delivering modern technology solutions that accelerate the transformation of the Pharmacy...PrincipalFull timeLocal areaWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal AI Infrastructure Engineer - Highrise AI. Be the first to apply!
- director software engineering Remote
- principal cloud engineer Remote
- director quality engineering Remote
- general engineer Remote
- chief design engineer Remote
- senior civil engineer project manager Remote
- senior director engineering Remote
- data center chief engineer Remote
- principal data engineer Remote
- director of product engineering Remote






