Senior Manager, AI Infrastructure Operations [Remote]

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Manager, AI Infrastructure Operations based in United States.

This role offers the opportunity to lead the engineering operations behind large-scale AI infrastructure in a fast-growing cloud environment. You will oversee the teams responsible for deploying, operating, and optimizing advanced AI compute clusters that power demanding machine learning workloads. The position combines technical leadership, operational excellence, and hands-on infrastructure expertise to ensure reliable and high-performance systems at scale. You will collaborate with engineering teams across AI/ML, networking, storage, hardware, and product to deliver next-generation cloud capabilities. This is a high-impact leadership role for someone passionate about solving complex infrastructure challenges and building scalable AI platforms.

Accountabilities:

As a Senior Manager, AI Infrastructure Operations, you will lead the execution and continuous improvement of AI infrastructure initiatives, ensuring reliable operations, efficient delivery, and strong engineering practices across large-scale compute environments.

• Lead the engineering team responsible for deploying, scaling, and operating AI compute clusters, ensuring consistent execution and operational excellence.
• Translate technical strategies into actionable project plans, milestones, and delivery priorities in collaboration with infrastructure leadership.
• Oversee GPU fleet operations, bare metal environments, hardware provisioning, configuration management, firmware updates, and validation processes.
• Drive improvements in cluster reliability, availability, monitoring, automation, and performance optimization.
• Manage incident response processes, root-cause analysis, and operational improvements for AI infrastructure environments.
• Partner with AI/ML, SRE, networking, hardware, and product teams to align infrastructure capabilities with business and technical requirements.
• Support the evolution of orchestration, scheduling, workload management, and multi-tenant infrastructure systems.
• Improve tooling and automation for provisioning, observability, configuration management, and large-scale fleet operations.
• Identify infrastructure bottlenecks and implement engineering solutions to improve efficiency and performance.
• Mentor engineers, support professional development, and foster a culture of ownership, collaboration, and technical excellence.
• Establish and improve engineering processes, including documentation, testing standards, code reviews, and operational runbooks.

Requirements:

The ideal candidate brings extensive experience in infrastructure engineering, AI compute environments, and technical team leadership, with the ability to balance strategic execution with deep technical involvement.

• 6–10 years of experience in infrastructure engineering, high-performance computing, large-scale systems, or related technical fields.
• Strong knowledge of AI infrastructure, including GPU/CPU clusters, distributed training systems, and high-performance networking technologies such as InfiniBand or RDMA.
• Proven experience operating production-scale bare metal, GPU, or hardware fleet environments.
• Hands-on expertise with Linux systems, Kubernetes or Slurm, infrastructure provisioning tools such as Terraform or Ansible, observability platforms, and networking fundamentals.
• Experience with cluster operations, hardware bring-up, distributed systems, or supporting machine learning workloads.
• Previous experience leading engineering teams or technical pods while remaining close to complex technical challenges.
• Ability to translate strategic goals into clear engineering priorities and execution plans.
• Strong communication skills with the ability to collaborate effectively across technical and cross-functional teams.
• Demonstrated ability to prioritize, adapt, and deliver results in a fast-paced, high-growth environment.

Benefits:

• Competitive compensation range of $150,000 – $160,000 , with final compensation based on experience, skills, location, and applicable regulations.
• Comprehensive medical benefits with company-paid employee medical premiums.
• Company-paid dental and vision coverage.
• 401(k) plan with 100% company match up to 4% and immediate vesting.
• Professional development reimbursement of up to $2,500 annually.
• Paid time off program with holidays, rollover options, increased PTO milestones, and birthday time off.
• Long-term employee benefits including paid sabbaticals and anniversary bonuses.
• Remote work support with equipment setup reimbursement and annual equipment allowances.
• Monthly internet reimbursement.
• Gym membership reimbursement.
• Company-paid wellness program.
• Opportunity to work on cutting-edge AI infrastructure technologies in a collaborative engineering environment.
• Career growth opportunities within a rapidly scaling global technology organization.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.