Senior Software Engineer, AI Compute [Remote]

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Software Engineer, AI Compute in United States.

This role sits at the core of a high-impact AI infrastructure organization responsible for building and operating large-scale GPU and Kubernetes-based platforms that power advanced machine learning workloads. You will play a key role in shaping the systems that enable efficient, secure, and scalable AI compute across the organization. Working at the intersection of infrastructure, platform engineering, and machine learning, you will help design and evolve the foundation that supports next-generation AI experiences. The position involves deep technical ownership of distributed systems and close collaboration with ML and infrastructure teams. You will influence architectural decisions, improve developer experience, and drive reliability and cost efficiency across GPU fleets. This is a highly visible role where your work directly impacts global-scale AI capabilities and platform performance.

Accountabilities:

• Provide technical leadership across high-impact infrastructure and AI compute initiatives
• Design, build, test, deploy, and maintain a Kubernetes-based GPU platform at scale
• Improve reliability, scalability, security, and cost efficiency of GPU and cloud infrastructure systems
• Drive execution of multi-year strategy for AI compute platform evolution and modernization
• Collaborate across ML, infrastructure, and platform teams to align goals and technical direction
• Lead and influence distributed engineering teams through coaching and technical guidance
• Manage project priorities, timelines, and deliverables across complex, multi-team initiatives
• Enhance developer experience for ML engineers through platform improvements and tooling

Requirements:

• BS, MS, or PhD in Computer Science or related field, or equivalent practical experience
• 5+ years of experience in infrastructure, platform engineering, or distributed systems roles
• 2+ years of hands-on experience with public cloud platforms (AWS, GCP, or Azure)
• Strong Kubernetes experience is required in production-scale environments
• Proven ability to lead technical direction and deliver large-scale, cross-team projects
• Strong understanding of system reliability, scalability, and performance optimization
• Experience working with or around ML infrastructure is preferred (LLMs, tuning, optimization)
• Excellent communication and leadership skills with ability to influence technical stakeholders
• Strong focus on developer experience, operational excellence, and system efficiency

Benefits:

• Competitive base salary ranging from $191,000 to $225,000 USD
• Eligibility for bonus, equity, and employee travel credits
• Remote-eligible role within the United States (with location eligibility requirements)
• Comprehensive health, wellness, and employee support benefits
• Strong focus on flexibility and work-life balance
• Opportunity to work on large-scale AI and GPU infrastructure systems
• High-impact role with significant technical ownership and visibility
• Inclusive and diverse workplace culture supporting belonging and innovation

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.