Software Engineer Graduate - 2027 Start

Responsibilities

• Design and build large-scale container-based cluster management and orchestration systems focused on performance, scalability, and resilience.
• Architect cloud-native GPU and AI accelerator infrastructure for cost-efficient and secure machine learning platforms.
• Deliver LLM inference solutions using vLLM, SGLang, TensorRT-LLM, and other inference engines.
• Integrate advances in Kubernetes, Ray, AI/ML, LLM infrastructure, and systems research into production systems.
• Write maintainable, testable, scalable, production-ready code.
• Collaborate with global, cross-functional teams and contribute to open-source infrastructure.

Requirements

• Completing or recently completed a PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
• Strong understanding of large model inference, distributed and parallel systems, and/or high-performance networking systems.
• Hands-on experience building cloud or ML infrastructure involving resource management, scheduling, request routing, monitoring, or orchestration.
• Knowledge of Docker and Kubernetes.
• Proficiency in at least one of Go, Rust, Python, or C++.
• Preferred experience operating or contributing to large-scale cluster management systems such as Kubernetes or Ray.
• Preferred experience with workload scheduling, GPU orchestration, scaling, and isolation in production environments.
• Preferred experience with CUDA or inference engines such as vLLM, SGLang, and TensorRT-LLM.
• Preferred familiarity with AWS, Azure, GCP, SageMaker, Azure ML, and Vertex AI.
• Preferred knowledge of Ray, DeepSpeed, PyTorch, and distributed training or inference platforms.
• Strong communication and cross-functional collaboration skills, with an interest in system efficiency, performance optimization, and open-source innovation.

Benefits

• Graduate role with a 2027 start and onboarding availability required by the end of the year.
• Opportunity to work in a hyperscale global datacenter environment and contribute to open-source infrastructure.
• Candidates should state their availability and graduation date clearly in their resume.