Senior Systems Engineer - AI Infrastructure

Role Description

We are looking for an Sr Systems engineer with strong hands-on experience in enterprise infrastructure, including GPU-accelerated platforms, VMware, and Kubernetes. This role will support and scale infrastructure for AI/ML workloads across hybrid environments that include NVIDIA DGX, HGX, and Nutanix.

• Support deployment and maintenance of NVIDIA DGX, HGX, and GPU-accelerated systems
• Administer VMware environments, including ESXi, vCenter, and virtual networking/storage
• Deploy and support Kubernetes clusters across various environments and distros (e.g., RKE, OpenShift, AKS, EKS, GKE)
• Perform day-to-day system administration across compute, storage, and networking layers
• Automate infrastructure tasks using Shell scripts, Ansible, or similar tools
• Collaborate with DevOps, data science, and engineering teams to ensure scalable, resilient infrastructure for AI/ML workloads
• Monitor infrastructure health and performance; participate in troubleshooting and root cause analysis

Qualifications

• Min 6 years of experience in systems engineering or enterprise infrastructure roles
• Experience with NVIDIA DGX, HGX, or other GPU-based compute platforms
• Strong working knowledge of VMware virtualization technologies
• Proficient with Kubernetes and experience managing multiple distributions (e.g., RKE, OpenShift, AKS, EKS)
• Understanding of enterprise storage, networking, and system monitoring tools
• Working knowledge of Mellanox (NVIDIA) networking and InfiniBand environments
• Understanding of RDMA and high-speed interconnects is a plus
• Experience with High Availability (HA), clustering, and failover technologies
• Scripting and automation experience (e.g., Bash, Python, Ansible)
• Strong communication, documentation, and troubleshooting skills
• Comfortable working independently in a remote environment

Company Description

At ePlus, we believe technology is a people business. Our team is passionate, skilled, and driven to deliver solutions that make a real difference. Join us and be part of a culture that values collaboration, innovation, and extraordinary results.

• Respectful communication and cooperation: We prioritize respectful communication, fostering an environment where everyone is treated with dignity and respect.
• Teamwork and employee participation: Collaboration and teamwork thrive through diverse perspectives, both within our teams and in our interactions with our customers.
• Work/life balance that supports our employees’ varying needs: We value the well-being of our employees, recognizing that a healthy work-life balance is pivotal to our collective success.
• Embracing communities: We embrace and support the communities that nurture us. Our employees' dedication to fostering positive change is a source of immense pride for us.
• Commitment to Diversity, Inclusion and Belonging: We are an equal opportunity employer that does not discriminate or allow discrimination based on race, color, religion, sex, sexual orientation, gender identity, age, national origin, citizenship, disability, veteran status, or any other classification protected by federal, state, or local law.