AI/LLM Developer/Engineer (Kubernetes & OpenShift)

AI/LLM Developer/Engineer (Kubernetes & OpenShift)

Duration: 12+ months / Long-Term (yearly renewals)


Location: Remote (Must reside in the US)

We're seeking a highly skilled AI/LLM Toolkit Developer to join a long-term remote contract engagement focused on building a cutting-edge enablement solution for technical support teams.

This role involves developing a comprehensive toolkit that leverages AI agents and large language models (LLMs) with retrieval-augmented generation (RAG) to streamline onboarding and reduce reliance on complex documentation.

What You'll Build:

You'll design and implement a robust, AI-powered toolkit that empowers support teams to manage and troubleshoot hybrid environments with ease. The toolkit will cover:


Kubernetes Foundations: Core concepts like pods, deployments, services, namespaces, limits, eviction policies, and network policies.


Virtualization Layer: Deep dive into OpenShift Virtualization and KVM-based VM management.


Mixed Workloads: Best practices for managing VMs and containers on a unified platform.


Containerization: Communication and coordination between VMs and containers, including useful container tools.


Resource Management: Efficient handling of CPU, memory, and storage for both VMs and containers.


Networking: Kubernetes networking, User Defined Networks (UDNs), and F5 SPK integration.


Storage: Persistent volume frameworks, tuning storage traffic, fault tolerance, and database replication strategies.


Live Migration: Seamless VM migration with minimal downtime, including database and storage considerations.


Automation & Orchestration: Automating provisioning, deployment, and scaling in a Webscale environment.


Troubleshooting & Maintenance: Diagnosing issues, analyzing logs, and applying software updates.


Configuration & Customization: Tailored networking and storage solutions to meet specific use cases.


High Availability: Strategies for fault tolerance and resilient application design across various workloads.

Ideal Candidate:

Strong experience with Kubernetes, OpenShift 4.18, and virtualization technologies


Familiarity with AI/LLM integration, especially RAG-based systems


Proven ability to create technical enablement tools and documentation


Comfortable working independently in a remote, contract-based environment

Work Environment:

Remote-first: Work from anywhere


Long-term contract: Stability with flexibility


Impactful work: Help shape how support teams onboard and operate at scale