Platform Engineer - AI/ML Infrastructure

Platform Engineer - AI/ML Infrastructure

Location: Halifax, NS



Work Model: Onsite / 4 Days



Job Type: Full Time Primary Skills

Kubernetes, GitOps (Flux CD/ArgoCD), Helm & Vault

Job Description

We are seeking a skilled Platform Engineer - AI/ML Infrastructure to deploy, manage, and support AI/ML infrastructure across enterprise Kubernetes environments. The role will focus on deploying platforms such as LlamaIndex Cloud and KDB.AI and building reliable, scalable, secure deployment pipelines using modern GitOps practices .

The ideal candidate will have strong experience managing production Kubernetes environments, developing Helm charts, implementing GitOps workflows, managing secrets with HashiCorp Vault, and maintaining enterprise CI/CD infrastructure.

Key Responsibilities

• Deploy and manage LlamaIndex Cloud, KDB.AI , and similar AI/ML applications across Dev, QA, and Production environments.
• Implement automated GitOps workflows using Flux CD, ArgoCD, or similar tools.
• Administer and maintain production Kubernetes clusters across multiple environments.
• Configure and manage HashiCorp Vault for secrets management and ExternalSecrets integration.
• Maintain CI/CD pipelines using GitHub Actions, Jenkins , or similar platforms.
• Collaborate with the Enterprise Identity Management team to configure OIDC authentication with Microsoft Entra ID .
• Create, maintain, and optimize Helm charts and Kubernetes manifests .
• Configure Kubernetes networking, Ingress, and Gateway API components.
• Monitor application and infrastructure performance and troubleshoot production issues.
• Support database and middleware infrastructure, including PostgreSQL, MongoDB, Redis, and RabbitMQ.
• Implement and maintain database high availability and failover configurations , including PgBouncer and HAProxy.
• Develop and maintain infrastructure documentation, procedures, runbooks, and reusable infrastructure patterns.
• Identify opportunities to improve platform reliability, automation, scalability, and operational efficiency.

Required Skills & Experience Core Technologies

• 3+ years of experience managing production Kubernetes clusters .
• 2+ years of experience with Flux CD, ArgoCD, or similar GitOps tools .
• Advanced experience developing and managing Helm charts .
• Hands-on experience with HashiCorp Vault and secrets management.
• Experience with Artifactory or similar container registries.
• Strong experience with CI/CD pipelines , particularly GitHub Actions, Jenkins, or equivalent tools.

Infrastructure & Database

• Experience administering PostgreSQL, MongoDB, Redis, and RabbitMQ .
• Knowledge of database HA/failover configurations , including PgBouncer and HAProxy.
• Strong Linux/Unix administration and shell scripting skills using Bash and/or PowerShell.
• Knowledge of Kubernetes networking, Ingress, and Gateway API .
• Experience troubleshooting production infrastructure and application issues.

Nice to Have

• Experience with LlamaIndex, LangChain , or other AI/ML platforms.
• Knowledge of vector databases and KDB.AI .
• Experience with Temporal.io workflow orchestration.
• Programming/scripting experience with Python and/or Go for automation.
• Exposure to AI/ML infrastructure deployment and operational practices.