AI DevOps Engineer

Job DescriptionJob Description Job Title: AI DevOps EngineerJob SummaryWe are seeking an AI DevOps Engineer to build, automate, and manage the infrastructure and deployment pipelines that support AI and machine learning applications. This role bridges DevOps, MLOps, and cloud engineering to ensure reliable, secure, and scalable delivery of AI solutions. The ideal candidate has expertise in cloud platforms, container orchestration, CI/CD, Infrastructure as Code (IaC), and observability, with experience supporting production AI and Generative AI workloads.Key ResponsibilitiesDesign, implement, and maintain CI/CD pipelines for AI and machine learning applications.Automate the deployment, scaling, and lifecycle management of AI services across cloud and hybrid environments.Build and manage containerized AI workloads using Docker and Kubernetes.Provision and manage infrastructure using Infrastructure as Code (Terraform, Pulumi, or CloudFormation).Deploy and support AI/ML models in production using model serving frameworks and MLOps tools.Monitor application health, infrastructure performance, model availability, and operational metrics.Implement logging, tracing, and observability solutions for AI platforms.Optimize cloud resources, GPU utilization, and infrastructure costs.Integrate security best practices, secrets management, identity management, and compliance controls into AI deployment pipelines.Collaborate with AI engineers, ML engineers, data engineers, platform engineers, and software development teams to streamline AI delivery.Support automated testing, release management, rollback strategies, and disaster recovery for AI systems.Troubleshoot production issues related to AI infrastructure, deployments, networking, and performance.Continuously improve deployment automation, reliability, scalability, and operational efficiency.Required QualificationsBachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.4 years of experience in DevOps, Cloud Engineering, Platform Engineering, or Site Reliability Engineering (SRE).Experience supporting AI, machine learning, or data platforms in production environments.Strong programming and scripting skills in Python and Bash; Go is a plus.Hands-on experience with Docker and Kubernetes.Experience with AWS, Microsoft Azure, or Google Cloud Platform.Experience building CI/CD pipelines using GitHub Actions, GitLab CI, Azure DevOps, or Jenkins.Experience with Infrastructure as Code tools such as Terraform or Pulumi.Strong understanding of Linux administration, networking, and cloud security.Experience with monitoring and observability tools such as Prometheus, Grafana, OpenTelemetry, ELK Stack, or Splunk.Preferred QualificationsExperience with MLOps platforms such as MLflow, Kubeflow, SageMaker, Vertex AI, or Azure Machine Learning.Experience deploying Large Language Models (LLMs) and Generative AI applications.Knowledge of model serving frameworks such as KServe, NVIDIA Triton Inference Server, Ray Serve, or BentoML.Experience with vector databases and Retrieval-Augmented Generation (RAG) architectures.Familiarity with Apache Airflow, Kafka, Ray, or Apache Spark.Experience with GPU-enabled infrastructure and NVIDIA CUDA environments.Understanding of AI governance, Responsible AI, and model monitoring practices.Technical SkillsPythonBashGo (preferred)DockerKubernetesTerraform / Pulumi / CloudFormationGitGitHub ActionsGitLab CIAzure DevOpsJenkinsAWS / Azure / Google Cloud PlatformLinuxPrometheusGrafanaOpenTelemetryELK StackSplunkMLflowKubeflowSageMakerVertex AIAzure Machine LearningKServeNVIDIA Triton Inference ServerRay ServeBentoMLPostgreSQLRedisSoft SkillsStrong analytical and troubleshooting skillsExcellent communication and cross-functional collaborationOwnership and accountabilityAbility to thrive in Agile and DevOps environmentsStrong automation mindsetContinuous learning and adaptabilityNice to HaveExperience with LLMOps and Generative AI deployment pipelinesExperience implementing GitOps using Argo CD or FluxKnowledge of service mesh technologies such as Istio or LinkerdExperience with FinOps and cloud cost optimizationCloud, Kubernetes, or DevOps certifications (AWS, Azure, GCP, CKA, CKAD, Terraform)LocationHybrid / Remote / On-site (as applicable)Employment TypeFull-time