DevOps Platform Engineer (Azure DevOps & Databricks Administrator)

DevOps Platform Engineer (Azure DevOps & Databricks Administrator)

DTI is seeking an experienced DevOps Platform Engineer to support the ongoing development and operation of a modern cloud-based data platform built on Microsoft Azure and Databricks.

This role is responsible for designing, automating, administering, and continuously improving platform services that support enterprise data engineering, analytics, and application delivery teams. The ideal candidate will possess deep expertise in Azure DevOps, Kubernetes, Terraform, Databricks administration, cloud security, CI/CD automation, and infrastructure management.

You will play a key role in ensuring platform reliability, scalability, security, and operational excellence while enabling development teams to deliver solutions efficiently and consistently.

Key Responsibilities

Platform Engineering & Automation

• Design, implement, and maintain Infrastructure as Code (IaC) solutions using Terraform and related automation tools.
• Develop and manage CI/CD pipelines utilizing Azure DevOps and GitHub Actions.
• Standardize deployment processes across development, testing, and production environments.
• Automate provisioning, configuration management, and platform lifecycle activities.

Kubernetes & Container Operations

• Deploy, manage, and troubleshoot Kubernetes-based workloads.
• Administer containerized applications using Docker and Helm.
• Monitor cluster health, resource utilization, scaling activities, and platform performance.
• Implement secure runtime configurations and container governance practices.

Databricks Platform Administration

• Administer Databricks environments, workspaces, cluster policies, and user access controls.
• Support platform governance initiatives using Databricks Unity Catalog.
• Assist development teams with data platform orchestration, integration, and operational support.
• Optimize platform performance and ensure adherence to organizational standards.

Security, Governance & Identity Management

• Implement and maintain Role-Based Access Control (RBAC) and Identity & Access Management (IAM) policies.
• Manage Azure Active Directory integrations and group-based security models.
• Administer Azure Key Vault for secrets, certificates, and encryption key management.
• Support least-privilege access models and auditable entitlement processes.
• Partner with security teams to ensure compliance with enterprise security standards and best practices.

Monitoring & Operational Excellence

• Configure monitoring, alerting, and observability solutions using Dynatrace and Azure-native tools.
• Perform incident response, troubleshooting, and root cause analysis activities.
• Develop preventative automation and operational improvements to reduce platform incidents.
• Maintain high platform availability, reliability, and performance.

Collaboration & Support

• Work closely with development, data engineering, architecture, and operations teams.
• Provide technical guidance on cloud-native architectures, automation, security, and platform best practices.
• Participate in release planning, deployment activities, and operational readiness reviews.
• Support continuous improvement initiatives across the DevOps and platform engineering ecosystem.

Required Qualifications

• 6+ years of experience in DevOps, Platform Engineering, Cloud Engineering, or Infrastructure Administration.
• Strong hands-on experience with Azure cloud services and Azure DevOps.
• Expertise administering and supporting Kubernetes environments.
• Experience with Terraform, Helm, and Docker.
• Proven experience building and maintaining CI/CD pipelines using Azure DevOps and/or GitHub Actions.
• Experience supporting enterprise data platforms utilizing Databricks.
• Working knowledge of Azure Data Factory (ADF), Airflow, and Azure Data Lake technologies.
• Strong understanding of RBAC, IAM, and Azure Active Directory security models.
• Experience implementing secrets management solutions using Azure Key Vault.
• Hands-on experience with Dynatrace or similar monitoring and observability platforms.
• Strong scripting skills using Python, PowerShell, Bash, or related technologies.
• Understanding of cloud networking, platform security, and infrastructure best practices.

Preferred Qualifications

• Experience supporting large-scale cloud data platforms.
• Knowledge of Databricks Unity Catalog governance and permissions management.
• Experience implementing platform reliability engineering practices.
• Exposure to enterprise security frameworks and compliance requirements.
• Experience supporting highly available and mission-critical production environments.
• Familiarity with Agile delivery methodologies and DevOps best practices.

Technical Environment

Cloud & Platform Technologies

• Microsoft Azure
• Azure DevOps
• Azure Active Directory
• Azure Key Vault
• Azure Data Factory
• Azure Data Lake
• Databricks
• Databricks Unity Catalog

Container & Automation

• Kubernetes
• Docker
• Helm
• Terraform
• GitHub Actions

Monitoring & Operations

• Dynatrace
• Incident Management
• Root Cause Analysis
• Performance Monitoring

Scripting & Development

• Python
• PowerShell
• Bash

What Success Looks Like

The successful consultant will help deliver a secure, scalable, and highly automated Azure-based data platform while improving deployment efficiency, strengthening governance and security controls, enhancing operational visibility, and supporting enterprise-wide cloud modernization initiatives.

Pay rate: $55-$59hr based on experience