Sr Azure DevOps Engineer - AI & Data Focused

Sr Azure DevOps Engineer - AI & Data Focused
Chicago, IL - hybrid WFH, 3 days onsite, 2 days WFH

Summary:
We're seeking a Sr Azure DevOps Engineer, who will sit on the AI team, and focus on deploying data pipelines to strengthen our cloud platform engineering team. Given most of the team you'd be working with is not strong with Databricks, we're looking for someone who has experience deploying data pipelines with Databricks as the primary focus (65%). Specifically design, deploy, and optimize Azure Databricks workspaces, clusters, and jobs (including use of Databricks Asset Bundles).


The other 35% will be focused on traditional software Azure DevOps, using ARM templates currently for IaC, but we're considering using other IaC tools like Terraform.


You must be strong building CI/CD pipelines using Azure DevOps and GitHub. And we're also looking for someone to be hands on scripting with Python, PowerShell, Bash.


What you'll be doing

• Design, deploy, and optimize Azure Databricks workspaces, clusters, and jobs using IaC and Databricks Asset Bundles.
• Architect and automate Azure environments with Infrastructure-as-Code (Bicep, ARM, Terraform).
• Own Git strategy and CI/CD pipelines (Azure DevOps, GitHub): branching standards, PR automation, and release orchestration.
• Partner with data-engineering and platform teams to run fully isolated dev, staging, and production environments.
• Develop reusable, modular IaC templates for consistent, reliable deployments across all tiers.
• Embed automated testing and monitoring in every pipeline to ensure resilient, high-performance systems.
• Continuously identify opportunities to streamline deployments and boost reliability through automation.
• Champion DevOps culture: automated testing, shift-left security, trunk-based development, post-mortems.
• Audit and improve tooling, processes, and infrastructure management practices on an ongoing basis.

Skills we're seeking

• 8+ years of experience with DevOps
• 3+ years of experience with Azure DevOps
• Strong experience with Databricks is a hard requirement
• Must have IaC experience, any tool is fine, but ARM templates are preferred
• Must be proficient scripting with Python, PowerShell and/or Bash

Nice to haves (in no particular order)

• Multi-cloud experience with AWS and/or GCP - even though Azure is the strong focus near term, we may be going multi-cloud
• Experience with Data Engineering, .NET Development or Python Development
• Experience deploying ML models
• Experience with Site Reliability and Cloud Monitoring
• Experience migrating to-or building-data platforms from the ground up
• Experience with Azure Security
• Experience working in an Agile delivery model