Azure Solution architect Databricks

About the Role: We are seeking a highly motivated and detail-oriented Azure Cloud infrastructure Architect to join our team. In this critical role, you will be responsible for ensuring the secure, compliant, and efficient databricks implementation and migration on a Azure platform. He/She will play a key role in deploying infrastructure, maintaining strict adherence to security measures, collaborating with various teams to uphold operational integrity.

Key Responsibilities:

Azure infrastructure Design and build

Design and implement enterprise-grade Azure infrastructure architectures supporting Azure Databricks workloads.

Define cloud landing zones, network topology, identity integration, security controls, and governance frameworks.

Architect highly available, scalable, and cost-optimized cloud environments.

Develop Azure reference architectures and reusable deployment patterns.

Ensure compliance with enterprise architecture standards and security requirements.

Azure Databricks Platform Engineering

• Design, deploy, and manage Azure Databricks workspaces across Development, QA, UAT, and Production environments.
• Architect secure Databricks connectivity using:
  • VNet Injection
  • Private Endpoints
  • Private Link
  • NSGs
  • Azure Firewall
  • Hub-and-Spoke Architecture
• Configure Unity Catalog, Data Governance, and Role-Based Access Control (RBAC).
• Design cluster policies, auto-scaling strategies, workload isolation, and performance optimization.
• Integrate Databricks with:
  • Azure Data Factory
  • Azure Synapse Analytics
  • Azure Storage Accounts (ADLS Gen2)
  • Azure Key Vault
  • Azure Purview
  • Microsoft Fabric (preferred)

DevOps & Automation

• Design and implement CI/CD pipelines using Github.
• Automate deployment of infrastructure, Databricks assets, notebooks, clusters, and jobs.
• Build GitOps-based deployment frameworks.
• Manage source control, branching strategy, release governance, and approval workflows.
• Integrate security scanning and compliance validation into CI/CD pipelines.

Preferred Experience and Qualifications:

• 10+ years of IT Infrastructure and Cloud Architecture experience.
• 5+ years of Azure Cloud Architecture experience.
• 3+ years of Azure Databricks architecture and implementation experience.
• Extensive experience deploying enterprise-scale cloud platforms using Infrastructure as Code.
• Azure certifications (e.g., Azure Administrator Associate, Azure Security Engineer Associate).
• Experience with scripting and automation (e.g., PowerShell, Azure CLI).