DevOps Engineer-Databricks

Senior Databricks DevOps Engineer (Azure & CI/CD)We are seeking an experienced Databricks DevOps Engineer with strong expertise in Azure Cloud, Azure Databricks, CI/CD automation, Infrastructure as Code (IaC), and cloud-native application deployment. The ideal candidate will have hands-on experience in Azure platform services, Databricks administration, Terraform module development, API integrations, and DevOps automation.The candidate will play a key role in designing, automating, deploying, and supporting scalable cloud and data platform solutions while enabling continuous delivery and operational excellence across enterprise environments.Key ResponsibilitiesDesign, develop, and maintain Azure Databricks environments and cloud platform infrastructure.Build and manage CI/CD pipelines using Jenkins, GitLab CI/CD, and DevOps best practices.Develop reusable Infrastructure as Code (IaC) solutions using Terraform and Terraform modules.Automate deployment, monitoring, and operational processes across Azure and Databricks environments.Design and implement secure authentication and authorization solutions using Azure AD, OAuth, JWT, and Azure AD B2C.Develop and integrate REST APIs and third-party APIs with enterprise applications.Manage Azure application registrations, service principals, and identity integrations.Deploy and maintain cloud-native applications on Azure Kubernetes Service (AKS).Build and support Microsoft Teams applications using Microsoft Teams SDK and Bot Framework.Implement real-time communication solutions using Azure SignalR Services.Configure monitoring, logging, and observability using Azure Application Insights and Azure monitoring tools.Collaborate with Data Engineering teams to support ETL/ELT workloads and data platform operations.Ensure security, scalability, reliability, and performance of cloud-based solutions.Participate in troubleshooting, incident resolution, and root cause analysis activities.Support Agile development and DevOps delivery processes.Required SkillsCloud & Platform TechnologiesMicrosoft AzureAzure DatabricksAzure Active Directory (Azure AD)Azure AD B2CAzure Kubernetes Service (AKS)Azure SignalRAzure Application InsightsDevOps & AutomationCI/CD PipelinesJenkinsGitLab CI/CDInfrastructure as Code (IaC)TerraformTerraform Module DevelopmentGitGitHubGitLabSecurity & IdentityOAuth 2.0JWT AuthenticationAzure App RegistrationsService PrincipalsIdentity & Access ManagementDevelopment & IntegrationREST APIsThird-Party API IntegrationsSQL ServerOracle SQLPythonBash ScriptingPowerShellCollaboration PlatformsMicrosoft Teams SDKTeams Application DevelopmentAzure Bot FrameworkNice to Have SkillsData EngineeringData Engineering ConceptsETL / ELT DevelopmentData WarehousingData ModelingBig Data TechnologiesData Pipeline AutomationAdditional SkillsWorkflow AutomationMonitoring & ObservabilityCloud GovernanceSecurity Best PracticesPreferred QualificationsExperience supporting enterprise-scale Azure Databricks environments.Hands-on experience with Terraform module development and cloud automation.Experience integrating Azure services with enterprise applications.Exposure to Data Engineering and modern data platforms.Knowledge of DevSecOps practices.Soft SkillsStrong analytical and troubleshooting abilities.Excellent communication and stakeholder management skills.Ability to work independently in fast-paced environments.Strong collaboration and problem-solving mindset.