Databricks Data Engineer

We are looking for a highly motivated Data Engineer with strong expertise in Databricks and modern data engineering practicesThe ideal candidate should have handson experience in building scalable data pipelines notebooks implementing CICD processesand working with Delta Lake technologies The candidate must possess excellent Python programming skillsa solid understanding of Unity Catalog and the ability to collaborate effectively within large crossfunctional teamsKey ResponsibilitiesDesign develop and maintain scalable ETLELT pipelines Notebooks using DatabricksBuild and optimize data processing solutions using PySpark and PythonImplement and manage data governance security and access controls using Unity CatalogWork with Delta Lake features including Delta Sharing Time Travel Change Data Feed CDF and data optimization techniquesDevelop and maintain CICD pipelines for Databricks deployments using industrystandard DevOps practicesPerform performance tuning and optimization of Databricks workloadsCollaborate with architects business analysts and stakeholders to understand data requirements and deliver solutionsSupport production deployments troubleshooting monitoring and performance improvementsFollow coding standards documentation and best practices for software development lifecycle SDLCRequired SkillsDatabricks StrongStrong understanding of Databricks architecture and ecosystemHandson experience withDelta LakeDelta SharingUnity CatalogStructured StreamingWorkflow orchestrationPerformance tuning and optimizationData governance and access managementExperience with Medallion Architecture Bronze Silver Gold layersProgrammingStrong handson coding experience in PythonExperience with PySpark for largescale data processingGood understanding of SQL and query optimizationDevOps CICDExperience implementing CICD processes for Databricks workloadsFamiliarity with Gitbased source control and branching strategiesExperience with deployment automation tools and DevOps pipelinesData Engineering ConceptsETLELT design patternsData modeling and data warehousing conceptsData quality monitoring and observability frameworksGood to Have SkillsAWS CloudAWS GlueS3IAMLambdaAzure CloudAzure Data Factory ADFAzure StorageAzure DatabricksKey VaultSoft SkillsExcellent verbal and written communication skillsStrong problemsolving and analytical abilitiesAbility to work effectively in a large global team environmentStrong stakeholder management and collaboration skillsSelfdriven proactive and able to work independently with minimal supervision