Lead Data Engineer

Lead Data EngineerLarge Healthcare Organization Is Seeking A Lead Data Engineer To Join Their Expanding TeamThis Is What You’ll DoLead design, development, and optimization of scalable data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta LakeEnhancement of CI/CD pipelines and Azure DevOps, Git, and automated deployment frameworks to streamline development and release processesEnsure data quality and consistency through data integration, transformation, and cleansingFamiliarity with security and governance best practices using Unity Catalog, Azure RBAC, managed identities, and data access controls to ensure compliance and secure data management is preferredResponsibility includes leading a team of data engineers and mentoring in best practicesUtilize Python for data manipulation, automation, and custom data solutionsCollaborate with stakeholders to understand data needs and translate them into technical solutionsParticipate in on-call rotation and assist with after-hours issues, as requiredPerform other duties as assignedThis Is What It TakesBachelor’s degree in computer science or information systems science, or equivalent experienceThree (3) years’ experience with Azure Databricks platformFive (5) years of comprehensive data warehouse analysis and design experience, with full knowledge of data warehouse methodologies, data modeling and familiarity with operational data storesFive (5) years of experience with ETL/ELT Development, Python, PySparkPython, SQL, and Terraform experienceRequired Certifications, Licenses, and RegistrationsDatabricks Data Engineer Professional or Databricks Data Engineer Associate Certification preferredKnowledge, Skills, and AbilitiesAbility to adapt to changing priorities and respond to problems creativelyAbility to assist clients with migrating from legacy to modern data platformProficiency with technical, conceptual, interpersonal, written, and verbal communication skillsKnowledge of general business, quality and regulatory requirements preferredFamiliarity with Power BI and MicroStrategy architecture is a plusKey Skills / Words: (at least 6)Data EngineerPower BIMicroStrategyDatabricksPythonPySparkComputer scienceInformation technology