Principal Engineer Databricks / Analytics

As Principal Engineer Databricks / Analytics at Kaiser Permanente, you will lead the design and evolution of our Databricks-based analytics platform. You will architect scalable Spark and Delta Lake solutions, build robust ETL pipelines, and enable high-quality, trusted data for clinicians, analysts, and business leaders. Partnering closely with product, data science, and IT, you will define standards, ensure security and compliance, and mentor engineers. This role combines deep hands-on engineering with technical leadership in a highly impactful healthcare environment.

Responsibilities

• Architect and own the Databricks-based analytics and data engineering platform for Kaiser Permanente.
• Design, build, and optimize scalable ETL/ELT pipelines and Delta Lake architectures.
• Collaborate with analytics, product, and clinical stakeholders to translate requirements into robust data solutions.
• Establish best practices, coding standards, and governance for data engineering on Databricks.
• Lead and mentor engineers, providing technical guidance and code reviews.
• Ensure data quality, security, and compliance within healthcare and enterprise standards.
• Evaluate new data technologies and drive continuous improvement of the analytics ecosystem.
• Partner with IT and security teams to optimize performance, reliability, and cost of the platform.

Required Skills

• Databricks
• Apache Spark
• Python
• SQLDelta Lake
• Data warehousing
• ETL pipeline development
• Cloud platforms (Azure/AWS/GCP)
• Data modeling
• Analytics/BI tools (Power BI/Tableau)