Architect

Role Description

We are currently searching for an Architect (Databricks Lakehouse):

• Design and implement end-to-end data architectures utilizing the Databricks Lakehouse Platform and Medallion Architecture (Bronze, Silver, Gold layers).
• Oversee the reliable creation of production-ready pipelines and data organization patterns.
• Troubleshoot and tune large-scale distributed computing jobs leveraging Apache Spark internals (caching, partitioning, broadcast joins).
• Manage data schemas, ACID transactions, and optimization operations (like Z-ordering) within Delta Lake.
• Design unified governance models, row/column-level security, role-based access control (RBAC), and data lineage using Unity Catalog.
• Implement native cloud infrastructure setups (e.g., ADLS/Entra for Azure, S3/IAM for AWS), including Virtual Network (VNet) configurations and IAM roles.
• Monitor resource usage (DBUs), right-size serverless/multi-node clusters, and implement cost optimization strategies.

Qualifications

• Deep expertise with the Databricks Lakehouse Platform, Apache Spark, and Delta Lake.
• Proven ability to design and implement Medallion data architectures.
• Strong knowledge of Spark internals and large-scale performance tuning.
• Demonstrated experience with Unity Catalog for data governance and AI asset management.
• Strong grasp of native cloud ecosystems (AWS, Azure, or GCP).
• Advanced coding proficiency in SQL and either Python or Scala.
• Demonstrated experience in cloud cost optimization and avoiding bill shock.
• High-Performance Mindset: Resilience, emotional intelligence, and a focus on agile delivery.
• Technologist DNA: A deep understanding of the difference between "coding" and "engineering."

Requirements

• Expertise in designing end-to-end data architectures (Bronze, Silver, Gold layers).
• Deep understanding of Databricks & Spark Internals (troubleshooting, tuning, caching, partitioning, broadcast joins).
• Must understand ACID transactions, schema enforcement, time travel, and optimization operations in Delta Lake.
• Proven ability to design unified governance models using Unity Catalog (RBAC, row/column-level security, data lineage).
• Strong grasp of native cloud infrastructure (AWS, Azure, or GCP).
• Advanced SQL skills and fluency in Python or Scala.
• Ability to monitor DBUs and implement cost optimization & performance tuning.

Benefits

• This is your chance to thrive in a workplace recognized as one of the most sustainable corporations in the world.
• Join an environment that values innovation and societal impact.
• Work on end-to-end digital transformation projects for global leaders.
• Exposure to high-impact projects within an international network of expertise.

Work Arrangement

We value flexibility to support your lifestyle. This position is available as:

• Remote