Azure Databricks Platform Architect / Solution Architect - No C2C

• Architecture & Strategy
  
• Define end-to-end migration strategy from Azure Databricks to AWS Databricks.
  
• Design scalable Lakehouse architecture using Medallion principles (Bronze, Silver, Gold).
  
• Develop Day 1 Business Continuity and Day 2 Modernization / AI Enablement migration roadmaps.
  
• Perform application and dependency assessments across upstream and downstream systems.
  
• Establish architecture patterns, standards, and best practices for cloud-native data platforms.
  
• Migration & Modernization
  
• Lead migration of data pipelines, notebooks, Delta tables, workflows, and data products.
  
• Modernize legacy ETL/ELT frameworks using Databricks native capabilities.
  
• Optimize performance, scalability, security, and operational efficiency.
  
• Define migration approaches for CDC, batch, streaming, and real-time workloads.
  
• Drive technology rationalization and tool consolidation initiatives.
  
• AI-Ready Data Platform
  
• Build AI-ready data foundations leveraging Delta Lake and Unity Catalog.
  
• Design data architectures supporting ML, GenAI, RAG, feature stores, and advanced analytics.
  
• Enable governed data access for data scientists and AI applications.
  
• Define semantic models, metadata strategies, lineage, and data discovery frameworks.
  
• Establish frameworks for AI governance and responsible AI adoption.
  
• Data Governance & Security
  
• Architect enterprise-wide governance using Unity Catalog.
  
• Design data lineage, auditing, access controls, masking, and compliance standards.

Requirements

• 15+ Years of experience
  
• Azure Databricks
  
• AWS Databricks
  
• Lakehouse architecture
  
• Medallion principles (Bronze, Silver, Gold)
  
• Delta Lake
  
• Unity Catalog
  
• ML
  
• GenAI
  
• RAG
  
• feature stores
  
• advanced analytics
  
• Data Governance
  
• Data lineage
  
• auditing
  
• access controls
  
• masking
  
• compliance standards
  
• ETL/ELT frameworks