Senior Data Engineer (BigQuery to Databricks Migration)

Data EngineerHome Depot is seeking experienced Data Engineers to support a high-priority initiative focused on replicating enterprise data from Google BigQuery into Databricks. This role will be responsible for designing, building, and optimizing large-scale data replication pipelines while ensuring performance, scalability, and reliability across the data platform.The ideal candidate will have hands-on experience with BigQuery-to-Databricks migrations and a strong background in modern data engineering, distributed processing, and cloud-based data platforms.Key Responsibilities:Design, develop, and maintain data replication pipelines from BigQuery to Databricks.Build scalable ingestion frameworks supporting large-scale enterprise datasets.Develop and optimize Databricks notebooks using PySpark.Implement incremental data replication and change data capture (CDC) strategies.Optimize query performance, data movement, and processing efficiency.Work with BigQuery authorized views and federated connections to support enterprise data access patterns.Utilize Apache Iceberg and Unity Catalog for data governance and management.Collaborate with architects, engineers, and business stakeholders to define migration requirements and solutions.Productionize and monitor Databricks workflows and jobs.Troubleshoot data quality, performance, and replication issues across environments.