Technical Lead - Azure Databricks
Celebal Technologies
Job Description
Technical Lead – Azure Databricks
Location: Grand Rapids, MI (Hybrid)
Employment Type: Full-time
Experience Level: 8–15 Years
Department: Data & Analytics
About the Role
We are seeking an experienced and hands-on Technical Lead – Azure Databricks to architect and drive large-scale, enterprise data platform migrations. In this role, you will lead the technical strategy, design, and execution of migrating legacy data warehouses and processing systems (e.g., on-premises Hadoop, Teradata, Netezza, or legacy SQL) to a modern, scalable Lakehouse architecture powered by Azure Databricks.
You will act as the bridge between enterprise architecture, data engineering teams, and key stakeholders, ensuring robust delivery, performance optimization, and adherence to cloud security standards.
Key Responsibilities
- Migration Strategy & Execution: Lead end-to-end design, planning, and implementation of legacy platform migrations to Azure Databricks using the Medallion Architecture (Bronze/Silver/Gold).
- Architecture & Pipeline Engineering: Design highly scalable batch and streaming data pipelines using PySpark/Scala, Spark SQL, Delta Lake, and Delta Live Tables (DLT).
- Data Integration & Orchestration: Build robust orchestration workflows using Azure Data Factory (ADF), Databricks Workflows, and Event Hubs/Kafka.
- Performance Tuning: Optimize Databricks clusters, query performance, compute utilization, partition pruning, and Delta Lake optimizations (Z-Ordering, compaction, liquid clustering).
- Governance & Security: Implement Unity Catalog for fine-grained access control, data lineage, auditing, and data masking across Azure environments.
- Technical Leadership & Mentorship: Guide, mentor, and conduct code/architecture reviews for a team of 5–10 data engineers, establishing best practices in CI/CD, unit testing, and Databricks Asset Bundles (DABs).
- Stakeholder Management: Collaborate with project managers, solution architects, and business stakeholders to identify technical blockers, scope sprints, and deliver business value on schedule.
Required Technical Skills & Qualifications
- Experience: 8–15 years of hands-on data engineering experience, with at least 3+ years leading technical teams on enterprise Azure Databricks implementations.
- Core Databricks Expertise: Deep knowledge of Apache Spark internals, Delta Lake, Delta Live Tables, Unity Catalog, and cluster performance tuning.
- Azure Data Ecosystem: Strong expertise in Azure Data Factory, Azure Data Lake Storage Gen2 (ADLS Gen2), Azure Key Vault, Azure Synapse, and Azure DevOps (CI/CD pipelines).
- Migration Experience: Proven track record of delivering at least one end-to-end large-scale migration project (e.g., Hadoop/Cloudera, Teradata, Oracle, or SQL Server to Azure Databricks Lakehouse).
- Programming Languages: Proficiency in Python / PySpark and advanced SQL (experience with Scala is a strong plus).
- Data Modeling: Solid foundation in dimensional modeling (Star/Snowflake schema), modern Lakehouse modeling, and historical data reconciliation strategies.
- DevOps & Automation: Experience setting up CI/CD using Azure DevOps or GitHub Actions, Infrastructure as Code (Terraform/Bicep), and automated testing frameworks.
Preferred Qualifications & Certifications
Certifications:
- Databricks Certified Data Engineer Professional
- Microsoft Certified: Azure Data Engineer Associate (DP-203)
- Experience with automated schema migration, data reconciliation, and dual-run validation tooling.
- Familiarity with data observability, monitoring (Databricks System Tables, Azure Monitor/Log Analytics), and cost optimization frameworks (FinOps).
- ...Technical Lead – Azure Databricks Location: Grand Rapids, MI (Hybrid) Employment Type: Full-time Experience Level: 8–15 Years Department: Data & Analytics About the Role We are seeking an experienced and hands-on Technical Lead – Azure Databricks...DatabricksFull time
- ...Role: Team Lead / Solution Architect – (Databricks & Azure Migration) Location: Grand Rapids, MI 49544 Position Type: Full-Time/Direct Hire (Preferred... ...systems to Azure Databricks and Delta Lake. Technical Leadership: Lead, mentor, and provide technical governance...DatabricksLong term contractFull timeImmediate start
$60 - $75 per hour
job summary: We are seeking a Lead Azure Developer with 7+ years of Microsoft .Net experience, including 2+ years developing native... ...to collaborate with team members, to find compromises to technical solutions, when necessary skills: Microsoft .Net...SuggestedHourly payTemporary workWork experience placementRemote work$87k - $120k
...Network Engineer (Palo Alto, Cisco, Azure) Our client is seeking a hands-on Network Engineer... ...brings strong networking fundamentals, technical problem-solving skills, and the ability... ..., connectivity, and integration. Lead network segmentation, security enhancements...SuggestedImmediate start- ...WE ARE HIRING | Technical Project Manager – Data Migration (Databricks) Location: Grand Rapids, MI, USA Experience:... ...experienced Technical Project Manager to lead a large-scale legacy data... ...Databricks, Delta Lake, Apache Spark, AWS/Azure, and ETL pipelines. ~ Experience...DatabricksLong term contract
- ...Job Title: Lead Data Engineer Location: Grand Rapid, MI... ...Full-Time Certification: Databricks Certification preferred... ...Databricks, Medallion Architecture, Azure/AWS cloud platforms, SQL, PySpark... ...control best practices. Provide technical leadership and architectural...DatabricksFull timeContract work
- ...Technical Project Manager – Data Migration (Databricks) Duration: Long term/Full Time Location: Grand Rapids, MI(hybrid... ...Technical Project Manager to lead a critical cloud transformation initiative... ...Spark, Cloud Data Warehouses (AWS/Azure), and ETL pipelines. Agile...DatabricksFull time
- ...Data Engineering & Platform Manager - Azure Databricks and Medallion Architecture Impact Business... ..., understand how teams use both, and lead the work to make the newer platform... ...Analytics & AI and work together to set the technical roadmap. This is an individual...Databricks
$100k - $130k
...Azure.NET Developer Seeking an Azure.NET Developer with strong experience in Azure Cloud,.NET technologies, and SQL Server to develop and support enterprise applications Roles & Responsibilities Develop and maintain applications using C#, ASP.NET,.NET Core/...- ...Azure Solution Architect The Azure Solution Architect will provide architectural guidance and cloud knowledge working closely with... ...runway. Providing subject matter expertise and technical consulting support on either vendor or internal applications and...Work experience placement
- ...Engineer who combines strong technical expertise with exceptional business... ...someone equally comfortable leading business workshops, advising... ...SQL, APIs, cloud platforms (Azure, AWS, or GCP), and modern... ...architecture. Experience with Databricks, Microsoft Fabric, Snowflake,...DatabricksFull time
- ...WE'RE HIRING | Databricks SME – Engineering LeadLocation: [Mention Location]Experience... ...Matter Expert (SME) / Engineering Lead who brings deep hands-on technical expertise, strong architectural... ...and Databricks SQL.Experience with Azure / AWS / GCP cloud data platforms.Ability...DatabricksFull time
- ...Job Description Job Description Job Title: Azure .NET Engineer Location: Grand Rapids, MI Duration: Fulltime Job... ...K-110K/Year Required Skills & Qualifications: Must Have Technical/Functional Skills Azure Functions Azure Service Bus Azure...Full time
- ...We're Hiring | Technical Project Manager – Data Migration (Databricks) Location: Grand Rapids, MI, USA Engagement: Long... ...Technical Project Manager to lead a large-scale legacy data migration... ...Apache Spark, ETL pipelines, and AWS/Azure. ~ Hands-on project management...DatabricksLong term contract
$132.23k - $176.31k
...today. The Role The Senior Lead Marketing Data Platform... ...architecture. This role provides technical leadership for the design and... ...and operational strategy of Databricks as the strategic platform for... ...analytics environments. ~ Azure platform expertise, including...DatabricksFull timeTemporary work$50 per hour
...individual contributor, you will set technical direction across projects and... ...capabilities. You will lead through technical judgment,... ...Experience with AWS Bedrock, Azure OpenAI, or comparable model services... ...specifications, files, or Databricks.Experience with Docker,...DatabricksFull timeTemporary workWork experience placementCasual workFlexible hours- ...Databricks Data Engineer Our client is hiring a Data Engineer to build and improve production pipelines in Databricks. You'll work across... ...or Lakeflow Jobs. Working knowledge of Unity Catalog and Azure data services such as Azure Data Lake Storage or Azure Data...Databricks
$141.2k - $278.3k
...skilled and client-facing Engineering Lead to sit at the intersection of... ...and client-facing teams to shape the technical go-to-market strategy.Maintain a library... ...platforms (e.g., Snowflake, Databricks, AWS, Google Cloud, or Azure) in a financial services or other highly...DatabricksWork at officeLocal area- ...privacy regulations such as GDPR and CCPA. This is a hands-on technical role, ideal for someone who thrives in ambiguity, works autonomously... ...with Python. Experience working within data platforms like Databricks/Snowflake, and analytics modeling platforms such as Tableau...DatabricksFull time
- ...This role is ideal for a hands-on NOC Lead or Senior Network Engineer who work in a... ...Lead day-to-day NOC operations and provide technical direction to L1/L2 engineers. Serve as... ...preferred Cloud networking, preferably Azure or GCP Load balancing, preferably F5...Remote workWork from homeNight shift3 days per week
$100k - $120k
...Engineer Location: Jersey City, NJ Job Type: Fulltime Permanent Role Salary Range: $100,000-$120,000 a year Job Description Must Have Technical/Functional Skills Playwright automation framework, Python, AI-assisted development tools ( GitHub, Copilot), Pytest, Python-based...Permanent employmentFull time$80.51k - $107.34k
...alongside experienced team members while gaining exposure to AWS, Azure, Microsoft 365, vulnerability scanning platforms, and industry... ...based on identified risks. Participate in customer technical discussions, working sessions, assessment reporting, and findings...Full time$93.1k - $131.1k
...role ends on 12/30/2026. Work You'll Do As a Consultant on the team, you will be responsible for: Leading the design, coordination, and delivery of Oracle HCM Cloud technical integrations across enterprise systemsDefining integration strategy and overseeing inbound/...Local area$122k - $240.5k
...decisions the business can act on takes both rigorous technical craft and real industry fluency. As a Data Scientist on... ...cloud-based data and analytics platforms (e.g., Snowflake, Databricks, AWS, Google Cloud, or Azure) in a financial services or other highly regulated...DatabricksLocal area$120k - $140k
...Collaborate with multi-functional teams to define, design, and build big data solutions using tools and programming languages like Databricks, Azure Data Factory, Apache Spark, Python, SQL, etc. Architect and develop scalable and robust data pipelines using data from diverse...DatabricksFull timeWork experience placementWork at officeWork visaFlexible hours- ...Location: Grand Rapids, MI Duration: Fulltime Job Skills: .NET | ASP.NET | Azure | MVC Salary: 110K-120K/Year Required Skills & Qualifications: Must Have Technical/Functional Skills C#, .NET Core/.NET Framework, ASP.NET MVC, Web API Microsoft...Full time
- ...softwareengineering fundamentals. A genuine engineeringmindset. We are looking for people who automate and build, not people whooperate a console. Azure platform as aservice expertise, including function apps, App Service, networking and KeyVault. Deep GitHub Actionsexperience, plus...H1b
- ...report to the IT Dynamics Developer Team Lead and as a member of a high-performing team... ...define and assist in the implementation of technical processes and procedures including on-... ...integrations using Microsoft CRM SDK in C#. Azure Cloud experience with App Services, App...
- ...cloud infrastructure services with a primary focus on Microsoft Azure. This role supports cloud resource provisioning, infrastructure... ..., and business stakeholders to gather requirements, validate technical designs, and deliver cloud solutions aligned with enterprise standards...Immediate startFlexible hours
$75k - $80k
...settings from the CMS (Content Management System) to all client apps. Technical Leadership: Serve as a senior technical voice within a small... ...with cloud functions or infrastructure management in Azure (e.g., Azure Functions). Prior experience building features related...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technical Lead - Azure Databricks. Be the first to apply!







