DataBricks Lead / Architect

Databricks Lead / Architect

At Staffworxs, we don't just connect talent — we power transformation. Headquartered in Frisco, TX, with teams in Bengaluru and Hyderabad, we combine global reach with deep expertise. Our Digital & Data Analytics practice drives growth and innovation for some of the world's top brands, who continue to retain us as their trusted partner. If you're ready to make an impact, you're in the right place.

Job Title: Databricks Lead / Architect

Experience: 8–12 Years

Location: Dearborn, Michigan, United States

Job Summary:

Azure Databricks Data Architect in manufacturing, with strong Databricks/Azure engineering depth plus architecture and governance skills, backed by Azure and Databricks credentials.

Core technical skills:

• Advanced Apache Spark and PySpark/Scala for large-scale data processing, including performance tuning with Spark UI, partitioning, joins, caching, and shuffle optimization.
• Deep Databricks platform expertise: notebooks, jobs/workflows, cluster configuration, Databricks SQL, and applying Medallion (Bronze/Silver/Gold) architecture patterns.
• Delta Lake: ACID transactions, schema enforcement and evolution, MERGE operations, time travel, and design of performant Delta tables for lakehouse use cases.
• Unity Catalog and governance: catalogs/schemas/tables, permission models, data lineage, and secure access patterns across workspaces and domains.
• Strong SQL for data modeling, complex transformations, aggregates, and BI‐ready structures in a lakehouse context.
• Azure platform skills: Azure Data Lake Storage, Azure Data Factory (or Synapse pipelines), Event Hubs/IoT, networking, identity and access, Key Vault, and monitoring.
• Data modeling and warehousing: dimensional modeling, star/snowflake schemas, and performance-oriented design for analytics and reporting.
• CI/CD and DevOps for data: Git-based workflows, automated testing, and deployment using Azure DevOps or GitHub Actions for Databricks pipelines and artifacts.

Recommended certifications and accreditations:

• Microsoft Certified: Azure Solutions Architect Expert or Azure Data Engineer Associate
• Databricks certifications Data Engineer Associate/Professional, Hadoop Migration Architect

Staffworxs is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive workplace for all employees, regardless of race, color, religion, gender, sexual orientation, national origin, age, disability, or veteran status.