Azure Databricks Data Architect

Job Description

Responsibilities:

\n
• Architect scalable, high-performing data solutions to meet both functional and non-functional requirements.
\n
• Own the architecture, design, and optimization of Databricks platforms within cloud-based ecosystems (Azure preferred).
\n
• Serve as the technical lead and trusted advisor for clients, facilitating architecture workshops, requirements discovery sessions, and whiteboard discussions to design scalable Databricks Lakehouse solutions that align with business objectives, data strategy, and modernization initiatives.
\n
• Partner directly with business and technical stakeholders to define end-to-end data architectures, presenting and defending solution designs while providing hands-on guidance for Databricks, Spark, Delta Lake, cloud platforms (Azure/AWS/GCP), data governance, and CI/CD best practices, roadmaps throughout the project lifecycle and lead whiteboarding sessions.
\n
• Lead hands-on implementation of data pipelines and infrastructure using best practices for DevOps and infrastructure-as-code.
\n
• Partner with data engineering teams to ensure platform performance, reliability, and maintainability.
\n
• Integrate Databricks solutions across systems, aligning with enterprise architecture standards and delivery best practices.
\n
• Create and review architecture and solution design documents for large-scale data initiatives.
\n
• Evangelize reuse and modular design through shared services and common data models.
\n
• Enforce architectural standards and guide teams on patterns, tools, and delivery methods.
\n
• Mentor and provide technical guidance to engineers during development and delivery.
\n
• Contribute to risk management through proactive identification and mitigation of technical delivery risks.
\n
• Operate at varying levels of abstraction—solutioning high-level architecture while diving deep when needed.
\n

Required Qualification:

\n
• Bachelor’s or master’s degree in computer science, Information Technology, or related field.
\n
• 8+ years of experience in data architecture, cloud data warehousing, or large-scale data integration.
\n
• 3+ years of hands-on experience delivering production-ready Databricks solutions.
\n
• Strong proficiency in Python, SQL, data modeling, and Azure services (Data Factory, Event Hub, Synapse, DevOps).
\n
• Experience implementing infrastructure using Terraform, ARM templates, or similar IAC tools.
\n
• Comfort working in Agile/Scrum environments and supporting CI/CD pipelines.
\n
• Excellent communication skills—you can explain complex ideas to tech teams and business stakeholders alike.
\n
• Bonus: Familiarity with ML lifecycle concepts and MLOps tools, even if you're not a model builder yourself.
\n