Databricks Ecosystem / Full Stack Lead / Solutions Architect _Washington. DC

Databricks Ecosystem / Full Stack Lead / Solutions Architect Location: Washington, DC Duration: Long term Client: American Unit / AMTRAK Job And Role Overview We are seeking a Senior IT Applications Solution Architect specializing in Databricks to drive the architectural vision, governance, and end‑to‑end design of our next‑generation enterprise lakehouse platform. In this strategic role, you will serve as the premier technical authority, bridging the gap between enterprise business strategies and technical execution. You will architect scalable, secure, and resilient application integrations, define framework standards, and collaborate across engineering and executive leadership teams to align our data applications with overarching organizational goals. Key Responsibilities Architectural Blueprinting: Define and maintain the high‑level architectural designs, integration patterns, and governance frameworks for the enterprise Databricks environment and its connected application ecosystem. Cross‑Functional Alignment: Act as the primary conduit between enterprise application architects, data architects, and engineering teams to translate business capability demands into concrete, scalable technical solutions. Strategic Stakeholder Management: Articulate complex architectural trade‑offs, financial implications (FinOps), and platform capabilities to senior executives and non‑technical business leaders. Engineering Governance: Establish rigorous coding standards, design patterns, and architectural review processes; provide senior‑level technical mentorship to engineering squads. Data Application Engineering: Design end‑to‑end integration patterns utilizing Databricks Delta Live Tables (DLT), structured streaming, and advanced orchestration workflows to power downstream business applications. Enterprise Information Modeling: Standardize the enterprise Medallion Architecture (Bronze, Silver, Gold layers) to optimize application performance, downstream system consumption, and data compliance. Performance & Cloud Optimization: Architect optimization strategies for Spark jobs, cluster topologies, and data layouts using advanced features (Liquid Clustering, Z‑Ordering, Photon engines) to maximize throughput and minimize compute spend. Application Observability: Define and implement robust, proactive platform monitoring, operational logging, and alerting frameworks across all cloud data workflows. CI/CD Blueprinting: Architect and govern automated deployment pipelines to manage Databricks assets, workspace configurations, and code repositories across multi‑tier environments (Dev, QA, Prod). Infrastructure as Code (IaC): Collaborate with Cloud Infrastructure teams to design automated provisioning, environment scaling, and enterprise security policies (Unity Catalog governance, data masking, and access controls). Required Qualifications Professional Experience: 8+ years of technical experience in data engineering and IT architecture, with at least 3+ years as a Senior Solution Architect, Application Architect, or Principal Engineer. Databricks Architectural Mastery: Deep, hands‑on architectural experience designing and deploying enterprise‑grade, high‑availability production solutions natively on the Databricks platform. Advanced DLT & Streaming Blueprinting: Proven track record of architecting complex Delta Live Tables (DLT) architectures and streaming applications within a large‑scale corporate environment. Data Ecosystem Modeling: Expert‑level understanding of Medallion architecture, relational/dimensional data modeling, and master data management (MDM) paradigms. Enterprise DevOps/IaC Skills: Strong experience establishing multi‑environment CI/CD deployment pipelines for enterprise data platforms using tools such as GitHub Actions, GitLab CI, Azure DevOps, or Terraform. Influence & Communication: Exceptional communication, facilitation, and negotiation skills with a demonstrated ability to steer cross‑functional initiatives and influence technology roadmaps at the executive level. End Client Note: As mandated by the client, candidates must provide a minimum of 7 years of verifiable employment history with valid references. All submitted employment details must exactly match the candidate’s LinkedIn profile. Any discrepancies may result in delays, rejection during background verification (BGC), or failure in onboarding. Accurate and complete employment documentation and references are mandatory. #J-18808-Ljbffr Floga Technologies