Databricks Architect (Lead Data Platform Architect)
iLink Digital
Databricks Architect (Lead Data Platform Architect)
New York, United States | Posted on 06/25/2026
We are looking for a highly skilled Databricks Architect to design, build, and scale enterprise-grade Lakehouse data platforms . This role will drive architecture strategy, platform standardization, and enterprise data modernization initiatives , leveraging Databricks and cloud ecosystems.
The ideal candidate brings deep expertise in Spark, Delta Lake, and cloud-native architecture , along with strong leadership in driving large-scale data transformations.
Key Responsibilities
- Define and implement end-to-end Databricks Lakehouse architecture .
- Design scalable systems for:
- Batch & real-time data processing
- Structured & unstructured workloads
- Batch & real-time data processing
- Establish medallion architecture (Bronze, Silver, Gold layers) as a standard.
- Lead deployment and optimization of:
- Azure Databricks / AWS Databricks / GCP Databricks
- Azure Databricks / AWS Databricks / GCP Databricks
- Define standards for:
- Workspace design & cluster strategy
- Job orchestration
- Data storage (Delta Lake)
- Workspace design & cluster strategy
- Drive adoption of:
- Unity Catalog
- MLflow
- Databricks SQL & Photon
- Unity Catalog
- Batch (ADF, Airflow)
- Data modeling (star schema, data vault, dimensional models)
- Guide engineering teams on best practices in Spark/PySpark optimization .
Performance & Cost Optimization
- Query performance
- Implement cost governance strategies (auto-scaling, job clusters, spot instances).
Data Governance & Security
- Fine-grained access control (RBAC/ABAC)
- Ensure compliance with data privacy and regulatory standards .
- Integrate Databricks with:
- Data sources (ERP, CRM, APIs, IoT)
- BI tools (Power BI, Tableau)
- ML pipelines and AI platforms
- Data sources (ERP, CRM, APIs, IoT)
- Collaborate with cloud architects for:
- Networking, security, and storage strategies.
- Networking, security, and storage strategies.
- Provide architectural guidance to data engineers, scientists, and TPMs .
- Conduct design reviews and enforce architecture governance .
- Mentor teams on emerging patterns:
- Data Mesh
- DataOps / MLOps
- GenAI workloads on Databricks
- Data Mesh
Skills & Qualifications
Mandatory Skills
- 12+ years of experience in data engineering, architecture, or platform design .
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Databricks Architect (Lead Data Platform Architect) in New York, NY vacancy
- ...New York, NY (Hybrid) Full time Lead Level About This Role As a Data Architect, you'll define the data strategy... ...secure, and cost-effective data platforms. Responsibilities Design data models... ...knowledge of multiple data technologies (Databricks, Snowflake, etc.) Understanding...PlatformDatabricksFull time
ACI Infotech
New York, NY5 days ago - ...Data ArchitectNew York, NY, USA Or refer someone Job Openings... ...looking for an experienced Data Architect to design and manage scalable... ...analytics across multiple platforms.Responsibilities:Own enterprise... ...Warehouse/Lakehouse): BigQuery / Databricks / Snowflake /...PlatformDatabricks
Inizio Partners
New York, NY3 days ago - ...energetic and passionate Senior Data Architect to design and execute our... ...change agent, successfully leading and implementing organizational... ...patterns for scalable data platforms. Extensive experience with... ...technologies such as Data Lake, Databricks, Snowflake Experience with...PlatformDatabricksLocal area3 days per week
$168.5k - $206k
...Information Job Title Principal Data Architect Job ID 108701 Work... ...and Technology Strategy Lead the definition of enterprise... ...and secure enterprise data platforms and solutions across cloud,... ...services, including Databricks, Snowflake, Microsoft Fabric...PlatformDatabricksPermanent employmentFull timeWork at officeLocal area- ...seeking an experienced Senior Data Architect with deep expertise in... ...and technical requirements. Lead data transformation initiatives... ...governance adherence across platforms. Troubleshoot performance issues... ...). Exposure to Python, Databricks, and Apache Spark. #J-18808-...PlatformDatabricks
Compunnel
New York, NY3 days ago $122k - $163k
...create custom software, data, and cloud products... ...What You’ll DoAs a Data Architect at Slalom, you will work... ...Azure, and Google Cloud Platform technologies. You’ll stay... ...solutions* Lead and contribute to solution... ...Apache Spark, Presto, Databricks, Amazon Kinesis, Apache...PlatformDatabricksTemporary workLocal area- ...the world is looking for an Enterprise Data Architect to establish the enterprise data infrastructure... ...data knowledge and a validated Databricks POC but lacks a senior architect to design... ...-grade lakehouse. This role moves the platform from concept to enterprise reality. Key...PlatformDatabricks
Harnham
New York, NY3 days ago - ...Principal Data Architect – Data PlatformsRussell Investments is seeking a hands-on Principal... ...to design and build modern data platforms across our enterprise. This role is... ...modern cloud platforms (Snowflake, Databricks, Azure).Lead hands-on data modeling (3NF, dimensional...PlatformDatabricksVisa sponsorship
Russell Investments
New York, NY3 days ago - Senior GCP Data ArchitectLocation: RemoteEmployment... ...with over 400 leading technology providers,... ...experienced Senior GCP Data Architect to lead the design and... ...enterprise-scale data platforms. This role will define... ...Qualifications* Experience with Databricks, Snowflake, Terraform,...PlatformDatabricksFull timeContract workLocal areaFlexible hours
$175k - $205.9k
...you ready to make an impact?As a Data Architect at West Monroe, you will lead the design, implementation, and optimization... ...warehouses, lakes, and analytics platforms.Data Governance: Establish and... ...with modern data platforms: Databricks and/or Snowflake preferredExperience...PlatformDatabricksWork at officeLocal areaImmediate startFlexible hours- ...ACI Infotech is seeking a Data Architect based in New York, NY, for a hybrid full-time position... ..., designing scalable and secure data platforms. The ideal candidate will have over... ...strong knowledge of data technologies like Databricks and Snowflake, and excellent...PlatformDatabricksFull time
ACI Infotech
New York, NY8 hours ago - ...Position:Data Architect Location:Warren, NJ | Hybrid –Nearby state Need candidates with strong... ...experience. Key Responsibilities Platform Implementation & ConfigurationLead end-... ...downstream systems including Microsoft Fabric, Databricks, Azure Data Lake (OneLake), Snowflake,...PlatformDatabricks
Tech Mirrors
New York, NY2 days ago - ...Spaulding Ridge is seeking a Data Solutions Architect to join our Data Solutions team in the United States. You will lead pre‑sales, design and implement modern analytic solutions... ..., strong SQL, experience with cloud data platforms, and a proven SDLC consulting background....Platform
Spaulding Ridge
New York, NY2 days ago - ...with at least 5+ years in a Technical Architect, Lead Data Architect, or Principal Data Engineer... ...data quality, data governance, or data platform architecture. Exceptional hands-on proficiency... ..., Step Functions, S3), Azure (e.g., Databricks, Synapse Analytics, Data Lake Storage)...PlatformDatabricksPermanent employmentContract workLocal area
Quantum Technologies USA
New York, NY2 days ago - ...Data ArchitectWe are seeking an experienced Data Architect to lead the design and implementation of our enterprise data architecture... ...warehouse in Google Cloud Platform (GCP). You will play a pivotal... ...g., Tableau, Looker, AtScale, Databricks) to support self-service and...PlatformDatabricksFull timePart timeImmediate start
American Eagle Outfitters
New York, NY3 days ago - ...companies build teams. We're looking for a Data Architect to join one of our client teams in... ...to use them Experience with cloud data platforms (Snowflake, Redshift, BigQuery, or similar... ...ELT processes and data pipeline tools (Databricks, etc.) Nice to have Knowledge of real...PlatformDatabricksFull time
- ...** I am partnered with a global, data-driven organization to hire an experienced Data Architect to lead the design and delivery of scalable, secure... ...with at least one modern cloud data platform: Snowflake, Databricks, BigQuery, or Redshift ~ Experience with...PlatformDatabricksFull time
Next Ventures
New York, NYmore than 2 months ago $108k - $125k
...Data Architect Job Locations: US-MA-Watertown | US-GA-Atlanta | US-DC-... ...strategy. In this role, you will lead the design and... ...data warehouses, and analytics platforms. Architect end-to-end data solutions... ...data platforms such as Databricks is a plus. Highly organized,...PlatformDatabricksFull timeWork at officeFlexible hoursVanasse Hangen Brustlin , Inc.
New York, NY2 days ago$148.3k - $198.8k
...Lead Data ArchitectAt Disney, we're storytellers. We make the impossible, possible. The Walt... ...excellence.The Data Solutions & Platforms group is part of Enterprise Technology &... ...across The Walt Disney Company.The Data Architect position is one of the key roles on the...PlatformWalt Disney Company
New York, NY3 days ago- ...Business Consulting -Solution Architect The vision of the Data &Analytics team is to help... ...data products, analytics platforms and data servicesTranslate... ...in the industry.Lead workshops, requirements gathering... ...Google, Microsoft, Snowflake, Databricks. ., Managed Lakehouse...PlatformDatabricksFull timeTemporary workWork experience placementLocal area
$180k - $247.5k
A leading data and AI firm is seeking a Delivery Solutions Architect to collaborate with sales and engineering teams. This role involves engaging with customers to drive the adoption of the Databricks platform, ensuring customer success through effective technical management...PlatformDatabricks- ...Databricks is seeking a Solutions Architect to drive adoption of the Databricks Unified Analytics Platform across customer environments. You will lead architectural discussions, develop reference architectures... ...Lake, and MLflow enable data-driven decisions on public cloud...PlatformDatabricks
Databricks Inc.
New York, NY8 hours ago - ...preferred. Key Skills - Databricks, Python, LLM, AgenticAI (... ...for batch and streaming data. Define and enforce data... ...security, and compliance. Lead data strategy initiatives... ...and regulatory frameworks. Architect big data solutions across platforms like Azure Synapse, Snowflake...PlatformDatabricksFull timeContract workLocal area
- ...iLink Digital is seeking a Databricks Architect (Lead Data Platform Architect) in New York, NY to design, build, and scale enterprise-grade Lakehouse data platforms. You will lead architecture strategy, platform standardization, and modernization initiatives leveraging...PlatformDatabricks
iLink Digital
New York, NY8 hours ago - ...Job Summary Looking for data architect (onsite) , who will lead and involve in designs and maintains the... ...Selecting appropriate storage and cloud platforms (e.g. Snowflake, AWS, Azure, Big... ...and managing data analytics using Databricks in insurance domain. Proven...PlatformDatabricks
Mphasis
New York, NY8 hours ago - Databricks is seeking Solutions Architects who will lead customer engagements, translate business needs into scalable data architectures, and guide implementation using our platform. You will collaborate with sales, product, post-sales teams, and partners to deliver meaningful...PlatformDatabricks
- ...iLink Digital seeks a Databricks Architect to design, build, and scale enterprise Lakehouse data platforms in a leading data-driven environment. You will drive architecture strategy, define standards, and mentor cross-functional teams across cloud platforms to deliver...PlatformDatabricks
iLink Digital
New York, NY8 hours ago - ...experienced application Engineer and Data Architect to join our dynamic Credit... ...and Requirements Lead architecture/technical design... ...engineering patterns, primarily in Databricks Build and maintain... ...applications Ensure platform reliability, observability,...PlatformDatabricksContract workWork experience placementLocal area
Vaiticka Solution
New York, NY16 hours ago - ...Title: Enterprise Data Architect- In person interview - One day per week... ...quality expectations. Platform and Technology Collaboration... ...such as Snowflake, Databricks, MongoDB and big data on cloud... ...self, resolve ambiguity and lead teams without authority. Industry...PlatformDatabricksLong term contract1 day per week
Openkyber
New York, NY4 days ago - Databricks is seeking a Solutions Architect on the East Coast to lead pre-sales engagements for our Data Intelligence Platform. You will partner with sales to articulate business value, design distributed data solutions, and guide customers through architecture and implementation...PlatformDatabricks
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Architect (Lead Data Platform Architect). Be the first to apply!
Related searches
- database designer New York, NY
- senior data architect New York, NY
- big data architect New York, NY
- data architect New York, NY
- sr data modeler New York, NY
- hadoop big data architect New York, NY
- data center architect New York, NY
- remote data architect New York, NY
- senior data modeler New York, NY
- data integration architect New York, NY