Databricks Data Architect (AWS)

Lorven Technologies Inc

Role: Senior Databricks Data Architect (AWS)

Location: Ridgefield Park, New Jersey 07660

12 Contract onsite position - This role requires 100% onsite presence Monday through Friday and will cover core business hours based on the EST timezone.

JOB DESCRIPTION

JOB TITLE: Senior Databricks Data Architect (AWS) - Hands-On Technical Lead

PURPOSE OF THE JOB:

Lead the strategic design and architectural roadmap of the Enterprise Data Platform on Databricks/AWS while remaining actively hands-on in design, prototyping, coding, and performance tuning.
To provide high-level technical consultancy and solution design to internal business stakeholders and external partners, acting as the bridge between complex business requirements and technical implementation.
To govern the technical quality of the platform by establishing design standards, conducting code reviews, and guiding the engineering team on best practices for Databricks Serverless and AWS integration.
As part of the role, you will be required to provide technical assurance for all major data initiatives, ensuring that solutions are robust, cost-effective, and compliant with enterprise security standards.

KEY ACCOUNTABILITIES:

Lead all architecture design and review sessions for strategic Databricks initiatives.
Actively contribute code to critical architectural components, building complex frameworks, reusable libraries, and core ETL/ELT pipelines using Python and PySpark.
Lead by example by prototyping Proof of Concepts (PoCs) for new features (e.g., Databricks Asset Bundles, Delta Live Tables) before handing them off for wider team implementation.
Perform hands-on performance tuning and debugging of high-latency jobs by deep-diving into Spark UI, execution plans, and spill logs.
Defining and enforcing coding standards, data modeling best practices (Medallion Architecture), and CI/CD protocols for the development team to follow.
conducting deep-dive technical reviews of designs and code produced by the engineering team to ensure efficiency, maintainability, and security.
Designing the strategy for Unity Catalog governance, ensuring granular data access controls and compliance with data privacy regulations.
Acting as the Technical Design Authority for the Databricks platform, making high-level decisions regarding the adoption of new Serverless features and AWS services.
Mentoring and coaching Senior and Junior engineers, fostering a culture of technical excellence and continuous improvement.
Own the technical relationship with key business stakeholders and translate business strategy into robust data architecture
Engage and collaborate with Executive Stakeholders to present technical roadmaps and demonstrate the business value of data initiatives.
Actively seeks opportunities to develop knowledge in emerging technologies (e.g., Generative AI on Databricks, Vector Databases) and evaluate their impact on the business.
Provide guidance to the Change Management board regarding the risk and technical impact of proposed architectural changes.
Develop strategies to architect resilience, high availability, and disaster recovery into the data platform.
Develop clear communication channels with C-level executives and Product Managers to ensure technical strategies align with business goals.

KEY LIAISONS:

Head of Data & Analytics / CIO
Business Unit Directors & Product Managers
Lead Data Engineers and Data Scientists
Enterprise Security & Infrastructure Architects

DIMENSIONS:

Ownership of the Technical Roadmap and Architecture for the Data Estate
Maintain excellent relationships with all key liaisons
Responsible for architectural decisions impacting critical data assets
Primary Technical Advisor in the CST timezone

EDUCATION:

Educated to degree level in Computer Science, Engineering, or equivalent (Master's degree preferred)

SKILLS AND ATTRIBUTES:

Essential -

Exceptional "Customer Facing" skills: proven ability to lead workshops, manage stakeholder expectations, and present complex technical solutions to non-technical audiences.
Minimum 8-10 years' experience in Data Engineering/Architecture, with at least 4 years specialized in Databricks and AWS .
Expert-level knowledge of Data Lakehouse Architecture, Delta Lake internals, and Spark optimization strategies.
Proven experience in Data Modeling (Dimensional, Vault, Relational) and designing complex ETL/ELT pipelines.
Advanced hands-on coding proficiency in Python and SQL, with the ability to write clean, production-ready, and testable code.
Strong experience with Databricks Serverless architecture, Unity Catalog implementation, and security patterns.
Deep understanding of Cloud Architecture (AWS Well-Architected Framework), including networking, storage (S3), and IAM.
Experience in Design Review and Code Review processes, capable of constructive critique and enforcing standards.
Detailed knowledge of DevOps principles (IaC with Terraform, CI/CD pipelines).
Knowledge of the MS Office suite (Word, Excel, PowerPoint, Outlook) - specifically for creating architectural diagrams and presentations.
Very strong relationship building and influencing skills at a senior level.
Strategic thinking with the ability to balance immediate business needs with long-term architectural vision.

EXPERIENCE:

Essential -

8+ years of experience in Data Architecture and Engineering.
Extensive experience designing solutions on the Databricks platform.

Advantage -

Strong experience working with large-scale enterprises or as a Consultant for big agencies.
Certified Databricks Data Architect or AWS Solutions Architect (Professional).
Excellent organizational and planning skills, with an ability to manage architectural backlogs.
A best-in-class technical leader proactively driving business innovation and process improvements.
Languages: Python, SQL, Scala.
Experience designing APIs for data consumption.
Experience with Enterprise Architecture frameworks (TOGAF).

Apply

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Databricks Data Architect (AWS) in Ridgefield Park, NJ vacancy

AI & Data Lakehouse Architect
...machine learning models using Python, PySpark, and Databricks. The role includes architecting scalable ETL pipelines and integrating solutions with AWS services. You will collaborate with business leaders to drive data-informed initiatives while ensuring robust data availability...
Databricks
Amazon Web Service
AROHA TECHNOLOGIES
New York, NY
20 hours ago
Remote Big Data Architect: Spark, Databricks & AWS
$150k - $200k
...A global consulting and technology services organization is looking for a Big Data / Spark Principal Architect to lead the design and implementation of large-scale data systems. This role requires deep expertise in Spark and consulting within the Media & Entertainment...
Databricks
Amazon Web Service
Full time
Remote work
Mogi I/O : OTT/Podcast/Short Video Apps for you
New York, NY
20 hours ago
Data Architect
...Data Architect Location: NY/NJ Duration: 11 Months Remarks: Years' of experience: 12-15 Skills... ...experience data integration services, databricks or snowflake Should have worked on diagrams... ...architectures across cloud platforms (AWS, Databricks, Snowflake). Collaborate...
Databricks
Amazon Web Service
Contract work
InterSources
Passaic, NJ
2 days ago
Enterprise Data Architect
...greenfield opportunity to take an existing Databricks proof of concept and turn it into a scalable, production-grade data lakehouse powering analytics and AI... ...projects What You'll Do Architect and build Databricks on AWS Design a modern lakehouse architecture...
Databricks
Amazon Web Service
Harnham
New York, NY
4 days ago
Senior Data Architect
...Role:- Senior Data Architect Location:- Manhattan, NY (Hybrid) Technical Skills & Requirements: Advanced... ...Proven delivery across modern data technology stacks-Databricks, Snowflake, Spark, AWS/Azure/GCP data services, streaming/data integration platforms...
Databricks
Amazon Web Service
United IT Solutions
New York, NY
2 days ago
Principal Data Architect
...Role: Principal Data Architect Location: Flexible / Hybrid (NY/NJ) Full Time... ...cloud data platforms across hyperscaler's (AWS, Azure, Google Cloud). Design and... ...leveraging technologies such as Snowflake and Databricks. Define data ingestion,...
Databricks
Amazon Web Service
Full time
Flexible hours
Inficare
Jersey City, NJ
3 days ago
Data Architect
...Pencils, we harness the power of data to help our clients achieve... .... We’re seeking a Senior Data Architect/Strategist who blends advanced... ...architectures. Strong experience in AWS tools and infrastructure and... ...Experience with tools such as Databricks, SageMaker, and Snowflake is...
Databricks
Amazon Web Service
Robots and Pencils
New York, NY
20 hours ago
Enterprise Data Architect
...Enterprise Data Architect Location: Primary - NJ/NYC Secondary - Dallas/Charlotte/Atlanta... ...cloud architecture expertise (Azure, AWS, GCP) across large project with minimum... ...across different data platform such as Databricks, Snowflake, Talend, dbt, Data Virtualization...
Databricks
Amazon Web Service
Full time
SARIAN Co
Jersey City, NJ
3 days ago
Data Architect
...Insurance Domain, ETL, Python , PySpark , AWS Experience : 15+ years PCR ID : 11... ...-1 Job Summary : Looking for data architect (onsite) , who will lead involves in... ...implementing, and managing data analytics using Databricks in insurance domain. • Proven...
Databricks
Amazon Web Service
Diverse Lynx
New York, NY
20 hours ago
Principal Data / AI Architect
...Brightside is seeking a Principal Architect, Data & AI Platforms, to own and evolve the technical foundations that power... ...requirements Strong in modern cloud architectures (e.g., AWS) and modern data stacks (e.g., Databricks) Ability to connect technical decisions to business...
Databricks
Amazon Web Service
Brightside
New York, NY
20 hours ago
Senior Data Architect: Health Data Platform Lead
$160k - $165k
A leading health information provider is seeking a Data Architect to design a unified data layer for health services. This... ...of experience, expertise in cloud platforms like AWS and data technologies such as Databricks and Snowflake. Key responsibilities include architecting...
Databricks
Amazon Web Service
WebMD LLC
Newark, NJ
3 days ago
Data Solution Architect
...Role - Senior Solution Architect (Data & AI Solution Specialist) Location - NJ/NYC / Dallas/Charlotte/Atlanta/Raleigh... ...engineering, and analytics platforms • Experience across AWS, GCP, Azure, Snowflake, Databricks, Iceberg, dbt and Open source tech based data...
Databricks
Amazon Web Service
Full time
Envision Technology Solutions
New York, NY
1 day ago
Data Architect
...areas of expertise are UX, CMS, CRM, Commerce, Azure and AWS. We are a team of highly dedicated individuals,... ...years experience with MS SQL/NoSQL 3+ years with Azure Data Factory/AWS/GCP 5+ years with Databricks or Snowflake or Redshift Experience designing/building...
Databricks
Amazon Web Service
Full time
Remote work
Flexible hours
XCentium
New York, NY
20 hours ago
Senior Data Architect
...Job Title: Senior Data Architect Location: NYC, NY (3 days onsite, Hybrid) About the... ...data engineering patterns, primarily in Databricks. Build and maintain data ingestion... ...experience as an application developer. ~ AWS Certified Cloud Practitioner (or an...
Databricks
Amazon Web Service
Work experience placement
Jobs via Dice
New York, NY
3 days ago
Data and AI Architect | Onsite | New York
$100k - $300k
...Data And Ai Architect (Lead/Manager Level) We are seeking a Data and AI Architect with a proven track record in designing and... ...platforms and AI solutions using cloud technologies (AWS, Azure, GCP), Databricks, and Snowflake. The ideal candidate will combine technical...
Databricks
Amazon Web Service
Full time
Photon
New York, NY
4 days ago
Data Architect
...design their future state AI enabled Data Architecture. Day to day: 1.... ...with strong hands-on understanding of Databricks and medallion design • Strong experience... ...working knowledge of Databricks and AWS, with the ability to architect and execute within already-selected...
Databricks
Amazon Web Service
Contract work
Immediate start
Insight Global
New York, NY
1 day ago
Principal Data Architect
...of a global organization. As the Principal Data Architect, you will define and drive the technical vision... ...expertise in cloud environments such as AWS, GCP, or Azure, and modern data platforms such as Snowflake, Databricks, or BigQuery. Solid understanding of data modeling...
Databricks
Amazon Web Service
Remote work
Flexible hours
HostPapa
New York, NY
20 hours ago
Staff Data Architect
...Staff Data Architect At Komodo Health, our mission is to reduce the global burden of disease... ...Snowflake for scalable data warehousing, and Databricks for advanced analytics and machine... ...familiarity with Snowflake integrations in AWS/Azure/GCP environments and with tools...
Databricks
Amazon Web Service
Komodo Health
New York, NY
1 day ago
Manufacturing Data Solutions Architect (Resident)
...company in New York, NY is seeking a Resident Solutions Architect to work on customer data projects using the Databricks platform. This role involves handling impactful... ...and have expertise in cloud environments such as AWS, Azure, or GCP. Competitive pay and benefits are...
Databricks
Amazon Web Service
Menlo Ventures
New York, NY
4 days ago
Data Architect
$85k - $130k
...their schools. Summary Of The Role The Data Architect will play a crucial role in managing an... ...Anywhere within the US Responsibilities Databricks Platform Administration Manage groups, users... ...operate. Maintain platform-supporting AWS services, including IAM, S3, and VPC, as...
Databricks
Amazon Web Service
Permanent employment
Remote work
Worldwide
Finalsite
New York, NY
20 hours ago
SAP Cloud Data Solutions Architect
...SAP Cloud Data Solutions Architect with SAP BW - SAP Datasphere migration experience and a strong background... ...to hands-on technical expertise with AWS, Azure, or GCP, proficiency in SAP BW... ...modern cloud data platforms such as Databricks, Snowflake, BigQuery, Synapse, and...
Databricks
Amazon Web Service
Full time
Remote work
Bison Global Technology Search
New York, NY
20 hours ago
Data Engineering Solutions Architect
$150k - $220k
...Join the fastest growing Data engineering solutions company! This Jobot Job is hosted by: Adam Bennett Are you... ...a must. This includes the following: 1. Snowflake or Databricks engineering 2. Deep understanding of AWS or Azure or GCP 3. Code bases written in Python, Scala...
Databricks
Amazon Web Service
Local area
Visa sponsorship
Jobot
New York, NY
2 days ago
AI & Data Architect
$200k - $220k
...AI & Data Architect The AI & Data Architect sits within Carlyle's Enterprise Technology & Data... ..., Apache Iceberg, Snowflake, and Databricks, alongside MLOps/LLMOps platforms, AI gateways... ...platforms and tooling categories (e.g., AWS Bedrock, Databricks ML, Snowflake Cortex...
Databricks
Amazon Web Service
Work at office
Carlyle Group
New York, NY
4 days ago
Corporate Vice President - Data Architect
$147.5k - $211k
...seeking an energetic and passionate Senior Data Architect to design and execute our company's... ...solutions using cutting-edge technologies like AWS, APIs, and AI. What You'll Do:... ...platform technologies such as Data Lake, Databricks, Snowflake ~ Experience with database...
Databricks
Amazon Web Service
Local area
3 days per week
New York Life
New York, NY
1 day ago
Senior Data Architect
...and truly enjoy the ride. About the role As the Senior Data Architect , you'll be part of the center data function and will... ...modeling techniques, as well as cloud platforms (GCP, AWS, Azure) and tools like Databricks, BigQuery, Redshift, or Snowflake. Know how to build data...
Databricks
Amazon Web Service
Contract work
Work at office
Remote work
Flexible hours
Afternoon shift
SwingDev–a hippo company
New York, NY
20 hours ago
Principal Data Architect
$160k - $200k
...We are seeking an experienced Principal Data Architect to join our Data & AI team. In this leadership... ...working with cloud platforms (AWS, Azure, or GCP) and cloud-native data services... ...data platforms such as Snowflake, Databricks, or similar analytics environments. ~...
Databricks
Amazon Web Service
Work experience placement
Local area
Remote work
Work from home
Flexible hours
Method, a GlobalLogic company
New York, NY
20 hours ago
Sr. Data Architect
$160k - $165k
...About the Role Internet Brands is seeking a Data Architect to design and implement a unified common... ...warehouse/lakehouse solutions (e.g., Databricks, Snowflake, Redshift, BigQuery).... ...on experience with cloud data platforms (AWS, Azure, or GCP) and related services....
Databricks
Amazon Web Service
Full time
Part time
Flexible hours
WebMD
Newark, NJ
1 day ago
Cloud Data Architect
...Job Description Cloud Data Architect Must Have Technical/Functional Skills... ...Architect, Snowflake, demonstrate hands-On on Databricks (Delta Lake, Unity Catalogue), Snowflake... ...cloud architecture expertise (Azure, AWS, GCP) across large project with minimum...
Databricks
Amazon Web Service
ClifyX
New York, NY
4 days ago
Lead Data Architect, Consumer Card Technology
...Lead Data Architect Join a diverse team of visionaries dedicated to making a lasting impact... ...using Kafka, Flink, Apache Iceberg. AWS certification including Database Storage... ...Services Experience with Snowflake and Databricks is a plus Chase is a leading financial...
Databricks
Amazon Web Service
Chase
Jersey City, NJ
4 days ago
Data & AI Solutions Architect
...are looking for an AI Solutions Architect to join our team and help our... ...creating AI solutions using Databricks (certification is a plus); Experience... ...SQL; Proficiency in diverse data storage systems, including... ...experience) and knowledge of AWS; Understanding of neural network...
Databricks
Amazon Web Service
Contract work
Local area
Immediate start
Remote work
Sphere Software
New York, NY
20 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Databricks Data Architect (AWS). Be the first to apply!