Azure Databricks Lead: Lakehouse & Spark Architect
HCLTech
HCLTech in New York is seeking an Azure Databricks Technical Lead to design, build, and optimize scalable data engineering solutions in a hybrid, enterprise environment. You will leverage Azure Databricks, ADF and ADLS Gen2 to deliver cloud-native data lakehouse architectures and enable data-driven decisions. The role emphasizes strong Python expertise, PySpark, Spark SQL, and Delta Lake, plus collaboration with stakeholders and architects to drive performance and governance across large #J-18808-Ljbffr HCLTech
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Azure Databricks Lead: Lakehouse & Spark Architect in New York, NY vacancy
$201.68k - $322.69k
...believe that belonging leads to better outcomes... ...as a Lead Data Architect at Capital Group.”... ...not limited to Databricks, Dremio, Snowflake... ...Expertise in Python, Spark, and the... ...via AWS Bedrock, Azure OpenAI, or Mosaic... ...stream processing, Lakehouse, service-based/APIs...DatabricksFull timeTemporary workLocal areaFlexible hours$201.68k - $322.69k
...believe that belonging leads to better outcomes and... ...as a Lead Data Architect at Capital Group.”As a... ...cloud data platforms and lakehouse architectures, including... ...technologies such as Databricks, Snowflake, Dremio, and... ...background, including Python, Spark, distributed data...DatabricksFull timeTemporary workLocal areaFlexible hoursCapital Group
New York, NY2 days ago$215k - $275k
...enterprise scale. As an AI/ML Architect, you’ll design and... ...across AWS, Azure, and Google Cloud. You... ...decision-support use cases.* Lead enterprise adoption of... ...AI ecosystems such as Databricks, Snowflake, Spark, Kafka, dbt, vector databases, lakehouse architectures, and...DatabricksTemporary workLocal area- ...Lead Applied Scientist New York, NY - hybrid 3 days onsite... ...leader PYTHON, panda, Azure, databricks, computer engineering... ...to ensure data pipelines and Lakehouse structures support AI delivery... ...tracking and model management, and Spark-based data processing....DatabricksFull timeWork at officeLocal area3 days per week
Veterans Sourcing Group, LLC
New York, NY4 days ago $215.2k - $244.7k
...Monroe is seeking a Senior Architect to join our thriving... ...selection advice for Databricks, Snowflake, and/or... ...modern toolsets such as Spark on Scala, Storm, Flume... ...scalable data pipelines and lakehouse environmentsGuide and... ...and services such as Azure OpenAI, OpenAI APIs,...DatabricksLocal areaImmediate startFlexible hours- Databricks Senior Architect As a Databricks Senior Architect, you will lead the architecture and technical delivery of... ...production on the Databricks Lakehouse. While this role is... ...standards for Azure and Databricks. Stakeholder... ...such as Apache Spark™, Hadoop, or Cassandra...DatabricksRemote work
- SMBC seeks a Senior Databricks Engineer with deep AWS expertise to build and maintain enterprise data Lakehouse infrastructure. You will design high-performance data pipelines, implement regulatory and real-time reporting, and ensure seamless Databricks-AWS integration...Databricks
$110.84k - $145k
...reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build... ...Onsite Hybrid Your Role • Design enterprise-scale Lakehouse architectures using Databricks. • Define target-state data platform architectures and...DatabricksFull timeLocal area- Azure Data Engineer With Databricks ExpertiseLocation: Iselin NJ, 6th Avenue NY (100% Day 1 onsite)Must have... ...Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta... ...Services.Solid understanding of Spark and PySpark for big data processing....Databricks
- ...AI/ML Architect Location: New York or Texas – Onsite... ...seasoned AI/ML Architect to lead the design, development... ...SageMaker, Vertex AI, Databricks). Provide leadership... ...background in Python, Spark, and SQL. ~ Expertise... ...experience (AWS/GCP/Azure). ~ Hands-on with MLOps...DatabricksContract work
Argyle Infotech
New York, NY4 days ago $190k
...and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along... ...scale.What You'll DoLead AI Tech Architects at BCG Platinion are:Collaborative... ...e.g. Data Lake, Data Warehouse, Lakehouse, etc.).Data analytics, AI and...Work at officeLocal area- ...technical relationship between Databricks Product/Engineering and Microsoft Azure. You will be the primary... ...patterns, working with Solution Architects and Customer Success to accelerate... ...by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn...DatabricksWorldwide
$215.2k - $244.7k
...West Monroe is seeking a Senior Architect to join our thriving... ...and roadmaps with emphasis on Databricks, while gaining exposure to a... ...using modern toolsets such as Spark on Scala, Storm, Flume, SqoopDesign... ...frameworks such as OpenAI, Azure OpenAI, LangChain, Semantic Kernel...DatabricksLocal areaImmediate startFlexible hours2 days per week1 day per week- ...Confiz is seeking a Databricks Architect in New York, NY to lead the data-layer design and delivery for enterprise... ...expertise with the Databricks Lakehouse platform: Delta Lake, Unity Catalog... ...at least one major cloud platform (Azure, AWS, or GCP), including networking...Databricks
Confiz
New York, NY7 hours ago - ...Microsoft Fabric and Databricks, with a strong emphasis on lakehouse architecture,... ...BI) and Databricks (Spark, Delta Lake, SQL Warehouses... ...project managers, architects, and fellow... ...cloud data platforms (Azure preferred) Ability... .... Collectiv is the leading boutique consulting...DatabricksRemote work
- Synechron Inc - Sr. Datawarehouse Architect for New York City, NY We are... ...Data Warehouse Architect to lead the design and implementation... ...possess strong expertise in Azure Databricks, Python, and have a deep... ...big data technologies such as Spark. Deep domain knowledge of the...Databricks
- About the job Databricks Architect Role: Databricks Architect Location: Remote... ...Databricks on cloud (AWS, Azure, etc.) Experienced in implementing... ...and API Integration: Utilize Spark Structured Streaming for real... ...data outputs with REST APIs Lead Data Engineering Projects to...DatabricksRemote work
- Databricks Architect Location: Remote but 1 or 2 times per month office visit is fine Duration: Long term... ...Must Have Technical/Functional Skills: Azure Delta Lake & Unity Catalog Databricks Workflows Databricks SQL Apache Spark PySpark SQL Python Data Modeling ETL/ELT...DatabricksWork at officeLocal areaRemote work
$149k - $190k
...play a key role in architecting our modern data... ...strong experience in Databricks, distributed data... ...with the ability to lead large data... ...Databricks using Spark and Delta Lake.... ...data stacks (AWS, Azure, or GCP) Experience... ...Familiarity with lakehouse architectures and...DatabricksFull timeWork at officeRemote workSocotec
New York, NY19 days ago$180k - $190k
...certification year after year. Databricks Architect Experience 12-15 years of... ...a Data & AI Architect to lead the design and implementation... ...warehousing, data lakes, lakehouse architectures, data modeling... ...Delta Lake, Unity Catalog, Spark, Workflows, ML/AI capabilities...Databricks$158k - $217k
Partner Solution Lead, Databricks - East RegionWho You’ll Work WithSlalom... ...industry leaders, solution architects, and Databricks partner teams... ...solutions across data engineering, lakehouse architecture, data... ...Knowledge: Experience with AWS, Azure, or GCP data services,...DatabricksTemporary workLocal area$60 - $65 per hour
...patterns. Proficiency in PySpark, Spark SQL, and SQL. Experience with Azure Databricks, Azure Data Factory, and ADLS... ...Apache Spark, Delta Lake, Data Lakehouse architecture, and distributed... ...metro area, Cynet Systems Inc. is a leading technology staffing and...DatabricksTemporary workLocal areaCYNET SYSTEMS
New York, NY4 days ago- Azure Cloud Architect With AI/ML The Cloud Architect will be a key contributor to designing,... ...evaluate emerging approaches, and lead strategic pilots or proofs-of-concept... ...distributed computing approaches (Spark, Map Reduce, DataBricks) Proven track record of successfully...Databricks
$190k
...pragmatic path to change transforming strategies into leading-edge tech platforms, at scale.What You'll DoLead AI Tech Architects - AI Platforms at BCG Platinion are:... ..., with depth in at least one hyperscaler (AWS, Azure, or GCP).Experience of deploying AI solutions on...Work at officeLocal area$105k - $161.6k
...Security, Data & Analytics, and Infrastructure. MetLife is seeking a Lead Architect to enable AI-powered development platforms for Citizen... ...APIs, API security protocols, etc., with preferred experience in Azure.Experience working in large enterprise environments,...Full timeTemporary workWork at officeLocal areaWorldwideRelocation package3 days per week$141.2k - $278.3k
Position Summary Lead Architect with Agentic AI Experience, AI & Engineering/Engineering as a ServiceAgentic AI is moving from experimentation... ...using Cloud Native principles on a hyperscaler platform (AWS, Azure, GCP). Leverage a wide range of hyperscaler tools and services...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work- ...differentiate and scale business growth.You Are:The Integration Lead Architect playing a pivotal role in ensuring that diverse software... ...with cloud architecture and integration patterns across AWS or Azure, including containerized and Kubernetes-based deployment models...Full timeWork experience placementLive inWork at officeLocal area
$180k - $250k
...Portfolio Growth & GTM Lead (Financial Services)... ...with client Enterprise Architects, Principal Engineers,... ...partners ( AWS/GCP and Databricks ), collaborate with internal... ...expanding an initial lakehouse pilot into enterprise... ...architectures, Spark optimization, structured...DatabricksFull timeContract workLocal area- ...growing data management practice, the remote Azure Data Engineer will design, develop, and... .../ELT pipelines using Azure Data Factory, Databricks, and Snowflake Implement data quality... ...migration Experience with Python, SQL, and Spark for data transformation and orchestration...DatabricksRemote work
$125k - $130k
...technology to deliver industry-leading digital solutions. Synechron’... ...and implementation of Databricks-based data platforms. Design... ...data pipelines using Apache Spark, Delta Lake, and Structured Streaming... ...one major cloud platform: Azure, AWS, or Google Cloud. Strong...DatabricksTemporary workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks Lead: Lakehouse & Spark Architect. Be the first to apply!
