Azure Databricks Lead: Lakehouse & Spark Architect
HCLTech
HCLTech in New York is seeking an Azure Databricks Technical Lead to design, build, and optimize scalable data engineering solutions in a hybrid, enterprise environment. You will leverage Azure Databricks, ADF and ADLS Gen2 to deliver cloud-native data lakehouse architectures and enable data-driven decisions. The role emphasizes strong Python expertise, PySpark, Spark SQL, and Delta Lake, plus collaboration with stakeholders and architects to drive performance and governance across large #J-18808-Ljbffr HCLTech
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Azure Databricks Lead: Lakehouse & Spark Architect in New York, NY vacancy
- iLink Digital seeks a Databricks Architect to design, build, and scale enterprise Lakehouse data platforms in a leading data-driven environment. You will drive architecture strategy... ...the deployment and optimization across Azure, AWS, and GCP Databricks, shaping data governance...Databricks
$201.68k - $322.69k
...believe that belonging leads to better outcomes... ...as a Lead Data Architect at Capital Group.”... ...not limited to Databricks, Dremio, Snowflake... ...Expertise in Python, Spark, and the... ...via AWS Bedrock, Azure OpenAI, or Mosaic... ...stream processing, Lakehouse, service-based/APIs...DatabricksFull timeTemporary workLocal areaFlexible hours- A leading software staffing company is seeking a Databricks Architect to support a client in Detroit. This role involves designing and implementing cloud solutions... ...teams. The ideal candidate has experience building Lakehouse solutions and knowledge of cloud security best...Databricks
- Databricks Architect (Lead Data Platform Architect) New York, United States | Posted... ...and scale enterprise-grade Lakehouse data platforms . This role... ...brings deep expertise in Spark, Delta Lake, and cloud-native... ...and optimization of: Azure Databricks / AWS Databricks...Databricks
$201.68k - $322.69k
...believe that belonging leads to better outcomes and... ...as a Lead Data Architect at Capital Group.” As... ...cloud data platforms and lakehouse architectures, including... ...technologies such as Databricks, Snowflake, Dremio, and... ...background, including Python, Spark, distributed data...DatabricksTemporary workLocal areaFlexible hoursCapital Group
New York, NY15 hours ago$215k - $275k
...enterprise scale. As an AI/ML Architect, you’ll design and... ...across AWS, Azure, and Google Cloud. You... ...decision-support use cases.* Lead enterprise adoption of... ...AI ecosystems such as Databricks, Snowflake, Spark, Kafka, dbt, vector databases, lakehouse architectures, and...DatabricksTemporary workLocal area$151k - $253k
...Fabric - L55 - Fabric Architect/Engineer Join our... ...You’ll Do As a Lead Data Engineer II on... ...— spanning Lakehouse, Warehouse, and OneLake... ...pipeline work using Spark Notebooks,... ...practices (e.g., Azure DevOps, GitHub) 4+... ...: Experience with Databricks, Snowflake, Google...DatabricksLocal areaVisa sponsorshipFlexible hours- ...The role requires 2-4 years of hands-on experience with Azure, Databricks, Python, Spark, and SQL to build scalable data pipelines and analytics... ...solutions. You will collaborate with senior engineers, data architects, and client stakeholders, developing ETL/ELT workflows,...Databricks
- ...experience Experience architecting and securing API... ...an experienced Databricks Architect to help... ...Databricks Architect will lead the design of... ...capabilities, Spark, notebooks, workflows... ...platforms: AWS, Azure, or Google Cloud Platform... ...Experience with Lakehouse architecture and...DatabricksLocal area
$215.2k - $244.7k
...Monroe is seeking a Senior Architect to join our thriving... ...selection advice for Databricks, Snowflake, and/or... ...modern toolsets such as Spark on Scala, Storm, Flume... ...scalable data pipelines and lakehouse environmentsGuide and... ...and services such as Azure OpenAI, OpenAI APIs,...DatabricksLocal areaImmediate startFlexible hours- SMBC seeks a Senior Databricks Engineer with deep AWS expertise to build and maintain enterprise data Lakehouse infrastructure. You will design high-performance data pipelines, implement regulatory and real-time reporting, and ensure seamless Databricks-AWS integration...Databricks
- ...Azure Data lead - Python, Pyspark, Databricks, ADF, Data Lake, Azure Senior Data Lead Leads modernization... ...applications into scalable PySpark and Spark SQL data-processing solutions on... ...2 Apache Spark, Delta Lake, Data Lakehouse architecture, distributed...Databricks
VDart Inc
New York, NY3 days ago - ...technical relationship between Databricks Product/Engineering and Microsoft Azure. You will be the primary... ...patterns, working with Solution Architects and Customer Success to accelerate... ...by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn...DatabricksWorldwide
$190k
...and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along... ...scale.What You'll DoLead AI Tech Architects at BCG Platinion are:Collaborative... ...e.g. Data Lake, Data Warehouse, Lakehouse, etc.).Data analytics, AI and...Work at officeLocal area$215.2k - $244.7k
...West Monroe is seeking a Senior Architect to join our thriving... ...and roadmaps with emphasis on Databricks, while gaining exposure to a... ...using modern toolsets such as Spark on Scala, Storm, Flume, SqoopDesign... ...frameworks such as OpenAI, Azure OpenAI, LangChain, Semantic Kernel...DatabricksLocal areaImmediate startFlexible hours2 days per week1 day per week$144.2k - $288.4k
...Summary The Distributed Systems Architect is responsible for defining,... ...and integration standards. Lead distributed systems and big‑... ...and analytics using Apache Spark, Databricks, and Apache Kafka. Define... ...across multi‑cloud environments (Azure, GCP, AWS). Provide hands‑on...DatabricksFull timeTemporary workLocal areaCVS Health
New York, NY1 day ago- Synechron Inc - Sr. Datawarehouse Architect for New York City, NY We are... ...Data Warehouse Architect to lead the design and implementation... ...possess strong expertise in Azure Databricks, Python, and have a deep... ...big data technologies such as Spark. Deep domain knowledge of the...Databricks
$149k - $190k
...play a key role in architecting our modern data... ...strong experience in Databricks, distributed data... ...with the ability to lead large data... ...Databricks using Spark and Delta Lake. Build... ...data stacks (AWS, Azure, or GCP) Experience... ...Familiarity with lakehouse architectures and...DatabricksFull timeWork at officeRemote work- ...WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole:Azure Datalake and Data WarehouseLocation: New York City (... ...tools such as Azure Data Factory (ADF), Synapse, or Databricks.Organize data storage in lakehouse or data lake formats for optimal performance and...DatabricksWork at office
- Overview Acuity is looking for an AI Architect that will lead the design, development, and... ...GovCloud environments (AWS GovCloud, Azure Government). Oversee MLOps pipelines... ...secure environments. Data platforms: Databricks, Spark, Hadoop (with secure configurations)...DatabricksContract workFor contractors
- ...their data platforms using Microsoft Azure and other cloud technologies. Our team... ...have hands‑on experience with Azure, Databricks, Python, Spark, and SQL, along with a strong... ...closely with senior engineers, data architects, and client stakeholders to build scalable...Databricks
- EXL is seeking an experienced data architecture lead to design and govern enterprise data platforms on Azure, with a focus on Databricks Lakehouse, Delta Lake, and scalable cloud-native ecosystems. The role involves defining ingestion, transformation, and serving layers...Databricks
$158k - $217k
Partner Solution Lead, Databricks - East RegionWho You’ll Work WithSlalom... ...industry leaders, solution architects, and Databricks partner teams... ...solutions across data engineering, lakehouse architecture, data... ...Knowledge: Experience with AWS, Azure, or GCP data services,...DatabricksTemporary workLocal area- Overview We are seeking an experienced Azure Databricks Architect to design and develop modern data... ...from on-premises to cloud solutions (Spark, Hadoop to Databricks). Understanding... ...About ValueMomentum ValueMomentum is a leading solutions provider for the global property...DatabricksPart time
- ...with many industry-leading organizations across... ...platforms (AWS, Azure, GCP), data architectures (lakehouse, mesh, fabric), and... ...technology solutions. Architect and govern... ..., streaming (Kafka/Spark), cloud-native architectures... ...& AI Platforms: Databricks, Snowflake, dbt LLMs...DatabricksFlexible hours
- A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools...Databricks
- ...differentiate and scale business growth.You Are:The Integration Lead Architect playing a pivotal role in ensuring that diverse software... ...with cloud architecture and integration patterns across AWS or Azure, including containerized and Kubernetes-based deployment models...Full timeWork experience placementLive inWork at officeLocal area
$190k
...pragmatic path to change transforming strategies into leading-edge tech platforms, at scale.What You'll DoLead AI Tech Architects - AI Platforms at BCG Platinion are:... ..., with depth in at least one hyperscaler (AWS, Azure, or GCP).Experience of deploying AI solutions on...Work at officeLocal area$105k - $161.6k
...Security, Data & Analytics, and Infrastructure. MetLife is seeking a Lead Architect to enable AI-powered development platforms for Citizen... ...APIs, API security protocols, etc., with preferred experience in Azure.Experience working in large enterprise environments,...Full timeTemporary workWork at officeLocal areaWorldwideRelocation package3 days per week- ...engineering effort to develop a modern Lakehouse and AI data platform that... ...frameworks such as Apache Spark.Working knowledge of common... ...within a team.Ability to lead delivery for a workstream, manage... ...: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem...Databricks
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks Lead: Lakehouse & Spark Architect. Be the first to apply!
