Lead Data Engineer - Azure Pipelines & Databricks
$175k - $200kSimpson Thacher & Bartlett LLP
Simpson Thacher & Bartlett LLP is seeking a Senior Data Engineer to design, build, and optimize enterprise-scale data pipelines. You will lead development for data solutions using Azure technologies, collaborating with cross-functional teams to modernize platforms and ensure reliable data delivery. The role requires 5-7 years of experience with Azure Data Factory, Databricks, SQL Server, and Python. A Bachelor's degree in Computer Science or a related field is essential. The position offers a competitive salary range of $175,000 to $200,000. #J-18808-Ljbffr Simpson Thacher & Bartlett LLP
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - Azure Pipelines & Databricks in New York, NY vacancy
- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience... ...develop, and maintain data pipelines and ETL workflows using... ...with cloud platforms (AWS, Azure, or GCP) and related data services... ...(e.g., S3, Snowflake, Databricks). Should be familiar...DatabricksPipelineRemote work
VBeyond
Jersey City, NJ1 day ago $156.8k - $235.2k
Paramount Pictures is seeking a Senior Lead Data Engineer in New York to build and scale data foundations for personalization systems powering... ...systems, and deep experience with tools like Spark, Kafka, Databricks, and AWS. The position offers a salary range of $156,800 - $...DatabricksPipeline- ...the newly consolidated Data and Analytics (D&A) organization... ..., data governance, data engineering, data modeling, data... ...science, and AI. The Lead Data Engineer is crucial... ...build a reusable data pipeline utilizing Big Data and Azure/Databricks for Eligibility Program...DatabricksPipeline
MetLife
New York, NY3 days ago $220k
Specialist Recruiter | Databricks Data Engineer Recruitment | Connecting Top Talent with Leading US Opportunities Job Title: Lead Data... ...Design, build, and deploy data pipelines and platforms using Databricks... ...Nice to Have Experience with Azure or GCP in addition to AWS...DatabricksPipelineFull timeRemote workFlexible hours$220k - $230k
...in digital assets and data center infrastructure,... ...senior, hands-on data engineer with 8+ years of experience... ...- and you're ready to lead. You set the technical... ...modern data stack - AWS, Databricks/Spark, dbt, and Airflow... ...and streaming data pipelines, owning them from design...DatabricksPipelineLocal areaFlexible hoursGalaxy USA
New York, NY2 days ago$220k - $230k
...Are You're a senior, hands‑on data engineer with 8+ years of experience... ...scale — and you're ready to lead. You set the technical... ...the modern data stack — AWS, Databricks/Spark, dbt, and Airflow. You... ...scalable batch and streaming data pipelines, owning them from design...DatabricksPipelineFlexible hours- ...democratize the benefits of data and AI . Since 2019,... ...and decisioning for leading brands and agencies... ...culture from the ground up. Engineers here own major surface... ...with Microsoft and Databricks Fully remote or... ...for instrumenting data pipelines - push based, pull based...DatabricksPipelineRemote workFlexible hours
$70 - $85 per hour
Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/... ...develop, and maintain scalable data pipelines using Apache Spark on Databricks. Build and manage Delta Lake... ...efficiency in cloud platforms (AWS, Azure, or GCP). Ensure data quality,...DatabricksPipelineContract workLocal areaRemote workFlexible hours$164.64k - $246.96k
...We are hiring a Senior Lead Data Engineer to build and scale the data... ...You will design and operate pipelines processing billions of daily... ...streaming pipelines (Spark, Flink, Databricks, Airflow) producing ML... ...Ecosystems: Experience with AWS/Azure/GCP and high-performance engines...DatabricksPipelineParamount
New York, NY4 days ago- A leading technology company is seeking a Data Engineer - Spark Developer to join their dynamic team. This role involves designing and developing data pipelines, utilizing Apache Spark and other Azure services. Candidates should have a strong educational background in...DatabricksPipeline
$122.21k - $180.57k
...Government Consulting is seeking an Enterprise Data Engineer to design and operate data pipelines supporting the USSOCOM mission. This role requires hands-on experience in tools such as Azure Data Factory and Databricks, along with a strong background in SQL and Python...DatabricksPipeline- ...Azure Data Engineer Location: Raleigh, NC or Weehawken NJ (5 Days Work from Office) Duration... ...Experience with building data pipelines and applications to stream and process... ...pipelines using Azure Data Factory, Azure Databricks, and other Azure services Managing...DatabricksPipelineWork at office
United Software Group
Weehawken, NJ21 hours ago $110k - $170k
Press Ganey Associates LLC is hiring a Data Engineer to design and optimize data pipelines using Azure and Databricks. Candidates should have 7+ years of experience in data engineering with a strong focus on cloud-based platforms. The role requires advanced skills in Azure...DatabricksPipeline- A leading technology firm in New York is seeking an experienced Data Engineer to manage batch processes and support data pipelines in Azure Databricks and Azure Data Factory. The ideal candidate will have over 10 years of experience in data engineering within financial...DatabricksPipeline
- ...JOB DESCRIPTION 1.Azure Platform Experience: The... ...but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI.... ...design, build, and maintain ETL pipelines, manage data lakes, and... .... 2.Azure Data Engineer: Design, implement, and maintain...DatabricksPipeline
Sparktek
New York, NY2 days ago - ...United States with deep expertise in Oracle Data Integrator (ODI) and Teradata. The ideal candidate... ...Key responsibilities include designing ETL pipelines, optimizing SQL queries, and working with Azure Data Factory and Databricks. Strong communication and teamwork skills...DatabricksPipeline
- A leading tech company in the United States is seeking an experienced SAP-Azure Data Engineer to join their team. The role focuses on designing and maintaining data pipelines using Azure Synapse and Databricks, developing business intelligence dashboards with Power BI,...DatabricksPipeline
- ...for a highly skilled Microsoft Fabric Engineer. The successful candidate will have strong expertise in Azure Data Factory, Azure Databricks, and modern data platforms. Key responsibilities... ...include designing and maintaining data pipelines, developing ADF pipelines, and...DatabricksPipeline
- ...Design and implement scalable ETL/ELT pipelines using Azure Data Factory. Build automated data... ...integrating Power BI with Azure Synapse or Databricks Experience building self-service... ...Microsoft Power BI Data Analyst (PL-300) Microsoft Azure Data Engineer (DP-203)...DatabricksPipelineRemote work
The Dignify Solutions, LLC
Jersey City, NJ21 hours ago - ...Sr Azure Data Engineer Location: New York City, NY (Local Must & Hybrid) Duration: 6+ Month... ...not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should... ...able to design, build, and maintain ETL pipelines, manage data lakes and create insightful...DatabricksPipelineContract workH1bLocal area
Damco
New York, NY4 days ago - A leading technology firm is looking for a Data Engineer to enhance cloud capabilities for federal clients. This role involves designing ETL pipelines, optimizing data workflows on Azure Databricks, and ensuring data quality across systems. The ideal candidate has over...DatabricksPipeline
$70 - $90 per hour
...Data Engineer - Azure Databricks (Corporate Data Platform) We are hiring a Data Engineer with strong Azure Databricks and Azure Data Engineering experience to build and scale enterprise data pipelines across corporate functions including Finance, Compliance, Facilities...DatabricksPipelineHourly pay3 days per weekHighbridge Consulting LLC
New York, NY4 days ago- ...candidate 10 months duration Need a strong Sr Lead Data Engineer/ Architect for clients Azure Digital Data platform Core skills - Azure... ...platform Supply Chain and distribution company databricks Azure datalake ADF Unity Catalog...DatabricksFreelanceLocal areaRemote workFlexible hours
SysMind Tech
Jersey City, NJ3 days ago - ...the architecture, engineering and construction industries... ...As a Senior Data Engineer, you will... ...experience in Databricks, distributed data... ...with the ability to lead large data initiatives... ...scalable data pipelines that ingest and transform... ...data stacks (AWS, Azure, or GCP)...DatabricksPipelineFull time
SOCOTEC
New York, NY1 day ago - ...consulting, and world-class engineering talent. We partner... ...Solution Architect – Azure AI to lead the design,... ...Platform Enterprise Data & Integration Services... ...Establish secure data pipelines, AI data ingestion... ...Microsoft Fabric Azure Databricks Azure Functions...DatabricksPipelineRelocationFlexible hours
Inabia Solutions and Consulting, Inc.
New York, NY13 days ago - ...looking for an experienced SAP-Azure Data Engineer to join our team. The ideal... ...Azure Synapse Analytics, Databricks, and other cloud-native technologies... ...maintain data engineering pipelines using Azure Synapse... ...Change Management: Ability to lead organizational change and drive...DatabricksPipelineRemote job
- A leading technology firm in New Jersey is looking for a skilled professional to design, build, and maintain scalable data solutions. This role involves leading a team to implement robust data pipelines using Azure Cloud technologies and optimizing performance for cost...Pipeline
$135k - $150k
A leading tech recruitment firm is seeking a Lead Data Engineer in New York City. This role involves managing a team, designing data pipelines, and ensuring project requirements are met. The ideal candidate... ...in SQL Server SSIS and Azure technologies. This position offers...PipelineRemote jobWork from homeFlexible hours- An AI Engineer, a strong Software Engineer transitioning... ...AI, or perhaps a Data/Automation... ...knowledge of Azure OpenAI? Proficient... ..., Copilot Studio, Databricks, and modern engineering... .... Create ML pipelines and automate lifecycle... ...is the UK’s leading conveyancing and property...DatabricksPipeline
$128k - $168k
...inspire our consumers - every step of the way. Role Summary The Lead Azure Data Engineer operates as a technology expert and architect responsible... ...Azure data engineering products: Azure Synapse Studio, Pipelines/Workflows, Python Notebooks, Analytic Pools (serverless),...PipelineFull timeTemporary workWork experience placementLocal areaRemote workWorldwideAfternoon shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Azure Pipelines & Databricks. Be the first to apply!
Related searches
- azure data engineer New York, NY
- azure solution architect New York, NY
- azure developer New York, NY
- azure specialist New York, NY
- microsoft azure architect New York, NY
- devops engineer azure New York, NY
- azure infrastructure engineer New York, NY
- azure security engineer New York, NY
- cloud engineer azure New York, NY
- data mining New York, NY