Lead Data Engineer - Azure Pipelines & Databricks
$175k - $200kSimpson Thacher
Simpson Thacher & Bartlett LLP is seeking a Senior Data Engineer to design, build, and optimize enterprise-scale data pipelines. You will lead development for data solutions using Azure technologies, collaborating with cross-functional teams to modernize platforms and ensure reliable data delivery. The role requires 5-7 years of experience with Azure Data Factory, Databricks, SQL Server, and Python. A Bachelor's degree in Computer Science or a related field is essential. The position offers a competitive salary range of $175,000 to $200,000. #J-18808-Ljbffr Simpson Thacher
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - Azure Pipelines & Databricks in New York, NY vacancy
- SO Digital Recruitment is seeking a Lead Data Engineer based in New York to lead the design and delivery of scalable data pipelines and cloud-based solutions. This senior role... ...will have strong experience with Azure Databricks, Data Factory, and Spark, as well as a...DatabricksPipeline
- ...technology solutions firm is looking for a Lead Data Engineer to work remotely on building end-to-end... ...will design and maintain scalable data pipelines and collaborate with AI/ML teams. The position requires strong skills in Databricks, Python, and SQL, along with relevant...DatabricksPipelineRemote work
INSPYR Solutions
New York, NY1 day ago - ...in New York. They are hiring a Lead Data Engineer to lead the design and delivery of scalable data pipelines and cloud-based transformation frameworks across its Azure data platform. This is a hands... ...using Azure Data Factory, Databricks, and PySpark Architect and optimise...DatabricksPipeline
SO Digital Recruitment
New York, NY1 day ago - ...seeking a highly motivated Engineering Consultant with... ...Sciences domain to work on data and analytics-driven... ...cases. Work on data pipelines, data integration, and... ...cloud platforms (AWS, Azure, or GCP) and modern data... ...Python, SQL, Spark, Databricks, Snowflake, or similar...DatabricksPipeline
MathCo
New York, NY3 days ago - ...0+ years of hands‑on data engineering experience, including... ...on expertise with the Databricks Lakehouse Platform,... ...and building ETL/ELT pipelines for both batch and streaming... ...cloud platform (AWS, Azure, or GCP) and its core... ...Proven experience leading large‑scale data...DatabricksPipeline
Altraize
New York, NY4 days ago - ...are seeking a Senior Analytic Data Engineer to join our technical team,... ...Google Cloud Platform with Databricks/Apache Spark), and strong programming... ...of experience with data pipeline and workflow management... ...(Google Cloud Platform and Azure) and their respective data services...DatabricksPipeline
Openkyber
New York, NY1 day ago $220k
...Specialist Recruiter | Databricks Data Engineer Recruitment | Connecting Top Talent with Leading US Opportunities Job Title: Lead Data... ...Design, build, and deploy data pipelines and platforms using Databricks... ...Nice to Have Experience with Azure or GCP in addition to AWS Knowledge...DatabricksPipelineFull timeRemote workFlexible hoursKDR Talent Solutions USA
New York, NY1 day ago$220k - $230k
...Are You're a senior, hands‑on data engineer with 8+ years of experience... ...scale — and you're ready to lead. You set the technical... ...the modern data stack — AWS, Databricks/Spark, dbt, and Airflow. You... ...scalable batch and streaming data pipelines, owning them from design...DatabricksPipelineFlexible hoursUnchain Data
New York, NY2 days ago- ...Position Overview We are seeking a Lead Data Engineer to join a rapidly growing Data & Analytics... ...data architectures and reusable data pipelines supporting critical business... ...Build scalable ETL/ELT frameworks using Azure Databricks and modern big data technologies. Design...DatabricksPipeline
Burtch Works
New York, NY3 days ago - Lead Data Engineer - Front Office | Global Multi-Strategy Firm | Up to $600k TC My client is a global multi-strategy... .... The platform spans Snowflake, dbt, Spark, and Databricks/EMR. The work ranges from low-latency pipelines powering real-time PnL and risk, to the...DatabricksPipelineImmediate start
- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC... ...stakeholders to design and implement data pipelines and workflows. Ensure the smooth... ...technologies such as AWS Glue, Spark, and Databricks. Optimize database performance and...DatabricksPipelineLong term contractWork at office
InterSources
New York, NY11 hours ago - ...technology products. As a Lead Software Engineer at JPMorganChase within the... ...problems, with a focus on data engineering and Spark-based... ...systems, including data pipeline reliability and lakehouse maintenance... ...architecture (e.g., EMR/Databricks, lakehouse/table formats,...DatabricksPipeline
J.P. Morgan
Jersey City, NJ6 days ago - ...and drive innovation, data engineering solutions, and serve as... .... As a Senior Lead Software Engineering at... ...hands on delivery of data pipeline and architecture... ...Key Technical Skills : Databricks, DBX, PySpark, Spark,... ...S3, Databricks, GCP, Azure) Preferred qualifications...DatabricksPipelineWork at office
J.P. Morgan
New York, NY11 days ago $70 - $85 per hour
...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00... ...develop, and maintain scalable data pipelines using Apache Spark on Databricks. Build and manage Delta Lake... ...efficiency in cloud platforms (AWS, Azure, or GCP). Ensure data quality, lineage...DatabricksPipelineContract workLocal areaRemote workFlexible hoursINSPYR Solutions
New York, NY1 day ago- ...democratize the benefits of data and AI . Since 2019,... ...and decisioning for leading brands and agencies... ...culture from the ground up. Engineers here own major surface... ...with Microsoft and Databricks Fully remote or hybrid... ...instrumenting data pipelines – push‑based, pull‑based...DatabricksPipelineRemote workFlexible hours
Yobi AI
New York, NY3 days ago $220k - $230k
...in digital assets and data center infrastructure,... ...batch and streaming data pipelines, owning them from design... ...Work within the Databricks and Spark ecosystem to... ...practices in software engineering Mentor and develop other engineers, lead code reviews, and raise...DatabricksPipelineLocal areaFlexible hours(Brand Shop) Ttl Trading Private Limited- Thoppumpady
New York, NY4 days ago$140k - $160k
...currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading... ...and architecture of end-to-end data pipelines and solutions on modern cloud‑based platforms, including Snowflake, Databricks, and AWS. Build and optimize robust, scalable...DatabricksPipelineTemporary workWork at officeImmediate startWorldwideShift work2 days per weekFitch Ratings
New York, NY2 days ago- ...insurance company and a leading commercial lines... ...and risk engineering services; affluent... ...experienced lead data engineer to join our... ...of scalable data pipelines, and ensuring the... ...Informatica IICS, Databricks Python, ADF, snowflake and other Azure technologies along...DatabricksPipelineWork experience placementLocal area
Chubb
Jersey City, NJ2 days ago - ...the newly consolidated Data and Analytics (D&A) organization... ..., data governance, data engineering, data modeling, data... ...science, and AI. The Lead Data Engineer is crucial... ...build a reusable data pipeline utilizing Big Data and Azure/Databricks for Eligibility Program...DatabricksPipelineTemporary workWork at officeLocal area3 days per week
MetLife
New York, NY4 days ago - Perform is looking for a Data Engineer based in Georgia, USA, to manage and innovate our data platform utilizing Azure Databricks. Candidates must possess a strong background in data... ...experience in building scalable data pipelines. The ideal candidate will collaborate...DatabricksPipeline
- ...Senior Azure Data Engineer We are seeking a Senior Azure Data Engineer to design, build, and maintain... ...), and can deliver reliable ETL/ELT pipelines for analytics and ML use cases. This... ...Azure environments (Fabric, Synapse, Databricks or equivalent). Implement and operationalize...DatabricksPipelineRemote work
Adastra
New York, NY1 day ago - ...The Azure Data Engineer is responsible for building, implementing, and supporting Microsoft BI... ...maintenance of Data warehouses Develop ADF pipelines making use of various activities... ...Requirements Skills: Azure Data Factory Azure Databricks Azure Synapse Analytics Azure Synapse...DatabricksPipeline
TechDigital Group
New York, NY1 day ago $133k - $158k
PowerToFly is seeking a Senior Data Engineer based in Kentucky to design and enhance applications and data pipelines crucial for retail operations. Candidates... ...Engineering and 3 years with Azure technologies like Data Factory and Databricks. The ideal candidate possesses...DatabricksPipeline$135k - $150k
...A leading tech recruitment firm is seeking a Lead Data Engineer in New York City. This role involves managing a team, designing data pipelines, and ensuring project requirements are met. The ideal candidate... ...in SQL Server SSIS and Azure technologies. This position offers...PipelineRemote workWork from homeFlexible hoursCareer-Mover
New York, NY2 days ago- ...We are looking for an experienced Azure Architect to design and implement... ...scalable, secure, and high-performance data solutions using the latest Azure... ...and optimizing large-scale data pipelines and data lakes. Familiarity with Databricks , Azure Synapse Analytics , Power...DatabricksPipelineFull timeContract workRemote work
NAM Info Inc
New York, NY1 day ago - ...Hexion is seeking a senior, hands‑on Azure data engineer to lead the design, implementation, and... ...Data Factory, Azure Logic Apps, and Databricks as well as other adjacent Azure data... ...governed, reliable, and maintainable pipelines. You will work closely with architecture...DatabricksPipeline
Hexion
Brooklyn, NY4 days ago - Novasoft is looking for a talented Lead Data Engineer - Azure & Snowflake to develop and optimize enterprise data solutions. The role demands expertise... ..., and DBT, with a focus on building robust ETL/ELT pipelines and leading technical initiatives. Candidates should have...PipelineRemote job
- ...Job Title: Azure DevOps Engineer Employment Type: Full-time Permanent... ...Our client, a leading provider of Artificial... ...Services and innovative data platforms for... ...automating deployment pipelines, and ensuring seamless... ...Azure Machine Learning, Databricks). Benefits Our client...DatabricksPipelinePermanent employmentFull timeRemote work2 days per week3 days per week
Biz First
New York, NY1 day ago - VBeyond Corporation is seeking a Lead Data Engineer in Jersey City, NJ, to design and implement data pipelines using AWS and Snowflake. This role requires strong leadership... ...and a strong background with both AWS and Azure technologies. This position allows for significant...Pipeline
- ...consulting, and world‑class engineering talent. We partner... ...Solution Architect - Azure AI to lead the design,... ...Platform Enterprise Data & Integration Services... ...Establish secure data pipelines, AI data ingestion frameworks... ...Fabric Azure Databricks Azure Functions Azure...DatabricksPipelineRelocationFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Azure Pipelines & Databricks. Be the first to apply!
Related searches
- azure data engineer New York, NY
- azure developer New York, NY
- azure infrastructure engineer New York, NY
- microsoft azure architect New York, NY
- devops engineer azure New York, NY
- cloud engineer azure New York, NY
- azure security engineer New York, NY
- azure specialist New York, NY
- data New York, NY
- data collection researcher New York, NY