Lead Data Engineer - Azure Data Platform & Pipelines
SO Digital Recruitment
SO Digital Recruitment is seeking a Lead Data Engineer based in New York to lead the design and delivery of scalable data pipelines and cloud-based solutions. This senior role requires a hands-on approach in building and overseeing end-to-end pipeline architecture, mentoring others, and collaborating with business stakeholders. The ideal candidate will have strong experience with Azure Databricks, Data Factory, and Spark, as well as a proven track record in architecting data lakes at scale. #J-18808-Ljbffr SO Digital Recruitment
$175k - $200k
...Bartlett LLP is seeking a Senior Data Engineer to design, build, and optimize enterprise-scale data pipelines. You will lead development for data solutions using Azure technologies, collaborating... ...-functional teams to modernize platforms and ensure reliable data delivery...PlatformPipeline- ...Overview We are seeking an experienced Lead Data Engineer - Azure & Snowflake to design, develop, and optimize enterprise‑scale data platforms and cloud‑native data solutions. The ideal... ...in building scalable ETL/ELT pipelines and modern data architectures. This role...PlatformPipelineFull timeContract workRemote work
- ...Talent is partnering with a leading organisation within the Financial... ...sector to appoint a Lead Data Engineer as part of a significant... ...optimising large-scale ETL pipelines Data architecture and solution... ...of the organisation’s data platform. Candidates can be based in...PlatformPipeline
- ...Financial Services firm based in New York. They are hiring a Lead Data Engineer to lead the design and delivery of scalable data pipelines and cloud-based transformation frameworks across its Azure data platform. This is a hands‑on senior role for someone who can both...PlatformPipeline
- ...seeking a highly motivated Engineering Consultant with... ...Sciences domain to work on data and analytics-driven initiatives... ...use cases. Work on data pipelines, data integration, and platform enablement to support analytics... ...cloud platforms (AWS, Azure, or GCP) and modern data...PlatformPipeline
- ...10+ years of hands‑on data engineering experience, including... ...technical leadership of data platform initiatives Strong,... ...and building ETL/ELT pipelines for both batch and... ...cloud platform (AWS, Azure, or GCP) and its core... ...services Proven experience leading large‑scale data...PlatformPipeline
- ...are seeking a Senior Analytic Data Engineer to join our technical team,... ...with cloud-based data platforms (preferably Google Cloud Platform... ...years of experience with data pipeline and workflow management... ...(Google Cloud Platform and Azure) and their respective data services...PlatformPipeline
- ...Title: AWS Lead Data Engineer Location: Newark, NJ (Hybrid) Duration: Long Term Contract Associate... ...-scale, reliable, and secure data pipelines and data lake architecture on AWS. Architect... ...Familiarity with Lakehouse architecture and modern data platforms. #J-18808-Ljbffr...PlatformPipelineLong term contractWork at office
- ...We're hiring a Data Engineering Lead to help scale and guide a growing team of data engineers. This... ...for building and maintaining pipelines that support reporting, analytics, and... ...scientists on ML workflows and experimentation platforms. Knowledge of data contracts, schema...PlatformPipeline
$180k - $250k
...yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize... ...to design advanced data pipelines that unlock new sources of... ...expertise in Python, SQL, and cloud platforms (e.g., AWS, GCP, or Azure) Strong experience with ETL...PlatformPipelineFull time$220k
...Recruiter | Databricks Data Engineer Recruitment | Connecting Top Talent with Leading US Opportunities Job... ...mission-critical data platforms using Databricks and AWS... ..., and deploy data pipelines and platforms using Databricks... ...Have Experience with Azure or GCP in addition to...PlatformPipelineFull timeRemote workFlexible hours- ...seeking an experienced Senior Data Engineer to support complex data... ...and implement end‑to‑end data pipelines using PySpark, Snowflake, and... ...environments to cloud‑native platforms Develop and review complex... ...schemas Demonstrated experience leading or contributing to cloud...PlatformPipelineWork at office
- ...Lead Market Data Engineer - Systematic Data Join to apply for the Lead Market Data Engineer - Systematic... ...architect, build, and optimize the platforms that deliver high‑quality market data... ..., and maintain scalable market data pipelines for both historical and real‑time...PlatformPipelineFull time
- ...design, build, and optimize scalable data pipelines, develop robust backend services, implement... ...models, and drive end-to-end data engineering solutions. The role involves collaborating... ...Experience with cloud-based data platforms Understanding of data security and governance...PlatformPipeline
$125k - $140k
...of companies includes leading global exchanges such as... ...visionaries and our team. The platform team is responsible for... ...Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project... ..., and tooling. Pipeline Development: Design, build...PlatformPipeline- ...Position Overview We are seeking a Lead Data Engineer to join a rapidly growing... ..., and cloud-based data platforms. This role will lead the design... ...and reusable data pipelines supporting critical business... ...scalable ETL/ELT frameworks using Azure Databricks and modern big data...PlatformPipeline
$220k - $230k
...You Are You're a senior, hands‑on data engineer with 8+ years of experience... ...building, and operating production data platforms at scale — and you're ready to lead. You set the technical direction... ...batch and streaming data pipelines, owning them from design through...PlatformPipelineFlexible hours- Lead Data Engineer - Front Office | Global Multi-Strategy Firm | Up to $600k TC My client is a... ...public and private markets. The data platform sits at the centre of capital allocation... ...EMR. The work ranges from low-latency pipelines powering real-time PnL and risk, to the...PlatformPipelineImmediate start
- ...technology products. As a Lead Software Engineer at JPMorganChase within the... ...technical problems, with a focus on data engineering and Spark-based... ...and systems, including data pipeline reliability and lakehouse... ...best practices, and data platform operations Adds to team...PlatformPipeline
- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC... ...stakeholders to design and implement data pipelines and workflows. Ensure the smooth... ...the table enable us to grow as a global platform and they are causally linked with our...PlatformPipelineLong term contractWork at office
- SwiftCruit is seeking a Feature Lead Data Engineer based in New York, NY, responsible for building data pipelines to handle large structured and unstructured data volumes... ...You will design and engineer high-performance platforms that meet GenAI requirements. The role...PlatformPipeline
$70 - $85 per hour
...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work... ...develop, and maintain scalable data pipelines using Apache Spark on Databricks.... ...reliability, and cost-efficiency in cloud platforms (AWS, Azure, or GCP). Ensure data quality,...PlatformPipelineContract workLocal areaRemote workFlexible hours- ...and drive innovation, data engineering solutions, and serve as... .... As a Senior Lead Software Engineering at... ...Chase within the Employee Platforms, Workforce Experience... ...hands on delivery of data pipeline and architecture... ...S3, Databricks, GCP, Azure) Preferred qualifications...PlatformPipelineWork at office
$220k - $230k
...leader in digital assets and data center infrastructure,... ...digital assets platform spans trading, investment... ...batch and streaming data pipelines, owning them from design... ...best practices in software engineering Mentor and develop other engineers, lead code reviews, and raise...PlatformPipelineLocal areaFlexible hours$140k - $160k
...Group is currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading, global... ...the design and architecture of end-to-end data pipelines and solutions on modern cloud‑based platforms, including Snowflake, Databricks, and AWS. Build...PlatformPipelineTemporary workWork at officeImmediate startWorldwideShift work2 days per week- ...insurance company and a leading commercial lines... ...-to-consumer platform partnerships, exceptional... ...and risk engineering services; affluent... ...experienced lead data engineer to join our... ...of scalable data pipelines, and ensuring the... ...snowflake and other Azure technologies along...PlatformPipelineWork experience placementLocal area
- Lead Data Engineer in NY job at Vertex Elite LLC. New York, NY. Location:... ...implementation of our enterprise data platform. This role will be... ...and implement data models, pipelines, and data integration frameworks... ...cloud platforms (e.g., AWS, Azure) and data orchestration...PlatformPipelineLong term contract
$160k - $220k
...continents — and we're hiring the engineering team to build what comes next... ...alongside the wearable data. Your job is to make sure every... ...sensing, and the feature pipelines that prepare them for fusion... ...arriving data handling — so the platform stays correct as clinical sites...PlatformPipelinePermanent employmentFull timeWork experience placementH1bWorldwideRelocationFlexible hoursShift workNight shiftDay shift$188k - $275k
Lightning AI, based in New York City, is looking for its first Data Engineer to ensure data reliability across the company. You'll design ETL/ELT pipelines, manage data quality, and collaborate closely with product and ML teams. The role requires extensive experience in...PlatformPipeline- ...newly consolidated Data and Analytics (D&A)... ...data governance, data engineering, data modeling, data... ...science, and AI. The Lead Data Engineer is... ...build a reusable data pipeline utilizing Big Data and Azure/Databricks for... ...of data from various platforms for Analytics needs...PlatformPipelineTemporary workWork at officeLocal area3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Azure Data Platform & Pipelines. Be the first to apply!
- azure data engineer New York, NY
- azure developer New York, NY
- azure infrastructure engineer New York, NY
- microsoft azure architect New York, NY
- devops engineer azure New York, NY
- cloud engineer azure New York, NY
- azure security engineer New York, NY
- azure specialist New York, NY
- IT data engineer New York, NY
- data engineer freelance New York, NY


