Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer - Azure Data Platform & Pipelines

SO Digital Recruitment

SO Digital Recruitment is seeking a Lead Data Engineer based in New York to lead the design and delivery of scalable data pipelines and cloud-based solutions. This senior role requires a hands-on approach in building and overseeing end-to-end pipeline architecture, mentoring others, and collaborating with business stakeholders. The ideal candidate will have strong experience with Azure Databricks, Data Factory, and Spark, as well as a proven track record in architecting data lakes at scale. #J-18808-Ljbffr SO Digital Recruitment

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - Azure Data Platform & Pipelines in New York, NY vacancy
  • $175k - $200k

     ...Bartlett LLP is seeking a Senior Data Engineer to design, build, and optimize enterprise-scale data pipelines. You will lead development for data solutions using Azure technologies, collaborating...  ...-functional teams to modernize platforms and ensure reliable data delivery... 
    Platform
    Pipeline

    Simpson Thacher

    New York, NY
    12 hours ago
  •  ...Overview We are seeking an experienced Lead Data Engineer - Azure & Snowflake to design, develop, and optimize enterprise‑scale data platforms and cloud‑native data solutions. The ideal...  ...in building scalable ETL/ELT pipelines and modern data architectures. This role... 
    Platform
    Pipeline
    Full time
    Contract work
    Remote work

    Novasoft

    Brooklyn, NY
    3 days ago
  •  ...Talent is partnering with a leading organisation within the Financial...  ...sector to appoint a Lead Data Engineer as part of a significant...  ...optimising large-scale ETL pipelines Data architecture and solution...  ...of the organisation’s data platform. Candidates can be based in... 
    Platform
    Pipeline

    W Talent

    New York, NY
    2 days ago
  •  ...Financial Services firm based in New York. They are hiring a Lead Data Engineer to lead the design and delivery of scalable data pipelines and cloud-based transformation frameworks across its Azure data platform. This is a hands‑on senior role for someone who can both... 
    Platform
    Pipeline

    SO Digital Recruitment

    New York, NY
    1 day ago
  •  ...seeking a highly motivated Engineering Consultant with...  ...Sciences domain to work on data and analytics-driven initiatives...  ...use cases. Work on data pipelines, data integration, and platform enablement to support analytics...  ...cloud platforms (AWS, Azure, or GCP) and modern data... 
    Platform
    Pipeline

    MathCo

    New York, NY
    3 days ago
  •  ...10+ years of hands‑on data engineering experience, including...  ...technical leadership of data platform initiatives Strong,...  ...and building ETL/ELT pipelines for both batch and...  ...cloud platform (AWS, Azure, or GCP) and its core...  ...services Proven experience leading large‑scale data... 
    Platform
    Pipeline

    Altraize

    New York, NY
    4 days ago
  •  ...are seeking a Senior Analytic Data Engineer to join our technical team,...  ...with cloud-based data platforms (preferably Google Cloud Platform...  ...years of experience with data pipeline and workflow management...  ...(Google Cloud Platform and Azure) and their respective data services... 
    Platform
    Pipeline

    Openkyber

    New York, NY
    1 day ago
  •  ...Title: AWS Lead Data Engineer Location: Newark, NJ (Hybrid) Duration: Long Term Contract Associate...  ...-scale, reliable, and secure data pipelines and data lake architecture on AWS. Architect...  ...Familiarity with Lakehouse architecture and modern data platforms. #J-18808-Ljbffr... 
    Platform
    Pipeline
    Long term contract
    Work at office

    Innovim Technology Solutions

    New York, NY
    1 day ago
  •  ...We're hiring a Data Engineering Lead to help scale and guide a growing team of data engineers. This...  ...for building and maintaining pipelines that support reporting, analytics, and...  ...scientists on ML workflows and experimentation platforms. Knowledge of data contracts, schema... 
    Platform
    Pipeline

    Forbes Advisor

    New York, NY
    1 day ago
  • $180k - $250k

     ...yr - $250,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale, and optimize...  ...to design advanced data pipelines that unlock new sources of...  ...expertise in Python, SQL, and cloud platforms (e.g., AWS, GCP, or Azure) Strong experience with ETL... 
    Platform
    Pipeline
    Full time

    Evolve Group, Inc.

    New York, NY
    2 days ago
  • $220k

     ...Recruiter | Databricks Data Engineer Recruitment | Connecting Top Talent with Leading US Opportunities Job...  ...mission-critical data platforms using Databricks and AWS...  ..., and deploy data pipelines and platforms using Databricks...  ...Have Experience with Azure or GCP in addition to... 
    Platform
    Pipeline
    Full time
    Remote work
    Flexible hours

    KDR Talent Solutions USA

    New York, NY
    1 day ago
  •  ...seeking an experienced Senior Data Engineer to support complex data...  ...and implement end‑to‑end data pipelines using PySpark, Snowflake, and...  ...environments to cloud‑native platforms Develop and review complex...  ...schemas Demonstrated experience leading or contributing to cloud... 
    Platform
    Pipeline
    Work at office

    Inizio Partners Corp

    Jersey City, NJ
    1 day ago
  •  ...Lead Market Data Engineer - Systematic Data Join to apply for the Lead Market Data Engineer - Systematic...  ...architect, build, and optimize the platforms that deliver high‑quality market data...  ..., and maintain scalable market data pipelines for both historical and real‑time... 
    Platform
    Pipeline
    Full time

    Balyasny Asset Management

    New York, NY
    2 days ago
  •  ...design, build, and optimize scalable data pipelines, develop robust backend services, implement...  ...models, and drive end-to-end data engineering solutions. The role involves collaborating...  ...Experience with cloud-based data platforms Understanding of data security and governance... 
    Platform
    Pipeline

    TheStaffed

    New York, NY
    12 hours ago
  • $125k - $140k

     ...of companies includes leading global exchanges such as...  ...visionaries and our team. The platform team is responsible for...  ...Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project...  ..., and tooling. Pipeline Development: Design, build... 
    Platform
    Pipeline

    VettaFi

    New York, NY
    1 day ago
  •  ...Position Overview We are seeking a Lead Data Engineer to join a rapidly growing...  ..., and cloud-based data platforms. This role will lead the design...  ...and reusable data pipelines supporting critical business...  ...scalable ETL/ELT frameworks using Azure Databricks and modern big data... 
    Platform
    Pipeline

    Burtch Works

    New York, NY
    3 days ago
  • $220k - $230k

     ...You Are You're a senior, hands‑on data engineer with 8+ years of experience...  ...building, and operating production data platforms at scale — and you're ready to lead. You set the technical direction...  ...batch and streaming data pipelines, owning them from design through... 
    Platform
    Pipeline
    Flexible hours

    Unchain Data

    New York, NY
    2 days ago
  • Lead Data Engineer - Front Office | Global Multi-Strategy Firm | Up to $600k TC My client is a...  ...public and private markets. The data platform sits at the centre of capital allocation...  ...EMR. The work ranges from low-latency pipelines powering real-time PnL and risk, to the... 
    Platform
    Pipeline
    Immediate start

    Mondrian Alpha

    New York, NY
    12 hours ago
  •  ...technology products. As a Lead Software Engineer at JPMorganChase within the...  ...technical problems, with a focus on data engineering and Spark-based...  ...and systems, including data pipeline reliability and lakehouse...  ...best practices, and data platform operations Adds to team... 
    Platform
    Pipeline

    J.P. Morgan

    Jersey City, NJ
    6 days ago
  •  ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC...  ...stakeholders to design and implement data pipelines and workflows. Ensure the smooth...  ...the table enable us to grow as a global platform and they are causally linked with our... 
    Platform
    Pipeline
    Long term contract
    Work at office

    InterSources

    New York, NY
    12 hours ago
  • SwiftCruit is seeking a Feature Lead Data Engineer based in New York, NY, responsible for building data pipelines to handle large structured and unstructured data volumes...  ...You will design and engineer high-performance platforms that meet GenAI requirements. The role... 
    Platform
    Pipeline

    SwiftCruit

    New York, NY
    2 days ago
  • $70 - $85 per hour

     ...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work...  ...develop, and maintain scalable data pipelines using Apache Spark on Databricks....  ...reliability, and cost-efficiency in cloud platforms (AWS, Azure, or GCP). Ensure data quality,... 
    Platform
    Pipeline
    Contract work
    Local area
    Remote work
    Flexible hours

    INSPYR Solutions

    New York, NY
    1 day ago
  •  ...and drive innovation, data engineering solutions, and serve as...  .... As a Senior Lead Software Engineering at...  ...Chase within the Employee Platforms, Workforce Experience...  ...hands on delivery of data pipeline and architecture...  ...S3, Databricks, GCP, Azure) Preferred qualifications... 
    Platform
    Pipeline
    Work at office

    J.P. Morgan

    New York, NY
    11 days ago
  • $220k - $230k

     ...leader in digital assets and data center infrastructure,...  ...digital assets platform spans trading, investment...  ...batch and streaming data pipelines, owning them from design...  ...best practices in software engineering Mentor and develop other engineers, lead code reviews, and raise... 
    Platform
    Pipeline
    Local area
    Flexible hours

    (Brand Shop) Ttl Trading Private Limited- Thoppumpady

    New York, NY
    4 days ago
  • $140k - $160k

     ...Group is currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading, global...  ...the design and architecture of end-to-end data pipelines and solutions on modern cloud‑based platforms, including Snowflake, Databricks, and AWS. Build... 
    Platform
    Pipeline
    Temporary work
    Work at office
    Immediate start
    Worldwide
    Shift work
    2 days per week

    Fitch Ratings

    New York, NY
    2 days ago
  •  ...insurance company and a leading commercial lines...  ...-to-consumer platform partnerships, exceptional...  ...and risk engineering services; affluent...  ...experienced lead data engineer to join our...  ...of scalable data pipelines, and ensuring the...  ...snowflake and other Azure technologies along... 
    Platform
    Pipeline
    Work experience placement
    Local area

    Chubb

    Jersey City, NJ
    2 days ago
  • Lead Data Engineer in NY job at Vertex Elite LLC. New York, NY. Location:...  ...implementation of our enterprise data platform. This role will be...  ...and implement data models, pipelines, and data integration frameworks...  ...cloud platforms (e.g., AWS, Azure) and data orchestration... 
    Platform
    Pipeline
    Long term contract

    Vertex Elite LLC

    New York, NY
    2 days ago
  • $160k - $220k

     ...continents — and we're hiring the engineering team to build what comes next...  ...alongside the wearable data. Your job is to make sure every...  ...sensing, and the feature pipelines that prepare them for fusion...  ...arriving data handling — so the platform stays correct as clinical sites... 
    Platform
    Pipeline
    Permanent employment
    Full time
    Work experience placement
    H1b
    Worldwide
    Relocation
    Flexible hours
    Shift work
    Night shift
    Day shift

    Deliberate Solutions, Inc.

    New York, NY
    3 days ago
  • $188k - $275k

    Lightning AI, based in New York City, is looking for its first Data Engineer to ensure data reliability across the company. You'll design ETL/ELT pipelines, manage data quality, and collaborate closely with product and ML teams. The role requires extensive experience in... 
    Platform
    Pipeline

    Lightning AI

    New York, NY
    3 days ago
  •  ...newly consolidated Data and Analytics (D&A)...  ...data governance, data engineering, data modeling, data...  ...science, and AI. The Lead Data Engineer is...  ...build a reusable data pipeline utilizing Big Data and Azure/Databricks for...  ...of data from various platforms for Analytics needs... 
    Platform
    Pipeline
    Temporary work
    Work at office
    Local area
    3 days per week

    MetLife

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer - Azure Data Platform & Pipelines. Be the first to apply!