Senior Data Engineer — Medallion Pipelines & Delta Lake
Synoptek
Synoptek is seeking an experienced Data Engineer in the United States to design and manage scalable ETL/ELT pipelines leveraging Medallion Architecture. The role requires strong expertise in Databricks, Delta Lake, and extensive experience with PySpark and SQL to build robust data ingestion solutions. The ideal candidate will have a deep understanding of cloud platforms like Azure, AWS, and GCP, as well as experience in delivering reliable data products through collaboration and mentorship of junior staff. Join us to contribute to innovative data projects! #J-18808-Ljbffr Synoptek
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer — Medallion Pipelines & Delta Lake in New York, NY vacancy
- ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York Job Description: Hands-on tech lead responsible... ...from various sources into a common pool implementing data pipelines based on the ETL model. Strong tech lead in development, problem...PipelineSenior
Cardinal Integrated
New York, NY1 day ago $80k - $120k
Silversmith Capital Partners is looking for a Senior Data Engineer to join their remote Data Lake Team. In this role, you'll maintain data pipelines and validate data quality while collaborating closely with data scientists and ML engineers. The position requires 4+ years...PipelineSeniorRemote job- An established industry player seeks a Senior Data Engineer to join their innovative team. In this pivotal... ...and maintain scalable Python-based ETL pipelines, design high-performance database schemas, and build cloud data lake solutions using AWS and Databricks. Collaborating...PipelineSenior
$150k
OTC Markets Group Inc., located in New York, is hiring for the position of AVP, Data Engineer. The successful candidate will design and build scalable ETL pipelines to enhance the organization's data capabilities. Candidates must have over 5 years of experience in relevant...PipelineSenior$150k
OTC Markets in New York, NY is seeking a skilled Data Engineer to join their IT Infrastructure team. This role focuses on building and optimizing ETL pipelines, ensuring data quality, and integrating various data sources. Candidates should possess over 5 years of experience...PipelineSeniorFlexible hours- MSupply is seeking a Senior Data Engineer to design and manage their enterprise data platform using Microsoft Fabric. The successful candidate will handle end-to-end data pipelines from multiple sources and ensure data quality, operational health, and pipeline reliability...PipelineSeniorRemote jobFull time
- ...-person interview Senior Data Engineer Job Responsibilities... ...and resolve pipeline issues as a senior Data... ...using PySpark within the Medallion Lakehouse... ...ADLS) using Parquet and Delta formats, including partitioning... ...and Delta Lake for financial data workloads...PipelineSeniorContract work
Compu-Vision Consulting
New York, NY3 days ago - Senior Data Engineer - Media Org (Hybrid NYC or LA) I’m working on a Senior... ...designing batch and real-time data pipelines, working heavily within a... ...AWS environments, data lakes, and modern cloud data... ...design patterns, including Medallion Architecture (Bronze, Silver...PipelineSeniorFull time
- ...We are seeking an experienced Data Engineer to support the design and scaling of data pipelines and infrastructure for a high-priority... ...data lakehouse patterns, medallion architecture, and layered data... ...Azure Data Factory, Azure Data Lake, AWS S3, AWS Glue, Databricks,...PipelineSeniorWorldwide
IBM
New York, NY1 day ago - ...into a single, unified data platform to power... ...AI initiatives. As a Senior Data Engineer , you will play a critical... ...and AWS, following Medallion (Bronze/Silver/Gold)... ...ingestion and ETL/ELT pipelines from core business... ...architectures (Medallion, Delta Lake, Parquet, schema...PipelineSeniorFull time
- ...Job Title: Senior Data Integration Engineer - Credit Risk Location: New York City... ...of enterprise data pipelines. This role is responsible... ...experience with Databricks (Medallion Architecture, Unity Catalog... ...Cloud experience (Azure, Data Lake, ADF, Kafka, Spark-based distributed...PipelineSeniorPermanent employmentWork at office
Navitas Healthcare LLC
New York, NY5 days ago - ...We are seeking a senior Counterparty Credit Risk (CCR) Data Integration Engineer to assume end-to-end... ...observable data integration pipelines across CCR technology... ...platforms (e.g., data lakes, data warehouses, and... ...managing Databricks, Medallion Architecture, Unity Catalog...PipelineSeniorPermanent employmentTemporary workFixed term contract
Compu-Vision Consulting
New York, NY2 days ago $140k - $160k
...an ever‑evolving world. Job Description The Data Engineering team is seeking a Senior Data Engineer to help design, build, and scale... ...Design and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema...PipelineSeniorWork at office3 days per week$110k - $130k
...liquidity solutions, exclusive data and insights, a custody... ...way. The Role: As a Senior Data Engineer focused on data... ...data architectures (e.g., Medallion Architecture, data lakes) Experience in Private... ...experience setting up CI/CD pipelines, managing data orchestration...PipelineSeniorWork at officeLocal area2 days per week3 days per week- ...are looking for an AI Data Engineer to join our growing team... ...and design a RAG pipeline in the afternoon. What... ...Build and maintain a medallion Lakehouse (Bronze/Silver... ...performance. Implement Lake Formation tag‑based governance... ...with Apache Iceberg, Delta Lake, or Hudi in...PipelineSeniorRemote jobWork from homeDay shift
$155k - $235k
...About the Team The Data Platform team sits... ...— from our Medallion Architecture and Unity... ...ensuring data works for engineers, analysts, and... ...'re looking for a Senior AI Data Engineer to... ...they need to ship pipelines faster without... ...Sacramento, Salt Lake City, San Diego, San...PipelineSeniorHome officeFlexible hours- ...Python, GCP Skill Cluster : Data-GCP Data Plex, with Data... ...seeking a highly skilled Data Engineer with strong hands-on experience... ...processing, and cloud-native data pipelines. Key Responsibilities: Design... ...and Iceberg-based data lake architectures Implement and...PipelineSenior
Diversity Nexus
New York, NY3 days ago - ...Senior Data Engineer Polymarket is looking for a Senior Data Engineer to... ...strategy, indexing, trigger pipelines, autovacuum tuning, and bloat... ...Shape streaming and data lake infrastructure. Define Kafka... ...experience: Parquet, Iceberg (or Delta/Hudi), compaction strategies...PipelineSenior
Polymarket
New York, NY1 day ago - ...About the job Senior Data Engineer - Databricks Job Overview:... ...development and optimization of data pipelines, implementing robust data... ...Azure Databricks, Azure Data Lake etc. ~ Experience with data modeling, ETL processes, Delta Lake and data warehousing....PipelineSenior
Inizio Partners
New York, NY1 day ago - ...consultants bring deep expertise in Data Science, Machine Learning and... ...seeking an experienced Data Engineer to join our data team. In this... ...and maintaining scalable data pipelines, data integration processes,... ...of data modeling, data lake/lakehouse architectures, and ETL...PipelineSeniorLocal area
Tiger Analytics
Jersey City, NJ8 days ago $160k - $200k
...As a Senior Data Engineer at Rearc, you'll be the technical anchor on complex, client-facing data... ...production. You'll write code, build pipelines, and architect solutions side-by-side... ...solutions on the platform, including Delta Lake architectures, Unity Catalog governance...PipelineSeniorWork experience placementRearc
New York, NY4 days ago- Position Summary Lead complex data engineering projects; design data architectures aligned with... ...optimize data workflows and manage data pipelines; ensure smooth operation of data... ...data processing. Experience with data lake processing in Iceberg format. Experience...PipelineSenior
$200k - $220k
...Senior Data Engineer New York, New York, United States The Role As the driving force behind... ...you'll build and run high-throughput pipelines spanning ultra-low-latency market-data... ..., macro) Mastery of Iceberg, Delta Lake, or Hudi on S3 Hands-on work with real...PipelineSeniorSchonfeld
New York, NY19 days ago- Role Overview We are seeking a Senior Data Engineer to build and operate enterprise-grade data pipelines using Microsoft Azure as the orchestration layer and Snowflake as the enterprise data lake/warehouse. Focus on reliable ETL/ELT, push/pull data integration patterns...PipelineSeniorFor contractors
- Senior Data Engineer - Microsoft Fabric | US Remote We are working with a high-growth organization... ...Experience designing and implementing Medallion architecture and Gold-layer semantic... ...production‑ready solutions Improve existing pipelines and introduce modern design...PipelineSeniorRemote work
$180k - $220k
...Senior Data Engineer New York City, New York Garner's mission is to transform the healthcare... ...stack and implementations of data pipelines using Python and SQL in AWS. Where... ...Expertise with SQL tuning, Spark development, medallion and event-driven architectures. ~...PipelineSeniorWork at officeFlexible hours3 days per weekGarner Health
New York, NYa month ago$120k - $160k
...About the role: At Vantage, the Data Engineer is mainly responsible for ingesting and... ...an expertise in Data Modeling and Data Pipeline development within an Analytical, column... ...Modeling, such as Kimball, Data Vault, or Medallion Architecture. Strong familiarity...PipelineSeniorWork at officeRemote workFlexible hoursVantage Group Holdings Ltd
New York, NY3 days ago- ...proprietary AI Studio and AI Engines, the company helps drive the... ...full potential with AI. Senior Data Engineer Are you an experienced... ...-to-end real-time and batch pipelines, and developing cloud-native... .... Databricks: Delta Lake, Unity Catalog, Delta Live Tables...PipelineSeniorH1bLocal area
Fusemachines
New York, NY1 day ago - ...US and be available on EST hours. Senior Data Architect/Engineer Summary of Role We are seeking... ...data solutions, building robust data pipelines, optimizing analytical workloads,... ...implement scalable data warehouse, data lake, and lakehouse architectures. ...PipelineSeniorFull timeRemote work
Teambuilder
New York, NY2 days ago - ...Job Title: Senior Data Integration Engineer Location: New York, NY Important Notes: Must... ...develop, and maintain scalable data pipelines for counterparty, trade, collateral,... ...Experience with Azure Cloud, Data Lakes, ADF, and distributed data processing...PipelineSeniorPermanent employment
Navitas Healthcare LLC
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer — Medallion Pipelines & Delta Lake. Be the first to apply!
Related searches
- senior data center engineer New York, NY
- bi data engineer New York, NY
- data engineer manager New York, NY
- data science developer New York, NY
- etl data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- junior big data engineer New York, NY
- remote data engineer New York, NY