Senior Data Engineer Medallion Pipelines & Delta Lake
Synoptek
Synoptek is seeking an experienced Data Engineer in the United States to design and manage scalable ETL/ELT pipelines leveraging Medallion Architecture. The role requires strong expertise in Databricks, Delta Lake, and extensive experience with PySpark and SQL to build robust data ingestion solutions. The ideal candidate will have a deep understanding of cloud platforms like Azure, AWS, and GCP, as well as experience in delivering reliable data products through collaboration and mentorship of junior staff. Join us to contribute to innovative data projects! #J-18808-Ljbffr
Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer Medallion Pipelines & Delta Lake in New York, NY vacancy
- ...ago | Openings: 3 | Applicants: 100+ Responsibilities Lead Databricks data pipelines on GCP using PySpark & SQL Design pipelines with BigQuery, Spanner, GCS, Pub/Sub Implement Delta Lake & Medallion architecture Ensure data quality, performance, CI/CD Mentor team & manage...PipelineFull timeContract workTemporary workRemote work
Hungry Hr
New York, NY3 days ago - ...United ITs is seeking a highly skilled Data Engineer for a remote position. Ideal candidates will have at least 5 years of... ...Azure, AWS, or GCP. The role involves designing ETL/ELT pipelines, working with data lakes, and ensuring effective data integration across platforms...PipelineSeniorRemote work
United ITs
New York, NY4 days ago - An established industry player seeks a Senior Data Engineer to join their innovative team. In this pivotal... ...and maintain scalable Python-based ETL pipelines, design high-performance database schemas, and build cloud data lake solutions using AWS and Databricks. Collaborating...PipelineSenior
- ...MSupply is seeking a Senior Data Engineer to design and manage their enterprise data platform using Microsoft Fabric. The successful candidate will handle end-to-end data pipelines from multiple sources and ensure data quality, operational health, and pipeline reliability...PipelineSeniorFull timeRemote work
mSupply
New York, NY9 hours ago $140k - $170k
People Inc. is looking for a Senior Data Engineer in New York, NY. This role involves building data integration pipelines and collaborating with stakeholders to deliver data effectively. Candidates should have strong Python and SQL skills, with a minimum of 3 years of...PipelineSeniorRemote jobWork at office$150k
OTC Markets Group Inc., located in New York, is hiring for the position of AVP, Data Engineer. The successful candidate will design and build scalable ETL pipelines to enhance the organization's data capabilities. Candidates must have over 5 years of experience in relevant...PipelineSenior$150k
OTC Markets in New York, NY is seeking a skilled Data Engineer to join their IT Infrastructure team. This role focuses on building and optimizing ETL pipelines, ensuring data quality, and integrating various data sources. Candidates should possess over 5 years of experience...PipelineSeniorFlexible hours- ...-person interview Senior Data Engineer Job Responsibilities... ...and resolve pipeline issues as a senior Data... ...using PySpark within the Medallion Lakehouse... ...ADLS) using Parquet and Delta formats, including partitioning... ...and Delta Lake for financial data workloads...PipelineSeniorContract work
Compu-Vision Consulting
New York, NY1 day ago - ...into a single, unified data platform to power... ...AI initiatives. As a Senior Data Engineer , you will play a critical... ...and AWS, following Medallion (Bronze/Silver/Gold)... ...ingestion and ETL/ELT pipelines from core business... ...architectures (Medallion, Delta Lake, Parquet, schema...PipelineSeniorFull time
Level Access
New York, NY9 hours ago - Senior Data Engineer - Media Org (Hybrid NYC or LA) I’m working on a Senior... ...designing batch and real-time data pipelines, working heavily within a... ...AWS environments, data lakes, and modern cloud data... ...design patterns, including Medallion Architecture (Bronze, Silver...PipelineSeniorFull time
$125.98k - $157.47k
...Position Summary The Senior Data Engineer will design, build, and... ...optimize large-scale data pipelines and ETL workflows within the... ...development, notebooks, Delta Lake & Lakehouse architecture, jobs... ...data lake architectures, medallion patterns, and cloud-native...PipelineSeniorPart timeWork experience placementLocal areaFlexible hoursVoya Financial
New York, NY4 days ago- ...Role: Senior Data Engineer-Databricks, Python Location: New Jersey(... ...develop, and maintain data pipelines using Databricks and Spark,... ...Experience with Azure Databricks Medallion Architecture with DLT,... ...with data warehouse and data lake concepts and architectures...PipelineSeniorWork experience placement
Zortech Solutions
Jersey City, NJ3 days ago - ...We are seeking an experienced Data Engineer to support the design and scaling of data pipelines and infrastructure for a high-priority... ...data lakehouse patterns, medallion architecture, and layered data... ...Azure Data Factory, Azure Data Lake, AWS S3, AWS Glue, Databricks,...PipelineSeniorWorldwide
IBM
New York, NY3 days ago - ...Calling All Upstarters! SENIOR DATA/AI ENGINEER WANTED! We are Upstart 13. We... ...delivering production data pipelines, and implementing AI‑powered... ...reliability targets. Data lake management Conduct and lead... ...monitoring tools. Exposure to Medallion Architecture Understanding...PipelineSeniorFull timeRemote work
Upstart 13
New York, NY9 hours ago $140k - $160k
...an ever‑evolving world. Job Description The Data Engineering team is seeking a Senior Data Engineer to help design, build, and scale... ...Design and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema...PipelineSeniorWork at office3 days per week- ...are looking for an AI Data Engineer to join our growing team... ...and design a RAG pipeline in the afternoon. What... ...Build and maintain a medallion Lakehouse (Bronze/Silver... ...performance. Implement Lake Formation tag‑based governance... ...with Apache Iceberg, Delta Lake, or Hudi in...PipelineSeniorRemote workWork from homeDay shift
ProfitSolv
New York, NY3 days ago $110k - $130k
...liquidity solutions, exclusive data and insights, a custody... ...way. The Role: As a Senior Data Engineer focused on data... ...data architectures (e.g., Medallion Architecture, data lakes) Experience in Private... ...experience setting up CI/CD pipelines, managing data orchestration...PipelineSeniorWork at officeLocal area2 days per week3 days per week- ...Description Job Title: Senior Data Integration Engineer – Credit Risk Location:... ...optimization of enterprise data pipelines. This role is responsible... ...with Databricks (Medallion Architecture, Unity Catalog... ...Cloud experience (Azure, Data Lake, ADF, Kafka, Spark-based distributed...PipelineSeniorPermanent employmentWork at office
NavitasPartners
New York, NY1 day ago $155k - $235k
...About the Team The Data Platform team sits... ...— from our Medallion Architecture and Unity... ...ensuring data works for engineers, analysts, and... ...'re looking for a Senior AI Data Engineer to... ...they need to ship pipelines faster without... ...Sacramento, Salt Lake City, San Diego, San...PipelineSeniorHome officeFlexible hours$100k - $155k
...CrowdStrike Holdings, Inc. is looking for a seasoned Data Engineer to join their team in the United States. This role involves architecting... ...frameworks for Operational Data Store and Enterprise Data Lake Platforms. The ideal candidate will have over 5 years of experience...PipelineSeniorCrowdStrike Holdings, Inc.
New York, NY3 days ago- ...Python, GCP Skill Cluster : Data-GCP Data Plex, with Data... ...seeking a highly skilled Data Engineer with strong hands-on experience... ...processing, and cloud-native data pipelines. Key Responsibilities: Design... ...and Iceberg-based data lake architectures Implement and...PipelineSenior
Diversity Nexus
New York, NY1 day ago - ...Senior Data Engineer Polymarket is looking for a Senior Data Engineer to... ...strategy, indexing, trigger pipelines, autovacuum tuning, and bloat... ...Shape streaming and data lake infrastructure. Define Kafka... ...experience: Parquet, Iceberg (or Delta/Hudi), compaction strategies...PipelineSenior
Polymarket
New York, NY4 days ago - ...Overview Senior Data Engineer (Level II & Level III) Level II is Remote work. Level III is Onsite... ...dbt development, data transformation, pipeline validation and Snowflake optimization,... ...Engineering (Glue, Lambda, Step Functions) Data Lake / ELT pipeline experience Education...PipelineSeniorRemote work
EITACIES
New York, NY9 hours ago - ...About the job Senior Data Engineer - Databricks Job Overview:... ...development and optimization of data pipelines, implementing robust data... ...Azure Databricks, Azure Data Lake etc. ~ Experience with data modeling, ETL processes, Delta Lake and data warehousing....PipelineSenior
Inizio Partners
New York, NY4 days ago - ...Senior Data Engineer – Microsoft Fabric | US Remote We are working with a high-growth organization... ...Experience designing and implementing Medallion architecture and Gold-layer semantic... ...production‑ready solutions Improve existing pipelines and introduce modern design...PipelineSeniorRemote work
InterEx Group
New York, NY9 hours ago - ...measurable, competitive advantage through Data Management. We partner with our... ...six continents. Position: Senior Data Engineer Location: NYC, NY... ...OLTP/OLAP, dimensional modeling, medallion architecture) ~ ETL/ELT pipeline development and orchestration (Airflow...PipelineSeniorFull timeWork at office
EXL
New York, NY4 hours ago - ...consultants bring deep expertise in Data Science, Machine Learning and... ...seeking an experienced Data Engineer to join our data team. In this... ...and maintaining scalable data pipelines, data integration processes,... ...of data modeling, data lake/lakehouse architectures, and ETL...PipelineSeniorLocal area
Tiger Analytics
Jersey City, NJ1 day ago - ...Role: Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months... ..., implementing, and maintaining data pipelines and infrastructure for our big data projects... ..., and knowledge of Databricks and Delta Lake will be essential in driving the...PipelineSenior
Zortech Solutions
New York, NY3 days ago - ...Senior Data Engineer Location: NJ, hybrid 3X a week. Final round in person interview Responsibilities... ...large-scale batch and real-time data pipelines with data processing frameworks in... ..., Azure Data Analytics, Azure Data Lake, Azure Data Catalogue, LogicApps and FunctionApps...PipelineSeniorWork experience placement
RIT Solutions
New York, NY1 day ago - ...please visit . Job Title: Senior ML Data Engineer Work Location: Lyndhurst,... ...advanced feature engineering and ETL pipelines to enable robust machine learning... ...Databricks a deep understanding of the medallion architecture and a proven track record...PipelineSeniorRemote work
Futran Tech Solutions Pvt. Ltd.
Lyndhurst, NJ1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer Medallion Pipelines & Delta Lake. Be the first to apply!
Related searches
- bi data engineer New York, NY
- staff data engineer New York, NY
- data visualization developer New York, NY
- data science developer New York, NY
- senior data center engineer New York, NY
- sr information security engineer New York, NY
- IT data engineer New York, NY
- junior big data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer contract New York, NY