Azure Data Engineer: PySpark & Lakehouse Pipelines
Espire Infolabs
Espire Infolabs is looking for a Data Engineer with over 5 years of experience to join their team in the United States. The ideal candidate must have hands-on experience with Microsoft Fabric and Azure Synapse, along with proficiency in Python and/or PySpark for pipeline development. This role involves working with Azure Data Factory, data integration, and understanding Data Modelling and data warehouse concepts. Experience with Agile methodologies and DevOps practices is a plus. #J-18808-Ljbffr Espire Infolabs
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer: PySpark & Lakehouse Pipelines in New York, NY vacancy
- A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing...PipelineFull time
$140k - $160k
...leading media company in New York is seeking a Senior Data Engineer to design and scale the modern data platform. This... ...will have over 5 years of experience in cloud data pipelines using Spark, strong skills in PySpark and SQL, and a passion for data governance. The role...Pipeline- S&P Global is looking for a Data Engineer to build and maintain scalable data processing pipelines that support critical data sourcing and machine learning solutions... ...expertise in Python, SQL, and data ecosystems like PySpark and Databricks. You will contribute to various...Pipeline
$140k - $145k
...Digital, Cloud & DevOps, Data, and Software Engineering, serving notable financial... ...managing data solutions on the Azure platform within the... ...develop, and maintain data pipelines in Azure. Automate data... ...technologies like Spark and Pyspark. Experience applying data...PipelineFull timeFlexible hoursSynechron
Weehawken, NJ3 days ago- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands... ...Design, develop, and maintain data pipelines and ETL workflows using PySpark, SQL... ...Experience with cloud platforms (AWS, Azure, or GCP) and related data services (...PipelineRemote work
VBeyond
Jersey City, NJ3 days ago - Risebird is seeking an Azure Data Engineer to design, develop, and optimize scalable data pipelines on Microsoft Azure. This role involves working with cloud-based data... ...ADF, Databricks, and SQL, along with skills in PySpark and Python. Collaborating with analytics and business...Pipeline
- A leading technology firm is looking for a Data Engineer to enhance cloud capabilities for federal clients. This role involves designing ETL pipelines, optimizing data workflows on Azure Databricks, and ensuring data quality across systems. The ideal candidate has over...Pipeline
- ...Goldman Sachs Group, Inc. is seeking a Vice President Data Engineer in New York to join the Lakehouse and AI Data Platform team. The role involves designing, building, and supporting data pipelines on a modern data platform while ensuring data quality and efficiency. Candidates...Pipeline
Goldman Sachs Group, Inc.
New York, NY4 days ago - ...Goldman Sachs is seeking a Data Engineer to join the Lakehouse and AI Data Platform team in New York. The ideal candidate will design and support data pipelines, ensuring data reliability and quality. Responsibilities include building batch and streaming data pipelines...Pipeline
Goldman Sachs
New York, NY3 days ago $190k - $220k
Senior Data Engineer, Data Lakehouse Infrastructure TRM is a blockchain intelligence company that’s on a mission to build a safer world for billions... ...lakehouse to support complex workloads, real-time data pipelines, and secure data governance—at petabyte scale. We are...PipelineRemote workShift work- ...Hexion is seeking a senior, hands‑on Azure data engineer to lead the design, implementation, and... ...governed, reliable, and maintainable pipelines. You will work closely with architecture... .... Proficiency in SQL, Python, and PySpark. Strong troubleshooting, communication...Pipeline
- Royal Cyber is seeking a remote Senior Data Engineer available from 6 PM to 3 AM. This role requires over 10 years of experience in... ...ensure data quality and performance. Key skills include PySpark, SQL, and Azure services. A Bachelor's degree in Computer Science or equivalent...PipelineRemote work
- ...of different types of data systems across the organization... ...SQL Server, Teradata, Azure SQL Data Warehouse and... ...and other software engineers on design Collaborate... ...Data Lake, Data Lakehouse and Data Warehouse concepts... ...etc. Building data pipelines via tools like Apache...PipelineWork experience placement
- Software Engineering - Data, Lakehouse and AI Data Platform Engineer - Vice President -New York New York, NY, United States Job Description The... ...maintaining large-scale data platforms, delivering production pipelines, improving reliability and quality, and partnering...Pipeline
- ...Hands-on experience deploying AI agents using Azure AI Foundry Experience building and managing agents in Copilot Studio... ...authorization concepts Experience with Azure DevOps (Repos, Pipelines, Boards, CI/CD) Intermediate experience in Python for backend...Pipeline
Diamondpick
New York, NY3 days ago - ...We're looking for a Senior Data Engineer that is innovative, curious,... ...maintain scalable, reliable data pipelines that support sell-side media... ...requirements. Develop lakehouse-style data models that... ...~ Advanced SQL, Python, and PySpark skills and experience building...PipelineWork experience placement
datafuelX Inc.
New York, NY2 days ago - ...person interview Senior Data Engineer Job Responsibilities... ...operations and resolve pipeline issues as a senior Data Engineer... ...data pipelines using PySpark within the Medallion Lakehouse architecture on... ...Hands-on experience with Azure Databricks, including Medallion...PipelineContract work
Compu-Vision Consulting
New York, NY3 days ago - A leading technology firm is seeking a Data Engineer to support major cloud migration initiatives. The role involves modernizing on-prem Data Lakes to a cloud-based architecture on AWS. Candidates should possess strong data engineering skills, experience in cloud migration...Pipeline
- ...Azure Data Engineer Location: Raleigh, NC or Weehawken NJ (5 Days Work from Office) Duration: Long Term In-person Interview Mandatory... ...in a business environment Experience with building data pipelines and applications to stream and process datasets at low...PipelineWork at office
United Software Group
Weehawken, NJ2 days ago $140k - $180k
A leading data consulting firm is seeking experienced Data Engineers for a high-impact data modernization initiative. The role involves building and maintaining scalable data pipelines and foundational components of Data Warehouse. Candidates should have extensive experience...Pipeline- ...AI Studio and AI Engines, the company helps... ...with AI. Senior Data Engineer Are you... ...-time and batch pipelines, and developing cloud... ...such as AWS, GCP, Azure, Databricks, and... ...performance tuning), and PySpark/Apache Spark.... ...Schema) and Lakehouse/Warehouse architectures...PipelineH1bLocal area
Fusemachines
New York, NY1 day ago $65 - $70 per hour
...Position: Data Engineer- AWS Location: Jersey City, New Jersey Duration... ...and maintain essential data pipelines and architectures across... ...pipelines using Python and PySpark. Proficient in Python and PySpark... .... Expertise in cloud data lakehouse platforms such as AWS Data Lake...PipelineFull timeContract workPinnacle Group
Jersey City, NJ1 day ago- ...JOB DESCRIPTION 1.Azure Platform Experience: The candidate... ...but not limited to Azure Data Factory, Databricks, Data Lake... ..., build, and maintain ETL pipelines, manage data lakes, and create... ...plus. 2.Azure Data Engineer: Design, implement, and maintain...Pipeline
Sparktek
New York, NY4 days ago - ...Role: Lead Data Engineer Location: New York Mode of... ...and adaptable data ingestion pipelines. Must Have:... ...Fabric components, including Lakehouse, One Lake, Delta Lake format... ...- Strong proficiency in PySpark for data processing and transformation...Pipeline
Maintec Technologies
New York, NY5 days ago - HTEC Group is seeking an experienced Data Engineer to enhance their data infrastructure. The ideal candidate will have over 7 years of relevant... .... Responsibilities include designing and maintaining data pipelines, ensuring data quality, and collaborating with business...Pipeline
- ...Job Title Sr Azure Data Engineer Location New York City, NY (Local Must & Hybrid) Duration 6+ Month Contract / C2C Exp 10+ yrs... ...BI. They should be able to design build, and maintain ETL pipelines, manage data lakes and create insightful reports and...PipelineContract workH1bLocal area
Damco Solutions
New York, NY4 days ago - ...Azure Data Engineer Date: Start Date: 10/01/2025 Job Description: Assist in building and maintaining the infrastructure needed... ...big data technologies. Implement and support scalable data pipelines, ensuring they meet functional and non-functional business...Pipeline
Tanisha Systems
New York, NY5 days ago - The Walt Disney Company is seeking a Data Engineer II for the Commerce Data Pipelines team in New York. This position involves creating and maintaining data pipelines essential for data-driven business decisions, collaborating closely with various teams to improve data...Pipeline
$141.9k - $190.3k
...Senior Data Engineer Technology is at the heart of Disney's past,... ...and maintain large scale data pipelines that ingest vendor data (paid... ...reporting using Databricks, PySpark, SQL, and Unity Catalog.... ...Catalog, data governance, and Lakehouse patterns. ~ Strong experience...PipelineThe Walt Disney Studios
New York, NY1 day ago$110k - $130k
...workplace that includes engineers around the world. We value... ...implement complex ELT/ETL pipelines for the cleansed and curated data layers in the medallion... ...relational data modeling and PySpark for large-scale data processing within the Lakehouse, ensuring outputs meet...PipelineLocal areaRemote workFlexible hoursNew York Times
New York, NY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer: PySpark & Lakehouse Pipelines. Be the first to apply!
Related searches
- azure security engineer New York, NY
- microsoft azure architect New York, NY
- azure specialist New York, NY
- azure developer New York, NY
- azure solution architect New York, NY
- devops engineer azure New York, NY
- azure infrastructure engineer New York, NY
- azure data engineer New York, NY
- cloud engineer azure New York, NY
- senior data center engineer New York, NY