Azure Data Engineer: PySpark & Lakehouse Pipelines
Espire Infolabs
Espire Infolabs is looking for a Data Engineer with over 5 years of experience to join their team in the United States. The ideal candidate must have hands-on experience with Microsoft Fabric and Azure Synapse, along with proficiency in Python and/or PySpark for pipeline development. This role involves working with Azure Data Factory, data integration, and understanding Data Modelling and data warehouse concepts. Experience with Agile methodologies and DevOps practices is a plus. #J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer: PySpark & Lakehouse Pipelines in New York, NY vacancy
$120k - $130k
...A leading financial management service provider is seeking an experienced Azure Data Engineer to design and optimize scalable data pipelines within the Azure ecosystem. This role involves developing end-to-end data ingestion processes using Azure Data Factory and Databricks...PipelineRemote workPPL
New York, NY4 days ago- ...Azure Data Engineer With Databricks Expertise Location: Iselin NJ, 6th Avenue... ...onsite) Must have: Databricks, Pyspark, Azure Cloud Services, Asset... ...(Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.) Proficiency...Pipeline
United IT
New York, NY1 day ago - ...Senior Azure Data Engineer Location: Hybrid in Midtown, NYC Local Only/No Relocation We need... ...use—on our Azure + Databricks (PySpark) stack. Candidates must design, develop... ...robust, testable Python/PySpark data pipelines as well as build ingestion frameworks...PipelinePermanent employmentLocal areaRelocation
InterSources
New York, NY10 hours ago - ...-growth organization is seeking a Senior Data Engineer to shape modern data platform architecture using Microsoft Fabric and Lakehouse technologies. You will be responsible for... ...scalable solutions, and enhancing existing data pipelines. Preference is given to candidates...PipelineRemote work
InterEx Group
New York, NY2 days ago - ...Taskus India is looking for a Senior Data Engineer to support their data strategy. The role involves building resilient pipelines, optimizing SQL queries, and ensuring data reliability... ...should have expertise in Python, SQL, and PySpark with at least 5 years in data engineering....Pipeline
Taskus India
New York, NY2 days ago - ...Information Security Data Operations team are working... ...develop the ingestion pipeline of data sources... ...the Cybersecurity Data Lakehouse (CyberDW). This individual... ..., and the Security Engineering teams. They will be responsible... ...using Microsoft Azure technologies....Pipeline
3B Staffing LLC
Jersey City, NJ1 day ago - ...hands-on expertise with: PySpark (RDD, Data Frames, Spark SQL, performance tuning) DPL (Data Pipeline Language / relevant tool-... ...Proficiency in Python for data engineering workflows. Experience... ...on cloud platforms (AWS / Azure / GCP). Familiarity with...Pipeline
Purple Drive
Jersey City, NJ3 days ago - ...A leading technology firm is looking for a Data Engineer to enhance cloud capabilities for federal clients. This role involves designing ETL pipelines, optimizing data workflows on Azure Databricks, and ensuring data quality across systems. The ideal candidate has over...Pipeline
Cybermedia Technologies
New York, NY2 days ago - ...Senior Data Engineer with Databricks/PySpark Location: NJ, hybrid 3X a week. Final round in person interview RESPONSIBILITIES... ...• Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform. • Designing and...PipelineWork experience placement
RIT Solutions, Inc.
New York, NY4 days ago - ...10+ years of experience in data engineering, data analytics, or related... ...). Hands-on experience with Azure Data Services: Azure Data Factory... ...– Azure DevOps, Git, CI/CD pipelines. Strong skills in SQL,... ...dimensional, relational, or lakehouse). Experience in building and...Pipeline
Saxon Global
New York, NY7 hours ago - ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands... ...Design, develop, and maintain data pipelines and ETL workflows using PySpark, SQL... ...Experience with cloud platforms (AWS, Azure, or GCP) and related data services (...PipelineRemote work
VBeyond
Jersey City, NJ3 days ago - ...Data Engineer We are seeking an experienced Data Engineer with strong expertise in Azure cloud services, Data Engineering practices, and DevOps... ...Design and develop data pipelines and ETL processes using Azure... ..., relational, or lakehouse). ~ Experience in building...Pipeline
PamTen
Jersey City, NJ3 days ago - ...A SaaS business services provider is seeking an AI Data Engineer to support the development of a centralized data platform on AWS. This role involves creating and maintaining a medallion Lakehouse using AWS services and building AI-driven solutions. Candidates should have...PipelineRemote workFlexible hours
Profitsolv
New York, NY1 day ago $190k - $220k
...Senior Data Engineer, Data Lakehouse Infrastructure United States Build to Protect Civilization TRM is a blockchain intelligence company that’s... ...data lakehouse to support complex workloads, real-time data pipelines, and secure data governance—at petabyte scale. We are...PipelineRemote workShift workTRM
New York, NY2 days ago$125k
...opportunity then please let me know. Position: Data Engineer - Python/PySpark Location: Jersey City, NJ (3 Days onsite/week)... ...PySpark expertise - Experience building scalable ETL/ELT pipelines in big data environments - Strong understanding of KYC...PipelineFull time3 days per weekDiverse Lynx
Jersey City, NJ4 days ago- ...Hi, Our client is looking for Data Engineer - Python/PySpark in Jersey City, NJ / Hybrid below is the detailed requirements.... ...PySpark expertise ~ Experience building scalable ETL/ELT pipelines in big data environments ~ Strong understanding of KYC...PipelineFull time
Lorven Technologies
Jersey City, NJ2 days ago - ...Overview: Senior Data Engineer - Python & PySpark Job Summary We are seeking an experienced... ...developing, and optimizing scalable data pipelines and ETL/ELT workflows for processing... ...platforms such as: AWS Azure GCP Work with orchestration...Pipeline
Purple Drive
Jersey City, NJ1 day ago - ...Royal Cyber is seeking a remote Senior Data Engineer available from 6 PM to 3 AM. This role requires over 10 years of experience... ...and ensure data quality and performance. Key skills include PySpark, SQL, and Azure services. A Bachelor's degree in Computer Science or equivalent...PipelineRemote work
royal cyber
New York, NY2 days ago - ...InterWell Health is seeking a Senior Data Engineer to design and evolve a scalable cloud-native lakehouse platform for its healthcare... ...-on engineering to build data pipelines, implement data governance,... ...experience with Databricks, Azure, and data engineering principles...PipelineRemote work
InterWell Health
New York, NY2 days ago - ...A leading technology firm is seeking a Data Engineer to support major cloud migration initiatives. The role involves modernizing on-prem Data Lakes to a cloud-based architecture on AWS. Candidates should possess strong data engineering skills, experience in cloud migration...Pipeline
Insight Global Technologies
New York, NY2 days ago - ...HTEC Group is seeking an experienced Data Engineer to enhance their data infrastructure. The ideal candidate will have over 7 years of... ...Scala. Responsibilities include designing and maintaining data pipelines, ensuring data quality, and collaborating with business stakeholders...Pipeline
HTEC Group Inc
New York, NY2 days ago - ...A data solutions company in the United States is looking for a Data Engineer to design and implement data pipelines and governance frameworks for enterprise clients. This role requires over 4 years of data engineering experience, proficiency in SQL and Python, and hands...PipelineFull timeRemote work
Mashbot, Inc.
New York, NY2 days ago - ...ASRC Federal Holding Company is hiring a Business Intelligence Data Engineer to support data modernization for the Defense Contract Audit Agency (DCAA). The role involves designing scalable data pipelines, integrating AI/ML solutions, and ensuring data quality. Candidates...PipelineContract work
ASRC Federal Holding Company
New York, NY2 days ago - ...Hands-on experience deploying AI agents using Azure AI Foundry Experience building and managing agents in Copilot Studio... ...authorization concepts Experience with Azure DevOps (Repos, Pipelines, Boards, CI/CD) Intermediate experience in Python for backend...Pipeline
Diamondpick
New York, NY3 days ago - ...Data Engineer Design and develop technology solutions that meet the business requirements... ...platform. Design and develop scalable data pipelines using modern data stack technologies.... ...Engineer in any public cloud, preferably on Azure as well as on a cloud warehouse like...Pipeline
Keylent Inc
Jersey City, NJ4 days ago - ...looking for an experienced data engineer who thrives on solving applied... ..., build robust ETL/ELT pipelines, and optimize data flows using... ...Spark (Databricks preferred), PySpark, or similar distributed systems... ...of experience with data lakehouse or warehouse platforms, schema...PipelineContract workFor contractorsRemote work
MBO Partners
New York, NY2 days ago - ...Azure Data Engineer Location: Raleigh, NC or Weehawken NJ (5 Days Work from Office) Duration: Long Term In-person Interview Mandatory... ...in a business environment Experience with building data pipelines and applications to stream and process datasets at low...PipelineWork at office
United Software Group
Weehawken, NJ2 days ago - ...Cloud Data Engineer- Azure/Databricks/Snowflake Location - NYC, NY or Iselin, NJ 12+ months –... ...remote Key Requirements Must have pipeline development, platform setup and configuration experience Strong SQL and PySpark skills (must be able to answer SQL...PipelineWork at officeRemote work
Saxon Global
New York, NY1 day ago - ...Role: Data Engineer Location - New York, NY Onsite Experience... ...in developing data pipeline solutions to ingest and exploit... ...Databricks and Apache • Spark (PySpark and Scala). • Build data ingestion... ...robust data lake or Lakehouse architecture. •• Ensure high...PipelinePermanent employmentFull time
AceStack LLC
New York, NY3 days ago - ...Azure Data Engineer New York, NY 10017 Azure Cloud Expertise: ~ Design, implement, and optimize data solutions on the... ...Data Factory and Databricks: Develop and maintain data pipelines using Azure Data Factory for efficient and reliable data movement...Pipeline
Futran Tech Solutions Pvt. Ltd.
New York, NY58 minutes ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer: PySpark & Lakehouse Pipelines. Be the first to apply!
Related searches
- azure data engineer New York, NY
- azure specialist New York, NY
- devops engineer azure New York, NY
- azure infrastructure engineer New York, NY
- azure security engineer New York, NY
- cloud engineer azure New York, NY
- azure solution architect New York, NY
- azure developer New York, NY
- azure data architect New York, NY
- microsoft azure architect New York, NY