Azure Lakehouse Data Engineer - ETL & Spark Expert
JobCubby
Guidehouse is hiring a Senior Data Engineer to design, build, and operate Azure Lakehouse architectures using Azure Databricks, ADLS Gen2, Synapse, and Data Factory for analytical and operational workloads in a federal context. You will develop scalable ETL/ELT pipelines with Spark, Delta Lake, Python, SQL, and Scala; collaborate across teams; and implement data quality, performance, and cost optimization. #J-18808-Ljbffr JobCubby
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Azure Lakehouse Data Engineer - ETL & Spark Expert in Brooklyn, NY vacancy
- Harrison Street seeks an experienced Data Engineer to design, build, and maintain data pipelines... ...and data scientists, implement scalable ETL, and ensure data quality and security across... ...Platform. The role requires expertise in Azure services, Fabric, SQL, and modern BI...Suggested
- Overview The Infosys Data and Analytics (DNA) unit is at the forefront of transforming... ...technologies, collaborate with industry experts, and contribute to transformative projects... ...integration. Required Skill and Experience Python, Spark AWS Preferred Skill and Experience Python...SuggestedFull timeTemporary workRelocation
- ...testing, reviews, and production issue resolution while documenting technical decisions and maintaining code artifacts. You will work with Python, Spark, and AWS on data/analytics projects and may relocate or travel for assignments as needed. #J-18808-Ljbffr Infosys LimitedSuggestedRelocation
$100k - $120k
A leading technology company is seeking a Sr. Azure Data Engineer in Union City, New Jersey. The ideal candidate will have over 10 years of experience in data warehousing and ETL development, with strong skills in Informatica PowerCenter, Azure Data Factory, and SQL solutions...SuggestedRemote workFlexible hours- ...Job Title: ETL Data Engineer Job location : Jeresy,NJ (Onsite|) Job Type: Fulltime Job Description • Design and... ...as a Senior Data Engineer in any public cloud, preferably on Azure as well as on a cloud warehouse like Snowflake or Azure...SuggestedFull time
Texas State Library and Archives Commision
Jersey City, NJ5 days ago - ...Provide data from various bank applications for use by analysts, modelers, etc. Analysis and validation of data Testing... ...new data sources Must Have Technical Skills: ETL SQL Flex Skills/Nice to Have: Spark Soft Skills: Cloud Hybrid is an equal opportunity employer...Permanent employmentContract workLocal areaFlexible hours
Cloud Hybrid Technologies LLC
Brooklyn, NY1 day ago $140k - $145k
..., Digital, Cloud & DevOps, Data, and Software Engineering, serving notable financial... ...managing data solutions on the Azure platform within the... ...management skills: AKV, UAMI. ETL experience is mandatory. Knowledge... ...Big Data technologies like Spark and Pyspark. Experience...Full timeFlexible hours- Cloud Hybrid Technologies LLC is seeking a data-focused role to support analysts and modelers by delivering data from bank... ...sources in a fast-paced environment. The role requires ETL and SQL expertise, with Spark optional as a nice-to-have; you will collaborate with...
$80k - $90k
...Remote, Milwaukee) Data EngineerApplylocations... ...is seeking a Data Engineer. The Data Engineer... ...Fabric data lakehouse as well as developing... ...similar platforms like Azure Synapse or Databricks... ...**data modeling**, ETL/ELT processes, and... ...as **Python** or **Spark/PySpark**.*...Remote jobCasual workLocal area- Job Family Data Science & Analysis Travel Required... ...Design, build, and operate Azure Lakehouse architectures using... ...and optimize scalable ETL/ELT pipelines using Databricks Workflows, Spark jobs, and Delta Lake to... ...degree in Computer Science, Engineering, Data Science, or...Temporary workFlexible hours
- OhioHealth is seeking an experienced Data Engineering Tech Lead to oversee the data platform architecture and ETL development in a cloud-centric environment.... ...scalable pipelines using Informatica, IDMC, Spark, and Databricks on Azure Cloud, with a strong focus on leadership...Remote job
- Dynata in Westport, CT is seeking a senior data engineer to design and implement scalable batch and streaming data pipelines using Spark, Kafka, and Flink, and to build the Bronze/Silver/Gold lakehouse with Delta Lake or Iceberg. You will optimize PySpark and SQL transformations...
$140k - $185k
...responsible forturning data architecture vision... ...of the data engineering function. Leadday-to... ...leveraging Boomi, Dbt, Azure Data Bricks, Boomi/... ...with Databricks (Spark), Boomi/Rivery, and... ...patterns for scalable lakehouse processing. Strong experience with ETL/ELT design and...Contract workTemporary workWork at officeLocal areaRemote workHome office- ...Description Overview As a Data Engineer Manager, you will... ...within AWS and Azure cloud environments... ..., including data lakehouse patterns, SQL... ...integration patterns (ETL/ELT, streaming)... ...and automation. Expert-level proficiency... ...technologies such as Kafka, Spark, Flink....Local areaImmediate startFlexible hours
$159k - $208.95k
...name on itWe are seeking a Staff Data Engineer to lead the technical design... ...tools and frameworks such as Spark, Airflow, Kafka, Databricks, and... ...native services (AWS, GCP, or Azure)Deep understanding of data modeling, distributed systems, ETL/ELT pipelines, and streaming...Temporary workLocal areaWorldwide$91.7k - $163.7k
...the flow of health data and information to... ...Senior Cloud Data Engineer - Remote will be a... ...legacy data platforms, ETL/ELT processes, and... ...solutions leveraging Azure, Snowflake,... ...warehouses, data marts, and lakehouse architectures... ...SQL Server, Python, Spark/Pyspark, ETL/ELT development...Remote jobMinimum wageFull timeWork experience placementWork at officeLocal area$100k - $120k
About the role As a Sr. Azure Data Engineer , you will make an impact by driving end-to-end data integration and migration initiatives across... ...movement from source systems to reporting layers. Implement ETL processes using Informatica PowerCenter and optimize performance...Temporary workRemote work$125k - $145k
...building Our team runs a range of data and AI projects across the... ...AI-ready data platform and lakehouse that supports analytics,... ...role that spans data engineering, AI product enablement, and... ...architecture using Python, Spark, SQL, and modern ETL practices, turning large raw...Work at officeFlexible hoursShift workDay shift$86k - $115k
...Type: Full Time The Senior Data Engineer designs, evaluates, and tests... ...for designing and developing ETL process for extracting data from... ...and quality. Utilize Azure Data Factory to create pipelines... ...ETL Processes Delta Lakes Lakehouse Architecture 2+ years of experience...Full timeTemporary workWork experience placementRemote work- ...US Scheduled Hours 40 The C-BRAIN Data Engineer is a key technical member of the... ...infrastructure. Develops and maintains ETL/ELT workflows using tools such as Apache Spark, dbt, Airflow, or equivalent;... ...cloud data platforms: Microsoft Azure preferred (AWS or GCP also...Remote jobWork experience placementWork at office
$130k - $150k
...batch and streaming data pipelines using Apache Spark, Kafka, and Flink Build... ...within the lakehouse (Delta Lake / Iceberg... ...reviews and enforce engineering standards and best practices... ...-scale delivery Expert proficiency in Python... ...services: AWS Glue, Azure Data Factory, GCP Dataflow...Full time$128k - $190k
Senior Data Engineer - Homes.com - Arlington, VA Job Description CoStar Group... ...scalable data pipelines and ETL processes using Databricks,... ...services Implement and optimize Spark jobs, data transformations,... ...cloud platforms, including AWS or Azure Experience working with NoSQL...Work at officeImmediate startWork from home- Only Locals to OHIO Data Engineer with 6+ years of hands‑on experience building and maintaining robust data pipelines... ...workloads. Design, build, and maintain scalable ETL/ELT pipelines using Python, Apache Spark, and Azure Data Factory to ingest data from diverse retail...Local area
- ...Summary We are seeking a Data Engineer with strong hands-on Databricks... ...Oracle PL/SQL-based ETL processes to Microsoft Azure Databricks. The ideal candidate... ...them to Databricks using Spark SQL and/or PySpark. Design... ...users and subject matter experts to ensure business-level...
- ## Senior Data Engineer (Microsoft Fabric / Financial Data)Applyremote type... ...* Equivalent experience with Azure Synapse Analytics, Databricks... ....* Strong understanding of ETL/ELT development, data quality... ...Fabric Data Factory, Lakehouse, Warehouse, Power BI, or related...Contract workWork at officeWork from homeWork visa
$117.6k - $161.7k
The Senior Data Engineer builds and evolves the data foundation that powers... ...platform on the Databricks Lakehouse. This role is responsible for... ...pipelines using Databricks, Spark, Delta Lake, and event‑driven... ...platforms. Experience with Azure Data Factory, Azure Data Lake...Full timeTemporary workApprenticeshipWork at officeRemote workWork from homeHome officeMonday to Friday$77.5k - $176k
Data Engineer, Senior The Opportunity: Ever-expanding technology like IoT,... ...experience building scalable ETL/ELT workflows for reporting and... ...cloud, including AWS, Microsoft Azure, or Google Cloud Experience... ...or computing tools, including Spark, Databricks, Hadoop, Hive, AWS...Full timeContract workPart timeWork at officeLocal areaRemote work- American Tire Distributors seeks a Senior Data Engineer to identify trends, manage master data, and automate data management across multiple domains. You will design data pipelines to ETL data into data warehouses or data lakes and implement data models that support critical...Remote job
- Mandatory Skills: Apache Spark, Hive, Kafka, Amazon Glue, Google Dataflow... ...MongoDB, Cassandra. Role: Big Data Engineer Job Overview: We're seeking a... ...data systems, building ETL pipelines, and deploying AI models... ...Cloud Storage: Work with AWS, Azure, GCP, Databricks. Store and...
- ...our dynamic team as a Data Engineer. Details of the same have... ...data pipelines and ETL processes for efficient... ...platforms (AWS, Google Cloud, Azure) and associated data... ...with Hadoop, Spark, Kafka, or other big data... ...group of thinkers and experts to make a difference. #J...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Lakehouse Data Engineer - ETL & Spark Expert. Be the first to apply!
Related searches
- azure developer Brooklyn, NY
- azure specialist Brooklyn, NY
- junior data engineer remote Brooklyn, NY
- director data engineering Brooklyn, NY
- data engineer intern Brooklyn, NY
- senior data quality engineer Brooklyn, NY
- senior cloud data engineer Brooklyn, NY
- data engineer contract Brooklyn, NY
- data infrastructure engineer Brooklyn, NY
- entry level big data engineer Brooklyn, NY