Azure Databricks ETL Architect & Data Pipelines Lead
TechDigital Group
An established industry player is seeking a seasoned Data Engineer with extensive experience in Azure Databricks and Pyspark. This role involves designing and implementing complex data pipelines for lakehouse and data warehouse solutions, leveraging Azure Cloud Services and ADF. The ideal candidate will have a strong background in data engineering, ETL processes, and Agile methodologies. Join a dynamic team that values innovation and collaboration, and take your career to the next level by contributing to impactful data projects that drive business success. #J-18808-Ljbffr
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Azure Databricks ETL Architect & Data Pipelines Lead in Washington DC vacancy
- ...Data Engineer A mission-driven organization... ...scalable data pipelines, enabling advanced... ...with expertise in Databricks, Azure, and CI/CD... ...SQL skills. You'll lead technical best practices... ...workloads Implement ETL/ELT solutions for... ...Collaborate with architects, analysts, and...DatabricksPipeline
RIT Solutions
Washington DC13 days ago - ...Azure Databricks And Pyspark Skills Required skill/JD Azure Databricks and Pyspark skills: Data ETL / Data Engineering Key technology: ADF, Databricks, dbt, Azure Cloud Services... ...experience in building complex data pipeline for lakehouse/data warehouses using Agile...DatabricksPipelineWork experience placement
Omni Inclusive
Washington DC4 days ago $99k - $225k
...Data Engineer, Lead The Opportunity: Ever-expanding technology... ...and deployment of pipelines and platforms that... ...developing scalable ETL and ELT workflows for... ...AWS, Microsoft Azure or Google Cloud ~5+... ...tools including Spark, Databricks, Hadoop, Hive, AWS EMR...DatabricksPipelineFull timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Washington DC3 days ago$160.7k - $306.5k
Responsibilities Lead, mentor, and manage a team of data engineers working on new pipeline development and... ...patterns like Databricks Delta Live Tables... ...with the Solution Architect to identify and... ...(e.g., AWS or Azure) and data engineering... ...of scalable ETL/ELT tools and services...DatabricksPipelineLocal area$160.7k - $306.5k
...forward! As the Data Engineer Team Lead, you will lead a... ...sustainment of all data pipelines. This senior role... ...patterns like Databricks Delta Live Tables... ...the Solution Architect to identify and implement... ...(e.g., AWS or Azure) and data... ...maintenance of scalable ETL/ELT tools and...DatabricksPipelineLive inWork at officeLocal areaAccenture
Arlington, VA2 days ago$99k - $225k
...structured and unstructured data available today... ...solutions and lead data engineering activities... ...and deployment of pipelines and platforms that... ...scalable ETL and ELT workflows for... ...including AWS, Microsoft Azure or Google Cloud 5+... ...including Spark, Databricks, Hadoop, Hive, AWS...DatabricksPipelineFull timeContract workPart timeWork at officeLocal areaRemote work$160.7k - $306.5k
...forward! As the Data Engineer Team Lead, you will lead a... ...sustainment of all data pipelines. This senior role... ...patterns like Databricks Delta Live Tables... ...the Solution Architect to identify and implement... ...(e.g., AWS or Azure) and data... ...maintenance of scalable ETL/ELT tools and...DatabricksPipelineLive inLocal area$160.7k - $306.5k
Responsibilities Lead, mentor, and manage a team of data engineers working on new pipeline development and... ...modular patterns like Databricks Delta Live... ...with the Solution Architect to identify and... ...of scalable ETL/ELT tools and services... ...(e.g., AWS, Azure) and data engineering...DatabricksPipelineLive inLocal area- ...Azure Specialist (Engineer) Alexandria... ...is responsible for architecting, implementing, and... ...Experience with Azure Data Services including... ...Analytics, Azure Databricks, Azure Data Lake... ...experience with ETL/ELT processes, data... ...warehousing, and data pipelines. Migrate legacy...DatabricksPipelineWork at office2 days per week3 days per week
Match Point
Alexandria, VA5 days ago - ...Azure Data Architect/Engineer The intend of this work is to guide the design and development... ...data ingestion process into Azure Databricks environment, creating data services... ...High proficiency in developing complex ETL Data Pipelines using Databricks with PySpark,...DatabricksPipeline
Mindlance
Washington DC3 days ago - ...Role: Azure Data Solutions Architect Client: DC Government Location: Washington,... ...Database Architecture & Design: Lead the design and... ...high-volume environments. ETL and Data Pipelines: Architect, develop, and... ...SSAS, Azure Data Factory, Databricks, Python, and DAX; and senior...DatabricksPipelinePermanent employmentFull time
Go Intellects
Washington DC1 day ago - Analytica is seeking a Technical Lead - Data Engineering in Bethesda, MD. This hybrid role requires a senior engineer... ...8+ years of experience in building and maintaining ETL/ELT pipelines and strong expertise in Databricks and AWS. Candidates should have a Bachelor’s degree...DatabricksPipeline
$110k - $170k
...Washington, D.C., is seeking an experienced Staff Data Engineer to design, develop, and maintain enterprise-grade data infrastructure. You will leverage Azure and Databricks technologies to build robust data pipelines and ensure data governance. The ideal candidate will...DatabricksPipelinePress Ganey
Washington DC14 hours ago- ...complete cloud analytics and data platform for AI. By... ...As the Principal AI Architect for Teradata AI Studio... ...tracking, MLOps pipelines, or AI agent development... ...Teradata Vantage, Snowflake, Databricks, or equivalent) at... ...architecture (AWS, Azure, GCP) and containerized...DatabricksPipelinePermanent employmentFlexible hours
Teradata
Washington DC15 hours ago - ...E Logic is hiring a Modern ETL Developer to design, build, and deploy cloud-native data pipelines in the Washington DC area. This hybrid role focuses on developing... ...creating flexible data pipelines using AWS Glue and Databricks, and converting legacy ETL code into scalable...DatabricksPipelineWork at officeFlexible hours
E-Logic, Inc.
Washington DC1 day ago - ...a hands-on Technical Lead – Data Engineering to support... ...centered around Databricks and modern data engineering... ...maintenance of scalable data pipelines, integrations, and... ...~ Collaborate with architects and program leadership... ...and maintaining ETL/ELT pipelines and large...DatabricksPipelineFor contractorsLocal area
Analytica, Inc.
Bethesda, MD7 days ago - An established industry player is seeking a skilled Data Engineer proficient in Azure Databricks and Pyspark. This role involves designing and implementing complex data pipelines for lakehouse and data warehouse solutions, leveraging Azure Cloud Services and Agile methodologies...DatabricksPipeline
- ...a hands‑on Technical Lead - Data Engineering to support... ...heavily centered around Databricks and modern data... ...maintenance of scalable data pipelines, integrations, and... ...AWS Collaborate with architects and program leadership... ...building and maintaining ETL/ELT pipelines and large...DatabricksPipelineFor contractorsLocal area
- ...E-logic is hiring a Modern ETL Developer to design, build, and deploy cloud-native data pipelines within our expanding cloud-based analytics ecosystem for the Office... ...pipelines from scratch utilizing AWS Glue and Databricks within a pre-production AWS environment. Convert...DatabricksPipelineWork at officeFlexible hours
E-Logic, Inc.
Washington DC14 hours ago $180k - $190k
...Acclaim Technical Services, Inc. is hiring an ETL Developer with TS/SCI clearance to design and implement enterprise-level ETL... ...NiFi in Bethesda, MD. Responsibilities include building complex data pipelines, optimizing real-time performance, and collaborating with stakeholders...PipelineAcclaim Technical Services, Inc.
Bethesda, MD14 hours ago- ...Data Engineer Lead Lanham, Maryland, United States AST SpaceMobile... ..., production‑grade data pipelines and analytical infrastructure... ...such as AWS (preferred), Azure, or GCP ETL/ELT tools such as Airflow,... ...data ecosystems including Databricks, Snowflake, Redshift, or...DatabricksPipelineWork at office
AST SpaceMobile
Lanham, MD11 days ago - Job Description Experienced in architecting end-to-end data pipelines, dimensional data models, and cloud-based warehousing solutions utilizing VA-approved platforms such as Azure Data Factory, Azure Databricks, Python, SQL Server, and Dagster. Manage diverse BI environments...DatabricksPipelineTemporary work
- 9th Way in Washington, DC is seeking a Senior ETL Developer to support enterprise data integration, reporting modernization, and analytics initiatives. The role involves developing and maintaining ETL pipelines and ensuring data quality across multiple business lines....Pipeline
- Cybermedia Technologies is seeking a Data Engineer in McLean, VA. This role involves designing ETL pipelines, optimizing data processing in Azure Databricks, and supporting data migration efforts. The ideal candidate will have over 7 years of experience in data engineering...DatabricksPipeline
- Makpar is looking for a Senior Data Engineer in Washington, D.C. This role involves building and orchestrating data pipelines using Databricks, designing ETL processes, and translating business needs into SQL queries. A Bachelor’s or Master’s degree specializing in computer...DatabricksPipeline
$110k - $120k
...Azure Data & AI Strategy Expert At JDA TSG, we equip many of the... ...Purview (Data), Microsoft Fabric, Databricks, and Azure AI Foundry to... ...Microsoft Fabric, and Databricks. Lead workshops and strategy... ...lakehouse strategies, real-time pipelines, and integration with Power...DatabricksPipelineJDA TSG
Washington DC2 days ago- ...highly skilled Solution Architect specializing in Microsoft Azure Data & Microsoft Fabric, with... ...working knowledge of Databricks, to design, build, and... ...optimize scalable data pipelines using ADF, Fabric, and... ...experience with data modeling, ETL/ELT, and enterprise data...DatabricksPipelineFull time
- A tech company in Washington, DC is seeking an Azure Data Engineer Developer with extensive experience in Microsoft Azure data stack,... ...Factory and SQL Database. The role involves building complex ETL pipelines and providing expertise in data modeling and integration. Ideal...Pipeline
- ...in Arlington, Virginia is looking for a Senior Data Engineer to support a Modernized Data Science Platform... ...have extensive experience in building data pipelines and models using platforms like Palantir Foundry or Databricks. This role demands technical leadership and hands...DatabricksPipeline
$117.8k - $189k
Kapitus is looking for a Senior MLOps Architect in Washington, D.C. to design and scale... ...involves owning the architecture for ML pipelines ensuring reliability, governance, and security... ..., especially with SageMaker and Databricks, and be skilled in integrating LLM capabilities...DatabricksPipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks ETL Architect & Data Pipelines Lead. Be the first to apply!
Related searches
- azure security engineer Washington DC
- microsoft azure architect Washington DC
- azure specialist Washington DC
- azure developer Washington DC
- devops engineer azure Washington DC
- azure infrastructure engineer Washington DC
- azure data engineer Washington DC
- cloud engineer azure Washington DC
- data lead Washington DC
- data team lead Washington DC