Azure Databricks ETL Architect & Data Pipelines Lead
TechDigital Group
An established industry player is seeking a seasoned Data Engineer with extensive experience in Azure Databricks and Pyspark. This role involves designing and implementing complex data pipelines for lakehouse and data warehouse solutions, leveraging Azure Cloud Services and ADF. The ideal candidate will have a strong background in data engineering, ETL processes, and Agile methodologies. Join a dynamic team that values innovation and collaboration, and take your career to the next level by contributing to impactful data projects that drive business success. #J-18808-Ljbffr TechDigital Group
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Azure Databricks ETL Architect & Data Pipelines Lead in Washington DC vacancy
$72.2k - $147.9k
...Build, maintain, and optimize data pipelines for extracting, transforming, and loading (ETL) data from various sources into... ...usable format, and load it into Azure data storage solutions such as... ...such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure...DatabricksPipelineContract workWork experience placement- ...community is seeking a Data Engineer to join... ...scalable data pipelines, enabling... ...with expertise in Databricks , Azure , and CI/CD automation... ...skills. You'll lead technical best... ...Implement ETL/ELT solutions for... ...Collaborate with architects, analysts, and business...DatabricksPipeline
RIT Solutions, Inc.
Washington DC6 days ago $160.7k - $306.5k
Responsibilities Lead, mentor, and manage a team of data engineers working on new pipeline development and... ...patterns like Databricks Delta Live Tables... ...with the Solution Architect to identify and... ...(e.g., AWS or Azure) and data engineering... ...of scalable ETL/ELT tools and services...DatabricksPipelineLocal area$99k - $225k
...structured and unstructured data available today... ...solutions and lead data engineering activities... ...and deployment of pipelines and platforms that... ...scalable ETL and ELT workflows for... ...including AWS, Microsoft Azure or Google Cloud 5+... ...including Spark, Databricks, Hadoop, Hive, AWS...DatabricksPipelineFull timeContract workPart timeWork at officeLocal areaRemote work$160.7k - $306.5k
...forward! As the Data Engineer Team Lead, you will lead a... ...sustainment of all data pipelines. This senior role... ...patterns like Databricks Delta Live Tables... ...the Solution Architect to identify and implement... ...(e.g., AWS or Azure) and data... ...maintenance of scalable ETL/ELT tools and...DatabricksPipelineLive inLocal area$160.7k - $306.5k
Responsibilities Lead, mentor, and manage a team of data engineers working on new pipeline development and... ...modular patterns like Databricks Delta Live... ...with the Solution Architect to identify and... ...of scalable ETL/ELT tools and services... ...(e.g., AWS, Azure) and data engineering...DatabricksPipelineLive inLocal area- ...Azure Specialist (Engineer) Alexandria... ...is responsible for architecting, implementing, and... ...Experience with Azure Data Services including... ...Analytics, Azure Databricks, Azure Data Lake... ...experience with ETL/ELT processes, data... ...warehousing, and data pipelines. Migrate legacy...DatabricksPipelineWork at office2 days per week3 days per week
Match Point
Alexandria, VA5 days ago - ...Job Description TITLE: Azure Data Solutions Architect LOCATION: Washington,... ...Database Architecture & Design: Lead the design and... ...-volume environments. ETL and Data Pipelines: Architect, develop, and... ...with SQL, SSRS, SSIS, SSAS,Databricks, Python, and DAX. Required...DatabricksPipelinePermanent employmentContract work
AHU Technologies Inc
Washington DC6 days ago - ...Urgent Role: Databricks Certified Architect Location: Washington DC 12 YRS Exp Responsibilities... .... Architect end-to-end data pipelines for batch and real-time... ..., and cost efficiency. Lead cloud-native implementations across Azure environments. Define...DatabricksPipeline
Kastech Software Solutions Group
Washington DC1 day ago - Analytica is seeking a Technical Lead - Data Engineering in Bethesda, MD. This hybrid role requires a senior engineer... ...8+ years of experience in building and maintaining ETL/ELT pipelines and strong expertise in Databricks and AWS. Candidates should have a Bachelor’s degree...DatabricksPipeline
- ...Applications Solution Architect (SAP Architect) Senior... ...leader to architect SAP data, analytics, and AI... ...Essential Functions Lead SAP data, analytics,... ...virtualized models and pipelines blending SAP/non-SAP... ..., integrations (e.g., Databricks/Azure). Data modeling, metadata...DatabricksPipelineFor contractors
Lumen Solutions Group Inc.
Washington DC2 days ago - ...a hands-on Technical Lead – Data Engineering to support... ...centered around Databricks and modern data engineering... ...maintenance of scalable data pipelines, integrations, and... ...~ Collaborate with architects and program leadership... ...building and maintaining ETL/ELT pipelines and...DatabricksPipelineFor contractorsLocal area
Analytica
Bethesda, MD4 days ago - ...Chain Risk Management (SCRM) Data and Analytics Lead to support the design,... ...business requirements into data pipelines, analytical models,... ...deploying data pipelines, ETL/ELT processes, or data integration... ...architectures (e.g., Snowflake, Databricks, Redshift, Synapse, or...DatabricksPipelineContract work
- An established industry player is seeking a skilled Data Engineer proficient in Azure Databricks and Pyspark. This role involves designing and implementing complex data pipelines for lakehouse and data warehouse solutions, leveraging Azure Cloud Services and Agile methodologies...DatabricksPipeline
- ...Overview We are seeking a Lead Data Engineer to serve as a... ...scalable, production‑grade data pipelines and analytical... ...such as AWS (preferred), Azure, or GCP ~ ETL/ELT tools such as Airflow,... ...data ecosystems including Databricks, Snowflake, Redshift, or similar...DatabricksPipelineWork at office
AST SpaceMobile
Lanham, MD23 days ago $110k - $170k
...Washington, D.C., is seeking an experienced Staff Data Engineer to design, develop, and maintain enterprise-grade data infrastructure. You will leverage Azure and Databricks technologies to build robust data pipelines and ensure data governance. The ideal candidate will...DatabricksPipeline- ...complete cloud analytics and data platform for AI. By... ...As the Principal AI Architect for Teradata AI Studio... ...tracking, MLOps pipelines, or AI agent development... ...Teradata Vantage, Snowflake, Databricks, or equivalent) at... ...architecture (AWS, Azure, GCP) and containerized...DatabricksPipelinePermanent employmentFlexible hours
- ...a hands‑on Technical Lead - Data Engineering to support... ...heavily centered around Databricks and modern data... ...maintenance of scalable data pipelines, integrations, and... ...AWS Collaborate with architects and program leadership... ...building and maintaining ETL/ELT pipelines and large...DatabricksPipelineFor contractorsLocal area
- Job Description Experienced in architecting end-to-end data pipelines, dimensional data models, and cloud-based warehousing solutions utilizing VA-approved platforms such as Azure Data Factory, Azure Databricks, Python, SQL Server, and Dagster. Manage diverse BI environments...DatabricksPipelineTemporary work
- E Logic is hiring a Modern ETL Developer to design, build, and deploy cloud-native data pipelines in the Washington DC area. This hybrid role focuses on developing data... ...flexible data pipelines using AWS Glue and Databricks, and converting legacy ETL code into scalable cloud...DatabricksPipelineWork at officeFlexible hours
- ...support a cutting-edge data, analytics, and AI platform... ...infrastructure and pipelines using agentic workflows... ...technologies such as Hadoop, Databricks, and Splunk.... ...platforms like AWS and Azure to improve scalability,... ...requirements. Skilled in leading multi-disciplinary...DatabricksPipelineContract workSummer work
Science Applications International Corporation
Arlington, VA5 days ago - 9th Way in Washington, DC is seeking a Senior ETL Developer to support enterprise data integration, reporting modernization, and analytics initiatives. The role involves developing and maintaining ETL pipelines and ensuring data quality across multiple business lines....Pipeline
- E-logic is hiring a Modern ETL Developer to design, build, and deploy cloud-native data pipelines within our expanding cloud-based analytics ecosystem for the Office... ...pipelines from scratch utilizing AWS Glue and Databricks within a pre-production AWS environment. Convert...DatabricksPipelineWork at officeFlexible hours
$180k - $190k
Acclaim Technical Services, Inc. is hiring an ETL Developer with TS/SCI clearance to design and implement enterprise-level ETL solutions... ...in Bethesda, MD. Responsibilities include building complex data pipelines, optimizing real-time performance, and collaborating with...Pipeline- Cybermedia Technologies is seeking a Data Engineer in McLean, VA. This role involves designing ETL pipelines, optimizing data processing in Azure Databricks, and supporting data migration efforts. The ideal candidate will have over 7 years of experience in data engineering...DatabricksPipeline
$205k - $215k
...AI Architect & Engineering Director Core Spaces... ...owned or managed, with a pipeline of over 53,860 beds... ...practical experience with Databricks-based machine... ...Microsoft AI services Azure-native data and AI services where... ...Build and lead a high-performing AI...DatabricksPipelineHourly payCore Spaces
Washington DC3 days ago- Makpar is looking for a Senior Data Engineer in Washington, D.C. This role involves building and orchestrating data pipelines using Databricks, designing ETL processes, and translating business needs into SQL queries. A Bachelor’s or Master’s degree specializing in computer...DatabricksPipeline
$110k - $120k
...Azure Data & AI Strategy Expert At JDA TSG, we equip many of the... ...Purview (Data), Microsoft Fabric, Databricks, and Azure AI Foundry to... ...Microsoft Fabric, and Databricks. Lead workshops and strategy... ...lakehouse strategies, real-time pipelines, and integration with Power...DatabricksPipelineJDA TSG
Washington DC2 days ago- ...highly skilled Solution Architect specializing in Microsoft Azure Data & Microsoft Fabric, with... ...working knowledge of Databricks, to design, build, and... ...optimize scalable data pipelines using ADF, Fabric, and... ...experience with data modeling, ETL/ELT, and enterprise data...DatabricksPipelineFull time
- ...in Arlington, Virginia is looking for a Senior Data Engineer to support a Modernized Data Science Platform... ...have extensive experience in building data pipelines and models using platforms like Palantir Foundry or Databricks. This role demands technical leadership and hands...DatabricksPipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks ETL Architect & Data Pipelines Lead. Be the first to apply!
Related searches
- azure security engineer Washington DC
- microsoft azure architect Washington DC
- azure specialist Washington DC
- azure developer Washington DC
- devops engineer azure Washington DC
- azure infrastructure engineer Washington DC
- cloud engineer azure Washington DC
- data lead Washington DC
- data analytics lead Washington DC
- databricks Washington DC