Databricks Data Engineer Lead — ETL, Streaming & Spark
AUGUST SCHELL ENTERPRISES, INC.
AUGUST SCHELL ENTERPRISES, INC. in Rockville, MD, is seeking a highly skilled Data Engineer to manage data at rest and in streaming, and to lead data management and optimization initiatives. You will shape ETL pipelines, leverage Databricks, and implement Spark-based solutions to drive data integration and analytics. Ideal candidates bring 5+ years of data engineering experience, expert knowledge of Databricks and Spark, and hands-on skills in streaming tech and data security. #J-18808-Ljbffr AUGUST SCHELL ENTERPRISES, INC.
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Databricks Data Engineer Lead — ETL, Streaming & Spark in Rockville, MD vacancy
- August Schell is seeking a highly skilled Data Engineer to lead data management, optimize ETL pipelines, and drive streaming data initiatives in a dynamic environment. You will work across Databricks, Spark, and Snowflake to deliver robust data solutions and ensure data...Databricks
- Guidehouse is hiring a Senior Data Engineer to design, build, and operate Azure Lakehouse architectures using Azure Databricks, ADLS Gen2, Synapse, and Data Factory for... ...context. You will develop scalable ETL/ELT pipelines with Spark, Delta Lake, Python, SQL, and Scala;...Databricks
- ...seeking a hands-on Technical Lead - Data Engineering to support the design,... ...be heavily centered around Databricks and modern data engineering... ...experience building and maintaining ETL/ELT pipelines and large-... ...proficiency in Python and/or Spark-based data processing Familiarity...Databricks
$229.9k - $262.4k
Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI) Do you love building and pioneering in the... ...Python, SQL, Spark, ETL tools, AWS Glue 4+ years of... ...working on real-time data and streaming applications 4+ years of experience...DatabricksFull timePart timeInternshipLocal area- ...seeking a hands-on Technical Lead – Data Engineering to support the design,... ...be heavily centered around Databricks and modern data engineering... ...experience building and maintaining ETL/ELT pipelines and large-... ...proficiency in Python and/or Spark-based data processing ~...DatabricksFull timeFor contractorsLocal area
Analytica
Bethesda, MDa month ago $122.2k - $165k
...More is seeking a Senior Data Engineer to join our Technology... ...-tolerant batch and streaming data pipelines that... ...Develop and optimize ELT/ETL workflows using modern... ...frameworks (e.g., Spark/PySpark, Airflow, or notebook... ...Fabric, Snowflake, Databricks) and lakehouse...DatabricksHourly payMinimum wageWork at office$158.6k - $181k
Senior Data Engineer (Python, AWS, Spark) Do you love building and pioneering in the technology space? Do... ...working on real-time data and streaming applications. 2+ years of experience... ...experience (Redshift or Snowflake, Databricks). 3+ years of experience with UNIX/...DatabricksFull timePart timeInternshipH1bLocal area- Analytica is seeking a Technical Lead - Data Engineering in Bethesda, MD. This hybrid role requires a senior engineer with... ...years of experience in building and maintaining ETL/ELT pipelines and strong expertise in Databricks and AWS. Candidates should have a Bachelor’s...Databricks
$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering... ...including Python, SQL, Spark, ETL tools, or AWS Glue ~4+ years... ...working on real-time data and streaming applications ~4+ years of experience...DatabricksFull timePart timeInternshipH1bLocal area$110k - $160k
...looking for seasoned Data Engineer to work with our team... ...reliabilityAssess and understand the ETL jobs, workflows, BI... ...sets - Python, SQL, Databricks, AWS Data... ...Big data tools: Hadoop, Spark, Kafka, etc.Relational... ...Databricks, SnowflakeData streaming systems: Kafka, Storm,...Databricks$77.6k - $176k
Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT... ...building scalable ETL or ELT workflows for reporting... ...computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka... ...working on real-time data and streaming applications Experience with...DatabricksFull timeContract workPart timeWork at officeLocal areaRemote work- ...Summary:MITRE’s Data Science and Engineering department is looking... ...batch and streaming data-processing solutions... ..., as appropriate.Lead technical... ...Architectures, such as Spark, Hadoop, Ray,... ...Platforms, such as Databricks, Palantir Foundry... ...EMRData Pipeline/ETL Development, Integration...DatabricksInternshipLocal area
- Edgesource Corp. in McLean, VA is seeking a Data Engineer to build and optimize complex data... ...environment. You will work with Python, Spark, and AWS services, focusing on data security... ...SQL skills, and hands-on experience with ETL workflows, orchestration tools, and production...Full time
- ...Bethesda, MD seeks a Senior Data Engineer to design and operate data pipelines... ...build scalable batch and streaming pipelines, own data quality,... ..., expert SQL and Python, Spark, and strong cloud experience... ...BigQuery, Snowflake, and Databricks. #J-18808-Ljbffr Retail Services...Databricks
- ...Job Family Data Science & Analysis Travel... ...architectures using Azure Databricks, Azure Data Lake... ...optimize scalable ETL/ELT pipelines... ...Workflows, Spark jobs, and Delta Lake... ...optimized batch and streaming pipelines leveraging... ...Computer Science, Engineering, Data Science, or...DatabricksTemporary workFlexible hours
JobCubby
McLean, VA2 days ago - ...Lead Data EngineerLocations: Richmond - VA / McLean... ...deployment of scalable data engineering solutions that... ...implementation and management of ETL pipelines using... ...such as AWS Glue, Spark, and Databricks.Optimize database... ...Kafka for real-time data streaming.Experience with...DatabricksWork at office
InterSources
McLean, VA3 days ago - ...leverage their extensive experience in the Hadoop ecosystem and Spark within a 12-24 month contract. The successful candidate will require... ...components and programming in Java or Spark. Knowledge of data warehousing and distributed computing design patterns is essential...Contract workImmediate start
- ...Position : Data Engineer with AWS & Python Location... ..., Python programming, ETL/ELT development, data... ...Experience with PySpark/Spark and distributed data processing... .... Knowledge of Databricks, Snowflake, or Delta... ...working with streaming data pipelines. Knowledge...Databricks
Cloud BC Labs
McLean, VA2 days ago - Booz Allen Hamilton is seeking an AWS Streaming Data Engineer to design and implement end-to-end streaming solutions, including real-time data ingestion, processing, and geopatial data components. You will work across distributed environments to deliver production-ready...
$110k - $140k
...centered design, data analytics and visualization... ...seeking a Data Engineer to design, build,... ...data pipelines, ETL/ELT workflows,... ...Python, Apache Spark (PySpark), Databricks, dbt, SQL (... ...security controls. Lead modernization initiatives... ...with Kafka (streaming/data pipelines)...DatabricksFull timeTemporary workRemote work$75k - $115k
...human-centered design, data analytics and... ...seeking a Junior Data Engineer to design, build, and... ...scalable data pipelines, ETL/ELT workflows, and data models using Databricks, dbt, Apache Spark (PySpark), SQL (PostgreSQL... ...with Kafka (streaming/data pipelines) Experience...DatabricksFull timeTemporary workRemote work- Guidehouse is seeking a senior Data Engineer to design, build, and... ...architectures using Databricks, ADLS Gen2, Synapse, and... ...You will develop scalable ETL/ELT pipelines with Spark, Delta Lake, Python, SQL,... ...handling large datasets and streaming workloads. You will collaborate...Databricks
$99k - $225k
Data Science Engineer, LeadThe Opportunity: As a Data Science Engineer, you’ll help build advanced technology... ...years of experience with python, SQL, ETL, and data pipelinesExperience with... ...You Have: 1+ years of experience with Spark, containerization, ELK, or...Full timeContract workPart timeWork at officeLocal areaRemote work$125k - $165k
...an organization’s data has never been a more... ...Senior Data Engineer to work with our team... ..., and pipelines in Databricks. We are looking for... ...and problem solving. Lead and architect migrations... ...and understand ETL jobs, workflows, data... ...Databricks, Apache Spark, Delta Lake, etc....Databricks$116.2k - $229.1k
...Join Deloitte’s AI & Engineering practice and help... ..., modernize data environments, and... ...innovation. As a Databricks Engineer in our AI... ...Team and Technology Lead: Evaluate, pilot,... ...architecture, Apache Spark, Delta Lake, cloud... ...Autoloader, Structured Streaming, Databricks...DatabricksLocal areaVisa sponsorship- ...mission-oriented cloud, data, and AI-enabling... ...-on Cloud Data Engineer to support cloud-... ...data engineering, ETL, API integration,... ...Experience with AWS and Databricks is highly desired.... ...with Python, SQL, Spark, Java, or similar... ...architectures, or streaming data technologies....Databricks
Phoenix Operations Group
Bethesda, MD9 days ago - ...Mid-Level Big Data EngineerThe Big Data Engineers on AWS will be responsible for analyzing requirements, prototyping... ...Big Data platforms, Hadoop, Hive, Spark on AWSMust have extensive experience... ...with Data Analytics tools like Databricks/Dataiku/Domino for data wrangling to...Databricks
Software Technology Inc
Rockville, MD1 day ago - ...Data EngineerLocation: McLean, VADuration... ...build, and optimize ETL pipelines using... ...Python, PySpark, and Spark. Develop scalable... ...leveraging Databricks, AWS Glue, EMR, and... ...cross-functional engineering and analytics teams... ...deliver industry-leading capabilities to our...DatabricksFor contractors
InterSources
McLean, VA1 day ago - ...Job Number: R0229283 Data Engineer The Opportunity Ever-expanding technology... ...tools Experience with ETL operations, including on-premises... ..., Redshift, SageMaker, Azure Databricks, SQL Data Warehouse, or... ...deploying large-scale batch and stream analytics pipelines #J-18808-...Databricks
Phase2 Technology
McLean, VA1 day ago - ...Connsci is seeking a Senior Data Engineer to join our growing organization... ...and will architect, lead and manage development activities... ...The solution is built on the Databricks Medallion architecture, with... ...of experience with Power BI, ETL/ELT development, data modeling...DatabricksContract workApprenticeshipLocal area
Connsci
Gaithersburg, MD2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Data Engineer Lead — ETL, Streaming & Spark. Be the first to apply!
Related searches
- data engineer analytics Rockville, MD
- senior cloud data engineer Rockville, MD
- data center engineer Rockville, MD
- big data devops engineer Rockville, MD
- sr data engineer Rockville, MD
- data engineer Rockville, MD
- sr information security engineer Rockville, MD
- junior data engineer remote Rockville, MD
- data developer Rockville, MD
- etl data engineer Rockville, MD