Secure Data Engineer - ETL, Spark & Pipelines
Agile Defense
Agile Defense in Washington, DC is seeking a Data Engineer to design and maintain secure data pipelines and analytics-ready datasets. You will collaborate with data scientists, engineers, and mission stakeholders to process structured and unstructured data using Databricks, Spark, Palantir Foundry, or similar platforms, ensuring rigorous data quality and security.
The role requires a Bachelor's in a technical field, 3+ years of relevant experience, strong Python and SQL skills, and an active US
#J-18808-LjbffrVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Secure Data Engineer - ETL, Spark & Pipelines in Washington DC vacancy
- ...Agile Defense, LLC is seeking a Data Engineer to support secure data pipelines, ETL/ELT workflows, and analytics-ready datasets. You will collaborate with data... ...stakeholders to process data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or comparable...Pipeline
Agile Defense
Arlington, VA1 day ago $66.66 - $76.66 per hour
...delivering high-impact data platform solutions for... ...environments. As a Data Engineer, you will drive the architecture... ...-scale, robust data pipelines. You will collaborate... ...pipelines using Apache Spark and PySpark.... ...,data quality,Diagnose,security best practices,technical...PipelineHourly payContract workTemporary workWork experience placement- ...Agile Defense, LLC seeks a Data Engineer to build and maintain secure data pipelines for DoD missions, working with data scientists, engineers, and stakeholders... ...structured and unstructured data using Databricks, Spark, Palantir Foundry, Maven Smart Systems, or similar...Pipeline
Agile Defense
Washington DC1 day ago - Data Engineer - Etl We are seeking a data engineer to design, build, and scale... ...reliable, performant, and secure data platforms. This role requires... ..., ownership of complex data pipelines, and the ability to... ...processing frameworks (e.g., spark or equivalent). Experience building...Pipeline
- ...are seeking a Senior Data Engineer to design, develop, and... ...enterprise-scale data pipelines and platforms supporting... ..., scalable, and secure data solutions. Key Responsibilities... ...develop scalable ELT/ETL pipelines for finance... ...Kafka, Event Hub, and Spark Structured Streaming....PipelineFull time
BrickRed Systems
Washington DC4 hours ago - ...Data Engineer (Databricks) Location: Hybrid (Washington... ...maintaining scalable data pipelines, data lakehouse... ...to deliver reliable, secure, and high-performing data... ...Build and optimize ETL/ELT processes for structured... .... Develop PySpark, Spark SQL, and SQL-based...PipelineFull time
Big Impact Tech (BIT)
Washington DC3 days ago $101.3k - $160k
...The Amazon Security Experiences (ASE) organization is the data intelligence backbone of... ...through hundreds of pipelines consisting of... ...management scripts. Our engineers work directly with... ...and building ETL pipelines - Experience... ...as: Hadoop Hive Spark EMR - Experience...PipelineFull timeFlexible hours- Analytica is seeking a Databricks Data Engineer to support a high-profile... ..., and maintaining secure, scalable data pipelines and platform services within... ...with Databricks, Apache Spark, PySpark, or similar big data... ...or Redshift.Knowledge of ETL/ELT development and data...Pipeline
ANALYTICA
Washington DC2 days ago - Analytica is seeking a Senior Data Engineer to support large-scale... ...data platforms and pipelines that support mission-... ...of scalable, secure, and auditable data pipelines... .... Build and optimize ETL/ELT workflows that... ...proficiency with Apache Spark, PySpark, SQL, and Python...Pipeline
ANALYTICA
Washington DC2 days ago $62k - $141k
ETL Data EngineerThe Opportunity: As a data engineer, you know that a good site or system needs the right combination of... .... You’ll develop and deploy the pipelines and platforms that organize and make... ...selected will be subject to a security investigation and may need to meet...PipelineFull timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
McLean, VA5 days ago$115k - $150k
...our clients.As a Senior Data Engineer, you will architect,... ...design of robust data pipelines, enforce best practices... ...data governance and security, and mentor junior engineers... ...standards, including ETL/ELT frameworks, data... ...tools like Apache Spark, Kafka, Airflow, and dbt...PipelineFull timeVisa sponsorshipInsomniac Design
Washington DC2 days ago$62k - $141k
Data EngineerThe Opportunity: Ever-expanding... ...before. As a data engineer, you know that... ...develop and deploy the pipelines and platforms that... ...with ETL operationsExperience... ...including Apache Spark or NVIDIA CUDAExperience... ...Certification Information Security Certification,...PipelineFull timeContract workPart timeLocal areaRemote workBooz Allen Hamilton
Arlington, VA4 days ago$77.5k - $176k
Data Engineer, SeniorThe Opportunity: Ever-expanding technology... ...ll deploy and develop pipelines and platforms that... ...and maintenance for secure DoW information management... ...building scalable ETL and ELT workflows for... ...computing tools, including Spark, Databricks, Hadoop,...PipelineFull timeContract workPart timeLocal areaRemote workBooz Allen Hamilton
Alexandria, VA2 days ago- ...Title: Forward Deployed Engineer – Data Engineering & GenAI... ...fundamentals, including ETL/ELT, data modeling,... ...schema mapping, and data pipelines. ~ Strong Python... ...intelligence, national security, or other mission-critical... ..., Databricks, Spark, Kafka, Airflow, dbt,...PipelineWork at officeLocal area2 days per week3 days per week
Asterism IT Solutions
Washington DC4 hours ago - ...experienced Principal Data Engineer to lead the design,... ...enterprise-scale data pipelines and modern data platforms... ...architecture, ETL/ELT pipelines, data modeling... ...and deliver scalable, secure, and cost-efficient data... ...Azure Event Hubs, and Spark Structured Streaming...PipelineFull time3 days per week
BrickRed Systems
Washington DC4 hours ago - ...experienced Principal Data Engineer – Data & Intelligence... ...scale data platforms and pipelines supporting finance and... ...architecture, ETL/ELT development, cloud... ...in designing scalable, secure, and reliable data solutions... ...with Apache Kafka and Spark Structured Streaming....PipelineFull time
BrickRed Systems
Washington DC4 hours ago $87.1k - $157.45k
The C5ISR Center Cyber Security Service Provider (CSSP) delivers 24x7x365 defensive cyber operations... ..., and SaaS platforms.Leidos is seeking a Data Security Engineer to build, optimize, and sustain the cybersecurity data pipelines that power these defensive operations. You...PipelineFull time3 days per weekLeidos
Adelphi, MD4 days ago- ...Overview Lead Data Engineers at Excella play a key... ...and sustainable data pipelines using batch and streaming... ...and production-grade ETL/ELT systems. ~ Strong... ...technologies such as Spark, Kafka, and file formats... ...optimization, and designing secure, well-structured data...PipelineFull timeWork from homeHome officeFlexible hours
Excella
Arlington, VA4 hours ago $175k - $265k
...solutions to complex national security issues. With over 50... ...all Divisions. The Data Engineering Fellow serves as the... ...of data platforms and pipelines (e.g., data lakes,... ...lakes, data warehouses, ETL/ELT pipelines, streaming... ..., Snowflake, Apache Spark, Kafka, Airflow, dbt,...PipelineFull timePart timeWork at officeFlexible hoursSystems Planning and Analysis, Inc.
Alexandria, VA4 hours ago- ...federal project in Washington, DC. You will design and optimize high-performance Spark applications and enterprise data infrastructure in AWS Databricks, focusing on scalable ETL/ELT pipelines with PySpark, SQL, Delta Lake, and Medallion Architecture. Responsibilities...Pipeline
Red Cedar Consultancy, LLC
Washington DC4 days ago $100k - $160k
...tests Databricks pipelines, transformations,... ...routines, and reusable data products... ...Develop scalable ETL/ELT solutions using... ...Databricks, Apache Spark, PySpark, Python,... ...data architects, engineering leads, integration... ...analysts, testers, security specialists, governance...PipelineRemote work$140k - $180k
...Subcategory: Big Data Engineer Schedule: Full-Time... ...reliable, scalable data pipelines and datasets that power... ...teams to deliver trusted, secure, and performant data... ..., and load (ELT/ETL). Implement and manage... ...patterns, and Spark notebooks for large-scale...PipelineFull timeRemote workShift work- ...We're seeking a Data Integration Engineer for an exciting direct... ...accurately, completely, and securely from source systems... ...transformation pipelines into downstream reporting... ...Experience with APIs, ETL/ELT pipelines, batch... ...platforms (Databricks, Spark, Delta Lake, Fabric)....PipelineFull timeVisa sponsorship
SBS Creatix
Arlington, VA4 days ago $62k - $141k
...Job Number: R0251586 Data Engineer The Opportunity:... ...develop and deploy the pipelines and platforms that organize... ...data pipelines or ETL/ELT workflows for reporting... ..., including Apache Spark or NVIDIA CUDA... ...Certification Information Security Certification such as...PipelineFull timeContract workPart timeLocal areaRemote work$59k
...AWS Data Quality Engineer (ITAR/EAR Compliant Role) Experience:... ...across enterprise data pipelines. Create reusable Python... ...end-to-end testing of ETL/ELT workflows and... ...of those concerns to secure@hcltech.com for investigat... ...for you to find your spark and grow with us. We...PipelinePermanent employmentLocal areaRemote workHCLTech
Washington DC2 days ago- ...Forward Deployed Engineer with strong experience... ...engineering, data engineering, and Generative... ..., building data pipelines, integrating APIs,... .... Build ETL/ELT pipelines and... ...Databricks, Snowflake, Spark, Kafka, Airflow,... .... Enterprise security, authentication, authorization...Pipeline2 days per week3 days per week
FIRST SOFTSOLUTIONS INC
Washington DC1 day ago - ...Data EngineerIntegrityOne Partners - Data Engineer Location: Crystal City, VA Hybrid, periodic onsite presence... ...that keep our country safe and secure.Ideal Candidate ProfileDemonstrates... ..., Ansible, Terraform, Vault)ETL Pipeline (Apache Spark, AWS Glue, Databricks),...Pipeline
INTEGRITYOne Partners
Arlington, VA1 day ago - ...Apscareerportal in Woodlawn, MD seeks a Senior Data Streaming Engineer onsite to lead enterprise streaming... .... This role demands deep expertise in secure delivery, architecture patterns, and... ...leadership. You will design secure pipelines, guide security configurations (SSL/...Pipeline
Vervic Inc.
Riverdale, MD3 days ago - ...Data EngineerWe need an experienced Data Engineer at the National Guard Bureau (NGB). The NGB is... ...implement end-to-end data pipelines using ETL processes and... ...including Databricks, Python, Spark, Scala, JavaScript/JSON... ...fieldLocationRemoteClearanceActive Secret security clearanceU.S....PipelineFull timeWork at officeRemote work
West 4th Strategy
Arlington, VA5 days ago $135k - $165k
...vital interests. Job Title: Data Engineer Location: Arlington, VA... ...minimum, an active Secret security clearance. Roles under this... ...maintenance of secure data pipelines, ETL/ELT workflows, and analytics... ...unstructured data using Databricks, Spark, Palantir Foundry, Maven...PipelineAgile Defense
Arlington, VA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Secure Data Engineer - ETL, Spark & Pipelines. Be the first to apply!
Related searches
- data systems engineer Washington DC
- finance data engineer Washington DC
- data engineer contract Washington DC
- big data devops engineer Washington DC
- sr data engineer Washington DC
- senior data engineer Washington DC
- entry level big data engineer Washington DC
- principal data engineer Washington DC
- etl data engineer Washington DC
- data engineer manager Washington DC