Spark Data Engineer
Swoon
Hiring: Spark/Scala Data Engineer
Location: McLean, VA – Hybrid
Work Model: Hybrid – must be able to work onsite in McLean, VA
Duration: 12-month contract
Pay: $70/hr W2
We’re looking for an experienced Data Engineer to support a large-scale ETL modernization initiative. This role will focus on migrating legacy ETL workloads into a modern Spark/Scala-based architecture while ensuring data accuracy and consistency throughout the migration.
What You’ll Be Doing:
• Build and maintain large-scale data pipelines using Apache Spark and Scala
• Modernize legacy ETL workloads into a newer data architecture
• Support legacy-to-modern ETL migrations
• Perform data comparison, reconciliation, and validation between legacy and modern pipelines
• Identify and troubleshoot data discrepancies during migration
• Ensure migrated pipelines maintain data quality and accuracy
Must-Haves:
• Strong Data Engineering background
• Hands-on Apache Spark experience
• Strong Scala experience
• Data pipeline development experience
• ETL modernization or migration experience
• Data comparison, validation, or reconciliation experience
• Experience working with legacy-to-modern architecture migrations
• Ability to work a hybrid schedule in McLean, VA
The existing environment includes Ab Initio, but prior Ab Initio experience is NOT required.
This is a traditional Data Engineering position. AI/GenAI experience is not required.
If you’re a Senior Data Engineer with strong Spark/Scala experience and are open to a hybrid opportunity in McLean, VA, I’d love to connect.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Spark Data Engineer in McLean, VA vacancy
- ...Job Description: Position: Big Data Engineer – Python/Scala, Spark, Hadoop Location: Arlington, VA (3 Days onsite/week) Hire Type: Full Time Experience: 10+ Years Job Summary: Ability to easily move between business, data management, and technical teams...SuggestedFull time3 days per week
Programmers.io
Arlington, VA1 day ago $150k - $250k
...Job Description Job Description What You'll be Owning GRVTY is seeking a Spark Data Engineer with a TS/SCI + Poly clearance (applicable to this customer) to join one of our top projects in Tysons, VA. What You Must Have Active TS/SCI with Polygraph Clearance...SuggestedContract workImmediate startGRVTY
Tysons Corner, VA14 days ago- Programmers.io seeks a Big Data Engineer for a full-time hybrid role in Arlington, VA. You will translate business needs into robust data... ...teams. You'll design end-to-end pipelines with Python/Scala, Spark and Hadoop, ensuring data quality and scalable analytics. Experience...SuggestedFull time3 days per week
- ...Investigation (BI) About the Opportunity SDA is seeking a Senior Big Data Engineer / Java Data Integration Engineer to support the development... ...modern Big Data solutions using technologies such as Kafka, Spark, Elasticsearch, and cloud-based platforms. This position is...SuggestedFull timeRemote workFlexible hours
- ...Zachary Piper Solutions is seeking Data Engineers for our Professional Services team in McLean, VA. This role focuses on building scalable... ...across on-prem and cloud environments. The role requires strong Spark experience, 6+ years in data engineering, Python or Scala...Suggested
- ...Description 6+ years overall software development experience with at least 3+ years of experience in large scale data platforms .Excellent expertise in Spark and Java .Knowledge of Golang is highly desirable .Good understanding of containerization using Docker...Full time
Intelliswift - An LTTS Company
Washington DC4 hours ago $103k - $140k
...the pipelines that move a federal agency's data from source to platform. But we hire... ...Depending on the assignment, you may: Build Spark-based extract, transform, and load (ETL)... .... Requirements ~4+ years of data engineering experience ~ Bachelor's degree ~ Spark...Full timeTemporary workWork at officeImmediate startOpenDataJobs
Washington DC8 days ago- ...and citizen services. We’re a nonprofit engineering, applied research, and advanced technology... ...shape the future.Department Summary:MITRE’s Data Science and Engineering department is... ...Processing and Big Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage and Data...InternshipLocal area3 days per week
Mitre
McLean, VA3 days ago $62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and... ...available today than ever before. As a data engineer, you know that organizing data can yield... ...data and computing tools, such as Spark, Databricks, Hadoop, Hive, AWS EMR, or KafkaExperience...Full timeContract workPart timeLocal areaRemote workBooz Allen Hamilton
Arlington, VA1 day ago$125k - $160k
OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services... ...with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL databases, including Postgres...Steampunk
McLean, VA3 days ago- ...Hiring: Data Engineer – Python/AWS I’m working with a large financial services organization looking to add a Data Engineer to their team... ...ECS, Kinesis, S3, DynamoDB, IAM, Glue, and CDK • Support Glue/Spark consumers and Flink-based pipelines • Build rigorous unit...
Swoon
McLean, VA4 days ago - ...health coverage through our medical plans. Overview Lead Data Engineers at Excella play a key role in designing and building modern... ...environment ~ Hands-on experience with big data technologies such as Spark, Kafka, and file formats like Parquet, Delta Lake, and Iceberg...Full timeWork from homeHome officeFlexible hours
Excella
Arlington, VA50 minutes ago - ...Government Solutions is seeking a remote Database Engineer to support federal customers and modernize data platforms. You will design scalable cloud databases... ...deliver API-ready data platforms using Databricks, Spark, and Terraform, ensuring availability and compliance...Remote job
- ...Lead Data EngineerLocations: Richmond - VA / McLean - VA/ Plano - TX / Chicago - IL /... ...development, and deployment of scalable data engineering solutions that deliver operational and... ...pipelines using technologies such as AWS Glue, Spark, and Databricks.Optimize database...Work at office
InterSources
McLean, VA5 days ago $125k - $165k
OverviewWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms,... ...Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL databases, including...Steampunk
McLean, VA4 days ago- ...skilled and motivated individual to join our team as a Senior Data Engineer to align data solutions to business requirements by planning... ...experience with distributed processing tools (Apache Kafka, Airflow, Spark, Flink, NiFi). Skilled in building and orchestrating batch...Full timeContract workWork at officeLocal area3 days per week
SteerBridge
Vienna, VA4 hours ago - ...Responsibilities:Leverage a variety of modern big data tools / approaches to solve complex... ...minimum of five years of technical data engineering experience; U.S. Federal government... ...required (experience with Advana, Databricks, Spark preferred)Experience with development...Local area
KPMG
McLean, VA2 days ago - ...Data Engineer IISpark, Hadoop, and Python are the skills required for the role. It will be hybrid, 3 days a week in office. Please focus... ...The ideal candidate will have strong hands-on experience with Spark, Hadoop, Python, and SQL, along with a background building scalable...Work at officeLocal area3 days per week
Delan Associates Inc
Arlington, VA4 days ago - ...Expression is seeking an experienced Data Engineer to support the design, development, and operational deployment of scalable, AI-enabled... ...Select and implement appropriate modeling approaches using Python, Spark, and cloud-native ML frameworks such as SageMaker and MLflow....For contractorsWork at officeImmediate start
Expression Networks
Arlington, VA3 days ago $120k - $225k
...Zachary Piper Solutions is currently seeking Data Engineers on our Professional Services team in McLean, VA. Are you a skilledData Engineer... ...experience. What we look for: ~ Experienced in Apache Spark (Must have) ~6+ years of experience in data engineering, data...Work at officeZP Group
McLean, VA2 days ago- ...Data EngineerElder Research Inc., a wholly owned subsidiary of MANTECH international Corporation... ..., career and customer-oriented Data Engineer to join our team in Arlington, VA. This... ...experience in Unity Catalog, PySpark, Spark SQL, and JobsFamiliarity with vector, object...Work at officeLocal areaRemote work
Navstar
Arlington, VA5 days ago $59.28 - $67.28 per hour
...Data EngineerGenesis10 is currently seeking a Data Engineer for a hybrid position with a Major Financial Institution located in McLean, VA or Boston, MA. This is... ...utilize a range of AWS services including CDK, Glue, Spark, Lambda, and Flink to move data from source systems...Contract workGenesis10
McLean, VA4 days ago- ...Title: Data Engineer Duration: 12 Months Location: McLean, VA, Boston, MA and Plano, TX - hybrid 3 days on site Job Description: work on... ...AWS-native data ingestion platform (CDK infrastructure, Glue/Spark consumers, Lambda/ECS/Flink pipelines) that moves financial data...
Spectraforce Technologies
McLean, VA2 days ago $115k - $125k
...Overview Most data engineering jobs are maintenance. This one is construction. You would be standing up ETL on Databricks and Spark for a National Guard analytics platform that is still being built, designing the models, setting the governance, and deciding how it...Temporary workWork at officeRemote workRelocation2 days per week1 day per weekcareers-fedwriters
Arlington, VA4 days ago- ...Data EngineerLocation: McLean, VA (Hybrid - 3 Days onsite every week)Job Type: ContractPay Rate: $60/hr C2CJob DescriptionRequired must have skills:PythonAWSKubernetesKubeflowMLOpsML Tooling - Spark, Pandas, NumpyPrior Capital One experienceGood to have:Data analysis...Temporary workLocal area3 days per week
Anveta
McLean, VA5 days ago - ...Data EngineerHybrid McLean, VA or Boston, MAOur client seeks a Data Engineer to develop and support a Python-based, AWS-native data ingestion platform that moves financial... ...CDK-provisioned infrastructure, Glue and Spark consumers, and Lambda, ECS, and Flink pipelines...
Eliassen Group
McLean, VA4 days ago $100k - $105k
...Data is critical to how we understand our business, support decision-making, and deliver... ...downstream business needs. As a Data Engineer, you will partner with business users, technology... ...and PySpark. Experience using SQL, Spark, and Azure Data Factory (ADF)....MultiPlan
McLean, VA3 days ago$130k - $145k
...education and/or job related training. Open Job Opportunities Data Engineer Location McLean, VA Employment Type Full time... ...to deploy data pipelines, including configuring and updating Spark Jobs Containerizing and deploying applications in cloud environments...Full timeFor contractorsRemote workFlexible hoursEdgesource
McLean, VA2 days ago- ...Quantitative Analytics/Big Data Developer/Data Engineer SeniorFreddie Mac’s Single-Family Division is currently seeking a Quantitative Analytics... ...JSONs, PDFs) using Hadoop platform.• Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.• Manage and...Work experience placement
Software Technology Inc
McLean, VA5 days ago $101.14k - $174.59k
...Data Engineer - Clearance Required Job Locations US-PA-Pittsburgh | US-Remote ID 2026-14307 # of Openings 1 Overview LMI is seeking a skilled... ...in Databricks, including notebooks, Delta Lake tables, and Spark jobs, for workloads that complement or feed into the Foundry environment...Contract workWork experience placementLocal areaRemote workFlexible hoursLMI Consulting, LLC
Falls Church, VA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer. Be the first to apply!
Related searches
- data engineer machine learning McLean, VA
- aws data engineer McLean, VA
- big data developer McLean, VA
- sr data engineer McLean, VA
- big data cloud engineer McLean, VA
- finance data engineer McLean, VA
- junior big data engineer McLean, VA
- sr information security engineer McLean, VA
- data center engineer McLean, VA
- senior data integration developer McLean, VA