Spark Data Engineer

Swoon

Hiring: Spark/Scala Data Engineer

Be one of the first applicants, read the complete overview of the role below, then send your application for consideration.

Location: McLean, VA – Hybrid

Work Model: Hybrid – must be able to work onsite in McLean, VA

Duration: 12-month contract

Pay: $70/hr W2

We're looking for an experienced Data Engineer to support a large-scale ETL modernization initiative. This role will focus on migrating legacy ETL workloads into a modern Spark/Scala-based architecture while ensuring data accuracy and consistency throughout the migration.

What You'll Be Doing:

• Build and maintain large-scale data pipelines using Apache Spark and Scala

• Modernize legacy ETL workloads into a newer data architecture

• Support legacy-to-modern ETL migrations

• Perform data comparison, reconciliation, and validation between legacy and modern pipelines

• Identify and troubleshoot data discrepancies during migration

• Ensure migrated pipelines maintain data quality and accuracy

Must-Haves:

• Strong Data Engineering background

• Hands-on Apache Spark experience

• Strong Scala experience

• Data pipeline development experience

• ETL modernization or migration experience

• Data comparison, validation, or reconciliation experience

• Experience working with legacy-to-modern architecture migrations

• Ability to work a hybrid schedule in McLean, VA

The existing environment includes Ab Initio, but prior Ab Initio experience is NOT required.

This is a traditional Data Engineering position. AI/GenAI experience is not required. xhyhwjd

If you're a Senior Data Engineer with strong Spark/Scala experience and are open to a hybrid opportunity in McLean, VA, I'd love to connect.

Apply

Vacancy posted 12 days ago

Similar jobs that could be interesting for youBased on the Spark Data Engineer in Mc Lean, VA vacancy

Data Engineer (Spark / Databricks / Snowflake)
$66.66 - $76.66 per hour
...industry-leading team delivering high-impact data platform solutions for complex enterprise environments. As a Data Engineer, you will drive the architecture, development,... ...throughput data processing pipelines using Apache Spark and PySpark. Engineer data solutions and...
Suggested
Hourly pay
Contract work
Temporary work
Work experience placement
Washington DC
5 days ago
Lead Data Engineer
$134.5k - $265.1k
Position Summary Deloitte is seeking a Lead Data Engineer- Databricks to support the design, build, and delivery of modern data and... ...solutions• 3+ years of experience with Databricks and Apache Spark• 3+ years of experience with Python and Structured Query Language...
Suggested
Local area
Visa sponsorship
Deloitte
McLean, VA
4 days ago
Lead Data Engineer
...and citizen services. We’re a nonprofit engineering, applied research, and advanced technology... ...shape the future.Department Summary:MITRE’s Data Science and Engineering department is... ...Processing and Big Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage and Data...
Suggested
Internship
Local area
3 days per week
Mitre
McLean, VA
1 day ago
Data Engineer
$62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and... ...available today than ever before. As a data engineer, you know that organizing data can yield... ...data and computing tools, such as Spark, Databricks, Hadoop, Hive, AWS EMR, or KafkaExperience...
Suggested
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Arlington, VA
2 days ago
Data Engineer
$125k - $160k
OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services... ...with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL databases, including Postgres...
Suggested
Steampunk
McLean, VA
1 day ago
Sr. Data Engineer
...Wilmington, DE, McLean, VA, Richmond, VA or NYC Our client seeks a Data Engineer professional with strong ability to support a large-scale... ...and optimize AWS-based data pipelines using Java, Scala, and Spark, with PySpark and AWS Glue across multi-stage workflows. The...
Eliassen Group
McLean, VA
2 days ago
Senior Data Engineer
$125k - $165k
OverviewWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms,... ...Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL databases, including...
Steampunk
McLean, VA
2 days ago
Senior Data Engineer
...without the need for current or future sponsorship.The Senior Data Engineer is an experienced technical lead responsible for accelerating... ...vector search technologies, agent orchestration frameworks, Apache Spark, Python, SQL, Databricks, and Microsoft Fabric to deliver...
Internship
Monday to Friday
Navy Federal Credit Union
Vienna, VA
2 days ago
SQL Data Engineer
$77.6k - $176k
SQL Data EngineerThe Opportunity: As organizations collect increasing volumes of data from various sources, effective data engineering is essential to producing reliable insights and supporting mission... ..., jobs, workflows, Apache Spark, Delta Lake, and cluster configurationExperience...
Full time
Contract work
Part time
Local area
Remote work
Booz Allen Hamilton
McLean, VA
3 days ago
Lead Data Engineer (DHS)
...essential, please read the below carefully. Overview Lead Data Engineers at Excella play a key role in designing and building modern... ...~ Hands-on experience with big data technologies such as Spark, Kafka, and file formats like Parquet, Delta Lake, and Iceberg...
Work from home
Home office
Flexible hours
Excella
Arlington, VA
10 days ago
Data Engineering Architect, Senior
$180k - $220k
You are a data engineer who thrives in a highly collaborative environment, partnering with product, analytics, and engineering teams to deliver... ...production data workloads.Strong hands-on experience with Spark/PySpark and distributed data processing in a production...
Full time
Bloomberg Industry Group
Arlington, VA
2 days ago
Data Engineer
...Data Engineer We are actively recruiting for a Data Engineer to design, build, and maintain scalable data infrastructure, integration... ...proficiency in Python and SQL required; experience with Apache Spark and other data ingestion and orchestration tools strongly preferred...
Temporary work
Casual work
Arlington Community Federal Credit Union
Falls Church, VA
4 days ago
Data Engineer
...Position Title: Data Engineer Location: McLean, VA Duration: 12+ Months (Possible extension) Job Description: Key Responsibilities... ...build, and optimize ETL pipelines using Python, PySpark, and Spark Develop scalable data solutions leveraging Databricks,...
For contractors
InterSources
McLean, VA
1 day ago
Junior Big Data Engineer (AI-Forward)
...Guidance & Assistance, Inc., (SGA), is searching for a Junior Big Data Engineer (AI-Forward) for a CONTRACT assignment with one of our... ...and maintain data pipelines alongside senior engineers using Spark, Python, and AWS. SQL and coding fundamentals matter, but we're...
Contract work
Internship
Software Guidance & Assistance, Inc. (SGA, Inc.)
Tysons Corner, VA
3 days ago
Data Engineer - Databricks
$125k - $160k
OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services... ...in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake, etc. Relational SQL (Preferably T-SQL. Alternatively...
Steampunk
McLean, VA
2 days ago
Senior Data Engineer
...skilled and motivated individual to join our team as a Senior Data Engineer to align data solutions to business requirements by planning and... ...with distributed processing tools (Apache Kafka, Airflow, Spark, Flink, NiFi). Skilled in building and orchestrating batch...
Contract work
Work at office
Local area
3 days per week
SteerBridge
Vienna, VA
1 day ago
Lead Data Engineer
$161k - $266k
...potential. Title and Summary Lead Data EngineerOverview: Mastercard’s Data Commercialization... ...(DCP) team is seeking a Lead Data Engineer to design, build, and scale cloud-native... .... • Advanced proficiency with Apache Spark/PySpark, Delta Lake, SQL, and Python for...
Full time
Part time
Immediate start
Worldwide
Flexible hours
3 days per week
Mastercard
Arlington, VA
1 day ago
Data Engineer
$155k - $165k
...Data Engineer We need an experienced Data Engineer at the National Guard Bureau (NGB). The NGB is the link between the Army and Air National... ...ETL processes and technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL, working closely with cross-...
Full time
Work at office
2 days per week
1 day per week
West 4th Strategy
Arlington, VA
a month ago
Data Engineer
...Job Description Job Description 540 is seeking a Data Engineer to support a mission-critical federal health data modernization initiative... ...and maintain scalable, production-ready data pipelines using Spark, Python, and SQL in a Databricks environment Integrate and...
Temporary work
Work at office
Local area
Remote work
Flexible hours
540
Arlington, VA
a month ago
Data Engineer
...Hello, Tittle- Data Engineer Location: Mclean, VA hybrid Job Type- Contract W2 Interview- In person JD-... ...is an existing Discover product) Key skills needed Spark, Python, AWS, SQL, Glue and must be able to build data pipelines...
Contract work
For contractors
Live in
Stellent IT LLC
McLean, VA
2 days ago
Data Engineer
...expertise, and long-term career growth. We are seeking a Data & Software Engineer to join a small, agile team developing advanced data... ...production-grade data pipelines, and expertise with Apache Spark, AWS cloud services, relational databases, and modern data...
Fantom Corporation
McLean, VA
a month ago
Data Engineer II
...Spark, Hadoop, and Python are the skills required for the role. It will be hybrid, 3 days a week in office. Please Focus on local... ...to Arlington Interview: F2F Assessment: Glider – Data Engineering (Advanced) Overview seeking an experienced Data Engineer...
Temporary work
Work at office
Local area
Monday to Friday
3 days per week
Delan Associates, Inc
Arlington, VA
more than 2 months ago
Data Engineer
$100k - $215k
...you have come to the right place. Position Overview: The Data Engineer shall develop new tools code and services to execute data... ...Basic) Postgres Admin(Basic) MariaDB Admin (Basic) Hadoop/Spark (Intermediate) ElasticSearch (Intermediate) Kibana (Basic)...
Full time
Contract work
For contractors
Local area
Fusion Innovation
Vienna, VA
7 days ago
Senior Specialist, Federal Data Engineer
...Responsibilities:Leverage a variety of modern big data tools / approaches to solve complex... ...leading technologies (e.g. - Hadoop, Spark, Kafka, Kubernetes, Terraform, Airflow, AWS... ...& technical stakeholders)Develop data engineering designs that positively impacts business...
Local area
KPMG
McLean, VA
3 days ago
Data Engineer
...Job Description Hiring: Data Engineer – Python/AWS \n I’m working with a large financial services organization looking to add a Data... ...Kinesis, S3, DynamoDB, IAM, Glue, and CDK \n • Support Glue/Spark consumers and Flink-based pipelines \n • Build rigorous unit...
Swoon
McLean, VA
15 days ago
Data Engineer (Temporal & Apache Kafka required)
...About Infinitive Infinitive is a data and AI consultancy that helps clients modernize... ...Role We are seeking an experienced Data Engineer to help design, build, and scale our next... ...ETL/ELT pipelines using Python, Apache Spark, and modern cloud data warehouses and Lakehouse...
Full time
Contract work
Local area
Infinitive Inc
McLean, VA
19 days ago
Data Engineer
...Hybrid in McLean, VA Tuesday-Thursday Our client seeks two Data Engineers to build and support batch-oriented data pipelines for AML and... ...micro-pod structure and requires hands-on engineering across Spark, Python, AWS Glue, Airflow, and SQL. Engineers will develop...
Hourly pay
Temporary work
Local area
Eliassen Group
McLean, VA
12 days ago
Data Engineer
...Expression is seeking an experienced Data Engineer to support the design, development, and operational deployment of scalable, AI-enabled... ...Select and implement appropriate modeling approaches using Python, Spark, and cloud-native ML frameworks such as SageMaker and MLflow....
Full time
For contractors
Work at office
Immediate start
Expression
Arlington, VA
more than 2 months ago
Data Engineer
...Job Description Job Description 540 is looking for a Data Engineer to develop data transformation and workflow solutions supporting an... ...Familiarity with X12/MILS processing Experience with Apache Spark, Kafka, or other distributed data processing frameworks Knowledge...
Temporary work
Work at office
Local area
Remote work
Flexible hours
540
Arlington, VA
5 days ago
Data Engineer (DEA)
...Expression is seeking a Data Engineer to support the Drug Enforcement Administration (DEA) Investigative Case and Data Ecosystem (ICDE) modernization... .... Knowledge of big-data technologies such as Hadoop, Spark, or other distributed-processing frameworks. Experience...
Full time
For contractors
Work at office
Immediate start
Expression
Arlington, VA
a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Spark Data Engineer. Be the first to apply!