Big Data Engineer - Python/Scala, Spark, Hadoop - Full Time

Full-time

Programmers.io

Arlington, VA

One of our client is Looking Big Data Engineer for Full Time Role at Arlington VA (Hybrid)

Title – Big Data Engineer – Python/Scala, Spark, Hadoop

Location- Arlington, VA (3 Days onsite/week)

Terms- Full Time

Job Summary:

Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required

Apply

Vacancy posted -78

Similar jobs that could be interesting for youBased on the Big Data Engineer - Python/Scala, Spark, Hadoop - Full Time in Arlington, VA vacancy

Big Data Engineer: Python/Scala, Spark & Hadoop (Hybrid)
Programmers.io seeks a Big Data Engineer for a full-time hybrid role in Arlington, VA. You will translate business needs into robust data... ...teams. You'll design end-to-end pipelines with Python/Scala, Spark and Hadoop, ensuring data quality and scalable analytics. Experience...
Full time
Big data
3 days per week
Programmers.io
Arlington, VA
2 days ago
Senior Big Data Engineer (Java, Kafka, Spark, ETL)
...Remote) Employment Type: Full-Time Citizenship: U.S.... ...SDA is seeking a Senior Big Data Engineer / Java Data... ...technologies such as Kafka, Spark, Elasticsearch, and cloud... ...platforms. Experience with Hadoop ecosystem technologies. Experience with Scala development....
Full time
Big data
Remote work
Flexible hours
Systems Development and Analysis
Arlington, VA
2 days ago
Senior Data Engineer (Python, SQL, AWS)- Dealer Tech
$158.6k - $181k
Senior Data Engineer (Python, SQL, AWS) - Dealer Tech Do you... ...'ll be part of a big group of makers,... ...provides meaningful and timely insights. Build... ...(Flink, Spark Streaming) using programming... ...like Java, Scala, Python. Be part of... ...technical solutions in full-stack development...
Full time
Big data
Part time
Internship
H1b
Local area
Capital One National Association
Mc Lean, VA
1 day ago
Lead Data Engineer
$197.3k - $225.1k
...ll be part of a big group of makers,... ...We are seeking Data Engineers who are passionate... ...solutions in full-stack development... ...languages like Java, Scala, Python and Open Source... ...(MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL... ...working on real-time data and streaming...
Full time
Big data
Part time
Internship
H1b
Local area
Capital One
Mc Lean, VA
5 days ago
Kearney Activate Senior Consultant Data Engineer
...Senior Consultant Data Engineer Full‑time Americas Arlington,... ...frameworks such as Spark and Databricks. Monitor... ..., including Python and SQL, with Java or Scala a plus. Strong knowledge... .... Experience with big data technologies... ...including Spark, Hadoop, Kafka, and Kinesis...
Full time
Big data
Immediate start
Remote work
Flexible hours
Shift work
Kearney Italia, Inc.
Arlington, VA
2 days ago
Data Engineer
$62k - $141k
Data EngineerThe Opportunity: Ever-expanding... ...before. As a data engineer, you know that... ...stores that supply big data in forms needed... ...tools, such as Spark, Databricks, Hadoop, Hive, AWS EMR, or... ...KafkaExperience working on real-time data and streaming... ...of our values. Full-time and part-time...
Full time
Big data
Contract work
Part time
Local area
Remote work
Booz Allen Hamilton
Arlington, VA
1 day ago
Lead Data Engineer (DHS)
...plans. Overview Lead Data Engineers at Excella play a key... ...Strong proficiency in SQL, Python, and orchestration tools... ...Hands-on experience with big data technologies such as Spark, Kafka, and file formats... ...Specialty ~ Python or Scala Programming Certification...
Full time
Big data
Work from home
Home office
Flexible hours
Excella
Arlington, VA
16 hours ago
Data Engineer
$155k - $165k
...Data Engineer We need an experienced Data Engineer at the National... ...technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL,... ...and analysis. This is a full-time opportunity. We can offer a... ...of large datasets Leverage big data technologies to...
Full time
Big data
Work at office
2 days per week
1 day per week
West 4th Strategy
Arlington, VA
2 days ago
Data Engineer: Spark, AI & Cloud Data Architect
...Zachary Piper Solutions is seeking Data Engineers for our Professional Services... ..., guiding customers through big data initiatives, and delivering... ...environments. The role requires strong Spark experience, 6+ years in data engineering, Python or Scala proficiency, and deep cloud...
Big data
Jobleads-US
McLean, VA
2 days ago
Data Engineering Software Developer
$107.9k - $195.05k
...development phasesFull-time on-site... ..., reliable data systems and... ...visualization engineers, and other... ...Redshift, S3, Hadoop, Snowflake, or... ...languages such as Python, Java, SQL,... ...with big data technologies... ...such as Kafka, Spark, NiFi, Hadoop... ...: Washington, DCType: Full time
Full time
Big data
Remote work
Leidos
Washington DC
1 day ago
Lead AI & Data Analytics Engineer
...seeking a Lead AI & Data Analytics Engineer to support a federal... ...using Databricks, SQL, Python, PySpark, or similar... ...Design end-to-end big data architectures... ...procurement status, cycle times, data quality,... ...technologies (e.g. Databricks, Spark, Kafka, Hadoop, Snowflake, Azure...
Full time
Big data
Contract work
TekStream Solutions
Arlington, VA
3 days ago
Machine Learning Engineer 4 (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)
$197.3k - $225.1k
Machine Learning Engineer 4 (Python, AWS, SQL,... ...ll be part of a big group of makers... ...Modeling, and Data Engineering. In... ...languages like Python, Scala, or Java... ...distributed systems (Spark, Ray) to... ...concept At this time, Capital One... ...minimum and maximum full-time annual...
Full time
Big data
Part time
H1b
Local area
Capital One
McLean, VA
2 days ago
Junior Data Engineer (DEA)
...Expression is seeking a Junior Data Engineer to support the Drug... ...aggregations. Familiarity with Python for data manipulation or automation... ...Platform. Exposure to Hadoop, Spark, or other distributed-... ...Government contractors and a Top 20 Big Data Solutions Provider by...
Full time
Big data
For contractors
Internship
Work at office
Immediate start
Expression
Washington DC
a month ago
Big Data Engineer
...Title : Big Data Engineer Location : DC Metro Area Target Start Date : ASAP Type : contract... ...systems, cloud platforms, and technologies such as Spark, Hadoop, Python, and Scala. Responsibilities Design, develop, and...
Big data
Contract work
Immediate start
ConsultNet Technology Services and Solutions
Washington DC
-78
Data Engineer
$125k - $160k
...are looking for seasoned Data Engineer to work with our team and... ...Key must have skill sets - Python, AWSSupport an Agile software... ...in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL... ...languages: Python, Java, C++, Scala, etc.Advanced working SQL...
Big data
Steampunk
McLean, VA
3 days ago
Senior Data Engineer
$125k - $165k
...looking for seasoned Senior Data Engineer to work with our team and... ...must have skill sets - Python, AWSSupport an Agile software... ...in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL... ...languages: Python, Java, C++, Scala, etc.Advanced working SQL...
Big data
Steampunk
McLean, VA
4 days ago
Big Data Developer
...balance. As a Senior Backend Engineer, you'll lead through excellent... ...distributed microservices architecture, big-data technologies (HIVE, Presto, Spark, Hadoop), and full-stack systems. Partner with... ...skills: ~ Backend (any: Python / Scala / Java etc.) ~3 years Big...
Full time
Big data
Unisys
Tysons Corner, VA
-78
Senior Data Engineer
$115k - $150k
...United StatesTechnology /Full-time /HybridInsomniac... ...our clients.As a Senior Data Engineer, you will architect, build... ...tools like Apache Spark, Kafka, Airflow, and dbt... ...).Proficiency in Python (or similar languages)... ...Hands-on experience with big data tools:Apache Spark...
Full time
Big data
Visa sponsorship
Insomniac Design
Washington DC
2 days ago
Senior Data Engineer
$135k - $165k
...As a Senior Associate Data Engineer, you will be... ...maintaining scalable Big Data solutions. You will... ...large datasets, real-time processing frameworks... ...technologies such as Hadoop, Spark, Kafka, and Flink.... ...languages such as Java, Scala, or Python for data processing and...
Big data
Sapient
Arlington, VA
2 days ago
Big Data Engineer
...The Big Data Engineer will design, develop, and optimize large-scale data processing systems... ...and reliable data pipelines using Spark, Python/PySpark, Hadoop, Hive, Trino, and AWS services. The... ...such as Hadoop, Spark, Python, and Scala. Implement scalable and reliable...
Big data
Work experience placement
Compunnel
McLean, VA
2 days ago
Senior Data Engineer
...team as a Senior Data Engineer to align data solutions... ...adjudication wait times, ultimately... ...and platforms and Python. Experience in... ...Apache Kafka, Airflow, Spark, Flink, NiFi).... ...improvements. Big Data Technologies... ...computing frameworks (Hadoop, Spark, Hive,...
Full time
Big data
Contract work
Work at office
Local area
3 days per week
SteerBridge
Vienna, VA
2 days ago
Data Engineer, Senior
$77.6k - $176k
...structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal... ...Experience with SQL, Java, or Python and Spark Experience working... ...of our values. Full-time and part-time employees working...
Full time
Big data
Contract work
Part time
Local area
Remote work
Phase2 Technology
McLean, VA
2 days ago
Big Data Engineer: End-to-End Pipelines, ML & Analytics
Programmers.io in Arlington, VA is seeking a data engineer who can bridge business, data, and technical teams to uncover use... ...end-to-end with a strong emphasis on data quality, using Python or Scala, Spark and Hadoop, plus SQL for analytics. Experience with Hive, Airflow,...
Big data
programmers.io
Arlington, VA
3 days ago
Data Engineering Team Lead
$130k - $160k
OverviewWe are looking for a seasoned Data Engineering Team Lead to work with our team... ...experience with tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL... ...and scripting languages: Python, Java, C++, Scala, etc.Experience with Microsoft Purview...
Big data
Steampunk
McLean, VA
4 days ago
Data Engineer
Overview We are seeking a skilled Data Engineer with at least 5 years of... ...SQL Server). Experience with big data processing frameworks (e.g., Spark, Hadoop). Hands‑on experience building... ...programming languages such as Python, Scala, or Java. Experience with data...
Big data
VTG Defense
Mc Lean, VA
1 day ago
Data Engineer
...seeking a motivated and skilled Data Engineer to join our team. The ideal... ...programming languages such as Python, Java, or Scala. Proficiency with SQL and relational... ...of distributed computing and big data technologies such as Apache Hadoop, Spark, or Kafka. Knowledge of cloud...
Big data
Credence Management Solutions, LLC
Mc Lean, VA
1 day ago
Data Engineer
$77.6k - $176k
...Data Engineer The Opportunity: Ever-expanding technology... ...of experience with Python, SQL, Scala, or Java ~3+ years... ...tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka... ...working on real-time data and streaming applications... ...of our values. Full-time and part-time...
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
McLean, VA
3 days ago
Google Cloud Data Engineer
...Google Cloud Data EngineerAre you ready to... ...Intelligent Software Engineering practice, you will... ...to efficiently use Hadoop/Cloud infrastructure... ...with 3rd parties - Spark, Cloud DataProc,... ...consumption within a hybrid big data architecture, using Java, Python, Scala etc. Minimum 1 year...
Big data
Work experience placement
ClifyX
Washington DC
22 hours ago
Lead Site Reliability Engineer, Data- FreeWheel
$152.02k - $228.03k
...content, robust data, and advanced technology... ...with data engineers and other... ...including Kafka, Hadoop, Spark, Cassandra, HDFS... ...Programming skills in Python, Go, Java, or Scala.Experience with... ..., and other big data technologies... ...Reston, 11951 Freedom Dr Ste 900Type: Full time
Full time
Big data
Comcast
Reston, VA
1 day ago
Data Engineer
...seeking an experienced Data Engineer to support the design,... ...product managers, full-stack developers, platform... .... Location: Full time onsite at the Pentagon... ...modeling approaches using Python, Spark, and cloud-native ML... ...and a Top 20 Big Data Solutions Provider...
Full time
Big data
For contractors
Work at office
Immediate start
Expression
Arlington, VA
a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer - Python/Scala, Spark, Hadoop - Full Time. Be the first to apply!