Big Data Engineer - Python/Scala, Spark, Hadoop (Arlington)

Full-time

Programmers.io

Arlington, VA

Job Description:

Position: Big Data Engineer – Python/Scala, Spark, Hadoop

Location: Arlington, VA (3 Days onsite/week)

Hire Type: Full Time

Experience: 10+ Years

Job Summary:

Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it

Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality

High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms

Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or

Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting

Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required

Apply

Vacancy posted 14 hours ago

Similar jobs that could be interesting for youBased on the Big Data Engineer - Python/Scala, Spark, Hadoop (Arlington) in Arlington, VA vacancy

Lead Data Engineer (DHS) (Arlington)
...plans. Overview Lead Data Engineers at Excella play a key... ...Strong proficiency in SQL, Python, and orchestration tools... ...Hands-on experience with big data technologies such as Spark, Kafka, and file formats... ...Specialty ~ Python or Scala Programming Certification...
Big data
Full time
Work from home
Home office
Flexible hours
Excella
Arlington, VA
14 hours ago
Senior Data Engineer
$125k - $165k
...looking for seasoned Senior Data Engineer to work with our team and... ...must have skill sets - Python, AWSSupport an Agile software... ...in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL... ...languages: Python, Java, C++, Scala, etc.Advanced working SQL...
Big data
Steampunk
McLean, VA
2 days ago
Data Engineer
$125k - $160k
...are looking for seasoned Data Engineer to work with our team and... ...Key must have skill sets - Python, AWSSupport an Agile software... ...in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL... ...languages: Python, Java, C++, Scala, etc.Advanced working SQL...
Big data
Steampunk
McLean, VA
6 days ago
Data Engineer
$62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology... ...before. As a data engineer, you know that... ...data stores that supply big data in forms needed... ...computing tools, such as Spark, Databricks, Hadoop, Hive, AWS EMR, or... ...: McLean, VA; Arlington, VA; Alexandria, VA;...
Big data
Full time
Contract work
Part time
Local area
Remote work
Booz Allen Hamilton
Arlington, VA
4 days ago
Data Engineer II
...Spark, Hadoop, and Python are the skills required for the role. It will be hybrid... ...within a commutable distance to Arlington Interview: F2F Assessment: Glider – Data Engineering (Advanced) Overview... ...data. Develop and optimize big data workflows using Apache...
Big data
Temporary work
Work at office
Local area
Monday to Friday
3 days per week
Delan Associates, Inc
Arlington, VA
more than 2 months ago
Data Engineering Team Lead
$130k - $160k
OverviewWe are looking for a seasoned Data Engineering Team Lead to work with our team... ...experience with tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL... ...and scripting languages: Python, Java, C++, Scala, etc.Experience with Microsoft Purview...
Big data
Steampunk
McLean, VA
2 days ago
Data Engineer
$155k - $165k
...Data Engineer We need an experienced Data Engineer at the National... ...including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL,... ...large datasets Leverage big data technologies to efficiently... ...Available to work onsite in Arlington, VA 1-2 days per week ~3+...
Big data
Full time
Work at office
2 days per week
1 day per week
West 4th Strategy
Arlington, VA
a month ago
Sr Big Data/Machine Learning Engineer
$75.63 - $83.7 per hour
...Bachelors responsibilities: Data Engineering & Big Data Architecture: Design... ...: Advanced proficiency in Python and Scala or Java. Big Data Frameworks: Hands-on experience with Apache Spark (PySpark/Scala), Kafka, Flink, Hadoop, Databricks, or Snowflake....
Big data
Hourly pay
Contract work
Temporary work
Work experience placement
McLean, VA
6 days ago
Data Engineer (DEA)
...Expression is seeking a Data Engineer to support the Drug Enforcement... ...required. Location: Arlington, VA. The program is... .... Familiarity with Python for data manipulation, scripting... .... Knowledge of big-data technologies such as Hadoop, Spark, or other distributed-...
Big data
Full time
For contractors
Work at office
Immediate start
Expression
Arlington, VA
a month ago
Spark Data Engineer
...Hiring: Spark/Scala Data Engineer Location: McLean, VA – Hybrid Work Model: Hybrid – must be able to work onsite in McLean, VA Duration: 12-month contract Pay: $70/hr W2 We’re looking for an experienced Data Engineer to support a large-scale ETL modernization...
Contract work
Swoon
McLean, VA
7 hours ago
Data Engineer - Databricks
$125k - $160k
...are looking for seasoned Data Engineer to work with our team and... ...Databricks, SQL, PySpark/Python, AWS Support an Agile software... ...in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake, etc. Relational... .../Python, Java, C++, Scala, etc. Experience working...
Big data
Steampunk
McLean, VA
2 days ago
Data Engineer - Front End/UI, Accounting
$132.1k - $178.8k
...timely financial data. The team supports... ...working with ambiguity, big data, UI... ...stakeholders and other engineering teams to identify... ...scale solutions using Python, React, JavaScript... ...as Python, Java, Scala, or NodeJS-... ...benefits at .USA, VA, Arlington - 132,100.00 - 178...
Big data
Flexible hours
Amazon
Arlington, VA
4 days ago
Senior Data Engineer
...services. We’re a nonprofit engineering, applied research, and... ...Department Summary:MITRE’s Data Science and Engineering... ...EngineeringDistributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage... ...Advanced proficiency in Python and SQL requiredSoftware...
Big data
Internship
Local area
3 days per week
Mitre
McLean, VA
5 days ago
Lead Specialist, Federal Data Engineer
...architectures to tackle the Big Data and Data Science needs for federal... ...with programming languages (Python, Scala preferred) with the ability... ...rapidly ingest, transform, engineer, and visualize data for both... ...-scale big data methods (Hadoop stack, Cloud, Kubernetes)...
Big data
Local area
KPMG
McLean, VA
3 days ago
Data Engineer
$110k - $126k
...Position: Data Engineer Location: Quincy MA (Onsite) Duration: Full-time Salary... ...implementing Databricks solutions using scala and spark with data frames and notebooks/sql 8... ...development work Experience with apache big data implementation with programming...
Big data
Full time
Diverse Lynx LLC
Washington DC
2 days ago
Data Integration Engineer (Arlington)
...Must be US Citizen Arlington, VA (Hybrid) Direct Hire No... ...Respectful We're seeking a Data Integration Engineer for an exciting direct-hire... ..., Palantir, Celonis, SQL, Python, and agentic AI. This... ...data platforms (Databricks, Spark, Delta Lake, Fabric). Relevant...
Full time
Visa sponsorship
SBS Creatix
Arlington, VA
14 hours ago
Data Engineering Software Developer
$107.9k - $195.05k
...scalable, reliable data systems and pipelines... ..., visualization engineers, and other stakeholders... ...AWS Redshift, S3, Hadoop, Snowflake, or... ...languages such as Python, Java, SQL, and shell... ...environments.Experience with big data technologies... ...such as Kafka, Spark, NiFi, Hadoop,...
Big data
Full time
Remote work
Leidos
Washington DC
4 days ago
Databricks Data Engineer
...Mission: Square Peg is seeking a Data Engineer to be responsible for designing,... ...or more programming languages (Python, SQL, Java) Prepare big data, implement data models and develop... ...Experience with using Apache Spark and Hadoop to conduct large-scale data processing...
Big data
Square Peg Technologies
Washington DC
a month ago
Data Engineer II, Amazon Key
$132.1k - $178.8k
...solutions to flow huge amounts of data from production systems into... ...infrastructure using AWS big data stack Python Redshift QuickSight Glue/lake formation EMR/Spark/Scala Athena etc. Develop and manage... ...Work with Product Managers Engineering BI Teams on day-to-day basis...
Big data
Full time
Flexible hours
Amazon
Washington DC
2 days ago
Machine Learning Engineer 4 (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)
$197.3k - $225.1k
Machine Learning Engineer 4 (Python, AWS, SQL, GenAI) (Enterprise... ...One, you'll be part of a big group of makers,... ...as Ops, Modeling, and Data Engineering. In this role... ...languages like Python, Scala, or Java Basic Qualifications... ...distributed systems (Spark, Ray) to prepare AI/ML...
Big data
Full time
Part time
H1b
Local area
Capital One
McLean, VA
3 days ago
Data Engineer
...Thursday Our client seeks two Data Engineers to build and support batch-... ...requires hands-on engineering across Spark, Python, AWS Glue, Airflow, and SQL.... ...hands-on coding. ~4+ years with big data technologies such as Spark, Hadoop ecosystem, or EMR. ~4+ years...
Big data
Hourly pay
Temporary work
Local area
Eliassen Group
McLean, VA
7 days ago
Cloud Analytics Engineer - Flexible Schedule
...seeking a Cloud Analytic Software Engineer to design, develop, and... .... You will build scalable data pipelines, process large datasets... ...role requires expertise in Python/Java, cloud platforms (AWS/Azure/GCP), and big data tools like Hadoop/Spark, with a focus on secure,...
Big data
Flexible hours
Cymertek
Mc Lean, VA
5 days ago
Data Engineer II, AWS Marketplace and Partner Services
$132.1k - $178.8k
...best partner experience worldwide. Data Engineering is a horizontal layer that... ...solutions using technologies such as Spark EMR Python Redshift Glue and S3. You will... ...etc. experience - 3 years of big data technologies such as AWS Hadoop Spark Pig Hive Lucene/SOLR or Storm...
Big data
Full time
Worldwide
Flexible hours
Amazon
Washington DC
2 days ago
Data Engineer II, AWS Analytics Engineering FDT
$132.1k - $178.8k
...The AWS Analytics Engineering (AAE) organization is the analytics backbone of AWS we build and operate the data platform that powers business decisions across... ...databases) - Experience with big data technologies such as: Hadoop Hive Spark EMR - Experience working with...
Big data
Full time
Temporary work
Flexible hours
Amazon
Washington DC
2 days ago
Data / AI Native Engineer
...Data / AI Native Engineer (Multiple Openings) Description:... ...Location: St. louis, MO/ Arlington, VA/ NYC, NY & NJ... ...data pipelines using Spark and PySpark. Develop... ...specifically, rather than Scala-only Spark... ...only Data Architect DBA Hadoop Administrator...
Work experience placement
Work at office
3 days per week
Stellent IT LLC
Arlington, VA
1 day ago
Data Scientist
$125k - $160k
...are looking for seasoned Data Scientist to work with... ...science, information systems, engineering, business, or a... ...programming skills in SQL, Python, R, Scala, Java, or similar languageExperience... ...experience in big data systems including Hadoop, Spark, ScalaData visualization...
Big data
Steampunk
McLean, VA
2 days ago
Lead AI & Data Analytics Engineer - Must be government clearance eligible
...seeking a proactive Lead AI & Data Analytics Engineer to support a federal... ...layers using Databricks, SQL, Python, PySpark, or similar tools... ...Design end-to-end big data architectures across... ...technologies (e.g. Databricks, Spark, Kafka, Hadoop, Snowflake, Azure Data Factory...
Big data
Full time
Contract work
Navaide
Arlington, VA
a month ago
Data Engineer
$120k - $140k
...DescriptionEverforth ECS is seeking a Data Engineer to join our team in Arlington, VA (Hybrid). ECS is seeking a... ...Knowledge of Data Warehousing and Big Data. Knowledge of Data Analytics and... ...Oracle), ETL Tools (i.e., Informatica, python), Git, and operational modeling (...
Big data
ECS Federal
Arlington, VA
4 days ago
Senior Data Scientist
...We’re a nonprofit engineering, applied research,... ...Department Summary:MITRE’s Data Science and... ...Data Processing and Big Data Architectures (e.g., Spark, Hadoop, Ray, Dask, Kafka)Data... ...- Proficiency in Python and SQL requiredSoftware... ..., R, C/C++, Java, Scala, Julia, Rust,...
Big data
Internship
Local area
3 days per week
Mitre
McLean, VA
6 days ago
Data Engineer
Analytica is seeking a Databricks Data Engineer to support a high-profile program for... ...based data solutions.Proficiency in Python, SQL, and data engineering concepts.Experience with Databricks, Apache Spark, PySpark, or similar big data technologies.Experience with AWS...
Big data
ANALYTICA
Washington DC
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer - Python/Scala, Spark, Hadoop (Arlington). Be the first to apply!