Big Data Engineer - Python/Scala, Spark, Hadoop (Arlington)

Full-time

Programmers.io

Arlington, VA

Job Description:

Position: Big Data Engineer – Python/Scala, Spark, Hadoop

Location: Arlington, VA (3 Days onsite/week)

Hire Type: Full Time

Experience: 10+ Years

Job Summary:

Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it

Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality

High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms

Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or

Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting

Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required

Apply

Vacancy posted 4 hours ago

Similar jobs that could be interesting for youBased on the Big Data Engineer - Python/Scala, Spark, Hadoop (Arlington) in Arlington, VA vacancy

Big Data Engineer - Python/Scala, Spark, Hadoop - Full Time (Arlington)
...One of our client is Looking Big Data Engineer for Full Time Role at Arlington VA (Hybrid) Title – Big Data Engineer – Python/Scala, Spark, Hadoop Location- Arlington, VA (3 Days onsite/week) Terms- Full Time Job Summary: Ability to easily move between...
Big data
Full time
3 days per week
Programmers.io
Arlington, VA
4 hours ago
Lead Data Engineer (DHS) (Arlington)
...plans. Overview Lead Data Engineers at Excella play a key... ...Strong proficiency in SQL, Python, and orchestration tools... ...Hands-on experience with big data technologies such as Spark, Kafka, and file formats... ...Specialty ~ Python or Scala Programming Certification...
Big data
Full time
Work from home
Home office
Flexible hours
Excella
Arlington, VA
4 hours ago
Big Data Engineer
...by reading through the role overview below. Title Big Data Engineer Location DC Metro Area Target Start Date... ...distributed systems, cloud platforms, and technologies such as Spark, Hadoop, Python, and Scala. Responsibilities Design, develop, and maintain...
Big data
Contract work
Immediate start
ConsultNet Technology Services and Solutions
Washington DC
6 days ago
Senior Data Engineer
...Senior Data Engineer Qualifications: Bachelor's... ...1 year of experience in big data technologies... ...application development including Python, SQL, Scala, or Java ~2+ years of... ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~2+...
Big data
Internship
3B Staffing LLC
McLean, VA
5 days ago
Data Engineer II
...Data Engineer II Spark, Hadoop, and Python are the skills required for the role. It will be hybrid, 3 days a week... ...candidates within a commutable distance to Arlington. Interview: F2F Assessment:... ...data. Develop and optimize big data workflows using Apache Spark...
Big data
Work at office
Local area
Monday to Friday
3 days per week
Delan Associates Inc
Arlington, VA
2 days ago
Data Engineer
...Data Engineer We are seeking a skilled Data Engineer with at least 5 years... ...Server) ~ Experience with big data processing frameworks (e.g., Spark, Hadoop) ~ Hands-on experience building... ...programming languages such as Python, Scala, or Java ~ Experience with data...
Big data
VTG
McLean, VA
3 days ago
Data Engineer
...ROLE: - Data Engineer LOCATION: - Mclean - VA... ...Skills: Snowflake, AWS Big Data, Kafka Job Summary... ...techniques such as Hadoop Spark Map Reduce Sqoop Hive... ...Parquet Pyspark Spark Scala Hive Tuning Bucketing... ...Microservices using Java Python SPARK OCP RESTful APIs...
Big data
Long term contract
Work experience placement
Shift work
Maintec Technologies
McLean, VA
4 days ago
Data Engineer
$110k - $160k
...Data Engineer In today's rapidly evolving technology landscape... ...Key must have skill sets - Python, AWS Support an Agile software... ...in tools such as: Big data tools: Hadoop, Spark, Kafka, etc. Relational... ...: Python, Java, C++, Scala, etc. Advanced working...
Big data
Steampunk.com
McLean, VA
3 days ago
Data Engineer
$155k - $165k
...Data Engineer We need an experienced Data Engineer at the National... ...including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL,... ...large datasets Leverage big data technologies to efficiently... ...Available to work onsite in Arlington, VA 1-2 days per week ~3+...
Big data
Full time
Work at office
2 days per week
1 day per week
West 4th Strategy
Arlington, VA
3 days ago
Sr Big Data/Machine Learning Engineer
$75.63 - $83.7 per hour
...Bachelors responsibilities: Data Engineering & Big Data Architecture: Design... ...: Advanced proficiency in Python and Scala or Java. Big Data Frameworks: Hands-on experience with Apache Spark (PySpark/Scala), Kafka, Flink, Hadoop, Databricks, or Snowflake....
Big data
Hourly pay
Contract work
Temporary work
Work experience placement
McLean, VA
5 days ago
Data Engineer (DEA)
...Expression is seeking a Data Engineer to support the Drug Enforcement... ...required. Location: Arlington, VA. The program is... .... Familiarity with Python for data manipulation, scripting... .... Knowledge of big-data technologies such as Hadoop, Spark, or other distributed-...
Big data
Full time
For contractors
Work at office
Immediate start
Expression
Arlington, VA
a month ago
Google Cloud Data Engineer
...Google Cloud Data Engineer Are you ready to step up to the... ...team to efficiently use Hadoop/Cloud infrastructure to... ...combination with 3rd parties - Spark, Cloud DataProc, Cloud... ...within a hybrid big data architecture, using Java, Python, Scala etc. Minimum 1 year of...
Big data
Work experience placement
ClifyX
Washington DC
5 days ago
Big Data / Machine Learning Engineer
...Job Title: Big Data / Machine Learning Engineer Location : McLean VA – Hybrid Duration:: Contract Interview... ...xhyhwjd Preferred Skill Set: Python, SQL, Java, Airflow AWS, GCP EMR, Spark, MapReduce, Hadoop, Hive, Snowflake, Redshift Agile engineering...
Big data
Contract work
Local area
Holistic Partners, Inc
Mc Lean, VA
1 day ago
Sr. Big Data Engineer
...Big Data Engineer Location: Day 1 onsite in McLean, VA on Tuesdays, and Wednesdays.... ...) Job Description Must Haves: Python, PySpark, SQL. Hadoop Platform. Responsibilities include... ...platform. Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate...
Big data
Contract work
Samprasoft
McLean, VA
20 hours ago
Spark Data Engineer
...Hiring: Spark/Scala Data Engineer Location: McLean, VA – Hybrid Work Model: Hybrid – must be able to work onsite in McLean, VA Duration: 12-month contract Pay: $70/hr W2 We’re looking for an experienced Data Engineer to support a large-scale ETL modernization...
Contract work
Swoon
McLean, VA
4 days ago
Big Data Engineer
...Data Engineer Location: Hybrid Onsite (3 days onsite in Mclean, VA... ...Contract Must Haves: Python Sparks Json XML Snowflake... ...– XMLs, JSONs, PDFs) using Hadoop platform. Develop Python,... ...structured and unstructured big data. Big data technologies...
Big data
Contract work
Work experience placement
Samprasoft
McLean, VA
1 day ago
Senior Data Engineer
$140k - $180k
...Senior Data Engineer We are looking for seasoned Senior Data... ...Databricks, SQL, PySpark/Python, AWS Support an Agile... ...experience in tools such as: ~ Big data tools: Databricks, Apache Spark, Delta Lake, etc. ~... .../Python, Java, C++, Scala, etc. ~ Experience working...
Big data
Steampunk.com
Washington DC
21 hours ago
Senior Data Analytics Developer
...scalable applications using Hadoop ecosystem technologies. Develop... ...Skills Hadoop Spark Python SQL & Stored Procedures... ...enterprise analytics platforms Data engineering and ETL experience... ...Required Experience Big Data Development Hadoop Ecosystem...
Big data
Saxon Global
Washington DC
2 days ago
Sr. Data Engineer
...Data Engineer As part of the Data Management area, the Data... ...databases structures (Hadoop, MongoDB, dimensional... ..., and highly scalable ‘big data’ data stores. Experience... ...solutions), Hadoop, Spark, Kafka, Linux scripting... ...scripting languages: Python, Java, etc. Data Engineer...
Big data
Software Technology Inc
Washington DC
5 days ago
Data Engineer
$115k - $125k
...Data Engineer Position FWI is hiring a Data Engineer to support... ...Hybrid: This role is based in Arlington, Virginia and works on a... ...technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL... ...of large datasets Apply big data technologies to...
Big data
Temporary work
Work at office
Remote work
Relocation
2 days per week
1 day per week
FedWriters
Alexandria, VA
4 days ago
Data Engineer - Databricks
$110k - $160k
...looking for a seasoned Data Engineer to work with our team and... ...Catalog, SQL, PySpark/Python, and cloud technologies... ...technologies such as: ~ Big data technologies: Databricks, Apache Spark, Delta Lake, or similar.... .../Python, Java, C++, Scala, or similar. ~ Data lakehouse...
Big data
Steampunk.com
McLean, VA
3 days ago
Senior Data Engineer
...MITRE Data Engineer Position At MITRE, your passion fuels work that impacts... ...Distributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, Dask Data Storage and Data... ...Databases – Advanced proficiency in Python and SQL required Software...
Big data
Local area
3 days per week
MITRE
McLean, VA
4 days ago
Data Engineer
...Data Engineer McLean, VA Type: Contract Category: Data Industry:... ...requires hands-on engineering across Spark, Python, AWS Glue, Airflow, and SQL.... ...hands-on coding. ~4+ years with big data technologies such as Spark, Hadoop ecosystem, or EMR. ~4+ years with...
Big data
Hourly pay
Contract work
Local area
Eliassen Group
McLean, VA
1 day ago
Data Engineer
$62k - $141k
...Job Number: R0248893 Data Engineer The Opportunity:... ...including C++, Java, or Python ~2+ years of... ...data stores that supply big data in forms needed... ...development utilizing SQL or Scala Experience with a... ...tools, such as Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka...
Big data
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Alexandria, VA
5 days ago
Data Engineer
$110k - $126k
...Position: Data Engineer Location: Quincy MA (Onsite) Duration: Full-time Salary... ...implementing Databricks solutions using scala and spark with data frames and notebooks/sql 8... ...development work Experience with apache big data implementation with programming...
Big data
Full time
Diverse Lynx LLC
Washington DC
1 day ago
Lead Specialist, Federal Data Engineer
...architectures to tackle the Big Data and Data Science needs for federal... ...with programming languages (Python, Scala preferred) with the ability... ...rapidly ingest, transform, engineer, and visualize data for both... ...-scale big data methods (Hadoop stack, Cloud, Kubernetes)...
Big data
Local area
KPMG
McLean, VA
4 days ago
Databricks Data Engineer
...Mission: Square Peg is seeking a Data Engineer to be responsible for designing,... ...or more programming languages (Python, SQL, Java) Prepare big data, implement data models and develop... ...Experience with using Apache Spark and Hadoop to conduct large-scale data processing...
Big data
Square Peg Technologies
Washington DC
a month ago
Data Integration Engineer (Arlington)
...Must be US Citizen Arlington, VA (Hybrid) Direct Hire No... ...Respectful We're seeking a Data Integration Engineer for an exciting direct-hire... ..., Palantir, Celonis, SQL, Python, and agentic AI. This... ...data platforms (Databricks, Spark, Delta Lake, Fabric). Relevant...
Full time
Visa sponsorship
SBS Creatix
Arlington, VA
4 hours ago
Data Engineer II, Amazon Key
$132.1k - $178.8k
...solutions to flow huge amounts of data from production systems into... ...infrastructure using AWS big data stack Python Redshift QuickSight Glue/lake formation EMR/Spark/Scala Athena etc. Develop and manage... ...Work with Product Managers Engineering BI Teams on day-to-day basis...
Big data
Full time
Flexible hours
Amazon
Washington DC
1 day ago
Machine Learning Engineer 4 (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)
$197.3k - $225.1k
Machine Learning Engineer 4 (Python, AWS, SQL, GenAI) (Enterprise... ...One, you'll be part of a big group of makers,... ...as Ops, Modeling, and Data Engineering. In this role... ...languages like Python, Scala, or Java Basic Qualifications... ...distributed systems (Spark, Ray) to prepare AI/ML...
Big data
Full time
Part time
H1b
Local area
Capital One
McLean, VA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer - Python/Scala, Spark, Hadoop (Arlington). Be the first to apply!