Big Data Engineer - Python/Scala, Spark, Hadoop - Full Time

Programmers.io

One of our client is Looking Big Data Engineer for Full Time Role at Arlington VA (Hybrid)

All the relevant skills, qualifications and experience that a successful applicant will need are listed in the following description.

Title – Big Data Engineer – Python/Scala, Spark, Hadoop

Location- Arlington, VA (3 Days onsite/week)

Terms- Full Time

Job Summary:

Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
Implementing xhyhwjd machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Big Data Engineer - Python/Scala, Spark, Hadoop - Full Time in Arlington, VA vacancy

Big Data Engineer - Python/Scala, Spark, Hadoop
...Job Description: Position: Big Data Engineer – Python/Scala, Spark, Hadoop Location: Arlington, VA (3 Days onsite/week) Hire Type: Full Time Experience: 10+ Years Job Summary: Ability to easily move between business, data management, and technical teams...
Full time
Big data
3 days per week
Programmers.io
Arlington, VA
3 days ago
Data Engineer
$62k - $141k
Data EngineerThe Opportunity: Ever-expanding... ...before. As a data engineer, you know that... ...stores that supply big data in forms needed... ...tools, such as Spark, Databricks, Hadoop, Hive, AWS EMR, or... ...KafkaExperience working on real-time data and streaming... ...of our values. Full-time and part-time...
Full time
Big data
Contract work
Part time
Local area
Remote work
Booz Allen Hamilton
Arlington, VA
3 days ago
Lead Data Engineer (DHS)
...plans. Overview Lead Data Engineers at Excella play a key... ...Strong proficiency in SQL, Python, and orchestration tools... ...Hands-on experience with big data technologies such as Spark, Kafka, and file formats... ...Specialty ~ Python or Scala Programming Certification...
Full time
Big data
Work from home
Home office
Flexible hours
Excella
Arlington, VA
2 days ago
Data Engineer
$155k - $165k
...Data Engineer We need an experienced Data Engineer at the National... ...technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL,... ...and analysis. This is a full-time opportunity. We can offer a... ...of large datasets Leverage big data technologies to...
Full time
Big data
Work at office
2 days per week
1 day per week
West 4th Strategy
Arlington, VA
4 days ago
Data Engineering Software Developer
$107.9k - $195.05k
...development phasesFull-time on-site... ..., reliable data systems and... ...visualization engineers, and other... ...Redshift, S3, Hadoop, Snowflake, or... ...languages such as Python, Java, SQL,... ...with big data technologies... ...such as Kafka, Spark, NiFi, Hadoop... ...: Washington, DCType: Full time
Full time
Big data
Remote work
Leidos
Washington DC
3 days ago
Big Data Engineer
...Title : Big Data Engineer Location : DC Metro Area Target Start Date : ASAP Type : contract... ...systems, cloud platforms, and technologies such as Spark, Hadoop, Python, and Scala. Responsibilities Design, develop, and...
Big data
Contract work
Immediate start
ConsultNet Technology Services and Solutions
Washington DC
1 day ago
Machine Learning Engineer 4 (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)
$197.3k - $225.1k
Machine Learning Engineer 4 (Python, AWS, SQL,... ...ll be part of a big group of makers... ...Modeling, and Data Engineering. In... ...languages like Python, Scala, or Java Basic... ...systems (Spark, Ray) to prepare... ...concept At this time, Capital One... ...minimum and maximum full-time annual...
Full time
Big data
Part time
H1b
Local area
Capital One
Mc Lean, VA
5 days ago
Data Engineer
$125k - $160k
...are looking for seasoned Data Engineer to work with our team and... ...Key must have skill sets - Python, AWSSupport an Agile software... ...in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL... ...languages: Python, Java, C++, Scala, etc.Advanced working SQL...
Big data
Steampunk
McLean, VA
13 hours ago
Senior Data Engineer
$125k - $165k
...looking for seasoned Senior Data Engineer to work with our team and... ...must have skill sets - Python, AWSSupport an Agile software... ...in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL... ...languages: Python, Java, C++, Scala, etc.Advanced working SQL...
Big data
Steampunk
McLean, VA
1 day ago
Lead AI & Data Analytics Engineer - Must be government clearance eligible
...proactive Lead AI & Data Analytics Engineer to support a federal... ...using Databricks, SQL, Python, PySpark, or similar... ...Design end-to-end big data architectures... ...procurement status, cycle times, data quality,... ...technologies (e.g. Databricks, Spark, Kafka, Hadoop, Snowflake, Azure...
Full time
Big data
Contract work
Navaide
Arlington, VA
28 days ago
Big Data Developer
...balance. As a Senior Backend Engineer, you'll lead through excellent... ...distributed microservices architecture, big-data technologies (HIVE, Presto, Spark, Hadoop), and full-stack systems. Partner with... ...skills: ~ Backend (any: Python / Scala / Java etc.) ~3 years Big...
Full time
Big data
Unisys
Tysons Corner, VA
1 day ago
Senior Data Engineer
$115k - $150k
...United StatesTechnology /Full-time /HybridInsomniac... ...our clients.As a Senior Data Engineer, you will architect, build... ...tools like Apache Spark, Kafka, Airflow, and dbt... ...).Proficiency in Python (or similar languages)... ...Hands-on experience with big data tools:Apache Spark...
Full time
Big data
Visa sponsorship
Insomniac Design
Washington DC
4 days ago
Big Data Engineer
...The Big Data Engineer will design, develop, and optimize large-scale data processing systems... ...and reliable data pipelines using Spark, Python/PySpark, Hadoop, Hive, Trino, and AWS services. The... ...such as Hadoop, Spark, Python, and Scala. Implement scalable and reliable...
Big data
Work experience placement
Compunnel
McLean, VA
4 days ago
Senior Data Engineer
$135k - $165k
...As a Senior Associate Data Engineer, you will be... ...maintaining scalable Big Data solutions. You will... ...large datasets, real-time processing frameworks... ...technologies such as Hadoop, Spark, Kafka, and Flink.... ...languages such as Java, Scala, or Python for data processing and...
Big data
Sapient
Arlington, VA
4 days ago
Senior Data Engineer
...team as a Senior Data Engineer to align data solutions... ...adjudication wait times, ultimately... ...and platforms and Python. Experience in... ...Apache Kafka, Airflow, Spark, Flink, NiFi).... ...improvements. Big Data Technologies... ...computing frameworks (Hadoop, Spark, Hive,...
Full time
Big data
Contract work
Work at office
Local area
3 days per week
SteerBridge
Vienna, VA
4 days ago
Data Engineer
...seeking an experienced Data Engineer to support the design,... ...product managers, full-stack developers, platform... .... Location: Full time onsite at the Pentagon... ...modeling approaches using Python, Spark, and cloud-native ML... ...and a Top 20 Big Data Solutions Provider...
Full time
Big data
For contractors
Work at office
Immediate start
Talentify.io
Arlington, VA
1 day ago
Data Engineering Team Lead
$130k - $160k
OverviewWe are looking for a seasoned Data Engineering Team Lead to work with our team... ...experience with tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL... ...and scripting languages: Python, Java, C++, Scala, etc.Experience with Microsoft Purview...
Big data
Steampunk
McLean, VA
1 day ago
Data Engineer, Senior
$77.6k - $176k
...Data Engineer, Senior The Opportunity: Ever-expanding... ...Experience with Python, SQL, Scala, or Java Experience... ...computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or... ...working on real-time data and streaming... ...demonstration of our values. Full-time and part-time...
Full time
Contract work
Part time
Local area
Remote work
Booz Allen Hamilton
McLean, VA
3 days ago
Lead Site Reliability Engineer, Data- FreeWheel
$152.02k - $228.03k
...content, robust data, and advanced technology... ...with data engineers and other... ...including Kafka, Hadoop, Spark, Cassandra, HDFS... ...Programming skills in Python, Go, Java, or Scala.Experience with... ..., and other big data technologies... ...Reston, 11951 Freedom Dr Ste 900Type: Full time
Full time
Big data
Comcast
Reston, VA
3 days ago
Data Engineer (DEA)
...Expression is seeking a Data Engineer to support the Drug Enforcement Administration... ...tuning. Familiarity with Python for data manipulation, scripting,... ...Google Cloud Platform. Knowledge of big-data technologies such as Hadoop, Spark, or other distributed-processing frameworks...
Full time
Big data
For contractors
Work at office
Immediate start
Expression
Arlington, VA
8 days ago
Junior Data Engineer (DEA)
...Expression is seeking a Junior Data Engineer to support the Drug... ...aggregations. Familiarity with Python for data manipulation or automation... ...Platform. Exposure to Hadoop, Spark, or other distributed-... ...Government contractors and a Top 20 Big Data Solutions Provider by...
Full time
Big data
For contractors
Internship
Work at office
Immediate start
Expression
Arlington, VA
8 days ago
Manager, Data Science - Consumer and Developer Experience (Remote-Eligible)
$179.4k - $204.7k
...Overview Manager, Data Science -... ...to unlock the big opportunities... ...people save money, time and agony in... ...engine; the product suite... ...technologies - Python, Conda, AWS, H2O, Spark, and more - to... ...experience in Python, Scala, or R for... ...minimum and maximum full-time annual...
Full time
Big data
Part time
Local area
Remote work
Flexible hours
Capital One
McLean, VA
4 days ago
Data Management and Analytics Engineer
$80.5k - $149.5k
Data Management And Analytics EngineerMAG is... ...Management and Analytics Engineer to transform raw... ...optimizationStrong scripting skills (Python, R, or advanced SAS... ...with big data technologies (Hadoop, Spark, NoSQL databases)... ...your total well-being. Full-time and part-time...
Full time
Big data
Contract work
Part time
For contractors
Live in
Work at office
Immediate start
Remote work
MAG Aerospace
Fairfax, VA
3 days ago
Data Engineer (Java and Spark, Parquet, Avro, Hive, Iceberg)
...Description 6+ years overall software development experience with at least 3+ years of experience in large scale data platforms .Excellent expertise in Spark and Java .Knowledge of Golang is highly desirable .Good understanding of containerization using Docker...
Full time
Intelliswift - An LTTS Company
Washington DC
2 days ago
Data Engineer 4 (Python, PySpark, AWS)
$197.3k - $225.1k
...Overview Data Engineer 4 (Python, PySpark, AWS) Do you... ...you'll be part of a big group of makers,... ...technical solutions in full-stack development... ...as Python and Spark, along with open-source... ...(Python, Java, or Scala) At least 2... ...and operating real-time or streaming data...
Full time
Part time
Internship
H1b
Local area
Capital One
McLean, VA
14 days ago
Spark Data Engineer
...Hiring: Spark/Scala Data Engineer Location: McLean, VA – Hybrid Work Model: Hybrid – must be able to work onsite in McLean, VA Duration: 12-month contract Pay: $70/hr W2 We’re looking for an experienced Data Engineer to support a large-scale ETL modernization...
Contract work
Swoon
McLean, VA
4 days ago
Data Engineer - Databricks
$125k - $160k
...are looking for seasoned Data Engineer to work with our team and... ...Databricks, SQL, PySpark/Python, AWS Support an Agile software... ...in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake, etc. Relational... .../Python, Java, C++, Scala, etc. Experience working...
Big data
Steampunk
McLean, VA
1 day ago
Senior Data Engineer
...services. We’re a nonprofit engineering, applied research, and... ...Department Summary:MITRE’s Data Science and Engineering... ...EngineeringDistributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage... ...Advanced proficiency in Python and SQL requiredSoftware...
Big data
Internship
Local area
3 days per week
Mitre
McLean, VA
4 days ago
Big Data Developer
...Data EngineerLocation: Must be on-site 3... ...in the following: Big Data and distributed... ...such as Hadoop, Spark, Map Reduce, Sqoop... ..., Pyspark, Spark, Scala, Hive Tuning, Bucketing... ...Autosys.Experience with Python and Shell... ...Computer Science, Engineering or related field or...
Big data
Temporary work
Work experience placement
3 days per week
Samprasoft
McLean, VA
1 day ago
Data Engineers
$120k - $225k
...Solutions is currently seeking Data Engineers on our Professional Services... ...through transformational big data initiatives and third‑... ...: ~ Experienced in Apache Spark (Must have) ~6+ years of experience... ...~ Proficiency in Python or Scala ~ Working knowledge of at...
Big data
Work at office
Piper Companies
McLean, VA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer - Python/Scala, Spark, Hadoop - Full Time. Be the first to apply!