Data Engineer - Python/Scala, Spark, Hadoop
Programmers.io
Job Summary:
Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required
Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Python/Scala, Spark, Hadoop in Arlington, VA vacancy
$197.3k - $225.1k
...Overview Lead Data Engineer (Python, Scala, Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex... ...experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ year...SuggestedFull timePart timeInternshipH1bLocal area$158.6k - $181k
Senior Data Engineer (Python, AWS, Spark) Do you love building and pioneering in the technology space? Do you... ...programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL... ...data/computing tools (Lake, MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or...SuggestedFull timePart timeInternshipH1bLocal area- Accord Technologies Inc is seeking a Data Engineer II to design, implement, and maintain scalable... ...data processing code and leverage Spark/Hadoop to ensure timely data availability. Collaborate... ...hands-on experience in Spark, Hadoop, Python, and SQL, #J-18808-Ljbffr Accord...Suggested
- ...professional to leverage their extensive experience in the Hadoop ecosystem and Spark within a 12-24 month contract. The successful candidate will... ...components and programming in Java or Spark. Knowledge of data warehousing and distributed computing design patterns is essential...SuggestedContract workImmediate start
$179.4k - $204.7k
...Lead Data Engineer (Java, Python, AWS) Do you love building and pioneering in the technology... ...programming languages like Java, Scala, Python and Open Source RDBMS and... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ year experience...SuggestedFull timePart timeInternshipH1bLocal areaCapital One
McLean, VA4 days ago$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)... ...Utilize programming languages like Java, Scala, Python and Open Source RDBMS and... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ years of experience...Full timePart timeInternshipH1bLocal areaCapital One
McLean, VAa month ago$197.3k - $225.1k
Lead Data Engineer (Python, PySpark, AWS) Do you love building and pioneering in the technology... ...languages such as Java, Scala, Python, and open‑source RDBMS and... ...distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL). 4+ years...Full timeInternshipH1bLocal area- ...skilled professional with a solid understanding of the Hadoop ecosystem and hands-on experience in Spark and Java programming. The ideal candidate will have a... ...in the Hadoop environment, along with expertise in Data Warehousing, ETL processes, and NoSQL databases. You...
- ...Opportunity SDA is seeking a Senior Big Data Engineer / Java Data Integration Engineer... ...technologies such as Kafka, Spark, Elasticsearch, and cloud-based... ...platforms. Experience with Hadoop ecosystem technologies. Experience with Scala development. Experience with MongoDB...Full timeRemote workFlexible hours
- ...a skilled software developer with extensive experience in Big Data technologies. The ideal candidate will have at least 5 years of... ...'s in Computer Science or a related field. Proficiencies in Hadoop, Spark, and Java, as well as familiarity with AWS and Linux, are crucial...
- Capital One is looking for a Senior Lead Data Engineer in McLean, VA to spearhead data projects using Python, AWS, and Snowflake. You will collaborate with Agile teams to create innovative solutions that address real business challenges and enhance customer experiences....
- Lead Data Engineer - Risk Tech (Python, AWS) Do you enjoy solving complex business problems in fast‑paced, collaborative... ...programming languages such as Java, Scala, Python and open‑source RDBMS and... ...tools (MapReduce, Flink, EMR, Kafka, Spark, or MySQL). 4+ years of experience...InternshipLocal area
$125k - $160k
...landscape, an organization’s data has never been a more... ...for seasoned Data Engineer to work with our team... ...have skill sets - Python, AWSSupport an Agile software... ...as:Big data tools: Hadoop, Spark, Kafka, etc.Relational... ...: Python, Java, C++, Scala, etc.Advanced working...$152k - $205.6k
...combines the talents of science, engineering, and UX to build and... ...Amazonians worldwide.As a Data Engineer on PXTCS, you'll... ...programming language, such as Python, Java, Scala, or NodeJS- Experience... ...data technologies such as: Hadoop, Hive, Spark, EMRAmazon is an equal...Local areaWorldwideFlexible hours$77.6k - $176k
Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning... ...Nice If You Have:Experience with Python, SQL, Scala, or Java Experience with UNIX or... ...data or computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience...Full timeContract workPart timeWork at officeLocal areaRemote work$125k - $165k
...landscape, an organization’s data has never been a more... ...seasoned Senior Data Engineer to work with our team... ...have skill sets - Python, AWSSupport an Agile software... ...as:Big data tools: Hadoop, Spark, Kafka, etc.Relational... ...: Python, Java, C++, Scala, etc.Advanced working...$120k - $225k
Zachary Piper Solutions is seeking a skilled Data Engineer for our McLean, VA office. You will deliver high-value technical projects... ...6+ years in data engineering, proficiency in Apache Spark, Python, or Scala, and knowledge of major cloud ecosystems. The salary range...Work at office- Guidehouse is hiring a Senior Data Engineer to design, build, and operate Azure Lakehouse architectures using Azure Databricks... .... You will develop scalable ETL/ELT pipelines with Spark, Delta Lake, Python, SQL, and Scala; collaborate across teams; and implement data quality...
- ...Job Title8+ Years experience working in Data Analysis.Hands on Experience in Hadoop Stack of Technologies (Hadoop, Spark, HBase, Hive, Pig, Sqoop, Scala, Flume, HDFS, Map Reduce).Hands on experience with Python & Kafka.Good understanding of Database concepts, Data Design...Work experience placement
Saxon Global
Washington DC2 days ago - ...Data Engineer R&D division of a prominent DARPA partner, is hiring a Data Engineer... ...atleast two of these languages: Python(preferable), R, Scala, Go, Groovy ~ Experience with Rest... ...wrangling Experience with Kafka, Nifi, Spark or Hadoop Background with Elastic Search...Full timeWorldwide
ClearanceJobs
Falls Church, VA1 day ago - ...Data Engineer We are seeking a skilled Data Engineer with at least 5 years of experience... ...big data processing frameworks (e.g., Spark, Hadoop) ~ Hands-on experience building ETL/... ...in programming languages such as Python, Scala, or Java ~ Experience with data warehousing...
VTG
McLean, VA4 days ago $197.3k - $225.1k
...Lead Data Engineer - HR Tech Do you love building and pioneering in the technology... ...programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ year...Full timePart timeInternshipH1bLocal areaCapital One Financial Corp
McLean, VA1 day ago$229.9k - $262.4k
...Senior Lead Data Engineer (Bank Tech)Do you love building and pioneering in the technology... ...programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL... ...Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)4+ year...Full timePart timeInternshipLocal areaCapital One
McLean, VA3 days ago- ...the tools to deliver. We are a data and technology innovation hub... ...process-store pipelines on AWS: Spark-based extract, transform, and... ..., and Step Functions, in Python and PySpark. A data lake that... ...Who you are You are a data engineer who is serious about the craft...Temporary workWork at officeImmediate start
OpenDataJobs
Washington DC2 days ago - ...Position: Data Engineer (US Citizens Only) Location: Seattle, Washington Duration... ...in programming languages such as Python, Java, or Scala. Experience with cloud-based data... ...Familiarity with big data technologies like Hadoop, Spark, or Kafka. Excellent problem-...Full timeTemporary work
Pinnacle Group
Washington DC11 days ago - Senior Data Engineer with 3-5 years of experience // Secret with SCI or TOP secret with... ...1-3+ years of experience with Python, SQL, Scala, or R Experience creating solutions... ...distributed data/computing tools including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience...
- ...are seeking a motivated and skilled Data Engineer to join our team. The ideal candidate... ...in programming languages such as Python, Java, or Scala. Proficiency with SQL and relational... ...big data technologies such as Apache Hadoop, Spark, or Kafka. Knowledge of cloud-based...
$158.6k - $181k
Senior Data Engineer (Bank Tech) Do you love building and pioneering in the technology... ...programming languages like Java, Scala, Python and open‑source RDBMS and NoSQL databases... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 2+ years of...Full timePart timeInternshipH1bLocal area$62k - $141k
## Data EngineerApplylocations: McLean, VA: Arlington... ...id: R0244560Data Engineer**The Opportunity:**... ...including C++, Java, or Python* 2+ years of... ...development utilizing SQL or Scala* Experience with a... ...computing tools, such as Spark, Databricks, Hadoop, Hive, AWS EMR, or...Full timeContract workPart timeWork at officeLocal areaRemote work- DCI Solutions in Washington, D.C. is seeking a Data Engineer to join a cross-functional team focused on solving operational problems... .... Requirements include a BS in CS/Engineering, hands-on Spark/PySpark, Python and SQL, and an Active Secret Security Clearance. Foundry...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Python/Scala, Spark, Hadoop. Be the first to apply!
Related searches
- data center engineer Arlington, VA
- senior cloud data engineer Arlington, VA
- data infrastructure engineer Arlington, VA
- sr information security engineer Arlington, VA
- hadoop big data developer Arlington, VA
- data visualization developer Arlington, VA
- remote data engineer Arlington, VA
- etl data engineer Arlington, VA
- data engineer analytics Arlington, VA
- sr data engineer Arlington, VA