Big Data Engineer - Python/Scala, Spark, Hadoop
Programmers.io
Job Description:
Position: Big Data Engineer – Python/Scala, Spark, Hadoop
Location: Arlington, VA (3 Days onsite/week)
Hire Type: Full Time
Experience: 10+ Years
Job Summary:
Ability to easily move between business, data management, and technical teams;
ability to quickly intuit the business use case and identify technical solutions to enable it
Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Big Data Engineer - Python/Scala, Spark, Hadoop in Arlington, VA vacancy
- Programmers.io seeks a Big Data Engineer for a full-time hybrid role in Arlington, VA. You will translate business needs into robust... ...across teams. You'll design end-to-end pipelines with Python/Scala, Spark and Hadoop, ensuring data quality and scalable analytics....Big dataFull time3 days per week
- ...One of our client is Looking Big Data Engineer for Full Time Role at Arlington VA (Hybrid) Title – Big Data Engineer – Python/Scala, Spark, Hadoop Location- Arlington, VA (3 Days onsite/week) Terms- Full Time Job Summary: Ability to easily move between...Big dataFull time3 days per week
Programmers.io
Arlington, VA12 hours ago - ...Opportunity SDA is seeking a Senior Big Data Engineer / Java Data Integration Engineer... ...technologies such as Kafka, Spark, Elasticsearch, and cloud-based... ...search platforms. Experience with Hadoop ecosystem technologies. Experience with Scala development. Experience with...Big dataFull timeRemote workFlexible hours
- ...Zachary Piper Solutions is seeking Data Engineers for our Professional Services... ..., guiding customers through big data initiatives, and delivering... ...environments. The role requires strong Spark experience, 6+ years in data engineering, Python or Scala proficiency, and deep cloud...Big data
$110k - $160k
...are looking for seasoned Data Engineer to work with our team and... ...Key must have skill sets - Python, AWSSupport an Agile software... ...in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL... ...languages: Python, Java, C++, Scala, etc.Experience with Databricks...Big dataSteampunk
McLean, VA2 days ago$135k - $165k
...As a Senior Associate Data Engineer, you will be responsible for designing... ..., and maintaining scalable Big Data solutions. You will... ...using technologies such as Hadoop, Spark, Kafka, and Flink.... ...programming languages such as Java, Scala, or Python for data processing and...Big dataSapient
Arlington, VA1 day ago- ...The Big Data Engineer will design, develop, and optimize large-scale data processing systems... ...and reliable data pipelines using Spark, Python/PySpark, Hadoop, Hive, Trino, and AWS services. The... ...such as Hadoop, Spark, Python, and Scala. Implement scalable and reliable...Big dataWork experience placement
Compunnel
McLean, VA1 day ago - ...Title : Big Data Engineer Location : DC Metro Area Target Start Date : ASAP Type : contract... ...systems, cloud platforms, and technologies such as Spark, Hadoop, Python, and Scala. Responsibilities Design, develop, and...Big dataContract workImmediate start
ConsultNet Technology Services and Solutions
Washington DC12 hours ago $130k - $160k
OverviewWe are looking for a seasoned Data Engineering Team Lead to work with our team... ...experience with tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL... ...and scripting languages: Python, Java, C++, Scala, etc.Experience with Microsoft Purview...Big dataSteampunk
McLean, VA3 days ago- Overview We are seeking a skilled Data Engineer with at least 5 years of... ...SQL Server). Experience with big data processing frameworks (e.g., Spark, Hadoop). Hands‑on experience building... ...programming languages such as Python, Scala, or Java. Experience with data...Big data
- ...seeking a motivated and skilled Data Engineer to join our team. The ideal... ...programming languages such as Python, Java, or Scala. Proficiency with SQL and relational... ...of distributed computing and big data technologies such as Apache Hadoop, Spark, or Kafka. Knowledge of cloud...Big data
$125k - $165k
...looking for seasoned Senior Data Engineer to work with our team and... ...must have skill sets - Python, AWS. Support an Agile software... ...in tools such as: Big data tools: Hadoop, Spark, Kafka, etc. Relational SQL... ...languages: Python, Java, C++, Scala, etc. Advanced working...Big data- ...Google Cloud Data EngineerAre you ready to... ...Intelligent Software Engineering practice, you will... ...to efficiently use Hadoop/Cloud infrastructure... ...with 3rd parties - Spark, Cloud DataProc,... ...consumption within a hybrid big data architecture, using Java, Python, Scala etc. Minimum 1 year...Big dataWork experience placement
ClifyX
Washington DC4 days ago $197.3k - $225.1k
...One, you'll be part of a big group of makers, breakers... ...customer needs. We are seeking Data Engineers who are passionate about... ...languages like Java, Scala, Python and Open Source RDBMS and... ...tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year...Big dataFull timePart timeInternshipH1bLocal area$125k - $160k
...are looking for seasoned Data Engineer to work with our team and... ...Databricks, SQL, PySpark/Python, AWS Support an Agile software... ...in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake, etc. Relational... .../Python, Java, C++, Scala, etc. Experience working...Big dataSteampunk
McLean, VA3 days ago- ...services. We’re a nonprofit engineering, applied research, and... ...Department Summary:MITRE’s Data Science and Engineering... ...EngineeringDistributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage... ...Advanced proficiency in Python and SQL requiredSoftware...Big dataInternshipLocal area3 days per week
Mitre
McLean, VA1 day ago $120k - $225k
...Solutions is currently seeking Data Engineers on our Professional Services... ...through transformational big data initiatives and third‑... ...: ~ Experienced in Apache Spark (Must have) ~6+ years of experience... ...~ Proficiency in Python or Scala ~ Working knowledge of at...Big dataWork at officeZP Group
McLean, VA1 day ago- ...Data EngineerLocation: Hybrid Onsite (3 days onsite in... ...able to apply advanced Data Engineering and Machine learning... ...XMLs, JSONs, PDFs) using Hadoop platform.Develop Python, PySpark, Spark scripts to filter/cleanse... ...structured and unstructured big data. Big data technologies...Big dataWork experience placement
Samprasoft
McLean, VA4 days ago $62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology like... ...than ever before. As a data engineer, you know that organizing data... ...data stores that supply big data in forms needed for business... ...computing tools, such as Spark, Databricks, Hadoop, Hive, AWS EMR, or KafkaExperience...Big dataFull timeContract workPart timeLocal areaRemote workBooz Allen Hamilton
Arlington, VA20 hours ago- ...Data Engineer IISpark, Hadoop, and Python are the skills required for the role. It will be hybrid, 3 days a week... ...have strong hands-on experience with Spark, Hadoop, Python, and SQL, along with... ...-critical data.Develop and optimize big data workflows using Apache Spark and...Big dataWork at officeLocal area3 days per week
Delan Associates Inc
Arlington, VA3 days ago - ...Quantitative Analytics/Big Data Developer/Data Engineer SeniorFreddie Mac’s Single-Family Division is currently seeking a Quantitative... ...Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.• Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.•...Big dataWork experience placement
Software Technology Inc
McLean, VA4 days ago $140k - $180k
...Senior Data EngineerWe are looking for seasoned Senior Data Engineer to work with our team and our... ...Databricks, SQL, PySpark/Python, AWSSupport an... ...experience in tools such as:Big data tools: Databricks, Apache Spark, Delta Lake, etc.... ...Python, Java, C++, Scala, etc.Experience...Big dataSteampunk.com
Washington DC3 days ago- ...Data EngineerAs part of the Data Management area, the Data Engineer will provide leadership in the conceptualization... ...structures (Hadoop, MongoDB,... ...highly scalable ‘big data’ data stores... ...), Hadoop, Spark, Kafka, Linux scripting... ...languages: Python, Java, etc. Data...Big data
Software Technology Inc
Washington DC4 days ago - ...Big Data Engineer LOCATION Tysons, VA 22182 CLEARANCE TS/SCI Full Poly (Please... ...TITLES Data Engineer, Data Architect, Hadoop Developer, Spark Engineer, ETL Developer, Data... ...Proficiency in programming (e.g., Java, Python) Expertise in data processing...Big dataTemporary workFor contractorsImmediate startFlexible hours
Cymertek
McLean, VA4 days ago $115k - $125k
...Overview Most data engineering jobs are maintenance. This one is... ...standing up ETL on Databricks and Spark for a National Guard... ...technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL... ...large datasets Apply big data technologies to...Big dataTemporary workWork at officeRemote workRelocation2 days per week1 day per weekcareers-fedwriters
Arlington, VA3 days ago- Silverthorne Advisory Group is seeking a skilled Data Engineer to join our defense sector team. You will design, build, and maintain... ...and ensure robust, scalable pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks. You will collaborate...Big dataRemote job
$155k - $165k
...Data Engineer We need an experienced Data Engineer at the National Guard Bureau (NGB). The... ...and technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL, working... ...integrity of large datasets Leverage big data technologies to efficiently process...Big dataFull timeWork at office2 days per week1 day per weekWest 4th Strategy
Arlington, VA1 day ago- ...Data Engineer100% RemoteClient: CotivitiAt Cotiviti, we are custodians... ...owners, analysts, and software engineers.Create and maintain SOP... ...workloads.Working knowledge of big data/cloud technologies (Databricks, AWS, Azure, Hadoop, Spark, Snowflake etc.) is preferred.Expertise...Big dataWork experience placementWork at officeFlexible hoursWeekend work
Anveta
Washington DC4 days ago - Title: Data Engineer II Location: Arlington, VA (Onsite) Position Type: W2 contract Industry... ...‑scale ETL pipelines using Apache Spark, Hadoop, Python, and SQL. Strong background in the... ...and accessibility of data. Leverage big data processing frameworks such as Apache...Big dataContract workLocal area
- ...datasets. •Analyze complex data structures and source-to-... ...into effective data engineering solutions. •Monitor pipeline... .... •Familiarity with Python for data manipulation, scripting... .... •Knowledge of big data technologies (Hadoop, Spark, or distributed processing...Big data
Bow Wave LLC
Arlington, VA20 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer - Python/Scala, Spark, Hadoop. Be the first to apply!
Related searches
- data engineer machine learning Arlington, VA
- aws data engineer Arlington, VA
- big data developer Arlington, VA
- sr data engineer Arlington, VA
- big data cloud engineer Arlington, VA
- finance data engineer Arlington, VA
- junior big data engineer Arlington, VA
- sr information security engineer Arlington, VA
- data center engineer Arlington, VA
- senior data integration developer Arlington, VA