Data Engineer with Hadoop
Full-time
Delta System & Software, Inc.
Job Description: Data Engineer – Hadoop
Location: Washington, DC (Onsite- 5 days)
Duration: Fulltime
Active Top Secret Clearance Required
Job Description:
- Design, develop, implement, and maintain enterprise-scale Hadoop-based Big Data solutions using HDFS, MapReduce, YARN, and Hadoop ecosystem technologies to process large volumes of structured and unstructured data.
- Develop and optimize distributed data processing workflows using Apache Hive, Pig, Sqoop, Flume, and Oozie for efficient data ingestion, transformation, storage, and processing.
- Build, manage, and optimize complex ETL data pipelines within Hadoop clusters, ensuring data quality, performance tuning, fault tolerance, scalability, and high availability.
- Perform Hadoop cluster administration, configuration, monitoring, troubleshooting, and performance optimization while managing distributed storage and computing environments.
- Collaborate with data architects, analysts, developers, and federal stakeholders to deliver secure Big Data solutions while ensuring compliance with government security policies and data governance standards. Must possess an Active Top Secret Security Clearance and be available to work onsite in Washington, DC, five days per week.
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer with Hadoop in Washington DC vacancy
- DescriptionSAIC is seeking an experienced Data Engineer. Work directly with customers in a technical role to help ensure smooth adoption of the Crucible... ....· Familiarity with distributed systems like Hadoop, HBase / Accumulo, Docker, Kubernetes and Kafka.· Experience...Suggested
Science Applications International Corporation
Arlington, VA1 day ago - ...Reference26-02076Remote50% Remote Title: Big Data Engineer Location : DC Metro Area Target Start Date... ...The ideal candidate has strong experience with distributed systems, cloud platforms, and technologies such as Spark, Hadoop, Python, and Scala. Responsibilities Design...SuggestedContract workImmediate startRemote work
ConsultNet
Washington DC20 hours ago - ...supplier headquartered in Chantilly, VA with off-shore delivery centers in India.... ..., ERP and CRM counselling, Product Engineering, Business Intelligence, Data Management, SOA, BPM, Data... ...and coding applications leveraging Hadoop Components: HDFS, HBase, Hive, Sqoop...SuggestedWorldwide
USM Systems
Alexandria, VA1 day ago $77.5k - $176k
Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning, and... ...data meaningful. Here, you’ll work with and guide a multi-disciplinary team of analysts... ...tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience with...SuggestedFull timeContract workPart timeLocal areaRemote workBooz Allen Hamilton
Alexandria, VA4 days ago- ...Data Engineer AARP is the nation's largest nonprofit, nonpartisan organization dedicated to... ...older to choose how they live as they age. With a nationwide presence, AARP strengthens... ...processing technologies such as Spark, Hadoop, and Delta Lake. Experience with data...SuggestedWork at officeRemote workVisa sponsorshipWork visaMonday to Friday
Older Adults Technology Services
Washington DC1 day ago - ...Big Data Engineer – Python/Scala, Spark, Hadoop Location: Arlington, VA (3 Days onsite/week) Mode of interview: 2 videos Duration: 6+ months... ...building robust and efficient data pipelines end-to-end with a strong focus on data quality • High proficiency in...3 days per week
Echo IT Solutions
Arlington, VA5 days ago $95k - $112k
...collaborative environment? As an experienced Data Engineer-Consultant you will have the ability to... ...travel. If so, consider an opportunity with Deloitte under our Project Talent Model.... ...specifications in Databricks and Apache Hadoop using SparkUnit test the data...Local areaDeloitte
Rosslyn, VA2 days ago- ...Data Engineer As part of the Data Management area, the Data Engineer will provide leadership... ...years to come. The Data Engineer works with the business analysts, software engineers... ...with a variety of databases structures (Hadoop, MongoDB, dimensional designed solutions...
Software Technology Inc
Washington DC5 days ago - ...Senior Data Engineer Apex Systems is currently seeking a Senior Data Engineer who enjoys data... ...and execute ETLs using Apache Spark on Hadoop among other Data technologies... ...documentation and storage standards in conjunction with data architects Monitor performance,...Work experience placement
Software Technology Inc
Washington DC5 days ago $107.9k - $195.05k
...expect:Early-stage flexibility with partial telework during... ...maintains scalable, reliable data systems and pipelines to ingest... ...data analysts, visualization engineers, and other stakeholders to deliver... ...technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar)....Full timeRemote workLeidos
Washington DC4 days ago- ...under the guidance of more experienced engineers. Support analysis of data structures, mappings, and data... ...running migration scripts. Collaborate with analysts, data scientists, and business... .... Exposure to big data technologies (Hadoop, Spark, or distributed processing frameworks...Internship
- ...domain knowledge and technology expertise with the things partners can only know by... ...growthIgnite Digital Services is hiring a Data Engineer to independently build and optimize scalable... ...: Experience with Docker/Kubernetes, Hadoop/Spark, NiFi, ELK stack or comparable...Permanent employmentContract workFor contractorsLocal areaRemote work
Ignite Digital Services
Washington DC3 days ago $70k - $130k
...Description Job Description Position : Senior Data Engineer Location : Charlotte, NC / Wilmington,... ...-scale production environments Cloudera Hadoop ecosystem (HDFS, Hive, YARN, Spark on Cloudera) Strong SQL expertise with complex transformations, performance tuning...PeopleNTech LLC
Alexandria, VA5 days ago$130k - $175k
...strategy, consulting, and customer experience with agile engineering and problem-solving creativity. United... ...combine experience across technology, data sciences, consulting, and customer... ...Data applications built on EMR (Spark/Hadoop), Kafka, Apache NiFi, EKS, Aurora PostgreSQL...Permanent employmentPublicis Media
Arlington, VA20 hours ago- ...citizen services. We’re a nonprofit engineering, applied research, and... ...working in the public interest. With objectivity and integrity at our... ....Department Summary:MITRE’s Data Science and Engineering department... ...Architectures, such as Spark, Hadoop, Ray, DaskData Storage and...InternshipLocal area3 days per week
Mitre
McLean, VA20 hours ago $103.8k - $218.1k
Job Title: Data Engineer/AnalystJob Category: Information TechnologyTime Type: Full timeMinimum Clearance Required to Start: TS/SCIEmployee... ...support enterprise data management requirements.Collaborate with engineers, analysts, operators, and stakeholders to identify data...Contract workWork experience placementWork at officeFlexible hoursCACI International
Alexandria, VA20 hours ago- ...together the talent of our approximately 814,000 people with proprietary assets and platforms, deep process... ...Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve...Work experience placementLive inWork at officeLocal area
Accenture
Arlington, VA4 days ago $125k - $160k
OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and... ...Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL databases,...Steampunk
McLean, VA20 hours ago$112.2k - $196.4k
In a world of possibilities, pursue one with endless opportunities. Imagine Next!At Parsons, you can imagine a career where you thrive... ...Description:Parsons is looking for a highly skilled Senior Data Engineer to join our Joint Staff Chief Digital and Artificial...Full timeWork at officeFlexible hoursParsons
Arlington, VA2 days ago$190k - $225k
...most critical challenges.Whether we team with clients, colleagues, or partners, we put... ...experienced Principal Telecommunications Engineer to support the design, engineering, implementation... ..., and optimization of complex voice and data telecommunications solutions for our...Contract workIron Bow
Washington DC20 hours ago$113k - $188.4k
Position Summary Join Deloitte’s AI & Engineering team to help clients modernize data platforms, enable innovation, and solve complex mission challenges... ...Government & Public Services practice, you will work with teams that design, build, and scale data and...Local areaDeloitte
Rosslyn, VA4 days ago$107.7k - $179.5k
Position Summary Our Deloitte AI & Engineering team to transform technology platforms,... ...growth through innovation.Work you'll doAs a Data Engineer III on the AI & Engineering team... ...data pipeline orchestration workflows with tools such as Airflow and Dagster; and maintain...Local areaDeloitte
Rosslyn, VA4 days ago$130k - $150k
...solutions leveraging common standards in architecture, data and security. Altamira believes that our people and... ...: Joint Base AndrewsPosition Description: As a Data Engineer in this role, you will collaborate closely with various combatant commands, offering technical...Remote workWorldwide3 days per weekAltamira Technologies Corporation
Suitland, MD2 days ago$92.3k - $166.85k
...missions.What to expect:Early-stage flexibility with partial telework during initial... ...Responsibilities:Gather, clean, and validate data from multiple sources to ensure accuracy,... ...knowledge sharing.Work closely with data engineers, business analysts, and other...Full timeRemote workLeidos
Washington DC4 days ago$77.6k - $176k
Data EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning, and... ...available today than ever before. As a data engineer, you know that organizing data can yield... ...data meaningful. Here, you’ll work with and guide a multi-disciplinary team of analysts...Full timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Washington DC2 days ago- ...| Business Process | IT Effectiveness | Engineering | Environmental | Sustainability | Human... ...website at DescriptionProSidian Seeks a Data Engineer | Workforce Planning & Strategic... ...Analytics & Optimization [NSF0038038] is aligned with GSA Labor Category: Systems Engineer.We...Full timeContract workTemporary workFor contractorsH1bWork at officeFlexible hours
Prosidian Consultng
Alexandria, VA20 hours ago - Analytica is seeking a Databricks Data Engineer to support a high-profile program for a financial regulatory agency. This program entails... ...fastest-growing 250 businesses in the US for 3 years. We work with U.S. government clients in health, civilian, and national security...
ANALYTICA
Washington DC4 days ago $62k - $141k
Data Engineer, MidThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more... ...organize and make disparate data meaningful.Here, you’ll work with a multi-disciplinary team of analysts, data engineers,...Full timeContract workPart timeLocal areaRemote workBooz Allen Hamilton
Alexandria, VA2 days ago$124.7k - $207.8k
Position Summary Our Deloitte AI & Engineering team works to transform technology... ...growth through innovation.Work you'll doAs a Data Engineer III on the AI & Data team, you will... ..., and technical documentationCollaborate with client and engineering teams in onsite...Local areaDeloitte
Rosslyn, VA20 hours ago$140k - $170k
...Corporation. We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.S. national interests. We’... ..., graph analytics, and mission-driven software engineering. Our teams work alongside the Department of...Full timeContract workWork experience placementLocal areaRedhorse
Arlington, VA20 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer with Hadoop. Be the first to apply!
Related searches
- junior big data engineer Washington DC
- principal data engineer Washington DC
- data visualization developer Washington DC
- senior data center engineer Washington DC
- senior data engineer Washington DC
- data infrastructure engineer Washington DC
- data engineering intern summer Washington DC
- big data developer Washington DC
- data systems engineer Washington DC
- sr data engineer Washington DC