Data Engineer

Samprasoft

McLean, VA

Data Engineer

Location: McLean, VA (Tuesday and Wednesday onsite)

Duration: 6+ Months contract (with possible conversion)

Job Description:

Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
Develop Python, Py Spark, Spark scripts to filter/cleanse/map/aggregate data.
Manage and implement data processes (Data Quality reports)
Develop data profiling, deduping logic, matching logic for analysis
Programming Languages experience in Python, Hive Query Language, Py Spark and Spark for data ingestion
Programming experience in RDBMS and Bigdata using Hive, Hadoop platform
Present ideas and recommendations on Hadoop and other technologies best use to management
Good understanding of Functional programming and Object-oriented programming
Detail oriented. Excellent communication skills (verbal and written)
Must be able to manage multiple priorities and meet deadlines

Required Skills:

5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) - Mandatory
Programming experience in Python, Spark, SQL, HQL for data processing and analysis
Strong SQL experience
3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work

Desired Skills:

2+ years of experience with containerization and orchestration. Hands on experience with GIT, AWS, Kubernetes, Docker etc.

Apply

Vacancy posted 14 hours ago

Similar jobs that could be interesting for youBased on the Data Engineer in McLean, VA vacancy

Lead Data Engineer
$197.3k - $225.1k
...of a big group of makers, breakers, doers and disruptors who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity...
Suggested
Full time
Part time
Internship
H1b
Local area
Capital One
McLean, VA
4 days ago
Lead Data Engineer
...The Data Environments and Engineering Department (L176) in the Data and Human Centered Solutions Innovation Center is seeking highly motivated, adaptive, and enthusiastic candidates with a wide variety of interests and a foundation of skills in systems engineering, software...
Suggested
MITRE
McLean, VA
1 day ago
Lead Data Engineer
...HiLabs is looking for highly motivated and technically strong Lead Data Engineers with deep expertise in Big Data platforms and a passion for building scalable, data-intensive systems. The ideal candidates will have strong hands-on experience in Spark, PySpark, distributed...
Suggested
Relocation
Relocation package
HILABS Inc
Bethesda, MD
2 days ago
Lead Data Engineer
...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...
Suggested
Long term contract
Work at office
InterSources
McLean, VA
4 days ago
Lead Data Engineer
$113.4k - $223.2k
...Lead Data Engineer Category: Software Development/ Engineering Main location: United States, Virginia, Fairfax Position ID:J0326-3022 Employment Type: Full Time Position Description: As a Lead Data Engineer, you will lead a team...
Suggested
Full time
Work experience placement
Work at office
Local area
Flexible hours
CGI
Fairfax, VA
1 day ago
Lead Data Engineer
...Overview BigBear.ai is seeking a Lead Data Engineer to support one of our customers. This position will be based out of Washington, D.C. and will offer remote flexibility. You will be joining our amazing BigBear.ai team to provide development for legacy and existing systems...
Temporary work
Remote work
BigBear Inc
Washington DC
1 day ago
Data Engineer
...Overview We are seeking a skilled Data Engineer with at least 5 years of experience designing, building, and maintaining scalable data pipelines and architectures. The ideal candidate will have strong expertise in data integration, ETL/ELT processes, and cloud-based data...
VTG Defense
McLean, VA
2 days ago
Data Engineer
...Job Title: Data Engineer Location: Sterling, VA Clearance: TS/SCI Poly This position is CONTINGENT upon contract award. The Data Engineer works with the sponsor, mission partners, platform and operations team to engineer, install, operate and sustain database repositories...
Contract work
Limelight Health
Sterling, VA
1 day ago
Data Engineer, Mid
$98.72k - $123.4k
...individuals dedicated to being a vital partner for health solutions in the public sector. Job Summary Acentra Health is looking for a Data Engineer, Mid to join our growing team. Job Summary: The purpose of this position is to design, develop, and maintain scalable data...
Local area
Acentra Health
McLean, VA
14 hours ago
Data Engineer
...Must have experience in IDMC (Informatica's SAAS platform Intelligent Data Management on Cloud) and using Self service workbench. Ability to Develop and also Setup Informatica on cloud. Skilled in programming languages like Python, Unix Shell scripting Experience automating...
Unisys
Reston, VA
2 days ago
Data Engineer
...BigBear.ai are seeking a highly skilled and motivated Data Engineer to join our Data Architecture & Engineering team. In this role, you will design and build scalable, secure, and efficient data pipelines that transform raw data into actionable insights. You’ll work across...
BigBear Inc
Washington DC
4 days ago
Data Engineer
...Seeking an AWS Data Engineer to design, build, and maintain scalable data pipelines and ETL solutions using Python/Pyspark and AWS managed services to support analytics and data product needs. Key Responsibilities Build and maintain ETL pipelines using Python and PySpark...
Full time
Smart IT Frame
Reston, VA
2 days ago
Palantir Data Engineer
$113k - $188k
...Job Family: Data Science Consulting. Travel Required: Up to 25%. Clearance Required: Ability to Obtain Public Trust. We are seeking a Palantir Data Engineer to design, build, and operate ontology‑driven data products in Palantir Foundry (SaaS). This role emphasizes semantic...
Temporary work
Flexible hours
US101 Guidehouse Inc.
Falls Church, VA
3 days ago
Lead Data Engineer
$117.6k - $161.7k
...Become a part of our caring community This role leads the architecture, engineering, and operationalization of the centralized Finance reporting data platform supporting CenterWell Finance reporting, analytics, and month-end close processes. We are looking for deep...
Bi-weekly pay
Full time
Temporary work
Apprenticeship
Work at office
Remote work
Work from home
Home office
Humana
Washington DC
4 days ago
Lead Data Engineer
...Description Lead Data Engineer At MetaPhase, we believe Quirky is Cool and being authentic is the only way to be! We take the work we do very seriously and do a lot of important mission-focused work for our clients. We are individuals with different passions...
For contractors
Local area
Immediate start
Remote work
MetaPhase Consulting
Reston, VA
4 days ago
Remote Lead Data Engineer:Databricks & Enterprise Analytics
...Humana Inc in Washington is seeking a Lead Data Engineer for the Risk Adjustment and Stars Analytics team. This role entails designing and optimizing data pipelines, ensuring effective collaboration across teams to deliver data solutions that meet business needs. The ideal...
Remote work
Humana
Washington DC
1 day ago
Palantir Data Engineer
...Job Family : Data Engineering & Architecture Consulting Travel Required : None Clearance Required : Active Secret What You Will Do : Focus on engineering, building, and maintaining data pipelines, applications, workflows, and governance capabilities inside the Palantir...
Temporary work
Remote work
Flexible hours
Guidehouse Careers
Arlington, VA
1 day ago
Data Engineer
...including majority remote with meetings in Tysons Corner and Crystal City. Employment Type: Full-Time We are seeking highly skilled Data Engineers (DA II / DA III) to support a critical federal data modernization initiative focused on enterprise financial management,...
Full time
Interim role
Remote work
Acquisition NexGen
Washington DC
1 day ago
Data Engineer
...disruptors, who solve real problems and meet real customer needs. Capital One’s Finance Tech team is seeking a Senior Associate, Data Engineer who is passionate about marrying data with emerging technologies. As a Capital One Senior Associate, Data Engineer, you’ll have...
Full time
Part time
Internship
Local area
Capital One Financial Corp
McLean, VA
1 day ago
Data Engineer
$91k
...Get AI-powered advice on this job and more exclusive features. We’re Hiring: Data Engineers (Mid-Level – 3+ Years) Are you passionate about building data pipelines that power real-time insights and smarter decision-making? SteerBridge Strategies, a Veteran-led small business...
Full time
For contractors
Work at office
Local area
Relocation package
SteerBridge
Vienna, VA
2 days ago
Data Engineer
...success is driven by a talented team of technologists, consultants, engineers, and subject-matter experts who support complex federal... ...empowered to build meaningful, long-term careers. Position Summary The Data Engineer will be pivotal in designing, developing, and...
For contractors
Oasys
Fairfax, VA
1 day ago
Data Engineer
...a company that believes in being part of something bigger than themselves. Job Description Cortina Solutions, LLC is seeking a Data Engineer to support the development of analytical and automation solutions for Department of Justice clients. This high performing team works...
Temporary work
For contractors
Work experience placement
Local area
Flexible hours
Cortina Solutions
Washington DC
2 days ago
Data Engineer
$85.15k - $153.93k
...Mission, Vision, and Values guide the way we do business. The National Security Sector at Leidos currently has an opening for a Data Engineer with a strong background in data analytics to support an exciting DHS software development program. In this role, you will work...
Remote work
Via Logic LLC
Sterling, VA
14 hours ago
Palantir Data Engineer
...What You Will Do The Data Engineer will join a dynamic team supporting a global implementation of IT systems at the Department of State. In this role, the candidate will review and support the client’s data policies, processes, and standards to identify strengths and areas...
Temporary work
Remote work
Flexible hours
Guidehouse
Arlington, VA
2 days ago
Data Engineer
...we pride ourselves on providing industry‑leading expertise, big data analytics, and all‑source research and analysis. Our technical capabilities... ...employees, customers, and community. Responsibilities As a Data Engineer , you will transform and deliver high‑priority datasets to...
Flexible hours
Unavailable
Reston, VA
1 day ago
Data Engineer
...Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower our federal customers...
Full time
Flexible hours
CGS Federal (Contact Government Services)
Washington DC
2 days ago
Data Engineer
...Overview Data Engineer Herndon, VA TS/SCI with Poly At Bcore, our strength comes from how we deliver impact to the mission. Whether it’s architecting critical IT solutions, producing actionable intelligence, or developing cutting edge technology, we succeed because of...
Bridge Core
Herndon, VA
4 days ago
Data Engineer
$123k - $147k
...of public service and not for profit, we measure our success in the impact of our service. Position Summary ANSER is seeking a Data Engineer to design, build, and optimize enterprise-level data management systems to support Object-Based Intelligence (OBI) analytic processes...
Permanent employment
Full time
Temporary work
Local area
Flexible hours
ANSER
Washington DC
2 days ago
Lead Data Engineer
...Big Data Platform Software Engineer Lead, architect, design and develop secure, scalable, high-performance and reliable and cost-effective Big Data platform software and services in a Multi-Cloud environment. Provide technical leadership in Data Engineering practices...
Software Technology Inc
Washington DC
4 days ago
Data Engineer
$104k - $166k
...Data Engineer Location: US-VA-Herndon Responsibilities We are seeking a highly skilled and innovative Data Engineer to join our team in the greater DMV area, supporting the Army National Guard. Lead design, build, and optimization of data pipelines to ingest, normalize...
Contract work
Shift work
Peraton
Herndon, VA
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!