Data Engineer

Samprasoft

Data Engineer Location: McLean, VA (Tuesday and Wednesday onsite) Duration: 6+ Months contract (with possible conversion) Job Description: Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform. Develop Python, Py Spark, Spark scripts to filter/cleanse/map/aggregate data. Manage and implement data processes (Data Quality reports) Develop data profiling, deduping logic, matching logic for analysis Programming Languages experience in Python, Hive Query Language, Py Spark and Spark for data ingestion Programming experience in RDBMS and Bigdata using Hive, Hadoop platform Present ideas and recommendations on Hadoop and other technologies best use to management Good understanding of Functional programming and Object-oriented programming Detail oriented. Excellent communication skills (verbal and written) Must be able to manage multiple priorities and meet deadlines Required Skills: 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) - Mandatory Programming experience in Python, Spark, SQL, HQL for data processing and analysis Strong SQL experience 3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work Desired Skills: 2+ years of experience with containerization and orchestration. Hands on experience with GIT, AWS, Kubernetes, Docker etc. Samprasoft

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Mc Lean, VA vacancy

Entry Level Developer/Coder/Programmer/Data Scientist/Analyst/Engineer
...we are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full-time positions with clients. Who should apply? Recent computer science/engineering/mathematics/statistics...
Suggested
Full time
H1b
Remote work
SynergisticIT
Arlington, VA
3 days ago
Semantic Data and AI Engineer
$150k - $210k
...Enterprise Knowledge (EK) is hiring for a full-time Semantic Data and AI Engineer to join our growing Knowledge and Data Services Sector. In this role, you will be responsible for designing and deploying cutting-edge data discovery, integration, and governance solutions...
Suggested
Remote job
Full time
For contractors
H1b
Work at office
Local area
Enterprise Knowledge
Arlington, VA
1 day ago
Lead Data Engineer
...health, transportation, and citizen services. We’re a nonprofit engineering, applied research, and advanced technology organization working... ...purpose — and help shape the future.Department Summary:MITRE’s Data Science and Engineering department is looking for qualified...
Suggested
Internship
Local area
3 days per week
Mitre
McLean, VA
10 days ago
Data Scientist / ML Engineer
...Data Scientist / ML Engineer KSA Integration is a Service-Disabled Veteran-Owned Small Business (SDVOSB) that provides business and management solutions through three core capabilities: data analytics, comprehensive veterans support, and business process improvement...
Suggested
Full time
For contractors
Work experience placement
Summer work
Flexible hours
KSA Integration
Arlington, VA
3 days ago
Data Engineer
...share our passion for advancing technology and strengthening the missions we serve. Position Overview SteerBridge is seeking a Data Engineer (Mid-Level, 3+ years) to join our growing Aviation team at our headquarters in Tysons Corner (Vienna, VA). In this role, you...
Suggested
Full time
Work experience placement
Work at office
Local area
3 days per week
SteerBridge
Vienna, VA
17 days ago
Data Engineer - Baltimore City, MD
...Job Description Job Description Data Engineer – Baltimore City, MD About us Creative Information Technology Inc (CITI) is an esteemed IT enterprise renowned for its exceptional customer service and innovation. We serve both government and commercial sectors...
Contract work
Creative Information Technology, Inc.
Falls Church, VA
17 days ago
Data Engineer 3 - TS clearance required - Wash DC area
...loading structured and unstructured datasets. •Analyze complex data structures and source-to-target mappings to identify... ...business partners to translate requirements into effective data engineering solutions. •Monitor pipeline performance, troubleshoot operational...
Bow Wave LLC
Arlington, VA
4 days ago
Data Engineer
...Job Description Job Description KDA Consulting Inc. is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures supporting mission-critical programs within the Intelligence Community (IC). This role focuses on...
KDA Consulting Inc
McLean, VA
25 days ago
Data Engineer
$85k - $141k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Our consultants... ...and data science, from data querying and wrangling to data engineering, to data visualization, dashboarding, and business intelligence...
Full time
Flexible hours
Guidehouse
McLean, VA
2 days ago
Data Engineer
...Job Description Job Description POSITION DESCRIPTION: Pioneering Evolution is seeking a Data Engineer to design, develop, integrate, and operate secure enterprise data solutions for the SyncPoint program. The Data Engineer will work closely with software engineers...
Temporary work
Pioneering Evolution LLC
Arlington, VA
18 days ago
Data Engineer
...Job Description Job Description 540 is seeking a Data Engineer to support a mission-critical federal health data modernization initiative. The team is bringing together data from diverse defense and federal systems to build scalable pipelines, APIs, and data products...
Temporary work
Work at office
Local area
Remote work
Flexible hours
540
Arlington, VA
17 days ago
Data Engineer III with TS/SCI Eligibility
...Job Description Job Description Data Engineer III - Top Secret, SCI Eligible - MUST HAVE SECURITY CLEARANCE - PLEASE DO NOT APPLY UNLESS YOU HOLD A TS WITH SCI ELIGIBILITY Position Summary: Position Description: Data Engineer III Location: National Capital...
Contract work
Work at office
Sancorp Consulting LLC
McLean, VA
18 days ago
Data Engineer
$155k - $165k
...Data Engineer We need an experienced Data Engineer at the National Guard Bureau (NGB). The NGB is the link between the Army and Air National Guard and the Department of War (DoW). You will support operations on the Minuteman project team, which manages the NGB's enterprise...
Full time
Work at office
2 days per week
1 day per week
West 4th Strategy
Arlington, VA
5 days ago
Data Engineer - PowerBI Developer - TS required to apply - NCR
Job Description Job Description Data Engineer Top Secret clearance required to apply.7+ years of experience in database design and coding with big data. PowerBI development experience is highly desirable. Minimum Education: Bachelor's Degree.
Bow Wave LLC
Arlington, VA
25 days ago
Data Engineer (Temporal & Apache Kafka required)
...Description Job Description About Infinitive Infinitive is a data and AI consultancy that helps clients modernize, monetize, and... ...Business. About the Role We are seeking an experienced Data Engineer to help design, build, and scale our next-generation event-...
Contract work
Local area
Infinitive Inc
McLean, VA
3 days ago
Data Engineer
$125k - $160k
...OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines. We are looking for more than just a "Data Engineer", but a technologist with excellent communication and customer...
Steampunk
McLean, VA
a month ago
Data Engineer (Various Locations)
...leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests. Job Title: Data Engineer Location: On-Site, Various Locations (see below) Peterson Space Force Base, CO Stuttgart, Germany: Patch Barracks,...
Agile Defense
Arlington, VA
9 days ago
Data Engineer
...national-security focused agencies within the Department of Defense and U.S. Intelligence Community. We are seeking to hire a Data Engineer to our team! Client: CTEC develops and delivers innovative customer-centric technologies and solutions that support the...
Work experience placement
Work at office
CyberMedia Technologies
McLean, VA
17 days ago
Data Engineer 2 - TS required - Washington DC area
...maintaining basic ETL pipelines for ingesting, transforming, and loading datasets under the guidance of more experienced engineers. •Support analysis of data structures, mappings, and data quality checks to identify issues or gaps. •Help ensure data accuracy,...
Internship
Bow Wave LLC
Arlington, VA
4 days ago
M/L Data Engineer -
...Position Title: M/L Data Engineer - Python & Computer Vision Location: Mclean, VA Duration: 6-12 Months Contract Job Description: True must-haves: Strong, recent, hands-on Python coding SQL and Snowflake Image processing...
Contract work
Temporary work
Staffxpert LLC
McLean, VA
2 days ago
Data Engineer
...Summary: We are looking for a candidate to provide advanced data engineering expertise to support HITU modernization initiatives and enterprise data management capabilities. This role is responsible for designing, developing, and maintaining secure, scalable, and reliable...
Temporary work
Joseph and Associates LLC
McLean, VA
a month ago
Data Engineer
...Job Description Job Description Job Title: Data Engineer Company: BLN24 About Us: We find strength in teamwork-a better you is a better us BLN24 is an award-winning Management Consulting Firm that supports the U.S. Federal Government in successfully achieving...
Remote work
BLN24
McLean, VA
25 days ago
Data Engineer
...01(k) matching ~ Competitive salary ~ Health insurance ~ Paid time off About this Role: Imagineeer is seeking a Data Engineer to support the design, development, and maintenance of secure, compliant data pipelines and enterprise data platforms within DoD...
Local area
Work from home
Flexible hours
IMAGINEEER LLC
Arlington, VA
25 days ago
Data Engineer
...Job Description Job Description Job Listing: Data Engineer Location: Tysons Corner, VA (Off-Site/Hybrid) Position: Full-Time, Permanent Security Clearance: DoD Secret Clearance Required (Ability to obtain) Experience: 3+ years, $90,000 - $170,000...
Permanent employment
Full time
Remote work
Flexible hours
Woodgrove Solutions LLC
Vienna, VA
4 days ago
Data Engineer (All Levels) - Crystal City, VA
...development ~ Vision insurance Job Description Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense sector. As a Data Engineer, you will play a crucial role in...
Work from home
Flexible hours
Silverthorne Advisory Group LLC
Arlington, VA
23 days ago
Python Data engineer
...Python Data Engineer Our client, a Real Estate and Financial Services company, is looking for a Python Data Engineer for their McLean VA location as a first preference, with Plano TX as a second option. Responsibilities: The Senior Developer will be part of the...
Work at office
Local area
ICONMA
McLean, VA
4 days ago
Python Data Engineer
...Python Data Engineer 5+ years of relevant experience Hadoop and AWS experience required Looking for a Python Data Engineer Experience with XML and JSON is needed here This is not a machine learning position but should have standard libraries experience -...
My3Tech Inc
McLean, VA
2 days ago
Data Engineer
...Expression is seeking an experienced Data Engineer to support the design, development, and operational deployment of scalable, AI-enabled data solutions for the Department of Defense CDAO ADA IR program. The Data Engineer will work as part of a multidisciplinary team...
Full time
For contractors
Work at office
Immediate start
Expression
Arlington, VA
a month ago
Data Engineer
$62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more... ...unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it...
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Arlington, VA
2 days ago
Data Engineer
...for a Top Secret (Tier 5) clearance. No third party. ABOUT THE ROLE Strategic Innovation Group (SIG) is seeking a Senior Data Engineer to lead the data core of a new analytics platform for a federal government client. The platform consolidates program, financial,...
Temporary work
For contractors
Strategic Innovation Group LLC
Arlington, VA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!