Data Engineer

Samprasoft

McLean, VA

Data Engineer

Location: McLean, VA (Tuesday and Wednesday onsite)

Duration: 6+ Months contract (with possible conversion)

Job Description:

Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
Develop Python, Py Spark, Spark scripts to filter/cleanse/map/aggregate data.
Manage and implement data processes (Data Quality reports)
Develop data profiling, deduping logic, matching logic for analysis
Programming Languages experience in Python, Hive Query Language, Py Spark and Spark for data ingestion
Programming experience in RDBMS and Bigdata using Hive, Hadoop platform
Present ideas and recommendations on Hadoop and other technologies best use to management
Good understanding of Functional programming and Object-oriented programming
Detail oriented. Excellent communication skills (verbal and written)
Must be able to manage multiple priorities and meet deadlines

Required Skills:

5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) - Mandatory
Programming experience in Python, Spark, SQL, HQL for data processing and analysis
Strong SQL experience
3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work

Desired Skills:

2+ years of experience with containerization and orchestration. Hands on experience with GIT, AWS, Kubernetes, Docker etc.

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in McLean, VA vacancy

Lead Data Engineer
$197.3k - $225.1k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...
Suggested
Full time
Part time
Internship
H1b
Local area
Capital One
McLean, VA
4 days ago
Lead Data Engineer
...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...
Suggested
Long term contract
Work at office
InterSources
McLean, VA
16 days ago
Lead Data Engineer (Finance Tech)
$197.3k - $225.1k
...Lead Data Engineer (Finance Tech) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group...
Suggested
Full time
Part time
Internship
H1b
Local area
Capital One Financial Corp
McLean, VA
2 days ago
IICS Data Engineer
...IICS Data Engineer Our client is seeking an IICS Data Engineer with strong experience across Informatica IICS, AWS, and SQL to support enterprise data integration and cloud-based data movement initiatives within a fast-paced financial services environment. Responsibilities...
Suggested
TheStaffed
McLean, VA
2 days ago
Data Engineer
...Senior Data Engineer Duration: 6 months with possible Conversion GC/USC (Not Open for Relocation candidates) Bill Rate: $80 on c2c Location: Onsite in McLean, VA Tuesday through Thursday There will be a coding exercise or...
Suggested
Relocation
Exaways Corporation
McLean, VA
2 days ago
Data Engineer
...Quantitative Analytics/Big Data Developer/Data Engineer Senior Freddie Mac’s Single-Family Division is currently seeking a Quantitative Analytics/Big Data Developer/Data Engineer Senior to implement Big Data tools and methods of data processing and ingestion as a member...
Work experience placement
Software Technology Inc
McLean, VA
1 day ago
Data Engineer
...Data Engineer We are seeking a highly skilled Data Engineer with 5 to 7 years of experience to join our team as a Business Associate. The ideal candidate will have extensive experience in AWS, Python, PySpark, Snowflake, SQL, and Unix. This role involves analyzing business...
Keylent Inc
McLean, VA
1 day ago
Data Engineer
$110k - $160k
...today’s rapidly evolving technology landscape, an organization’s data has never been a more important aspect in achieving mission and... ...DevSecOps Contributions We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade...
Steampunk.com
McLean, VA
4 days ago
Data Engineer |
...Boto3. Experience with Pyspark with a solid understanding of big data. Your Work Falls Into Two Primary Categories: Strategy... ...impactful way Understand capabilities of and current trends in Data Engineering domain Qualifications At least 5 years of experience...
Work experience placement
Samprasoft
McLean, VA
2 days ago
Data Engineer
$77.6k - $176k
...Job Number: R0231399 Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing...
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
McLean, VA
3 days ago
IICS Data Engineer
...of experience with AWS services such as S3, Lambda, EC2, IAM, CloudWatch, and Glue; strong understanding of cloud architecture and data movement. ~ Experience integrating AWS, SQL, and IICS. Preferred Industry Knowledge Experience working with Freddie Mac...
RIT Solutions
McLean, VA
2 days ago
Data Engineer
$55 - $58 per hour
...Data Engineer 3 openings. Location: Role is on-site in McLean, VA 5 days/week Interview process: Teams call then onsite interview Local candidates only Rate= $55-58/hr In addition to below description, PySpark and Snowflake...
Local area
3B Staffing LLC
McLean, VA
1 day ago
Kubernetes Data Engineer
...Backend Data Engineer MC Lean, VA Long Term Contract * Manage/Administer Kubernetes *Develop Apps on Kubernetes using Python or Golang. * Supporting Batch AWS EMR, Pyspark * Strong in Pyspark, AWS Services, Dynamo DB, ELB, EC2, Lambda * 6-8 years' experience...
Long term contract
Maintec Technologies
McLean, VA
4 days ago
Data Engineer
$92k - $158k
Data Engineer Job Locations US-VA-Tysons Job ID 2026-13906 # of Openings 2 Benefit Type Salaried High Fringe/Full-Time Overview LMI is seeking a skilled and detail-oriented Data Engineer to join a high performing...
Full time
Contract work
Work at office
Local area
LMI Consulting, LLC
McLean, VA
3 days ago
Data Engineer
...Position contingent upon contract award As a Data Engineer , you will be responsible for developing, constructing, testing, and maintaining scalable and reliable data solutions. ESSENTIAL JOB FUNCTIONS: ~ Design, build, and maintain scalable data pipelines...
Contract work
Intrepid USA
McLean, VA
1 day ago
Data Engineer
...Data Engineer Intelligence/Intel Community McLean, VA • Full-Time/Regular Core4ce has an opportunity with a mission critical IC Sponsor for a Data Engineer position. This Sponsor organization plays a significant role in the highly optimized mission-ready data...
Full time
Immediate start
Flexible hours
Core4ce
McLean, VA
1 day ago
Data Engineer
...Job Title: Data Engineer Location: McLean, VA (Hybrid - 3 Days onsite every week) Job Type: Contract Pay Rate: $60/hr C2C Job Description Required must have skills: Python AWS Kubernetes Kubeflow MLOps...
Contract work
Temporary work
Local area
3 days per week
Anveta
McLean, VA
3 days ago
Snowflake Data Engineer
...About the job Snowflake Data Engineer Position: Snowflake Data Engineer Company: TALENT HIVE, LLC Contract Details: Full-time TALENT HIVE, LLC is seeking a highly skilled and experienced Snowflake Data Engineer to join our client's team on a full-time...
Full time
Contract work
Talent Hive
McLean, VA
4 days ago
Data Engineer
...Data Engineer for developing and maintaining ETL solutions to drive clinical operations, advanced analytics, and machine learning models. This position will work collaboratively with the technology team to support our clinical, operational, and finance teams to...
Texas State Library and Archives Commision
McLean, VA
3 days ago
Data Engineer
$60 - $70 per hour
...Immediate need for a talented Data Engineer . This is a 12 months contract opportunity with long-term potential and is located in Mclean VA (Onsite). Please review the job description below and contact me ASAP if you are interested. Job ID: 25-90054 Pay Range...
Contract work
Local area
Immediate start
Pyramid Consulting
McLean, VA
3 days ago
Data Engineer II
...Data Engineer Location: McLean VA (Onsite Hybrid Model) Duration: 6-12 Months | Extension Possible Job Description: Strong with Python Knowledgeable in Pyspark Snowflake Solid Data Engineers Someone who has worked on Structured and Unstructured...
Samprasoft
McLean, VA
2 days ago
Data Engineer III with TS/SCI Eligibility
...Data Engineer III - Top Secret, SCI Eligible - MUST HAVE SECURITY CLEARANCE - PLEASE DO NOT APPLY UNLESS YOU HOLD A TS WITH SCI ELIGIBILITY Position Summary: Position Description: Data Engineer III Location: National Capital Region Work...
Contract work
Work at office
SANCORP Consulting, LLC
McLean, VA
1 day ago
Data Engineer
...Data Engineer A Data Engineer with Python, PySpark, and AWS expertise is responsible for designing, building, and maintaining scalable and efficient data pipelines in cloud environment. Responsibilities: Design, develop, and maintain robust ETL/ELT pipelines...
Kasmo Global
McLean, VA
1 day ago
Data Visualization Engineer
$110k - $160k
...Overview Steampunk wants you to join our awesome team as Data Visualization Engineer. In this role you'll be working with a large team of Steampunk and clients to identify data sources, tools, and mission challenges that can all be brought together to create decision...
Contract work
Steampunk.com
McLean, VA
2 days ago
Data Engineer
...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview: ~ We are seeking a highly skilled Sr. Data Engineer to join our team in McLean, VA. The...
Local area
Remote work
Ampcus
McLean, VA
3 days ago
Data Engineer
...KDA Consulting Inc. is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures supporting mission-critical programs within the Intelligence Community (IC). This role focuses on enabling efficient data processing...
KDA CONSULTING INC
McLean, VA
2 days ago
Data Engineer
...Position Title: Data Engineer Location: McLean, VA Duration: 12+ Months (Possible extension) Job Description: Key Responsibilities: Design, build, and optimize ETL pipelines using Python, PySpark, and Spark Develop scalable data solutions leveraging...
For contractors
InterSources
McLean, VA
1 day ago
Data Engineer
...Data Engineer Data Engineer Tysons Corner, VA Active TS/SCI with Polygraph Company Overview: Cornerstone Defense is the Employer of Choice within the Intelligence, Defense, and Space communities of the U.S. Government. Realizing early on that our most prized assets...
Cornerstone Defense
McLean, VA
1 day ago
Data Engineer
...Job Title: Data Engineer Company: BLN24 About Us: We find strength in teamwork-a better you is a better us BLN24 is an award-winning Management Consulting Firm that supports the U.S. Federal Government in successfully achieving their mission and goals. Our service...
Remote work
BLN24
McLean, VA
20 hours ago
Data Engineer (Snowflake)
Snowflake Admin Location: Mclean VA – 3 days/week Duration: 6-12+ Months – Possible Extension Required Skills: Experience with Snowflake admin. Be able to identify the various aspects of compute and storage management in Snowflake. Illustrate administrative...
3 days per week
Software Technology Inc
McLean, VA
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!