Big Data Engineer

Samprasoft

McLean, VA

Data Engineer

Location: Hybrid Onsite (3 days onsite in Mclean, VA)

Duration: 6-12+ months Contract

Must Haves:

Python
Sparks
Json
XML
Snowflake
SQL

Your Impact:

You will be able to apply advanced Data Engineering and Machine learning skills to solve real world challenges in building applications that help the company build better models and do advanced reporting.
Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
Manage and implement data processes (Data Quality reports)
Develop data profiling, deduping logic, matching logic for analysis
Programming Languages experience in Python, PySpark and Spark for data ingestion.
Programming experience in BigData platform using Hadoop platform.
Present ideas and recommendations on Hadoop and other technologies best use to management.

Qualifications:

Bachelor’s degree in Computer Science, Statistics, Data science or a related quantitative field.
5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs)
5+ years of programming experience in Hadoop, Spark, Python for data processing and analysis.
Strong SQL experience is a must
5+ years of experience using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
2+ Prior experience working in Cloud platforms AWS. Kubernetes experience is highly desirable
Hands on Work experience using technologies for manipulating structured and unstructured big data. Big data technologies may include—but are not limited to—Hadoop, Hive, Spark, relational databases, and NoSQL.
Desired prior experience with MPP Databases like SnowFlake.
Detail oriented and superb communication and written skills

Apply

Vacancy posted 9 hours ago

Similar jobs that could be interesting for youBased on the Big Data Engineer in McLean, VA vacancy

Lead Data Engineer - HR Tech
$197.3k - $225.1k
Lead Data Engineer - HR Tech Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems... ...delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...
Big data
Full time
Part time
Internship
H1b
Local area
Capital One
McLean, VA
20 hours ago
Big Data Engineer
...Big Data Engineer We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize...
Big data
Temporary work
For contractors
Immediate start
Flexible hours
Cymertek
McLean, VA
3 days ago
Big Data Engineer
...and cost-effective solutions that meet the ever-changing challenges that our clients face. Specialties: Big Data, Strategy and Business Architecture, Systems Engineering, Enterprise cloud services and solutions, PMO services, Innovation, R&D, Business Process and...
Big data
ByteCubed
Arlington, VA
4 days ago
Data Engineer
$120k - $225k
Zachary Piper Solutions is currently seeking Data Engineers on our Professional Services team in McLean, VA. Are you a skilled Data Engineer... .... Guide strategic customers through transformational big data initiatives and third‑party migrations, including end‑to‑...
Big data
Work at office
Zachary Piper Solutions
McLean, VA
3 days ago
Senior Data Engineer
...with a premier financial regulatory organization, is seeking a Data Engineer for their Tysons Corner, VA or Rockville, MD location! This position... ...right candidate 5+ years of experience in Data Engineering, Big Data Engineering, or similar software engineering disciplines....
Big data
Optomi
Falls Church, VA
1 day ago
Data Engineer
...are a solution-driven company delivering data insights and technology solutions to customers... .... We are seeking a highly skilled Data Engineer to join our team supporting the Under Secretary... ...+ years of experience. Experience with big data systems, including Apache Spark and...
Big data
Contract work
Redhorse Corporation
Arlington, VA
5 days ago
Senior Data Engineer
$125k - $165k
We are looking for a seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services... ...in Data Engineering with experience in tools such as: Big data tools: Hadoop, Spark, Kafka, etc. Relational SQL and NoSQL...
Big data
Steampunk.com
McLean, VA
3 days ago
Data Engineer
...ROLE: - Data Engineer LOCATION: - Mclean - VA DURATION: - Long term contract Client: - Freddie Mac Experience... ...Shift: Day 9AM-7PM EST Required Skills: Snowflake, AWS Big Data, Kafka Job Summary: Years of experience in...
Big data
Long term contract
Work experience placement
Shift work
Maintec Technologies
McLean, VA
4 days ago
Data Engineer
...evolving technology landscape, an organization’s data has never been a more important aspect in... ...We are looking for seasoned Data Engineer to work with our team and our clients to develop... ...with experience in tools such as: Big data tools: Hadoop, Spark, Kafka, etc....
Big data
Steampunk.com
McLean, VA
3 days ago
Data Engineer, Mid
$62k - $141k
...learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need an experienced...
Big data
Full time
Contract work
Part time
Local area
Remote work
Phase2 Technology
McLean, VA
3 days ago
Data Engineer
...Defense and U.S. Intelligence Community. We are seeking to hire a Data Engineer to our team! Client: CTEC develops and delivers innovative... ...) for enterprise analytics. Familiarity with Spark-based big data processing frameworks. Experience supporting data migration...
Big data
Work experience placement
Work at office
Cybermedia Technologies
McLean, VA
3 days ago
Senior Data Engineer
...career while impacting our national security in cyber as Senior Data Engineer at GDIT. Technologists have many paths to grow a meaningful... ...Development, Database Architecture. Certifications: AWS Certified Big Data Specialty (preferred). Experience: 10+ years of related...
Big data
Temporary work
Work at office
Remote work
Dormont Manufacturing Company
Falls Church, VA
1 day ago
Data Engineer, Mid
$62k - $141k
...learning, and artifi cia l intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need an...
Big data
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
McLean, VA
4 days ago
Data Engineer
...: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence... ...to manipulate data (Python, R, SQL, SAS) Strong knowledge of big data analysis and storage tools and technologies Strong...
Big data
Full time
Flexible hours
CGS Federal (Contact Government Services)
Arlington, VA
3 days ago
Data Engineer
$62k - $141k
...learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need an experienced...
Big data
Contract work
Local area
Remote work
Phase2 Technology
Arlington, VA
3 days ago
Data Engineer, Mid
$98.72k - $123.4k
...Summary and Responsibilities Acentra Health is looking for a Data Engineer, Mid to join our growing team. Job Summary: ~... ...healthcare regulations (e.g., HIPAA). Hands-on experience with big data processing frameworks such as Apache Hadoop, Apache Spark,...
Big data
Contract work
Local area
Acentra Health
McLean, VA
9 hours ago
Data Engineer II
Title: Data Engineer II Location: Arlington, VA (Onsite) Position Type: W2 contract Industry: Banking/Financials/Payments Required Education... ...timely availability and accessibility of data. Leverage big data processing frameworks such as Apache Spark and Hadoop to build...
Big data
Contract work
Local area
Accord Technologies Inc
Arlington, VA
3 days ago
Data Engineer
Shift5 is building the data platform for onboard operational technology (OT). We deliver... ...mission assurance. We are seeking a Data Engineer to join our growing Product Engineering team... ...language (GoLang, Java, or Python). Databases & Big Data: 2+ years of relational database...
Big data
Shift5
Arlington, VA
4 days ago
Data Engineer
$62k - $141k
## Data EngineerApplylocations: McLean, VA: Arlington, VA: Alexandria, VA: Washington, DCtime... ...to apply)job requisition id: R0244560Data Engineer**The Opportunity:**Ever-expanding... ...maintaining scalable data stores that supply big data in forms needed for business analysis...
Big data
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
McLean, VA
5 days ago
Senior Data Engineer
...Senior Data Engineer BasisPath is seeking a highly motivated Senior Data Engineer to support mission-critical data acquisition, processing... ...AWS. Experience with distributed computing frameworks and big data technologies. Experience with Linux administration and...
Big data
Remote work
Relocation package
BasisPath Inc
McLean, VA
9 hours ago
Data Engineer
...highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview We are seeking a highly... ...extensive experience in data engineering, cloud services, and big data technologies, with a strong focus on AWS services, Python...
Big data
Local area
Remote work
Ampcus, Inc
Mc Lean, VA
5 days ago
Data Engineer
Overview We are seeking a skilled Data Engineer with at least 5 years of experience designing, building, and maintaining scalable data pipelines... ...(e.g., PostgreSQL, MySQL, SQL Server). Experience with big data processing frameworks (e.g., Spark, Hadoop). Hands‑on experience...
Big data
VTG Defense
Mc Lean, VA
3 days ago
Data Engineer
We are seeking a motivated and skilled Data Engineer to join our team. The ideal candidate is passionate about data engineering, possesses a... ...) processes. Basic understanding of distributed computing and big data technologies such as Apache Hadoop, Spark, or Kafka. Knowledge...
Big data
Credence Management Solutions, LLC
Mc Lean, VA
3 days ago
Data Engineer Associate
$105k - $122k
AIR's Tek Office is seeking a motivated Data Engineer Associate to join our collaborative data and analytics team. The Data Engineer Associate... ..., security, and compliance practices, with exposure to big data or distributed computing frameworks; relevant Microsoft and...
Big data
Full time
H1b
Work at office
Local area
3 days per week
American Institutes for Research
Arlington, VA
5 days ago
Senior Lead Data Engineer (Bank Tech)
$229.9k - $262.4k
Senior Lead Data Engineer (Bank Tech) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems... ...delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real...
Big data
Full time
Part time
Internship
Local area
Capital One
McLean, VA
1 day ago
Data Engineer
...iterative delivery environment? At Capital One, you’ll be part of a big group of makers, breakers, doers and disruptors, who solve real... ...Capital One’s Finance Tech team is seeking a Senior Associate, Data Engineer who is passionate about marrying data with emerging...
Big data
Full time
Part time
Internship
Local area
Capital One Financial
Mc Lean, VA
3 days ago
Senior Data Scientist/Engineer
...nation's vital interests. Requisition #: 1355 Job Title: Senior Data Scientist/Engineer Location: Chantilly, VA Clearance Level: Active DoD - TS/... ...-related datasets. Preferred Skills * Experience with big-data platforms (Spark, Hadoop) and stream processing (Kafka)...
Big data
Full time
Agile Defense, LLC
Mc Lean, VA
1 day ago
Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)
Lead Data Engineer (Python, AWS, SQL, GenAI) Enterprise Platforms Technology (EPTech) is a group that establishes best practices for building... ...experience does not apply) At least 2 years of experience with big data technologies At least 1 year of experience with cloud...
Big data
Internship
Local area
SwiftCruit
McLean, VA
3 days ago
Big Data Engineer
Required Skills - 8+ years Experience in Supporting Cloudera Applications running in AWS Cloud - Experience in Supporting Cloud Applications with Mongo DB - Experience in Cloud Disaster Recovery - Apache Kafka - strong Administration & troubleshooting skills...
Big data
3B Staffing LLC
Reston, VA
5 days ago
Lead Specialist, Federal Data Engineer
...practice. Responsibilities: Leverage a variety of modern big data tools / approaches to solve complex business objectives... ...Qualifications: A minimum of five years of technical data engineering experience; U.S. Federal government consulting experience preferred...
Big data
Local area
KPMG
McLean, VA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!