Data Engineer
Samprasoft
Data Engineer
Location: McLean, VA (Tuesday and Wednesday onsite)
Duration: 6+ Months contract (with possible conversion)
Job Description:
- Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
- Develop Python, Py Spark, Spark scripts to filter/cleanse/map/aggregate data.
- Manage and implement data processes (Data Quality reports)
- Develop data profiling, deduping logic, matching logic for analysis
- Programming Languages experience in Python, Hive Query Language, Py Spark and Spark for data ingestion
- Programming experience in RDBMS and Bigdata using Hive, Hadoop platform
- Present ideas and recommendations on Hadoop and other technologies best use to management
- Good understanding of Functional programming and Object-oriented programming
- Detail oriented. Excellent communication skills (verbal and written)
- Must be able to manage multiple priorities and meet deadlines
Required Skills:
- 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) - Mandatory
- Programming experience in Python, Spark, SQL, HQL for data processing and analysis
- Strong SQL experience
- 3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
Desired Skills:
- 2+ years of experience with containerization and orchestration. Hands on experience with GIT, AWS, Kubernetes, Docker etc.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in McLean, VA vacancy
- ...health, transportation, and citizen services. We’re a nonprofit engineering, applied research, and advanced technology organization working... ...purpose — and help shape the future.Department Summary:MITRE’s Data Science and Engineering department is looking for qualified...SuggestedInternshipLocal area3 days per week
$76.73k - $127.88k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Data Engineer, you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel...SuggestedLocal areaVisa sponsorship$110k - $160k
OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines within an AI-enabled software development environment. We are looking for more than just a "Data Engineer". We are...Suggested- DescriptionSAIC is seeking an experienced Data Engineer. Work directly with customers in a technical role to help ensure smooth adoption of the Crucible platform and develop cutting-edge solutions using the Crucible platform.· Spec, build, test and deploy customized mission...Suggested
$62k - $141k
BigID Data EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there... ...and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when...SuggestedFull timeContract workPart timeWork at officeLocal areaRemote work$84.4k - $140.6k
Position Summary Deloitte is seeking a Data Engineer II to support the design, development, and delivery of data solutions that enable analytics, reporting, and business decision-making. This role will focus on building scalable data pipelines, improving data quality...$89k - $148k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics...Full timeFlexible hours$62k - $141k
ETL Data EngineerThe Opportunity: As a data engineer, you know that a good site or system needs the right combination of ETL, data management, automation, clean code, APIs, analytics, and infrastructure to develop a user-focused solution. We’re looking for a data engineer...Full timeContract workPart timeWork at officeLocal areaRemote work- We are looking for an experienced Data Engineer for a full time opportunity in Northern, Virginia. In this role, you will design reliable data solutions that support analytics and business decision-making while helping improve the overall data environment. The ideal candidate...Full time
$120k - $225k
...TrustBusiness Unit: Zachary PiperDivision: Federal SubcontractingPosition Owner: Jesse BowersZachary Piper Solutions is currently seeking Data Engineers on our Professional Services team in McLean, VA.Are you a skilled Data Engineerseeking an opportunity to make a real impact?...Work at office$85k - $141k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Our consultants... ...and data science, from data querying and wrangling to data engineering, to data visualization, dashboarding, and business intelligence...Full timeFlexible hours- ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview:We are seeking a highly skilled Sr. Data Engineer to join our team in McLean, VA. The ideal...Local areaRemote work
$62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more... ...unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it...Full timeContract workPart timeWork at officeLocal areaRemote work$112.2k - $196.4k
...full potential. Unleash your talent and redefine what’s possible.Job Description:Parsons is looking for a highly skilled Senior Data Engineer to join our Joint Staff Chief Digital and Artificial Intelligence Office (CDAO) team. In this role, you will architect and deliver...Full timeWork at officeFlexible hours$197.3k - $225.1k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal areaCapital One National Association
McLean, VA2 days ago$132k - $198k
...building a safer global future. Overview of Opportunity: Two Six Technologies is seeking an experienced and motivated Lead Data Engineer to work within a cross-functional development team focused on advancing a state of the art in mission tracking technology...Contract workWork at officeLocal areaTwo Six Technologies
Arlington, VA4 days ago- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...Long term contractWork at office
InterSources
McLean, VA3 days ago - ...we are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full-time positions with clients. Who should apply? Recent computer science/engineering/mathematics/statistics...Full timeH1bRemote work
SynergisticIT
Arlington, VA20 hours ago - ...Data Engineer Position At MITRE, your passion fuels work that impacts our nation and improves lives. This is where your skills strengthen national security, cybersecurity, health, transportation, and citizen services. We're a nonprofit engineering, applied research,...InternshipLocal area3 days per week
MITRE
McLean, VA2 days ago $125k - $165k
...today’s rapidly evolving technology landscape, an organization’s data has never been a more important aspect in achieving mission and... ...DevSecOps.ContributionsWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade...- ...services. We are in search of a highly motivated candidate to join our talented Team.Job Title: Senior Data EngineerLocation: McLean, VA (Remote)Summary: Our Data Engineering team is dedicated to integrating our client data and applications with client infrastructure. We...Remote work
- ...role. Applicants must be authorized to work in the United States without the need for current or future sponsorship.The Senior Data Engineer is an experienced technical lead responsible for accelerating NFCU’s transition to AI-enabled data engineering by applying modern...InternshipMonday to Friday
$120k - $170k
OverviewSteampunk wants you to join our awesome team as a Senior Data Visualization Engineer. In this role you'll be working with a large team of Steampunk and clients to identify data sources, tools, and mission challenges that can all be brought together to create decision...$125k - $180k
cBEYONData + SMX is seeking a Senior Data Engineer to join our team in support of a Modernized Data Science Platform for a Federal customer. This role will support IT transformation and modernization efforts by designing, building, and delivering data-driven solutions that...Contract workWork experience placementH1b2 days per week- ...Data Engineer Location: Dallas, TX OR McLean, VA OR New York (Onsite from Day 1 in Hybrid Model) Duration: 6-12+ Months (With further ext. possibilities) Must Haves Python PySpark, Hadoop AWS Services Microservices Data Lakes experience...
Samprasoft
McLean, VA4 days ago $115k - $155k
...humanitarian missions worldwide. With 1,700+ team members, 1,500+ AI/data experts, and 100+ prime contracts, we deliver at scale and with... ...Credence has an immediate need for a Mid-Level AI Data Engineer to join our growing AI and Automation practice. You will be a technical...Temporary workImmediate startWorldwideCredence company
McLean, VA2 days ago- ...Job Title: DATA ENGINEER Location: Mclean,VA or Plano, TX Duration: 12+ Months Visa: USC, GC, H1B and EAD Contract Type: W2 Design, build, and operate large-scale batch and real-time data pipelines that move, transform, and publish data across the enterprise...Contract workH1b
Btree Solutions
McLean, VA4 days ago $116k - $126k
...Data Engineer (Mid-Level, 3+ Years) SteerBridge is a modern technology company delivering innovative, mission-focused solutions to the U.S. Government and private sector. Leveraging deep expertise in federal acquisition, digital transformation, and emerging technologies...Full timeWork experience placementWork at officeLocal area3 days per weekSteerBridge
Vienna, VA4 days ago- ...Advisory practice. Responsibilities:Leverage a variety of modern big data tools / approaches to solve complex business objectivesDevelop... ...:A minimum of five years of technical data engineering experience; U.S. Federal government consulting experience preferredBachelor...Local area
- ...Data Engineer (Agentic AI) Location: Falls Church, VA (Hybrid, with the expectation the selected individual will work three (3) days per week in office) US Person required As a Data Engineer at GDIT, you'll power innovation to drive mission impact and grow your...Work at officeWork from homeFlexible hours3 days per week
General Dynamics
Falls Church, VA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- aws data engineer McLean, VA
- data engineer machine learning McLean, VA
- data science developer McLean, VA
- senior data engineer McLean, VA
- finance data engineer McLean, VA
- big data devops engineer McLean, VA
- data engineer analytics McLean, VA
- senior data integration developer McLean, VA
- junior data engineer remote McLean, VA
- data center engineer McLean, VA