Data Engineer
Samprasoft
Data Engineer
Location: McLean, VA (Tuesday and Wednesday onsite)
Duration: 6+ Months contract (with possible conversion)
Job Description:
- Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
- Develop Python, Py Spark, Spark scripts to filter/cleanse/map/aggregate data.
- Manage and implement data processes (Data Quality reports)
- Develop data profiling, deduping logic, matching logic for analysis
- Programming Languages experience in Python, Hive Query Language, Py Spark and Spark for data ingestion
- Programming experience in RDBMS and Bigdata using Hive, Hadoop platform
- Present ideas and recommendations on Hadoop and other technologies best use to management
- Good understanding of Functional programming and Object-oriented programming
- Detail oriented. Excellent communication skills (verbal and written)
- Must be able to manage multiple priorities and meet deadlines
Required Skills:
- 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) - Mandatory
- Programming experience in Python, Spark, SQL, HQL for data processing and analysis
- Strong SQL experience
- 3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
Desired Skills:
- 2+ years of experience with containerization and orchestration. Hands on experience with GIT, AWS, Kubernetes, Docker etc.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in McLean, VA vacancy
- ...health, transportation, and citizen services. We’re a nonprofit engineering, applied research, and advanced technology organization working... ...purpose — and help shape the future.Department Summary:MITRE’s Data Science and Engineering department is looking for qualified...SuggestedInternshipLocal area3 days per week
$76.73k - $127.88k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Data Engineer, you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel...SuggestedLocal areaVisa sponsorship$125k - $160k
...today’s rapidly evolving technology landscape, an organization’s data has never been a more important aspect in achieving mission and... ...Design and DevSecOps.ContributionsWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise...Suggested$62k - $141k
BigID Data EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there... ...and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when...SuggestedFull timeContract workPart timeWork at officeLocal areaRemote work- ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview:We are seeking a highly skilled Sr. Data Engineer to join our team in McLean, VA. The ideal...SuggestedLocal areaRemote work
$62k - $141k
Data Engineer, MidThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield...Full timeContract workPart timeWork at officeLocal areaRemote work$62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more... ...unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it...Full timeContract workPart timeWork at officeLocal areaRemote work$112.2k - $196.4k
...full potential. Unleash your talent and redefine what’s possible.Job Description:Parsons is looking for a highly skilled Senior Data Engineer to join our Joint Staff Chief Digital and Artificial Intelligence Office (CDAO) team. In this role, you will architect and deliver...Full timeWork at officeFlexible hours- DescriptionSAIC is seeking an experienced Data Engineer. Work directly with customers in a technical role to help ensure smooth adoption of the Crucible platform and develop cutting-edge solutions using the Crucible platform.· Spec, build, test and deploy customized mission...
$120k - $225k
...TrustBusiness Unit: Zachary PiperDivision: Federal SubcontractingPosition Owner: Jesse BowersZachary Piper Solutions is currently seeking Data Engineers on our Professional Services team in McLean, VA.Are you a skilled Data Engineerseeking an opportunity to make a real impact?...Work at office$85k - $141k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Our consultants... ...and data science, from data querying and wrangling to data engineering, to data visualization, dashboarding, and business intelligence...Full timeFlexible hours$89k - $148k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics...Full timeFlexible hours$84.4k - $140.6k
Position Summary Deloitte is seeking a Data Engineer II to support the design, development, and delivery of data solutions that enable analytics, reporting, and business decision-making. This role will focus on building scalable data pipelines, improving data quality...- We are looking for an experienced Data Engineer for a full time opportunity in Northern, Virginia. In this role, you will design reliable data solutions that support analytics and business decision-making while helping improve the overall data environment. The ideal candidate...Full time
- ...Data Engineer Position At MITRE, your passion fuels work that impacts our nation and improves lives. This is where your skills strengthen national security, cybersecurity, health, transportation, and citizen services. We're a nonprofit engineering, applied research,...InternshipLocal area3 days per week
MITRE
McLean, VA2 days ago $132k - $198k
...building a safer global future. Overview of Opportunity: Two Six Technologies is seeking an experienced and motivated Lead Data Engineer to work within a cross-functional development team focused on advancing a state of the art in mission tracking technology...Contract workWork at officeLocal areaTwo Six Technologies
Arlington, VA4 days ago- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...Long term contractWork at office
InterSources
McLean, VA3 days ago $179.4k - $204.7k
...Lead Data Engineer EPTech's Enterprise Consumer Products team transforms customer experiences, and the platforms that enable them, at the optimal time through the preferred channel, to empower 100+ million customers on their financial journeys and beyond. Do you...Full timePart timeInternshipH1bLocal areaCapital One
McLean, VA13 hours ago$125k - $165k
...today’s rapidly evolving technology landscape, an organization’s data has never been a more important aspect in achieving mission and... ...DevSecOps.ContributionsWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade...- ...role. Applicants must be authorized to work in the United States without the need for current or future sponsorship.The Senior Data Engineer is an experienced technical lead responsible for accelerating NFCU’s transition to AI-enabled data engineering by applying modern...InternshipMonday to Friday
- ...services. We are in search of a highly motivated candidate to join our talented Team.Job Title: Senior Data EngineerLocation: McLean, VA (Remote)Summary: Our Data Engineering team is dedicated to integrating our client data and applications with client infrastructure. We...Remote work
$120k - $170k
OverviewSteampunk wants you to join our awesome team as a Senior Data Visualization Engineer. In this role you'll be working with a large team of Steampunk and clients to identify data sources, tools, and mission challenges that can all be brought together to create decision...$125k - $180k
cBEYONData + SMX is seeking a Senior Data Engineer to join our team in support of a Modernized Data Science Platform for a Federal customer. This role will support IT transformation and modernization efforts by designing, building, and delivering data-driven solutions that...Contract workWork experience placementH1b2 days per week$197.3k - $225.1k
...Lead Data Engineer - Nexus Data ProductsDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group...Full timePart timeInternshipLocal areaCapital One
McLean, VA4 days ago- ...Advisory practice. Responsibilities:Leverage a variety of modern big data tools / approaches to solve complex business objectivesDevelop... ...:A minimum of five years of technical data engineering experience; U.S. Federal government consulting experience preferredBachelor...Local area
- ...Data Engineer (Agentic AI) Location: Falls Church, VA (Hybrid, with the expectation the selected individual will work three (3) days per week in office) US Person required As a Data Engineer at GDIT, you'll power innovation to drive mission impact and grow your...Work at officeWork from homeFlexible hours3 days per week
General Dynamics
Falls Church, VA4 days ago - ...for a Top Secret (Tier 5) clearance. No third party. ABOUT THE ROLE Strategic Innovation Group (SIG) is seeking a Senior Data Engineer to lead the data core of a new analytics platform for a federal government client. The platform consolidates program, financial,...Temporary workFor contractors
Strategic Innovation Group, LLC
Arlington, VA3 days ago - ...ROLE: - Data Engineer LOCATION: - Mclean - VA DURATION: - Long term contract Client: - Freddie Mac Experience: 8 to 10yrs Shift: Day 9AM-7PM EST Required Skills: Snowflake, AWS Big Data, Kafka Job Summary: Years...Long term contractWork experience placementShift work
Maintec Technologies
McLean, VA2 days ago - ...Position Overview Infopact is seeking an experienced Data Engineer to support large-scale Department of Defense data and financial management initiatives. The ideal candidate will have hands-on experience developing and optimizing data pipelines using Databricks and...Interim role
Infopact
Arlington, VA1 day ago - ...Data Engineer Arlington, VA 540 is seeking a Data Engineer to support a mission-critical technology modernization effort for the Department of War. You will design, build, and maintain Databricks-based data pipelines and lakehouse capabilities that enable secure data...Temporary workWork at officeLocal areaFlexible hours
540
Arlington, VA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- aws data engineer McLean, VA
- data engineer machine learning McLean, VA
- data science developer McLean, VA
- senior data engineer McLean, VA
- finance data engineer McLean, VA
- big data devops engineer McLean, VA
- data engineer analytics McLean, VA
- senior data integration developer McLean, VA
- junior data engineer remote McLean, VA
- data center engineer McLean, VA