Big Data Engineer
Samprasoft
Data Engineer
Location: Hybrid Onsite (3 days onsite in Mclean, VA)
Duration: 6-12+ months Contract
Must Haves:
- Python
- Sparks
- Json
- XML
- Snowflake
- SQL
Your Impact:
- You will be able to apply advanced Data Engineering and Machine learning skills to solve real world challenges in building applications that help the company build better models and do advanced reporting.
- Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
- Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
- Manage and implement data processes (Data Quality reports)
- Develop data profiling, deduping logic, matching logic for analysis
- Programming Languages experience in Python, PySpark and Spark for data ingestion.
- Programming experience in BigData platform using Hadoop platform.
- Present ideas and recommendations on Hadoop and other technologies best use to management.
Qualifications:
- Bachelor’s degree in Computer Science, Statistics, Data science or a related quantitative field.
- 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs)
- 5+ years of programming experience in Hadoop, Spark, Python for data processing and analysis.
- Strong SQL experience is a must
- 5+ years of experience using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
- 2+ Prior experience working in Cloud platforms AWS. Kubernetes experience is highly desirable
- Hands on Work experience using technologies for manipulating structured and unstructured big data. Big data technologies may include—but are not limited to—Hadoop, Hive, Spark, relational databases, and NoSQL.
- Desired prior experience with MPP Databases like SnowFlake.
- Detail oriented and superb communication and written skills
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in McLean, VA vacancy
- ...Big Data Engineer We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems. In this role, you will design, develop, and maintain data pipelines, ensure efficient data processing, and optimize...Big dataTemporary workFor contractorsImmediate startFlexible hours
Cymertek
McLean, VA1 day ago - ...highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview:We are seeking a highly... ...extensive experience in data engineering, cloud services, and big data technologies, with a strong focus on AWS services, Python...Big dataLocal areaRemote work
$110k - $160k
OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services... ...experience in Data Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL...Big data$180k - $200k
Job DescriptionEverforth ECS is seeking a Sr. Data and AI Engineer to work Hybrid.(Typically 1-2x per week in Arlington, VA office for team planning... ...and Data Architecture concepts, Data Warehousing and Big Data tools, Data Analytics and applicable knowledge of Data Science...Big dataWork at office$125k - $165k
...evolving technology landscape, an organization’s data has never been a more important aspect in... ...are looking for seasoned Senior Data Engineer to work with our team and our clients to... ...Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc....Big data$125k - $160k
...evolving technology landscape, an organization’s data has never been a more important aspect in... ...are looking for seasoned Data Engineer to work with our team and our clients to develop... ...Engineering with experience in tools such as: Big data tools: Databricks, Apache Spark,...Big data$62k - $141k
Data Engineer, MidThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more... ...than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate...Big dataFull timeContract workPart timeWork at officeLocal areaRemote work$132.1k - $178.8k
...and consume accurate and timely financial data. The team supports the global accounting... ...environment, relishes working with ambiguity, big data, UI components and enjoys the... ...responsibilitiesWorking with stakeholders and other engineering teams to identify and scope the right...Big dataFlexible hours$62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial... ...today than ever before. As a data engineer, you know that organizing data can yield... ...maintaining scalable data stores that supply big data in forms needed for business analysis...Big dataFull timeContract workPart timeWork at officeLocal areaRemote work- ...Big Data Engineer Location: Day 1 onsite in McLean, VA on Tuesdays, and Wednesdays. Duration: 06+ months Contract (Possibility of Extension) Job Description Must Haves: Python, PySpark, SQL. Hadoop Platform. Responsibilities include: Cleanse, manipulate...Big dataContract work
Samprasoft
McLean, VA5 days ago - ...Data EngineerKDA Consulting Inc. is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures supporting mission-critical... ...services, data engineering best practices, and big data technologies, with the ability to operate...Big data
KDA CONSULTING INC
McLean, VA5 days ago - ...Advisory practice.Responsibilities:Leverage a variety of modern big data tools / approaches to solve complex business objectivesRapidly... ...between business & technical stakeholders)Develop data engineering designs that positively impacts business performanceQualifications...Big dataLocal area
- We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and...Big dataWork experience placement
- ...Data Engineer II Seeking an experienced Data Engineer II to join the Analytics Solutions Team. This team partners with stakeholders to extract... ...delivery of business-critical data. Develop and optimize big data workflows using Apache Spark and Hadoop technologies....Big dataMonday to Friday3 days per week
Delan Associates Inc
Arlington, VA1 day ago $120k - $225k
...Zachary Piper Solutions is currently seeking Data Engineers on our Professional Services team in McLean, VA. Are you a skilled Data Engineer... ...outcomes. Guide strategic customers through transformational big data initiatives and third‑party migrations, including end‑to‑...Big dataWork at officeZachary Piper Solutions
McLean, VA2 days ago- ...and cost-effective solutions that meet the ever-changing challenges that our clients face. Specialties: Big Data, Strategy and Business Architecture, Systems Engineering, Enterprise cloud services and solutions, PMO services, Innovation, R&D, Business Process and...Big data
- ...- and make a difference with us.Department Summary:MITRE’s Data Science and Engineering department is looking for qualified applicants to bring their... ...areas.Data EngineeringDistributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage...Big dataInternshipLocal area
$55 - $58 per hour
...Data Engineer 3 openings. Location: Role is on-site in McLean, VA 5 days/week Interview process: Teams call then... ...process and wrangle data in preparation for analysis; and analyse big data and perform exploratory analysis to uncover insights and...Big dataLocal area3B Staffing LLC
McLean, VA4 days ago- ...ROLE: - Data Engineer LOCATION: - Mclean - VA DURATION: - Long term contract Client: - Freddie Mac Experience... ...Shift: Day 9AM-7PM EST Required Skills: Snowflake, AWS Big Data, Kafka Job Summary: Years of experience in...Big dataLong term contractWork experience placementShift work
Maintec Technologies
McLean, VA3 days ago - ...Overview VTG is seeking a skilled Data Engineer with at least 5 years of experience designing, building, and maintaining scalable data pipelines... ...(e.g., PostgreSQL, MySQL, SQL Server) ~ Experience with big data processing frameworks (e.g., Spark, Hadoop) ~ Hands-on experience...Big data
VTG Defense
McLean, VA1 day ago - Shift5 is seeking a Data Engineer to join our Product Engineering team in Arlington, Virginia. In this role, you will design, build, and maintain... ...engineering experience, with strong skills in programming and Big Data technologies. We offer a competitive salary, bonus...Big data
- ...Quantitative Analytics/Big Data Developer/Data Engineer Senior Freddie Mac’s Single-Family Division is currently seeking a Quantitative Analytics/Big Data Developer/Data Engineer Senior to implement Big Data tools and methods of data processing and ingestion as a member...Big dataWork experience placement
Software Technology Inc
McLean, VA4 days ago - ...technology consulting firm is looking for a highly skilled Sr. Data Engineer to join their team in McLean, VA. The position demands extensive... ...engineering, focusing on AWS services, Python programming, and big data technologies. Responsibilities include managing data...Big data
- ...Advisory practice. Responsibilities:Leverage a variety of modern big data tools / approaches to solve complex business objectivesDevelop... ...:A minimum of five years of technical data engineering experience; U.S. Federal government consulting experience preferredBachelor...Big dataLocal area
- Silverthorne Advisory Group is seeking a skilled Data Engineer to join our defense sector team. You will design, build, and maintain our Advana data infrastructure and ensure robust, scalable pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter...Big dataRemote job
$98.72k - $123.4k
...Summary and Responsibilities Acentra Health is looking for a Data Engineer, Mid to join our growing team. Job Summary: ~... ...healthcare regulations (e.g., HIPAA). Hands-on experience with big data processing frameworks such as Apache Hadoop, Apache Spark,...Big dataContract workLocal areaAcentra Health
McLean, VA5 days ago- ...Brief Job Overview Client is seeking a high-energy, hands-on Data Engineer to design, build, and maintain scalable, production-grade data pipelines... ..., with strong expertise in AWS services and hands‑on work with big data and distributed data technologies in the AWS cloud...Big data
Smart Synergies
McLean, VA4 days ago $125k - $165k
...Senior Data Engineer In today's rapidly evolving technology landscape, an organization's data has never been a more important aspect in... ...experience in Data Engineering with experience in tools such as: Big data tools: Hadoop, Spark, Kafka, etc. Relational SQL and...Big dataClearanceJobs
McLean, VA4 days ago- ...Data EngineerEmployment Type: Full-Time, Mid-levelDepartment: Business IntelligenceCGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence... ..., SQL, SAS).Strong knowledge of big data analysis and storage tools...Big dataFull time
Contact Government Services LLC
Arlington, VA2 days ago $62k - $141k
An innovative tech company is seeking an experienced Data Engineer in McLean, Virginia, to manage and analyze big data for impactful missions such as fraud detection and national intelligence. The ideal candidate will have expertise in SQL, Java, Python, and Spark, as...Big dataFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- junior data engineer remote McLean, VA
- hadoop big data developer McLean, VA
- data engineer intern McLean, VA
- senior data quality engineer McLean, VA
- senior cloud data engineer McLean, VA
- data engineer contract McLean, VA
- entry level big data engineer McLean, VA
- data science developer McLean, VA
- junior big data engineer McLean, VA
- data visualization developer McLean, VA