Big Data Engineer
Samprasoft
Data Engineer
Location: Hybrid Onsite (3 days onsite in Mclean, VA)
Duration: 6-12+ months Contract
Must Haves:
- Python
- Sparks
- Json
- XML
- Snowflake
- SQL
Your Impact:
- You will be able to apply advanced Data Engineering and Machine learning skills to solve real world challenges in building applications that help the company build better models and do advanced reporting.
- Cleanse, manipulate and analyze large datasets (Structured and Unstructured data – XMLs, JSONs, PDFs) using Hadoop platform.
- Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
- Manage and implement data processes (Data Quality reports)
- Develop data profiling, deduping logic, matching logic for analysis
- Programming Languages experience in Python, PySpark and Spark for data ingestion.
- Programming experience in BigData platform using Hadoop platform.
- Present ideas and recommendations on Hadoop and other technologies best use to management.
Qualifications:
- Bachelor’s degree in Computer Science, Statistics, Data science or a related quantitative field.
- 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs)
- 5+ years of programming experience in Hadoop, Spark, Python for data processing and analysis.
- Strong SQL experience is a must
- 5+ years of experience using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
- 2+ Prior experience working in Cloud platforms AWS. Kubernetes experience is highly desirable
- Hands on Work experience using technologies for manipulating structured and unstructured big data. Big data technologies may include—but are not limited to—Hadoop, Hive, Spark, relational databases, and NoSQL.
- Desired prior experience with MPP Databases like SnowFlake.
- Detail oriented and superb communication and written skills
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in McLean, VA vacancy
- Required Skills - 8+ years Experience in Supporting Cloudera Applications running in AWS Cloud - Experience in Supporting Cloud Applications with Mongo DB - Experience in Cloud Disaster Recovery - Apache Kafka - strong Administration & troubleshooting skills...Big data
3B Staffing LLC
Reston, VA3 days ago - ...Mid-Level Big Data Engineer The Big Data Engineers on AWS will be responsible for analyzing requirements, prototyping data analysis solutions (primarily in Hive, Hadoop, python), collecting, preparing data for modeling and productionizing the data preparation pipelines...Big data
Software Technology Inc
Rockville, MD3 days ago - ...Our client, a leading organization in the financial services industry, is seeking a Big Data Engineer to join their team. As a Big Data Engineer, you will be part of the Data Engineering department supporting cross-functional teams. The ideal candidate will demonstrate...Big dataWeekly payTemporary workFlexible hours
Experis/Manpower Group
Rockville, MD3 days ago - ...and cost-effective solutions that meet the ever-changing challenges that our clients face. Specialties: Big Data, Strategy and Business Architecture, Systems Engineering, Enterprise cloud services and solutions, PMO services, Innovation, R&D, Business Process and...Big data
ByteCubed
Arlington, VA1 day ago - ...Spark core and Spark SQL 5 years of hands‑on programming experience in either core Java or Spark 3 years of hands‑on experience in Data Warehousing and Data Marts and Data/Dimensional Modeling and ETL 1 year of hands‑on experience in HBase or Cassandra or any other...Big dataContract workImmediate start
- AN INNOVATIVE START-UP IN ARLIGNTON IS LOOKING FOR BIG DATA ENGINEERS!!! What you'll get: Rapid growth where you will be challenged and rewarded Great benefits package Casual, fun environment and team Summary Seeking an experienced Engineer to join a fast-growing IT...Big dataCasual work
$220k
A technology-driven firm is seeking a Data Engineer to support big data environments and perform data analytics. Ideal candidates hold a BS in a related field and possess strong proficiency in Python, along with expertise in cloud architecture and MLOps. The position requires...Big data- ...Snowflake Experience with enterprise analytics platforms Data engineering and ETL experience Qualifications ~ Bachelor's... ...effectively within a team environment. Required Experience Big Data Development Hadoop Ecosystem Spark Development...Big data
Saxon Global
Washington DC5 days ago $220k
...collaborative tech company in McLean, Virginia is seeking a skilled Data Engineer to join their team. The role offers a base salary up to $220K for highly qualified candidates, requiring expertise in big data environments, Python, and software engineering. Candidates...Big data- ...candidate will require at least three years of direct experience with Hadoop components and programming in Java or Spark. Knowledge of data warehousing and distributed computing design patterns is essential for this role. The position offers a contract starting ASAP and...Big dataContract workImmediate start
- General Dynamics Information Technology is hiring a Senior Data Engineer to influence national security through innovative data solutions. This... ...will possess over 10 years of experience, AWS Certified Big Data Specialty, and a TS/SCI security clearance. GDIT promotes...Big data
- ...technology consulting firm is looking for a highly skilled Sr. Data Engineer to join their team in McLean, VA. The position demands extensive... ...engineering, focusing on AWS services, Python programming, and big data technologies. Responsibilities include managing data...Big data
- A consultancy in the Defense sector is seeking a skilled Data Engineer to join their team. The role involves designing, developing, and maintaining data infrastructure, utilizing technologies such as ETL processes, Databricks, Python, and more. Successful candidates require...Big dataRemote job
$5,000 per month
...Data Profiler Stanley Reid is a specialized recruiting firm connecting top contractors with exciting IC/DoD opportunities. We're dedicated... ...log formats (JSON, XML). Experience with Jupyter notebooks or Big Data Platforms (BDP/JCC2) is a plus. Certifications: DoD IAT II or...Big dataFor contractorsstanleyreid.com
Sterling, VA6 days ago$200k - $260k
A consulting firm in McLean, VA is seeking a Data Engineer to join their agile team, offering a salary between $200K and $260K. The ideal candidate will have a BS in a relevant field and experience with big data environments, data analytics, and cloud technology. Key skills...Big data- ...should have a Bachelor's degree in a related field and a minimum of 8 years of relevant experience, especially in Python development and data modeling. BCore offers an inclusive environment and opportunities to impact national cybersecurity efforts. #J-18808-Ljbffr Bridge...Big data
$62k - $141k
An innovative tech company is seeking an experienced Data Engineer in McLean, Virginia, to manage and analyze big data for impactful missions such as fraud detection and national intelligence. The ideal candidate will have expertise in SQL, Java, Python, and Spark, as...Big dataFlexible hours- ...days onsite / 2 days remote in Mclean, VA Our client seeks an ETL Data Engineer to build and maintain large-scale data pipelines and to design... ...window functions, joins, and complex aggregations. Engineer big data systems on EMR-on-EC2 and EMR-on-EKS and deliver solutions...Big dataWork experience placementRemote work
Eliassen Group
Falls Church, VA5 days ago $197.3k - $225.1k
Capital One in McLean, VA is looking for a Lead Data Engineer to drive major transformations with emerging technologies and data. In this role... ..., leveraging your experience in cloud environments and big data technologies. You will collaborate with Agile teams and lead...Big data- An established industry player is seeking a skilled data engineer to leverage big data for impactful missions. In this dynamic role, you will design and develop scalable data platforms, ensuring that complex data applications are operationalized effectively. Collaborating...Big dataRemote job
$120k - $225k
Zachary Piper Solutions is seeking a skilled Data Engineer for our McLean, VA office. You will deliver high-value technical projects, guide customers through transformative big data initiatives, and collaborate with various teams. Required qualifications include 6+ years...Big dataWork at office- SAIC is looking for qualified candidates for a data architecture and engineering position to support a cutting-edge data, analytics, and AI platform in Arlington, Virginia. Responsibilities include managing customer relationships, software engineering, and data pipeline...Big data
$77.6k - $176k
...during your journey as a candidate with us. Data is only as powerful as the pipelines that... ...and the trust that supports it. As a Data Engineer, you’ll help build and scale a cloud‑... ...storage formats such as Parquet Experience with big data frameworks such as Apache Spark and...Big dataFull timeContract workPart timeBooz Allen Hamilton
McLean, VA3 days ago$220k
...challenges using bleeding-edge technology. This Role We are seeking a Data Engineer. Base salary up to $220K for highly qualified candidates. What... ..., Computer Science, or a related field Experience supporting big data environments Experience with data analytics and...Big data- ...practice. Responsibilities: Leverage a variety of modern big data tools / approaches to solve complex business objectives... ...translate between business & technical stakeholders) Develop data engineering designs that positively impacts business performance Qualifications...Big dataLocal area
KPMG
Washington DC1 day ago - Capital One is looking for a Lead Data Engineer to drive major transformation through data modeling and architecture. This role involves designing... ...and have substantial experience in application development, big data technologies, and cloud computing. An exciting opportunity...Big data
$197.3k - $225.1k
Capital One is seeking a Lead Data Engineer to transform its financial technology. This role focuses on innovative solutions within a collaborative... ...will have a strong background in both application development and big data technologies. #J-18808-Ljbffr Comfort Systems USABig data- ManpowerGroup Global, Inc. is seeking a highly skilled AI Big Data Engineer to design and develop data processing systems. The successful candidate will work in Rockville, MD or Tysons Corner, VA, focusing on data pipelines, integration, and ensuring scalability. With a...Big data
- Optomi is seeking a Data Engineer in Washington, DC to develop large-scale data pipelines and design AI systems. The role involves building ETL pipelines, optimizing SQL for big data, and developing AI agent systems. The ideal candidate should have experience with Apache...Big data
$110k - $130k
Steampunk is seeking a skilled ETL Engineer located in McLean, Virginia, to develop enterprise-grade data pipelines. This role requires strong communication skills and a passion for data. You will assess ETL workflows, create reusable pipelines, and support analytics and...Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- senior cloud data engineer McLean, VA
- finance data engineer McLean, VA
- aws data engineer McLean, VA
- data engineer McLean, VA
- sr data engineer McLean, VA
- software data engineer McLean, VA
- junior data engineer remote McLean, VA
- remote data engineer McLean, VA
- data visualization developer McLean, VA
- big data cloud engineer McLean, VA