Senior Big Data Engineer: Spark, Hadoop & Cloud Pipelines
Compunnel
Compunnel, Inc. is seeking a Big Data Engineer to design, develop, and optimize large-scale data processing systems at petabyte scale.
You will build scalable data pipelines using Spark, PySpark, Hadoop, Hive, Trino, and AWS services, collaborating with data scientists and analysts to translate business needs into robust solutions. The role emphasizes performance tuning, reliability, automation, and data quality, with opportunities to apply AI tooling and modern development practices in a
#J-18808-LjbffrVacancy posted 20 hours ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer: Spark, Hadoop & Cloud Pipelines in McLean, VA vacancy
$125k - $165k
...are looking for seasoned Senior Data Engineer to work with our team and... ...platforms, services, and pipelines. We are looking for more... ...data warehouse solutions in cloud (Preferably AWS.... ...experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL...PipelineCloudSeniorBig dataSteampunk
McLean, VA8 days ago- ...services. We’re a nonprofit engineering, applied research, and... ...Summary:MITRE’s Data Science and Engineering... ...maintainable data platforms and pipelines in cloud-based and self-hosted... ...Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage...PipelineCloudSeniorBig dataInternshipLocal area3 days per week
Mitre
McLean, VA6 days ago - ...highly skilled and experienced Big Data Engineer to design, develop, and... ...functional teams to architect data pipelines, implement data integration... ...in distributed systems, cloud platforms, and modern Big Data technologies such as Hadoop, Spark etc. Demonstrated technical...PipelineCloudSeniorBig data
Unisys
McLean, VA15 hours ago - ...highly skilled and experienced Big Data Engineer to design, develop, and... ...functional teams to architect data pipelines, implement data integration... ...in distributed systems, cloud platforms, and modern Big Data technologies such as Hadoop, Spark etc. \n Demonstrated technical...PipelineCloudSeniorBig data
Unisys
McLean, VA6 days ago - ...join our team as a Senior Data Engineer to align data... ...Experience in data pipelines, utilizing advanced... ...Apache Kafka, Airflow, Spark, Flink, NiFi). \n... ...time pipelines on cloud platforms (AWS... ...improvements. \n \n \n Big Data Technologies... ...frameworks (Hadoop, Spark, Hive,...PipelineCloudSeniorBig dataContract workWork at officeLocal area3 days per week
SteerBridge
Vienna, VA18 days ago $125k - $165k
...are looking for seasoned Senior Data Engineer to work with our team... ...platforms, services, and pipelines in Databricks. We are looking... .../data mart solutions in cloud (Preferably AWS.... ...experience in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake, etc....PipelineCloudSeniorBig dataSteampunk
McLean, VA8 days ago- ...future sponsorship.The Senior Data Engineer is an experienced... ...orchestration frameworks, Apache Spark, Python, SQL,... ...Microsoft Fabric, and modern cloud-native data and... ...time, and real-time data pipelines within Lakehouse and... ...across cloud platforms, big data ecosystems,...PipelineCloudSeniorBig dataInternshipMonday to Friday
Navy Federal Credit Union
Vienna, VA8 days ago - ...hiring a Full-stack Engineer 4 to drive architecture... ..., and scaling of data infrastructure and enterprise... ...projects, combining big data, microservices,... ...designing scalable pipelines, optimizing Spark jobs, and integrating... ...are required, plus cloud experience (AWS). #J-...PipelineCloudSeniorBig data
Capital One
McLean, VA2 days ago $136k - $160k
...Senior Associate Data Engineering - Chicago HybridAs a Senior Associate Data... ...maintaining scalable Big Data solutions. You will... ...frameworks, and cloud-based data platforms... ...batch and streaming data pipelines across modern cloud... ...Azure Data Factory, Spark, Spark Streaming, or...PipelineCloudSeniorBig dataContract workDigitas
Arlington, VA4 days ago- Senior Data Infrastructure Engineer The Senior Data Infrastructure Engineer... ...and scaling cloud OR on-premise... ...infrastructure targeting big data and... ...such as Hadoop, Flume, Solr, NiFi... ...Kafka, Kudu, Oozie, Spark, YARN, ZooKeeper... ...SQL DevOps (CI/CD Pipeline) Applies and...PipelineCloudSeniorBig data
- ...(SGA), is searching for a Big Data/Spark Engineer for a contract assignment... ...functional teams to architect data pipelines, implement data integration... ...in distributed systems, cloud platforms, and modern big data technologies such as Hadoop, Spark etc....PipelineCloudBig dataContract workWork experience placementWork at officeLocal area
- ...Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join a dynamic team in Washington, DC... ...maintaining scalable ETL data pipelines that handle both... ...using Python, Java, Spark, and SQL, optimizing... ..., leveraging cloud services and big data technologies.Responsibilities...PipelineCloudSeniorBig data
Kaav Inc.
Washington DC4 days ago $115k - $150k
...for our clients.As a Senior Data Engineer, you will architect, build... ...design of robust data pipelines, enforce best... ...indexing, cost-efficient cloud solutions).Stay updated... ...using tools like Apache Spark, Kafka, Airflow, and dbt... ...-on experience with big data tools:Apache Spark...PipelineCloudSeniorBig dataFull timeVisa sponsorshipInsomniac Design
Washington DC6 days ago- ...SmartRecruiters, Inc. is seeking a senior Hadoop/AWS developer for Mapjects.com Federal services to design and implement large-scale data processing pipelines. The role targets cleared engineers capable of delivering in a federal environment and handling on-site data platforms...PipelineSeniorBig data
Mapjects
Washington DC3 days ago - ...RCT Systems seeks a Senior-level Data Architect/ SME to support... ...data acquisition, engineering, and management across... .... The role covers cloud infrastructure design, ETL pipeline development, and... ...collaboration using AWS, Hadoop/HDFS, Cloudera, Spark, Presto, SQL, and NoSQL...PipelineCloudSeniorBig data
RCT Systems
McLean, VA3 days ago $125k - $160k
...are looking for seasoned Data Engineer to work with our team and... ...platforms, services, and pipelines. We are looking for more than... ...data warehouse solutions in cloud (Preferably AWS.... ...experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL...PipelineCloudBig dataSteampunk
McLean, VA7 days ago- ...Azure Data EngineerJob Summary: We are looking... ...skilled Azure Data Engineer to design and... ...solutions using the Azure cloud ecosystem. The... ...develop robust data pipelines using Azure Data Factory... ...processing using Spark clusters in Azure... ...data pipelines for big data and analytics....PipelineCloudSeniorBig data
MDA Edge
Rockville, MD4 days ago - ...Cymertek Corporation is seeking a Cloud Analytic Software Engineer to design, develop, and... ...environment. You will build scalable data pipelines, process large datasets, and... ...platforms (AWS/Azure/GCP), and big data tools like Hadoop/Spark, with a focus on secure, efficient...PipelineCloudBig dataFlexible hours
Cymertek
McLean, VA20 hours ago - ...currently seeking a Senior Specialist to join our... ...a variety of modern big data tools / approaches to... ...Data Science needsBuild pipelines / scalable analytics... ...technologies (e.g. - Hadoop, Spark, Kafka, Kubernetes,... ...stakeholders)Develop data engineering designs that...PipelineSeniorBig dataLocal area
KPMG
McLean, VA9 days ago $62k - $141k
Data EngineerThe Opportunity: Ever-expanding... .... As a data engineer, you know that organizing... ...and deploy the pipelines and platforms... ...that supply big data in forms needed... ...ScalaExperience with a public cloud, including AWS,... ...tools, such as Spark, Databricks, Hadoop, Hive, AWS EMR,...PipelineCloudBig dataFull timeContract workPart timeLocal areaRemote workBooz Allen Hamilton
McLean, VA6 days ago$150k - $175k
...Senior Data EngineerDark Wolf is looking for a Senior Data Engineer to join our team in Herndon, VA supporting... ...robust data pipelines and data... ...data with Apache Spark, DBT, and Trino.Establishing... ...applications to cloud... ...engineering and big data technologies...PipelineCloudSeniorBig dataFull timeFor contractorsRemote workDark Wolf Solutions
Herndon, VA15 hours ago$130k - $160k
...are looking for a seasoned Data Engineering Team Lead to work with... ...platforms, services, and pipelines. We are looking for more... ...technical standards for cloud-based database and data warehousing... ...with tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational...PipelineCloudBig dataSteampunk
McLean, VA4 days ago- ...Data Scientist / Data EngineerJTEC Consulting... ...Scientists, Data Engineers, and Data... ...open-source tools, cloud environments, and... ...may include:Data Pipelines & Engineering: Architect... ...solutions, big data analytics,... ...frameworks (e.g., Apache Hadoop, Apache Spark/PySpark, SQL)....PipelineCloudBig dataLocal area
JTEC Consulting LLC
McLean, VA3 days ago - ...The Big Data Engineer will design, develop, and optimize large-scale data processing... ...building scalable and reliable data pipelines using Spark, Python/PySpark, Hadoop, Hive, Trino, and AWS services.... ...and Athena to build and support cloud-based data solutions. Develop...PipelineCloudBig dataWork experience placement
Compunnel
McLean, VA19 hours ago $110k - $160k
...are looking for seasoned Data Engineer to work with our team and... ...platforms, services, and pipelines. We are looking for more than... ...warehouse solutions in cloud (Preferably AWS. Alternatively... ...in tools such as: Big data tools: Hadoop, Spark, Kafka, etc. Relational...PipelineCloudBig dataLocal areaNavstar
McLean, VA4 days ago- ...client seeks two Data Engineers to build and support... ...-oriented data pipelines for AML and personal... ...engineering across Spark, Python, AWS Glue,... ...~4+ years with big data technologies such as Spark, Hadoop ecosystem, or EMR.... ...~4+ years with cloud platforms such as...PipelineCloudBig dataHourly payLocal area
- Senior Data Engineer Qualifications: Bachelor's Degree At least 3 years... ...1 year of experience in big data technologies 5+ years... ...experience with a public cloud (AWS, Microsoft Azure,... ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 2+...CloudSeniorBig dataInternship
$151.5k - $227.3k
...Analytics Delivery Engineering TeamYour work days... ...together, tackling big challenges with bold... ...proven enterprise cloud platform, Workday brings... ...automation, CI/CD pipelines, and observability... ...Mapping (ORM), big data technologies (Apache Spark, Hadoop, HDFS, Storm), data...PipelineCloudSeniorBig dataWork experience placementWork at officeRemote workFlexible hoursWorkday
Reston, VA4 days ago$158.6k - $181k
...Senior Data Engineer (Bank Tech) Do you love building and pioneering... ...One, you’ll be part of a big group of makers, breakers... ...and NoSQL databases and cloud‑based data warehousing services... ...tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~2+ years...CloudSeniorBig dataFull timePart timeInternshipH1bLocal areakozmetickesluzby.vecnakraska.sk - Jobboard
McLean, VA19 hours ago- ...services. We’re a nonprofit engineering, applied research,... ...Summary:MITRE’s Data Science and Engineering... ...Data Processing and Big Data Architectures (e.g., Spark, Hadoop, Ray, Dask, Kafka)Data Pipeline/ETL Development and Orchestration... ...Git, Containers, and Cloud PlatformsExpectations...PipelineCloudSeniorBig dataInternshipLocal area3 days per week
Mitre
McLean, VA7 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer: Spark, Hadoop & Cloud Pipelines. Be the first to apply!
Related searches
- finance data engineer McLean, VA
- data engineer contract McLean, VA
- big data devops engineer McLean, VA
- sr data engineer McLean, VA
- senior data engineer McLean, VA
- entry level big data engineer McLean, VA
- etl data engineer McLean, VA
- data engineer manager McLean, VA
- director data engineering McLean, VA
- data engineer machine learning McLean, VA