Big Data Engineer
Princeton IT Services, Inc
Overview We are seeking a highly skilled Big Data Engineer to join our team in Mt. Laurel, NJ. The ideal candidate will have hands-on experience with Big Data frameworks (Spark, Flink, Databricks, Hadoop ecosystem), streaming technologies (Kafka, Kinesis, Flink Streaming), and Cloud platforms (AWS preferred). The role involves designing and optimizing data pipelines, enabling large-scale data ingestion, transformation, and analytics to support enterprise applications and reporting. Responsibilities Design, develop, and optimize scalable data pipelines for batch and real-time processing. Work with streaming frameworks (Flink, Spark Streaming, Kafka) to handle large event-driven data flows. Build and maintain ETL/ELT processes using tools like Apache Airflow, AWS Glue, and EMR. Implement data lake and data warehouse solutions on AWS (S3, Redshift, DynamoDB, Athena, EMR, Lambda, Step Functions, Kinesis, MSK). Collaborate with data scientists, analysts, and application developers to deliver curated data sets for analytics and reporting. Ensure data quality, governance, and security standards across systems. Work with Java, Python, and Scala for data transformation, API integration, and microservices. Participate in Agile ceremonies and contribute to sprint planning, demos, and retrospectives. Troubleshoot and optimize performance of big data pipelines in production environments. Required Skills & Experience Bachelor’s degree in Computer Science, Engineering, or related field. 10+ years of experience as a Data Engineer or Big Data Engineer. Strong experience with Big Data tools: Spark (PySpark, Spark SQL, Spark Streaming), Flink, Hadoop ecosystem (Hive, HDFS, HBase, Sqoop). Hands-on expertise in cloud platforms (preferably AWS – EMR, Glue, S3, Kinesis, Lambda, Step Functions, DynamoDB). Strong programming skills in Java, Python, or Scala. Experience with Kafka (MSK or equivalent) for real-time data streaming. Proficiency with SQL and NoSQL databases (Redshift, Oracle, MongoDB, Cassandra, DynamoDB). Knowledge of CI/CD tools (Jenkins, Git, Bitbucket, Terraform, Docker, Kubernetes). Strong problem-solving, analytical, and communication skills. #J-18808-Ljbffr
- ...love the bullet points, but we love the work!) In this key Data Engineering role, you'll get to build the workflow engines behind the curtain... ...and monitor complex workflows Experience using Distributed Big Data processing engines including Apache Spark Experience...Big dataVisa sponsorshipWork visa
GIGATEC Engineering
Annapolis Junction, MD2 days ago - ManTech International in Laurel, MD is looking for Cloud and Software Engineers to enhance complex Big-Data systems. The ideal candidate should have substantial experience in software development, testing, and cloud technologies, contributing to pivotal projects at Ft....Big data
- ...currently possess this level of clearance. ---------- Telework: None Basic Requirements: ~14 years of experience as a software engineer ~ Bachelor’s degree in a technical discipline ~4 additional years of experience as a software engineer may be substituted for...Big dataFull timeImmediate startRemote work
- ...Basic Requirements: ~14 years of experience as a software engineer ~ Bachelor’s degree in a technical discipline ~4 additional... ...Accumulo ingest (streaming and bulk imports) Familiarity with the Data Warehouse and their processing pipelines. ---------- Excellent...Big data16 hoursFull timeImmediate startRemote work
$129k - $229k
Central Maryland Chamber is seeking a Data Engineer to support critical dataset ingestion into a big data environment. Responsibilities include developing data pipelines, supporting data analysis initiatives, and ensuring data integrity. Candidates must have over 14 years...Big data$5,000 per month
...IC/DoD. They specialize in cybersecurity, software development, data science, and cloud migration. Enjoy a close-knit team and exceptional... ...log formats (JSON, XML). Experience with Jupyter notebooks or Big Data Platforms (BDP/JCC2) is a plus. Certifications: DoD IAT II...Big dataFor contractorsstanleyreid.com
Columbia, MD1 day ago$204k - $247k
...Columbia, MD. This role involves developing custom applications and data visualizations to enhance mission processes. Ideal candidates... ...degree (or 16 years without) and familiarity with Python, AWS, and big data environments. The role also requires TS/SCI clearance with...Big data$230k - $240k
...Requirements: ~7 years of experience as a software engineer ~ Bachelor’s degree in a technical... ...extensive expertise in dataflow design, data transport mechanisms, and Apache Spark... ...workflows Experience with Distributed Big Data processing engines including Apache Spark...Big dataFull timeImmediate startRemote work- ...currently possess this level of clearance. ---------- Telework: None Basic Requirements: ~14 years of experience as a software engineer ~ Bachelor’s degree in a technical discipline ~4 additional years of experience as a software engineer may be substituted for...Big dataFull timeImmediate startRemote work
$129k - $229k
...Application Deadline: N/A Business & Information Syndicus NACON is seeking a talented Data Engineer to support the ingestion of mission-critical and mission-support datasets into a big data environment. The ideal candidate will have experience supporting cyber or...Big dataTemporary workFlexible hours- ...Job Description Pointer Technologies is seeking a talented Data Flow and ETL Engineer to design, implement, and maintain robust data pipelines... ...data warehousing concepts. Nice To Have Experience with big data technologies (e.g., Hadoop, Spark, Kafka)....Big dataTemporary workImmediate startFlexible hours
$186k - $220k
...Analytics Developer who loves tackling massive data challenges and pushing technical... ...collaborative environment and are passionate about big data and distributed computing, we want... ...Spark and/or MapReduce . Database Engineering: Proven experience working across modern...Big dataHourly payContract workWork experience placementImmediate startFlexible hours$180k - $260k
...possess this level of clearance.*** Are you a Senior Analytics Engineer who is ready for a new challenge that will launch your career... ...Enterprise capabilities include Full-Stack Application Development, Big Data, Cloud Technologies, Analytics, Machine Learning, AI, and...Big dataFull timeContract workRemote workWork from homeRelocation package- ...motivated candidate to join our talented Team. Job Title Data Intelligence - Sr. Data Engineer Location Columbia, MD (Hybrid) Description Purpose The... ...and scaling cloud OR on premise infrastructure targeting big data and platform data management (Relational and NoSQL,...Big dataWork experience placement
$205k - $215k
...Requirements: ~5 years of experience as a software engineer ~ Bachelor’s degree in a technical... ...responsible for creating and maintaining data workflows and automation pipelines using... ...workflows Experience using Distributed Big Data processing engines including Apache...Big data16 hoursFull timeImmediate startRemote work- ...Description: Join our team of talented engineers in the Annapolis Junction area supporting... ...that operate over large volumes of data at-rest, or they may be streaming analytics... ...Our technical competencies include Big Data analytics (batch and streaming), Cloud...Big data
- ...We are seeking a Software Engineer to help build and scale a graph-database-backed social listening platform. This role sits at the intersection of backend data infrastructure and front-end visualization, supporting a product that ingests high-volume social and web data...
Hire Hangar
Laurel, MD18 hours ago $150k - $210k
...Principal Data Scientist PLEX Solutions, A Part of Markon, is looking for a Principal... ...databases Collaborate with AI/ML engineers and data scientists to understand data requirements... ...), Cisco (CCNA), and/or STIGs/IAVA, Big Data Platform (BDP) Strong background...Big dataContract workTemporary workFlexible hoursMarkon
Annapolis Junction, MD4 days ago- Enlighten, a leader in big data solutions based in Columbia, MD, is looking for a Senior Backend Developer. This role involves designing and operating critical backend systems to manage vast amounts of data for the Department of Defense (DoD). We offer a competitive salary...Big data
- ...Description Job Description: Quevera is seeking a highly skilled Data Engineer with an active TS/SCI clearance with Polygraph to support... ...data processing and operational success. You'll leverage big data technologies to ensure reliable, accurate, and timely data...Big dataTemporary work
$61.72k - $108.33k
...responsible for coding and designing analytical solutions that turn data into knowledge. This position will work closely with business... ...Qualifications Bachelor's Degree in Computer Science, Engineering or Information Systems. Required Two (2) years Proficient BI...Full timeWork at officeVisa sponsorshipWork visaFlexible hoursCovista
Laurel, MD5 days ago$125k - $155k
...Job Description Job Description We're hiring a full-time Data Platform Engineer, based in Beltsville, MD and reporting into the Office of... ...wants to own data in a manufacturing setting, not a generic big-data or data-science position. The right person is fluent on...Big dataPermanent employmentFull timeWork at office$105k - $290k
Johns Hopkins Applied Physics Laboratory in Laurel, Maryland is seeking an engineer for their systems interoperability team. The ideal candidate will lead performance analysis of tactical data links, integrate advanced capabilities into network architectures, and develop...$176k - $282k
...support national security? Do you thrive in fast-paced, mission-driven environments? Peraton is seeking a talented and skilled Data Scientist Engineers to join our team in Laurel, MD. A data scientist will develop machine learning, data mining, statistical and graph-based...Contract workTemporary workShift work$176k - $282k
Peraton is seeking a Data Scientist Engineer in Laurel, MD, to build cutting-edge solutions supporting national security. The role involves developing machine learning algorithms and generating insights from complex datasets using data analysis software like R and Python...$200k - $275k
Technology Resource Experts, LLC is seeking an experienced Software Engineer to develop and enhance compliance and business processing tools. Responsibilities include automating compliance functions and investigating ML/AI algorithms. Candidates should possess expertise...- ...University Applied Physics Laboratory in Laurel, MD is seeking an Interoperability and Communications Systems Engineer to lead performance analysis of tactical data links and develop innovative data network capabilities for future joint warfighting systems. You will...
- ...Columbia, MD is seeking a Senior Backend Developer to join their engineering team. This position involves working on critical backend... ...of Defense, with a focus on scalable architecture and efficient data management. The ideal candidate has substantial experience in software...Big data
$115.2k - $145k
Mission Technologies, a division of HII, is seeking a Cloud Platform Engineer in Columbia, MD. The role requires expertise in AWS, strong programming skills in Python or Go, and extensive experience with Kubernetes. This hybrid position focuses on developing and optimizing...Big data$133k - $238k
...Senior Data Engineer / Technical Lead Stanley Reid is a specialized recruiting firm connecting top contractors with exciting IC/DoD opportunities. We're dedicated to a personalized, stress-free job search, matching your unique skills and goals with the perfect role....Contract workFor contractorsRemote workstanleyreid.com
Annapolis Junction, MD1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- data engineer analytics Laurel, MD
- senior cloud data engineer Laurel, MD
- data infrastructure engineer Laurel, MD
- data engineer machine learning Laurel, MD
- data center engineer Laurel, MD
- software data engineer Laurel, MD
- data science developer Laurel, MD
- senior data center engineer Laurel, MD
- big data cloud engineer Laurel, MD
- data developer Laurel, MD