Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Shield Consulting Solutions

Job Title

Active TS/SCI with Polygraph Required. Please do not apply if you do not currently possess this level of clearance.

Telework: (up to 16 hours per week) may be available for this position based on mission needs/available tasking at the discretion of leadership, after the individual has become fully acclimated to the duties and responsibilities of the position and has completed the necessary telework training.

Basic Requirements:

  • 14 years of experience as a software engineer
  • Bachelor's degree in a technical discipline. Four additional years of experience as a software engineer may be substituted for a degree.

Job Description:

  • Experience setting up, deploying, and troubleshooting Hadoop, Map/Reduce, Accumulo, and Zookeeper – this also extends to current sustainment tasking.
  • Tasking would also include troubleshooting and fixing issues – for example off lining an HDFS node because of a bad disk. Off lining an Accumulo server processes because of bad memory…

Required Experience:

  • Familiar with Kubernetes deployment and troubleshooting.
  • Familiar with and able to develop and run ansible playbooks.
  • Primary development language would be Java.
  • Experience writing Map/Reduce applications.
  • Experience writing Accumulo iterators and using scanners and Accumulo ingest (streaming and bulk imports)
  • Familiarity with the Data Warehouse and their processing pipelines.

Excellent benefits package including 25 days PTO, 11 paid holidays, 100% employer-paid healthcare for employees and dependents – available day 1, 8% 401(k) employer match – immediate vesting.

Shield Consulting Solutions is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Annapolis Junction, MD vacancy
  • $129k - $229k

    Central Maryland Chamber is seeking a Data Engineer to support critical dataset ingestion into a big data environment. Responsibilities include developing data pipelines, supporting data analysis initiatives, and ensuring data integrity. Candidates must have over 14 years... 
    Big data

    Central Maryland Chamber

    Columbia, MD
    1 day ago
  • A specialized recruiting firm is seeking a SME-level Data Engineer to support crucial data ingestion into a big data environment. The successful candidate will focus on software infrastructure for big data, requiring extensive experience in Data Engineering, proficiency... 
    Big data

    stanleyreid

    Columbia, MD
    3 days ago
  • A specialized recruiting firm is seeking a Senior Data Engineer to support mission-critical data operations in Columbia, MD. This hybrid role...  ..., fluency in Java and Python, and expertise in ETL and big data tools like Apache NiFi. The candidate must hold a TS/SCI clearance... 
    Big data

    Stanley Reid & Company

    Columbia, MD
    3 days ago
  • $5,000 per month

     ...IC/DoD. They specialize in cybersecurity, software development, data science, and cloud migration. Enjoy a close‑knit team and exceptional...  ...log formats (JSON, XML). Experience with Jupyter notebooks or Big Data Platforms (BDP/JCC2) is a plus. Certifications: DoD IAT II or... 
    Big data
    For contractors

    stanleyreid.com

    Columbia, MD
    2 days ago
  • A specialized recruiting firm is seeking a Data Engineer to enhance government data analysis and analytics. This role involves managing data quality and complexity using big data systems, requiring strong Python skills and an active TS/SCI clearance. Ideal candidates will... 
    Big data

    Stanley Reid & Company

    Columbia, MD
    13 hours ago
  • $204k - $247k

     ...Columbia, MD. This role involves developing custom applications and data visualizations to enhance mission processes. Ideal candidates...  ...degree (or 16 years without) and familiarity with Python, AWS, and big data environments. The role also requires TS/SCI clearance with... 
    Big data

    Neuralsolutions

    Columbia, MD
    13 hours ago
  • A specialized recruiting firm is seeking a Senior/Lead Data Flow Engineer to lead strategic data efforts and manage software infrastructure for big data ingestion. The ideal candidate will have over 14 years of experience in software development and data engineering, with... 
    Big data

    stanleyreid.com

    Columbia, MD
    4 days ago
  • $190k - $240k

    A technology solutions company is seeking a Senior Cloud Software Engineer to join their intel team in Maryland. Responsibilities include developing and maintaining Big-Data Cloud systems and contributing to all stages of back-end processing. Candidates are required to... 
    Big data

    Belay Technologies

    Columbia, MD
    4 days ago
  • $5,000 per month

     ...specialize in cybersecurity, software development, data science, and cloud migration. Enjoy a...  ...The Role We are seeking a SME‑level Data Engineer to support the ingestion of mission‑critical and mission‑support data sets into a big data environment. This role is pivotal in... 
    Big data
    For contractors

    stanleyreid

    Columbia, MD
    3 days ago
  • $129k - $229k

     ...Application Deadline: N/A Business & Information Syndicus NACON is seeking a talented Data Engineer to support the ingestion of mission-critical and mission-support datasets into a big data environment. The ideal candidate will have experience supporting cyber or... 
    Big data
    Temporary work
    Flexible hours

    Central Maryland Chamber

    Columbia, MD
    1 day ago
  • $5,000 per month

     ...specialize in cybersecurity, software development, data science, and cloud migration. Enjoy a...  .... The Role We are looking for a Data Engineer to support government data analysis and analytic development. You will work with big data systems and complex structured/unstructured... 
    Big data
    For contractors

    Stanley Reid & Company

    Columbia, MD
    13 hours ago
  •  ...currently possess this level of clearance. ---------- Telework: None Basic Requirements: ~14 years of experience as a software engineer ~ Bachelor’s degree in a technical discipline ~4 additional years of experience as a software engineer may be substituted for... 
    Big data
    Full time
    Immediate start
    Remote work

    Shield Consulting Solutions

    Annapolis Junction, MD
    13 hours ago
  •  ...Basic Requirements: ~14 years of experience as a software engineer ~ Bachelor’s degree in a technical discipline ~4 additional...  ...Accumulo ingest (streaming and bulk imports) Familiarity with the Data Warehouse and their processing pipelines. ---------- Excellent... 
    Big data
    16 hours
    Full time
    Immediate start
    Remote work

    Shield Consulting Solutions

    Annapolis Junction, MD
    13 hours ago
  • Enlighten, a leader in big data solutions based in Columbia, MD, is looking for a Senior Backend Developer. This role involves designing and operating critical backend systems to manage vast amounts of data for the Department of Defense (DoD). We offer a competitive salary... 
    Big data

    Enlighten

    Columbia, MD
    13 hours ago
  • Enlighten is seeking a Cloud Platform Engineer based in Columbia, Maryland. The ideal candidate will be proficient in AWS, Kubernetes, and...  ..., and generous PTO. Join Enlighten, a recognized leader in data solutions, to tackle exciting challenges in a flexible work approach... 
    Big data
    Flexible hours

    Enlighten

    Columbia, MD
    13 hours ago
  • A leading defense contractor in Columbia, MD is looking for a Cloud Platform Engineer. The ideal candidate will have extensive experience in cloud technologies, particularly AWS, and strong programming skills in Python or Go within a hybrid work environment. Responsibilities... 
    Big data
    For contractors

    Huntington Ingalls Industries

    Columbia, MD
    13 hours ago
  •  ...love the bullet points, but we love the work!) In this key Data Engineering role, you'll get to build the workflow engines behind the curtain...  ...and monitor complex workflows Experience using Distributed Big Data processing engines including Apache Spark Experience... 
    Big data
    Full time
    Visa sponsorship
    Work visa

    GIGATEC Engineering

    Annapolis Junction, MD
    18 days ago
  • Visionist, Inc. is seeking a Cloud Software Engineer to support big data processing platforms. You will work with the latest technology to develop analytics that aid mission-critical decision-making. Responsibilities include building interactive applications and deploying... 
    Big data
    Flexible hours

    Visionist, Inc.

    Columbia, MD
    13 hours ago
  • Enlighten is hiring a Cloud Platform Engineer in Columbia, MD. This role requires extensive experience in AWS and programming skills in...  ...engineer will develop and integrate software components using Big Data solutions while working in a hybrid environment, averaging 1-2... 
    Big data
    Work at office
    2 days per week
    1 day per week

    Enlighten

    Columbia, MD
    13 hours ago
  • $230k - $240k

     ...Requirements: ~7 years of experience as a software engineer ~ Bachelor’s degree in a technical...  ...extensive expertise in dataflow design, data transport mechanisms, and Apache Spark...  ...workflows Experience with Distributed Big Data processing engines including Apache Spark... 
    Big data
    Full time
    Immediate start
    Remote work

    Shield Consulting Solutions

    Annapolis Junction, MD
    13 hours ago
  •  ...currently possess this level of clearance. ---------- Telework: None Basic Requirements: ~14 years of experience as a software engineer ~ Bachelor’s degree in a technical discipline ~4 additional years of experience as a software engineer may be substituted for... 
    Big data
    Full time
    Immediate start
    Remote work

    Shield Consulting Solutions

    Annapolis Junction, MD
    13 hours ago
  • $230k - $240k

     ...: ~20 years of experience as a software engineer ~ Bachelor’s degree in a technical discipline...  ...of web-based applications that automate data management for IC data custodians. The...  ...statistical libraries against data. Skilled with big data processing frameworks such as Pig,... 
    Big data
    Full time
    Immediate start
    Remote work

    Shield Consulting Solutions

    Annapolis Junction, MD
    13 hours ago
  •  ...Job Description Pointer Technologies is seeking a talented Data Flow and ETL Engineer to design, implement, and maintain robust data pipelines...  ...data warehousing concepts. Nice To Have Experience with big data technologies (e.g., Hadoop, Spark, Kafka).... 
    Big data
    Temporary work
    Immediate start
    Flexible hours

    Pointer Technologies

    Annapolis Junction, MD
    4 days ago
  • $205k - $215k

     ...: ~17 years of experience as a software engineer ~ Bachelor’s degree in a technical discipline...  ...value from structured and unstructured data leverage statistical methods and/or...  ...statistical libraries against data Skilled with big data processing frameworks such as Pig,... 
    Big data
    Full time
    Immediate start
    Remote work

    Shield Consulting Solutions

    Annapolis Junction, MD
    13 hours ago
  • $180k - $260k

     ...possess this level of clearance.*** Are you a Senior Analytics Engineer who is ready for a new challenge that will launch your career...  ...Enterprise capabilities include Full-Stack Application Development, Big Data, Cloud Technologies, Analytics, Machine Learning, AI, and... 
    Big data
    Full time
    Contract work
    Remote work
    Work from home
    Relocation package

    GliaCell Technologies

    Annapolis Junction, MD
    25 days ago
  • $200k - $250k

    Senior Full-Stack Software Engineer — Data Visualization & Workflow Automation Columbia, MD | Full Time | TS/SCI with Polygraph Required Position...  ...with React. Experience querying and developing in a big data environment. Experience developing on and managing Linux... 
    Big data
    Full time
    Local area

    Intezra, Inc.

    Columbia, MD
    2 days ago
  • $205k - $215k

     ...Requirements: ~5 years of experience as a software engineer ~ Bachelor’s degree in a technical...  ...responsible for creating and maintaining data workflows and automation pipelines using...  ...workflows Experience using Distributed Big Data processing engines including Apache... 
    Big data
    16 hours
    Full time
    Immediate start
    Remote work

    Shield Consulting Solutions

    Annapolis Junction, MD
    13 hours ago
  • A leading analytics firm is seeking a Data Scientist for a hybrid role focused on developing predictive modeling solutions. Candidates...  ...collaboration with government stakeholders. Additionally, expertise in big data technologies and visualization tools is essential for... 
    Big data
    Remote job

    SourceFly, LLC.

    Columbia, MD
    3 days ago
  •  ...Description: Join our team of talented engineers in the Annapolis Junction area supporting...  ...that operate over large volumes of data at-rest, or they may be streaming analytics...  ...Our technical competencies include Big Data analytics (batch and streaming), Cloud... 
    Big data

    Phoenix Operations Group

    Annapolis Junction, MD
    15 days ago
  •  ...Hybrid Onsite At Columbia, MD Understands data needs and advise company on technological resources. Partners with senior level...  ...develop data models and ETL processes. ~20% Supports the Software Engineering team with data analysis and validation with extensive SQL... 
    Work experience placement
    Immediate start
    Remote work

    Mindlance

    Columbia, MD
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!