Data Engineer (Skillbridge Intern)

Data Engineer (Skillbridge Intern)

This is an UNPAID internship through the DoD SkillBridge Program for transitioning active-duty US military personnel. The intern will actively train on meaningful projects and work closely with a mentor and with senior company leadership.

Essential Job Responsibilities:

• The SkillBridge intern will train as a Data Engineer with Enlighten, reporting to a designated Enlighten Supervisor, with the goal of learning Enlighten's Enterprise approach to design, build, and optimize Big Data Platform (BDP) systems for data collection, storage, access, and analytics at scale.
• The intern will be assigned special projects as needed.

Desired End State (3-4 month target): At the end of four months, the intern will be able to understand basic data engineer concepts. Data engineers, as part of enterprise data analytics teams, manage, optimize, oversee, and monitor data retrieval, storage, and distribution throughout the BDP enclaves. The intern will develop a good understanding of all critical tasks to successfully conduct data engineer objectives:

• Data acquisition
• Develop data set processes (Extract, transform, load (ETL))
• Use programming language and tools
• Identify ways to improve data reliability, efficiency, and quality
• Prepare data for predictive and prescriptive modeling
• Use data to discover tasks that can be automated

Training Plan:

1. Phase 1 Basics

• Week 1: In processing, Introductions/office familiarization
• Week 2: Intro to the Big Data Platform (BDP) technologies
• Week 3: Intro to BDP analytics and applications
• Week 4: Intro to Army and Air Force Cyber data ETL process

• Phase 2 Parser Overview

• Week 5: Data Acquisition, Taxonomy/Schema
• Week 6: Review existing parsers and deployment flows; understand existing transforms available for use in parsers.
• Weeks 7-8: BDP technologies - Kafka and Nifi workflows; Establish a development environment for BDP parser development

• Phase 3 Parser Development, Deployment, and Testing

• Weeks 9-11: Modify Kafka and Nifi workflows; modify existing parser schema and transforms to alter ingest pipeline.
• Weeks 12-13: Understand how to access logs to identify errors; understand common parser development errors; troubleshoot errors.

Additional Goals:

• Project management

Minimum Qualifications:

• Active-Duty Military ONLY within final 180 days of active-duty service.
• Minimum of 5 years relevant experience with Bachelors in related field; 3 years relevant experience with Masters in related field; or High School Diploma or equivalent and 9 years relevant experience.
• Additional experience dependent on Program of Instruction.

Physical Requirements will vary and is dependent on the Program of Instruction.