Data Engineer (Skillbridge Intern)

Data Engineer (Skillbridge Intern)This is an UNPAID internship through the DoD SkillBridge Program for transitioning active-duty US military personnel. DoD SkillBridge Internships are available to help transitioning active-duty military personnel gain real-world experience in the work force sometime during their final 180 days of active-duty service. The intern will actively train on meaningful projects and work closely with a mentor and with senior company leadership. Enlighten Internship programs are focused on placing transitioning military into internships that require KSAs, Education & Military Training similar to their current or previous military jobs; positions that could easily transition over to a full-time regular and permanent job with Enlighten.Essential Job Responsibilities: The SkillBridge intern will train as a Data Engineer with Enlighten, reporting to a designated Enlighten Supervisor, with the goal of learning Enlighten's Enterprise approach to design, build, and optimize Big Data Platform (BDP) systems for data collection, storage, access, and analytics at scale. The intern will be assigned special projects as needed.Desired End State (3-4 month target): At the end of four months, the intern will be able to understand basic data engineer concepts. Data engineers, as part of enterprise data analytics teams, manage, optimize, oversee, and monitor data retrieval, storage, and distribution throughout the BDP enclaves. The intern will develop a good understanding of all critical tasks to successfully conduct data engineer objectives: Data acquisition, Develop data set processes (Extract, transform, load (ETL)), Use programming language and tools, Identify ways to improve data reliability, efficiency, and quality, Prepare data for predictive and prescriptive modeling, Use data to discover tasks that can be automated.Training Plan: Phase 1 Basics, Week 1: In processing, Introductions/office familiarization, Week 2: Intro to the Big Data Platform (BDP) technologies, Week 3: Intro to BDP analytics and applications, Week 4: Intro to Army and Air Force Cyber data ETL process. Phase 2 Parser Overview, Week 5: Data Acquisition, Taxonomy/Schema, Week 6: Review existing parsers and deployment flows; understand existing transforms available for use in parsers. Weeks 7-8: BDP technologies - Kafka and Nifi workflows; Establish a development environment for BDP parser development. Phase 3 Parser Development, Deployment, and Testing, Weeks 9-11: Modify Kafka and Nifi workflows; modify existing parser schema and transforms to alter ingest pipeline. Weeks 12-13: Understand how to access logs to identify errors; understand common parser development errors; troubleshoot errors.Additional Goals: Project managementMinimum Qualifications: Active-Duty Military ONLY within final 180 days of active-duty service. Minimum of 5 years relevant experience with Bachelors in related field; 3 years relevant experience with Masters in related field; or High School Diploma or equivalent and 9 years relevant experience. Additional experience dependent on Program of Instruction. Physical Requirements will vary and is dependent on the Program of Instruction.