Data Engineer

Data EngineerLocation - Helena, MT (Remote)Duration - 8-10 monthsClient - State of MontanaJob Description: This Data Engineer position works primarily with the Early Childhood and Family Support Division (ECFSD) Early Childhood Integrated Data System (ECIDS) effort to build a centralized data system/warehouse for unifying data in the division.This position works closely with Division stakeholders to identify data requirements, onboard and transform data, confirm data quality and accessibility, and troubleshoot data-related technical issues. The Data Engineer streamlines data workflows, enhances data infrastructures for greater scalability and collaboration, and identifies opportunities to optimize delivery by developing, maintaining, and testing infrastructure for data generation.The Data Engineer contributes to the management of all data assets, a data lake, and serves to help deliver modernized reporting and Business Intelligence solutions.Background: The Montana Bright Futures B-5 renewal grant continues to develop the Montana comprehensive childhood system to support early learning and development, health, family support and engagement. It is aligned with the 2019 early childhood needs assessment findings and related strategic plan goals of increasing early childhood care and education (ECCE) access and quality.Three findings incorporated into the Montana Bright Futures B-5 grant that establish the need for an Early Childhood Integrated Data System (ECIDS) are:Child and family data is in multiple, disconnected systems.Integrating data is an essential step in the process of transforming data into information that can be used to improve and inform the Early Childhood Care & Education (ECCE) system.Montana will invest in strengthening the Early Childhood Integrated Data System (ECIDS) through the development of a shared purpose, data governance structure, and system design.This Position is to satisfy the following 2 pillars for this project:Design and implement a centralized data integration process using an IT Data Solution that integrates ECFSD data from multiple disconnected systems and creates a unique identifier for programs to easily and accurately compare data.Generate additional data reporting opportunities using integrated ECFSD data to provide Leadership with updated accurate reports and to create data dashboards available to stakeholders, researchers and Public.ECFSD has partnered with the Department Chief Data Officer(CDO) and the Data Management Office (DMO) to identify the internal Snowflake platform as the IT Data Solution and Advanced Data Reporting pieces that will directly achieve pillars three and four of the ECIDS structure.We are requesting the services of a contracted Data Engineer with experience in Snowflake to facilitate an ECIDS by designing and building the data storage structure in Snowflake, importing data from multiple ECFSD data collections, performing data matching to integrate data, and creating a unique identifier, and ensure this data is connected to current ECFSD data visualization software.In addition, this Data Engineer Contractor will maintain a link between the ECFSD data for ECIDS and the DPHHS agency-wide data lake project managed by DMO.This position will be supervised by DMO and funded by Bright Futures B-5 using the Montana Bright Futures B-5 Grant.Objectives of this CEP:Collect and document all business and technical requirements necessary to complete the project.Complete an integrated data solution in Snowflake for the Early Childhood and Family Services Division that automatically updates data at regular intervals. The solution will include a reporting solution to visualize and report on data in the warehouse.Train Division staff on the use of the solution.Train DMO staff on the management of the solution.Knowledge, Skills, and Abilities:Primary Duties or Responsibilities as related to the ECIDS project:Manages data collection, management, and storage for this project.Enhances and maximizes the quality, integrity, reliability, and access to data assets.Builds data pipelines to bring together information from different source systems and creates the infrastructure for optimal extraction, transformation, and data loading from multiple sources.Enables data sharing and interoperable data exchange for the Division, the Department, other state agencies, and external partners/providers.Oversees all stages of data onboarding, transformation, and enablement.Assembles complex data sets that meet non-functional and functional business requirements.Collaborates with associated programs to collect, prepare, organize, and secure the department's data assets. Implements and enforces data privacy policies to comply with regulations.Provides data models and engages in data modeling efforts as needed.Delivers high-quality, uniform data to support analytics. Improves and streamlines access to data to drive innovation and outcomes.Prepares data for analytical and operational uses. Integrates, consolidates, and cleanses data and structures it for analytics applications.Enhances and maximizes the quality, integrity, and reliability of data assets. Expands the effective utilization of data through improved usability and accessibility of IT systems.Enables data sharing and access across the department. Seeks opportunities to eliminate data redundancies, improve data quality, and provide exceptional data services to the department.Train Data Management Office staff on management of the ECIDS solutionTrain Division Staff on access and use of the system.Experience Requirements:7+ years' experience in data engineering and analytics, computer science, information technology, or related fields. A minimum bachelor's degree in data sciences is desirable, and a Master's Degree in a Data Science field is preferred. Combinations of experience and education will be considered on a case-by-case basis.5+ years of experience building Snowflake data warehouse solutions incorporating multiple source system data5+ Years integrating reporting solutions, specifically Thoughtspot, PowerBI, and/or Tableau. Other BI solutions experience will be considered.5+ years of Data Modeling experienceSignificant experience producing deliverables on a regular cadence, as well as reporting on status to stakeholdersDemonstrated ability to communicate effectively to diverse audiences with varying levels of technical understanding.