Data Engineer

Data EngineerNew York State Department of Financial Services (DFS) is undertaking a significant modernization of its enterprise data environment, including the migration of critical data processing workflows to Snowflake and Informatica and the expansion of business intelligence capabilities through Tableau.Position Summary:The New York State Department of Financial Services (DFS) is undertaking a significant modernization of its enterprise data environment, including the migration of critical data processing workflows to Snowflake and Informatica and the expansion of business intelligence capabilities through Tableau.The selected IT Specialist (Expert) will provide technical leadership for the Research & Innovation (R&I) Division, primarily supporting the VC and LPTC Bureaus, while also contributing to broader R&I Data Steward initiatives.The consultant will guide, design, and optimize enterprise data processes and help strengthen DFS's ability to leverage data as a strategic asset while ensuring scalability and long-term sustainability of its data infrastructure.Responsibilities:Guide the migration of enterprise data processing and ETL workflows to Snowflake and Informatica platforms.Design, implement, and maintain scalable data warehouse workflows.Develop and optimize ETL/ELT processes to improve data integration, performance, and reliability.Perform data validation, reconciliation, and quality assurance to ensure the accuracy, completeness, and integrity of enterprise data.Establish, implement, and monitor data governance standards, data quality controls, and compliance with organizational policies and regulatory requirements.Develop automation solutions and reusable data processing tools using Python, R, and VBA to improve operational efficiency and reduce manual effort.Design, develop, and maintain complex scripts, stored procedures, and workflows supporting enterprise reporting and analytics.Analyze, troubleshoot, and resolve complex data integration, transformation, and performance issues across multiple systems.Collaborate with business and technology teams to translate business requirements into technical solutions.Develop and maintain technical documentation, including data flow diagrams, process documentation, data dictionaries, and system specifications.Evaluate emerging technologies and recommend enhancements that improve data management capabilities, security, scalability, and operational efficiency.Create and maintain interactive Tableau dashboards with a focus on scalability, manageability, extensibility, performance, and reusability.Work with team members to create reports and dashboards that provide insights, improve or automate processes, and add value to the organization.Support the R&I Data Steward in administering the data stewardship program and coordinating with various data users and data owners.Required Skills:84 months of experience in Data Engineering, Architecture, Data Governance, or Data Quality Assurance for Financial Reporting.84 months of experience in SQL and Relational Database Management Systems (RDBMS), including querying complex datasets.84 months of experience compiling, computing, and validating financial data using advanced statistical formulas and model calculations.48 months of experience building and maintaining data workflows and data pipelines using database tools, including translating business requirements into technical specifications.36 months of experience automating data ingestion and reporting using programming languages such as Python, R, or Excel VBA.36 months of experience in data visualization utilizing Business Intelligence software, preferably Tableau.24 months of experience with cloud-based data platforms, preferably Snowflake.Bachelor’s Degree in a quantitative discipline such as Computer Science, Statistics, Finance, or a related field.