Data Engineer

Overview NYSTEC is a nonprofit technology consulting company that has advised agencies, organizations, institutions, and businesses since 1996. We are independent and vendor-neutral, focusing on helping clients succeed so that individuals and teams flourish. This role is focused on the data engineering function and collaboration with the Business Intelligence team and stakeholders. Compensation : The target base salary range for this position is $97,172 to $126,323 per year. The final compensation package is determined by factors including skill set, experience, location, and job-related qualifications. Responsibilities Design, develop, and maintain scalable enterprise data pipelines that support data integration, analytics, and business intelligence initiatives. Design, implement, and support enterprise data architecture, including data warehouses, lakehouses, and other analytical data repositories. Develop and maintain robust ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes to ingest, transform, validate, and deliver data from multiple internal and external systems. Design and implement logical and physical data models that promote consistency, scalability, and long-term maintainability. Develop, test, deploy, and maintain data engineering solutions that leverage SQL, Python, and PySpark to support enterprise data processing and automation. Integrate data from enterprise applications, APIs, relational databases, flat files, and third-party systems while ensuring data integrity and reliability. Implement and maintain enterprise data governance standards, including data quality, metadata management, lineage, security, and access controls. Monitor, troubleshoot, and optimize data pipelines, databases, and platform performance to ensure reliability and scalability. Collaborate with business stakeholders, application owners, and technical teams to translate business requirements into scalable data solutions. Develop and maintain technical documentation, including solution architecture, operational procedures, and development standards. Evaluate emerging technologies and recommend improvements that enhance the data platform, engineering practices, and data maturity. Partner with Business Intelligence team members to ensure data assets support reporting, analytics, AI, and self-service data initiatives. Participate in platform planning, architecture reviews, and continuous improvement efforts to maintain security, scalability, and alignment with objectives. About you Required Qualifications Experience developing enterprise data solutions using Microsoft Fabric. Experience with Microsoft Azure Data Factory, Azure Data Lake Storage, Azure SQL, SQL Server Integration Services (SSIS), SQL Server, or related Microsoft data services in cloud or on‑premises environments. Advanced SQL development skills, including query optimization, database design, and performance tuning. Strong proficiency in Python and/or PySpark for data engineering, automation, and data transformation. Experience designing and developing ETL/ELT solutions and enterprise data integration processes. Experience designing and supporting relational databases, data warehouses, lakehouses, and enterprise analytical data models. Experience integrating data from enterprise applications, APIs, relational databases, flat files, and cloud services. Strong understanding of enterprise data architecture, data modeling, data governance, metadata management, and security best practices. Experience implementing source control, testing, deployment, and operational support practices for enterprise data solutions. Excellent analytical, troubleshooting, organizational, and communication skills. Preferred/Desired Qualifications Experience supporting enterprise BI, analytics, and AI initiatives through modern data engineering practices. Experience implementing data governance, security, and performance optimization within Microsoft enterprise data platforms. Education and Experience A bachelor’s degree in computer science, information systems, data engineering, information technology or a related discipline and five years of related experience designing, developing and supporting enterprise platforms. An equivalent combination of advanced education, training, and experience will be considered. The information above describes the role and expectations for the Data Engineer at NYSTEC. It is the policy of NYSTEC to provide equal employment opportunity to all individuals and to comply with applicable laws regarding equal opportunity in employment. #J-18808-Ljbffr