Data Engineer

Data Engineer

The Data Engineer is an integral part of the Information Technology Services department (ITS), reporting to the Director of Business Intelligence (BI). The role will be involved in efforts to ensure the accuracy, integrity, and security of data within the BI system that supports data processing and analysis needs.

Interaction with stakeholders such as data governance workgroups, machine learning engineers, integration data pipeline builders, and BI developers is a key aspect of the role. The role involves designing, building, and maintaining test pipelines, data transformation or systems performance logs, and metadata or data catalogs. The Data Engineer is responsible for ensuring accurate and complete data collection, per business requirements, KPIs, and SLAs or SLOs. Gaining a thorough understanding of the data maintained in the enterprise data warehouse is mandatory. Advocating for data quality across teams is essential.

This is a full-time role with at least two required days at the Excelsior home office in Albany, NY. The remaining days can be worked from home. The Data Engineer will play a significant role in shaping the data operations strategy and infrastructure of the University.

Duties and Responsibilities:

• Work with data analysts, data governance workgroups, and other stakeholders to understand their needs and translate them into technical requirements.
• Maintain a strong understanding of business workflows, processes, and events, and relate this understanding to how these are captured in transactional systems.
• Develop and implement strategies to ensure data is clean and reliable.
• Design and execute tests to validate data transformations, migrations, and storage within the data warehouse environment.
• Identify any errors or inconsistencies in the enterprise data warehouse.
• Write technical documentation and term definitions in the Data Governance Platform.
• Implement data governance and ensure data integrity across all BI initiatives.

Qualifications: To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

• Bachelor's degree in computer science, information technology, systems engineering, database management, or related field
• 8 years of experience writing and troubleshooting complex SQL queries (PL/SQL and TSQL) and Python or R data frame functions.
• Strong understanding of relational database systems and data warehousing concepts.
• Strong analytical, research, and critical thinking.
• Experience in creating data quality requirements analysis documentation.

Strongly Preferred Qualifications:

• Experience with reporting tools (Power BI, QlikView, or QlikSense).
• Ability to work with a diverse group of stakeholders in a collaborative manner and communicate effectively.
• Excellent organizational skills

The hiring salary range for this position is $100,000.00 - $110,000.00. The hiring salary range above represents the University's good faith estimate at the time of posting.

Equal Opportunity Employer This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.