Sr. Data Engineer

Sr. Data Engineer

Location: Canada (Remote) Terms: Full Time

Job Summary: We are seeking a skilled Sr. Data Engineer to join our dynamic team. The Sr. Data Engineer will be responsible for designing, developing, and maintaining our data pipelines, integrations, and data warehouse infrastructure. The successful candidate will work closely with data scientists, analysts, and business stakeholders to ensure that our data is accurate, secure, and accessible for all users.

Key Responsibilities:

• Design and build scalable data pipeline architecture that can handle large volumes of data

• Develop ELT/ETL pipelines to extract, load and transform data from various sources into our data warehouse

• Build batch-processing, near-real-time, and event-driven data integration solutions.

• Optimize and maintain the data infrastructure to ensure high availability and performance

• Collaborate with data scientists and analysts to identify and implement improvements to our data pipeline and models

• Develop and maintain data models to support business needs

• Develop complex SQL queries, stored procedures, functions, views, and data transformation logic.

• Ensure data security and compliance with data governance policies

• Identify and troubleshoot data quality issues

• Automate and streamline processes related to data management

• Stay up-to-date with emerging data technologies and trends to ensure the continuous improvement of our data infrastructure and architecture.

• Analyze the data products and requirements to align with data strategy

• Assist in extracting or researching data for cross-functional business partners for consumer insights, supply chain, and finance teams

• Enhance the efficiency, automation, and accuracy of existing reports

• Follow best practices in data querying and manipulation to ensure data integrity

• Support enterprise data governance, data cataloging, metadata management, and data lineage initiatives.

Requirements:

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field

• 14+ years of experience in Information Technology

• 10+ years of experience as a Data Engineer or related role

• Strong SQL development experience including SQL queries and stored procedures

• Experience with data orchestration tools such as Apache Airflow, Azure Data Factory, Informatica, Matillion, dbt, or equivalent technologies.

• Hands on experience with a modern cloud data platform such as Snowflake or comparable platform.

• Experience integrating data from platforms such as SAP, Salesforce, Shopify, or similar enterprise applications.

• Strong experience building, maintaining and documenting data pipelines

• Expertise in Snowflake concepts like RBAC management, virtual warehouse, file format, streams, zero copy clone, time travel and understand how to use these features is preferred.

• Well versed in data standardization, cleansing, enrichment, and modeling

• Proficiency in one or more programming languages such as Python, Java, or C#

• Experience with cloud computing platforms such as AWS, Azure, or GCP

• Knowledge of ELT/ETL processes, data warehousing, and data modeling

• Familiarity with data security and governance best practices

• Excellent hands-on experience in problem-solving and analytical skills and improving the performance of processes

• Strong communication and collaboration skills