Snowflake Data Engineer

Lead Data Engineer

This position will be supporting Canteen, a sector of Compass Group, focused on unattended retail solutions for clients and consumers across the US. The role will primarily be focused on providing expertise with development and management of our analytical data and reporting platforms.

The Lead Data Engineer role is responsible for:

• Leading the effort to design, implement, and optimize large-scale data and analytics solutions on Snowflake Cloud data warehouse.
• Managing and elevating other engineers (both full-time, contractor and/or third party resources) while remaining hands-on.
• Maintaining and building on our data warehouse and analytics environment utilizing Python, Snowflake, and AWS.
• Collaborating with the data services team and data architect to develop strategy for long term data platform architecture.
• Assisting application teams with the collection of transactional and master data from source systems.
• Designing and implementing data movement and transformation pipelines (e.g. AWS Glue, Apache AirFlow, dbt, Snowflake).
• Designing processes and algorithms to enhance data quality and reliability.
• Providing availability and access to consume analytical data through a wide range of Business Intelligence and Reporting toolsets (e.g. Microsoft Power BI, Google Looker).
• Implementing proactive monitoring and alerting to ensure operational stability and supportability.
• Collaborating with data analysts, data scientists, security engineers, and architects to achieve the best possible technical solutions that address our business needs.
• Performing analysis and critical thinking required to troubleshoot data-related issues and assist in the resolution.
• Coordinating change and release management across technical teams inside and outside the department.
• Minimizing operational impact while achieving the best possible performance and system health.
• Assisting with production issues in Data Warehouses like reloading data and transformations.

Required Skills:

• Expertise and excellent proficiency with Snowflake internals and integration of Snowflake with other technologies for data processing and reporting.
• 5+ years in Data Warehousing, Big Data, or ETL development (preferably using AWS S3, Glue, Apache AirFlow).
• 5+ years of experience with a programming language (preferably Python).
• Experience designing, building, and maintaining data processing and transformation pipelines (AWS Glue, Apache AirFlow, dbt, Snowflake).
• Technical expertise with data models, data mining, and data segmentation techniques.
• Knowledge of CI/CD deployment practices.