Lead Data Engineer

Job Description

• Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems

• Participate in all aspects of the software development lifecycle for Snowflake solutions, including planning, requirements, development, testing, and quality assurance

• Work in tandem with our engineering team to identify and implement the most optimal solutions

• Ensure platform performance, uptime, and scale, maintaining high standards for code quality and thoughtful design

• Troubleshoot incidents, identify root causes, fix and document problems, and implement preventive measures

• Able to manage deliverables in fast paced environments Areas of Expertise

• At least 8-10 years of experience designing and development of data solutions in enterprise environment

• At least 5+ years’ experience on Snowflake Platform

• Strong hands on SQL and Python development

• Experience with designing and development data warehouses in Snowflake

• A minimum of three years experience in developing production-ready data ingestion and processing pipelines using Spark, Scala

• Strong hands-on experience with Orchestration Tools e.g. Airflow, Informatica, Automic

• Good understanding on Metadata and data lineage

• Hands on knowledge on SQL Analytical functions

• Strong knowledge and hands-on experience in Shell scripting, Java Scripting

• Able to demonstrate experience with software engineering practices including CI/CD, Automated testing and Performance Engineering.

• Good understanding and exposure to Git, Confluence and Jira

• Good problem solving and troubleshooting skills.

• Team player, collaborative approach and excellent communication skills