Data Snowflake Engineer

Job Description:

We are seeking a highly skilled Data Engineer with strong expertise in Snowflake, Python, PySpark, Airflow, and Streamlit to design, build, and support modern cloud-based data platforms. The ideal candidate will have experience developing scalable data pipelines, implementing Snowflake-based data solutions, and working with GCP environments.

Key Responsibilities

• Design, develop, and maintain data ingestion, transformation, and orchestration pipelines in Snowflake.

• Build and optimize Snowflake SQL queries, stored procedures, data models, and Snowpark-based solutions.

• Develop scalable ETL/ELT processes using Python and PySpark.

• Create and manage Airflow DAGs for workflow scheduling, monitoring, and automation.

• Develop interactive dashboards and data applications using Streamlit.

• Work with structured and semi-structured data formats including JSON, CSV, and Parquet.

• Design and implement data quality, validation, reconciliation, and monitoring frameworks.

• Integrate Snowflake solutions with AWS cloud services.

• Troubleshoot production issues, optimize performance, and ensure data reliability.

• Collaborate with business stakeholders, architects, and cross-functional teams to deliver data solutions.

Required Skills

• 8+ years overall Data Engineering experience

• Strong hands-on experience with Snowflake including:

• Data ingestion and transformation

• Snowflake SQL

• Complex joins and performance tuning

• Stored Procedures, Views, Tasks, and Streams

• Snowpark libraries

• Data Modeling

• 5+ years of Python development experience

• Strong knowledge of PySpark

• Hands-on experience with Apache Airflow

• Hands-on experience with Streamlit

• Experience with GCP

• Strong understanding of data warehousing concepts, ETL/ELT, and dimensional modeling.

• Experience working with large-scale structured and semi-structured datasets.

• Strong analytical, debugging, and problem-solving skills.

Preferred Qualifications

• Experience in Banking or Financial Services environments.

• Exposure to AWS services such as S3, EMR, Redshift, or equivalent GCP services.

• Experience with CI/CD, Git, Jenkins, Terraform, or CloudFormation.

• Snowflake and Cloud certifications are a plus.

Education

• Bachelor's or master's degree in computer science, Information Technology, Engineering, or a related field.