Snowflake Data Engineer

Data Engineer Position

Project: Marketing Data Platform (used to enable real time campaigns and data for other teams). Building new cloud data warehouse solution, that is built in SnowFlake. Consume real time data through Kafka (coming from multiple sources). Data gets uploaded to SnowFlake. Framework is built, but they are in the initial stages.

Looking for:

• Data Engineer with SnowFlake, Kafka, and Data Bricks (mid to senior level)
• Knowledge of connecting with Kafka streams
• Python
• Azure experience (can look at other Cloud solutions, but Azure is highly preferred)
• ETL
• Data security and governance guideline

Team size: Scrum team that is consulting (9 people), and they are building an internal team. Consultants will be there through end of year.

Screening topics:

• Databricks OR Snowflake
• Lead Data Engineer
• Can use Azure Data Engineer if they have Azure experience
• Python PySpark Coding

The candidate will be working closely with IT team members building a robust Marketing technology platform for enabling real time campaigns and data for marketing and Data Scientist team to make quick decisions.

Responsibilities:

• Prior experience managing Data lake and data warehouse type application
• Prior experience managing big data platform to ingest / transform time series, batch data for real time access
• 1 to 3 years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark.
• Experience with data security and governance guideline
• Experience managing such application on cloud (preferably Azure) platform and also understand native cloud concept such as eventHub, ADLS, Azure data factory.
• Experience managing various kind of BI tools for reporting like tableau, DOMO

Ideal candidate background: ETL, Data warehousing, Python experience

Required skills:

• Undergraduate degree or equivalent experience
• 5 + year of IT experience
• 1 to 3 years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark.

Preferred skills:

• 1 to 3 or more years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark.

This is a very urgent need. The manager has filled this role twice and needs to find a third person because the others backed out. They are VERY eager to hire.