Data Engineer

Title: Data Engineer


Remote but local to MA, NH, RI, CT, ME, VT


Must have: DBT, SnowFlake, Python, Dagster, AWS, S3


Experience with OCI (Oracle Cloud Infrastructure) and Oracle Cloud services, including Oracle Fusion, is a big plus.


Responsibilities:

• Writing and building Python-based data pipelines
• Scheduling and parameterizing those pipelines using Dagster
• Parameterizing means making things easily adjustable so the data pipelines can adapt to different needs instead of having to be completely redone every time there's a new business need.
• Working in an AWS + Snowflake environment
• Handling data stored in S3
• Moving data into Snowflake from various sources

Nice to Have Skills:


Ability to model up through medallion architecture using DBT. Which means:


This means the person knows how to organize and transform data in a structured way using DBT (a data transformation tool), following something called the medallion architecture.


Medallion architecture: A layered approach to data transformation that separates data into:


Bronze (raw data),


Silver (cleaned and filtered),


Gold (final, business-ready data).


Retail industry experience a plus or someone who has worked in multiple industries.