Data Architect

Tech Lead Or Architect With Python Development Background

We are looking for a tech lead or architect with a background in python development that can build solutions/help lead a team for a migration project. This is exclusive to Apex Systems. This is technically going to be a Data/Solution Architect, but we need someone who can still be hands on and do implementation.

We need a Solutions Architect capable of working hands-on, probably about 50-50 split between setting up best practices, architecture, CI/CD Solutions, cost optimization, talking to stakeholders/C-suite vs hands on/being involved in some of the implementation. Excellent communication is key as this person will be interfacing with UNFI C-suite.

Role Notes:

• Data Migration Project à on-prem data stores to Snowflake.
• Looking for a Solutions Architect capable of working hands-on, probably about 50-50 split between setting up best practices, architecture, CI/CD Solutions, cost optimization, talking to stakeholders/C Suite, and then involved in some of the implementation.
• Either Redshift or Snowflake à his role is involved in more ingestion vs building out the warehouse. Other resources (MDC Data Engineers) will be responsible for that.
• Setting up data pipelines, real-time streaming. Likely an MSK/Kafka solution with Python and Spark-SQL. Migrating data into AWS using Lambdas, SQS, Step Functions
• Automation and setting up data CI/CD pipelines (any tooling is okay, but needs to understand the difference in CICD for Applications vs the Cloud)
• UNFI seems to have some CI/CD and DataOps in place already, structures and playbooks that they can leverage so may not need to architect the whole solution from scratch.
• Not looking for a traditional data warehouse architect or someone from an Analytics/BI background. Looking for a Cloud Data Platform Architect/Lead.

Must Have:

• AWS Cloud Data Engineering background
• Snowflake or Redshift cloud data warehouse
• Python or Java
• Kafka or MSK
• AWS native data ingestion experience and relevant services (Lambdas, Step Functions, SQS, S3, MSK)
• CI/CD for data pipeline deployment knowledge needed
• Strong communication and documentation, solutions experience, ability to interface with C Suite

Nice to Have:

• Both Snowflake and Redshift
• SnowSQL, Snowpipes