Data Engineer

Job Summary:


The Senior Technical Lead will be responsible for leading technical teams and projects related to Snowflake, DBT, SQL, and Python. The role involves overseeing the design, development, and implementation of data solutions leveraging these technologies to meet business requirements.


Key Responsibilities


1. Lead and manage technical teams in the development and implementation of snowflake data solutions.


2. Design, build, and optimize data models using snowflake and dbt for efficient data processing.


3. Develop and optimize sql queries for data extraction, transformation, and loading processes.


4. Utilize python for scripting and automation of data processes and workflows.


5. Collaborate with cross functional teams to understand data requirements and ensure the successful delivery of technical solutions.


6. Conduct code reviews, provide technical guidance, and mentor team members to enhance overall technical capabilities.


7. Troubleshoot technical issues and provide resolutions in a timely manner to ensure smooth project execution.


Skill Requirements:


1. Proficiency in snowflake for data warehousing and cloud data platform.


2. Experience with dbt (data build tool) for data transformation and modeling.


3. Strong command of sql for querying and manipulating data in databases.


4. Proficient in python programming for scripting, automation, and data manipulation.


5. Excellent problem-solving skills and the ability to communicate effectively with technical and nontechnical stakeholders.


6. Strong leadership skills to effectively lead and motivate technical teams towards project success.


Job Overview:


Expected to be functionally knowledgeable in multiple EDW, DBT, Snowflake, Informatica, DataStage, Hadoop, Big Data and NoSQL Technology areas and hands-on experience in data management. As a leader in our Data Solutions, you will provide best-fit architectural solutions for one or more projects; assist in defining scope and sizing of work; and anchor Proof of Concept developments.


Responsibilities:


- Own and aggressively drive forward specific areas of Cloud EDW technology architecture. This includes data management architectures involving batch, micro-batch, and real-time streaming of data in both cloud and on-premise solutions


- Architect market leading DBT, Snowflake on AWS using Solutions. This includes ETL (Informatica or DataStage) and EDW design.


- Provide data architectural solutionsdesigns to project execution teams for implementation.


- Provide architectural assessments, strategies, and roadmaps for data management.


- Lead projects within architecture. Work with Product OwnerBusiness Analysts to understand functional requirements and interact with other cross-functional teams to architect, design, develop, test, and release features.


- Project and solution estimation and team structure definition


- Develop Proof-of-Concept projects to validate new architectures and solutions.


- Support multiple Agile Scrum teams with planning, scoping and creation of technical solutions for the new product capabilities, through to continuous delivery to production.


- Liaise with offshore team and clients for resolving technical dependencies, issues, and risks.


- Mentor and provide architectural guidance to multiple teams building innovative applications.


- Drive common vision, practices and capabilities across teams.


- Engage with business stakeholders to understand required capabilities, integrating business knowledge with technical solutions


- Engage with Technical Architects and technical staff to determine the most appropriate technical strategy and designs to meet business needs


- Demonstrate broad solutions technical leadership, impacting significant technical direction, exerting influence outside of the immediate team and driving change.