Senior architecture architect

Hadoop & Talend Senior Architect
Number of Openings: 1
Duration of Hiring: Sep 2021 – Jun 2022
No of years' experience: 10+
Skill Set:

Expertise in Hadoop Data Lake Architecture – Raw, transformed, semantic layers creation.
Expertise in Hive – creating external tables, loading file data, Hive queries for transformations, UDF's
Expertise in Spark (PySpark) – Spark SQL, Data frames, Joins, UDF's, Job scheduling, configurations (executors and memory), Monitoring.
Expertise in Talend ETL – Reusable Jobs, File processing, Connecting to RDBMS Sources, Connecting to Hive/Impala, Audit Jobs, Calling Spark Jobs, Talend cloud 7.3.
Design, Architecture and implement effective Analytics solutions and models using Hadoop/Impala.
Design, Architecture and implement effective Analytics solutions using Power BI and Hive/Impala.
Examine and identify Datawarehouse structural necessities by evaluating business requirements.
Assess Datawarehouse implementation procedures to ensure they comply with internal and external regulations.
Prepare accurate Datawarehouse design and architecture reports for management and executive teams.
Monitor the system performance by performing regular tests, troubleshooting and integrating new features.
Recommend solutions to improve new and existing Datawarehouse solutions.
Educate staff members through training and individual support.
Offer support by responding to system problems in a timely manner.
Understand and document data flows in and between different systems/applications
Guidance to developers in preparing functional/technical specs to define reporting requirement and ETL process.
Technical Skills:

Cloudera (CDH) Hadoop
Hive
PySpark
Impala
Talend 7.1, 7.3
Data Modeling
Framework build on Ingestion, Audit, Logging and Reconciliation
DevOps
Work Location: Rosemead, California