Senior Specialist - Data Engineering

Role description

We are seeking a skilled Data Engineer with strong handson expertise in Hadoop ecosystem technologies particularly in onpremise environments The ideal candidate will have deep experience working with PySpark HDFS and Hive and a solid understanding of largescale data processing and distributed systems

Strong handson experience in Hadoop ecosystem onpremise

Expertise in PySpark for largescale data processing

Minimum 5 years of experience in HDFS Hive and Spark

Deep understanding of HDFS architecture and storage mechanisms

Proficiency in Hive for data warehousing and querying

Experience in building and optimizing Spark jobs

Handson experience with data ingestion using Sqoop

Strong knowledge of distributed data processing and big data concepts

Ability to design develop and maintain scalable data pipelines

Experience working with large volumes of structured and unstructured data

Strong skills in performance tuning and query optimization HiveSpark

Ability to troubleshoot and resolve data pipeline and processing issues

Good understanding of data quality governance and best practices

Exposure to cloud platforms AWSAzureGCP good to have

Strong problemsolving skills and ability to work independently in fastpaced environments