Big Data Engineer

Role Description

We are currently seeking a Senior Big Data Engineer in the Hadoop Platform. Our ideal candidate exhibits a can-do attitude and approaches his or her work with vigor and determination. Candidates will be expected to demonstrate excellence in their respective fields, possess the ability to learn quickly, and strive for perfection within a fast-paced environment.

• Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
• Implementing ETL processes using Spark
• Ensure optimization of software through design reviews and code reviews
• Monitoring performance and advising any necessary infrastructure changes & defining data retention policies
• Management of Hadoop cluster, with all included services
• Building stream-processing systems, using solutions such as Storm or Spark-Streaming
• Solve any ongoing issues with operating the Hadoop cluster

Qualifications

• Proficient understanding of distributed computing principles
• Proficiency with Hadoop, MapReduce, HDFS
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Strong understanding of Data Structures and Algorithms
• Experience with integration of data from multiple data sources
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Experience in scripting languages such as Python
• Experience with Cloudera/MapR/Hortonworks Apache HDFS
• Experience in the field of Automotive Telematics Software is a big plus
• Experience with scripting tools and methods to optimize SW development and testing activities
• At least 4-7+ years of industry experience in Big Data Domain

Education

• MS/BS minimum in the areas of Computer Science, Computer Engineering, or other related fields or equivalent experience

Contact Information

Regards,
Niranjan | Manager - Business Development & Staffing - North America
View email address on remotive.com