Hadoop Administrator Job Description Template
Our company is looking for a Hadoop Administrator to join our team.
Responsibilities:
- Pre-processing using Hive and Pig;
- Knowledge of Troubleshooting Core Java Applications is a plus;
- Assist MapReduce programs running on the Hadoop cluster;
- Excellent knowledge of Linux as Hadoop runs on Linux;
- Responsible for implementation and support of the Enterprise Hadoop environment;
- Be a part of a POC team and help build new Hadoop clusters Performing cluster coordination services via Zookeeper;
- Managing and deploying HBase;
- Develop highly scalable and web services with exceptional performance, for data tracking;
- Involves designing, capacity arrangement, cluster set up, performance fine-tuning, monitoring, structure planning, scaling and administration;
- Fine tune applications and systems for high performance and higher volume throughput;
- Translate, load and exhibit unrelated data sets in various formats and sources like JSON, text files, Kafka queues, and log data.
Requirements:
- Bachelor’s in computer science or related field;
- Fluency in other programming languages such as Python, Scala, R with the ability to pick up new languages and technologies quickly;
- Knowledge and understanding of operating systems, networks and services;
- Expert knowledge of Hadoop;
- Big Data querying tools such as Drill, Presto, Hive etc;
- Big Data Components/Frameworks such as Hadoop (MapR), Spark, Yarn, Kafka, Flink, ELK etc;
- Experience with Docker or other Containerization technologies;
- Openshift;
- Experience maintaining Hadoop Clusters;
- Development tools such as GIT, and familiarity with collaboration tools such as Jira and Confluence or similar tools;
- Strong analytical, research, and problem-solving skills;
- Monitoring tools like Grafana, Splunk etc;
- NoSQL databases such as HBase, Cassandra, MapR DB;
- Ambari;
- Experience using AWS/EMR for enterprise IT.