Big Data Engineer

Big Data EngineerVisa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes SO#000452348623 Austin, TXSkill Description - Hadoop, Kafka, Hbase, Spark, big data adminEssential Functions:Perform Big Data Platform Administration and Engineering activities on multiple Hadoop, Kafka, Hbase, and Spark clustersWork on Performance Tuning and Increase Operational efficiency on a continuous basisMonitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvementsWorking closely with development, engineering, and operation teams jointly work on key deliverables ensuring production scalability and stabilityDevelop and enhance platform best practicesEnsure the Hadoop platform can effectively meet performance & SLA requirementsResponsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow, Nifi, Hbase, etcPerform optimization, debugging, and capacity planning of a Big Data clusterPerform security remediation, automation, and self heal as per the requirementQualifications:Basic Qualifications:2 years of work experience with a Bachelor's Degree or an Advanced DegreeHands on Experience in Hadoop Admin, Hive, Spark, Kafka is mustPreferred Qualifications:Minimum 3 years of work experience in maintaining optimization issue resolution of Big Data large scale clusters supporting Business users and Batch processHands-on Experience No SQL Databases HBASE is plusPrior Experience in Linux / Unix OS Services Administration Shell awk scripting is a plusExcellent oral and written communication and presentation skillsAnalytical and problem solving skillsSelf-driven Ability to work independently and as part of a team with proven track recordExperience on Hortonworks distribution or Open Source preferredWork Hours:Incumbent must make themselves available during core business hours. Occasional weekend and evening hours needed on a rotational basis for operational support.Travel Requirements:This position requires the incumbent to travel for work 5% of the time.Physical Requirements:This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone frequently, operate standard office equipment such as telephones and computers, and reach with hands and arms.