Big Data Developer - Albany, NY

Big Data DeveloperImmediate Duties and Responsibilities:Deploying, automating, maintaining and managing AWS cloud based production system, to ensure the availability, performance, scalability and security of productions systems.Build, release and configuration management of production systems.Design, Build and support Hadoop system.Translate complex functional and technical requirements into detailed design.Create scalable and high-performance web services for data tracking.Loading from disparate data sets o Pre-processing using Hive and Pig.Writing high-performance, reliable and maintainable code.Skills and Competencies: Should have over all minimum 6+ years of IT experience out of which 3+ years of strong technical experience in following areas:AWS, Lambda, S3, AWS CLIHadoop - Yarn, Tez, HDFS, CLI, Java APIApache Spark - Pyspark, Spark Core, SparkSQL, Scala, JDBCCore Java - Maven, Class, methods, dependencies, build managementHive - strong HQL, Java API, DMLExperience in working with below eco systems:SqoopHbasePhoenixZookeeperHueLinux – Scripting, Hadoop Linux ecosystem - conf files o Python – Scripting for connecting different eco systems etc.Hive - strong HQL, Java API, DMLApache Spark - Pyspark, Spark Core, SparkSQL, Scala, JDBCCloudformation, Elastic map reduceAWS certification will be an added advantageHealthCare knowledge will be an added advantage. Communication skills and Education requirements to be added as per Client Syntel standards.