Big Data Architect

Big Data Architect/DeveloperLocation: Edison, NJ or Downtown Manhattan, NYRequirements:10+ years industry related experience. Overall Experience - 10-15 YrsHave a deep understanding of information systems and their applications to data management processes.Clearly articulate the pros and cons of various technologies and platformsExcellent written and verbal communication skillsTo be able to help program and project managers in the design, planning and governance of implementing projects of any kindTo be able to perform detailed analysis of business problems and technical environments and use this in designing the solutionTo be able to work creatively and analytically in a problem-solving environmentTo be able to work in a fast-paced agile development environmentExperience with big data tools: Hadoop Eco System (Hive, Pig, Oozie, Spark, Kafka, Elastic search, Kibana)Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.Experience with stream-processing systems: Spark-Streaming, Storm etc.Experience with object-oriented/object function scripting languages: Python and ScalaAgile software processes, data driven development, hands-on with Scala/Java/Python, Kafka EcosystemExperience in one or more of the following technologies: Hadoop, Spark, Hive, Pig, SQL query, dependency management tools such as Luigi/AirflowExperience in data application development (ETL, MR) at scale in the Hadoop ecosystem, excellent communication skills and a team player.