Big Data Engineer

Data Engineer San Jose, CA/PST Zone Duration: 1 year # of Positions: 2 Responsibilities Designing, developing & tuning data products, applications and integrations on large scale data platforms (Hadoop, Kafka Streaming, Hana, SQL server etc) with an emphasis on performance, reliability and scalability and most of all quality. Analyze the business needs, profile large data sets and build custom data models and applications to drive business decision making and customers experience Develop and extend design patterns, processes, standards, frameworks and reusable components for various data engineering functions/areas. Collaborate with key stakeholders including business team, engineering leads, architects, BSA's & program managers. Skills MS/BS in Computer Science / related technical field with 4+ years of strong hands-on experience in enterprise data warehousing / big data implementations & complex data solutions and frameworks Strong SQL, ETL, scripting and or programming skills with a preference towards Python, Java, Scala, shell scripting Demonstrated ability to clearly form and communicate ideas to both technical and non-technical audiences. Strong problem-solving skills with an ability to isolate, deconstruct and resolve complex data / engineering challenges Results driven with attention to detail, strong sense of ownership, and a commitment to up-leveling the broader IDS engineering team through mentoring, innovation and thought leadership Desired Skills Familiarity with streaming applications Experience in development methodologies like Agile / Scrum Strong Experience with Hadoop ETL/ Data Ingestion: Sqoop, Flume, Hive, Spark, Hbase Strong experience on SQL and PLSQL Nice to have experience in Real Time Data Ingestion using Kafka, Storm, Spark or Complex Event Processing Experience in Hadoop Data Consumption and Other Components: Hive, Hue HBase, Spark, Pig, Impala, Presto Central Business Solutions