Senior Hadoop Developer

Role Description

A Hadoop developer is responsible for the design, development, and operations of systems that store and manage large amounts of data. Most Hadoop developers have a computer software background and have a degree in information systems, software engineering, computer science, or mathematics.

IT Developers are responsible for development, programming, coding of Information Technology solutions. They are responsible for:

• Documenting detailed system specifications.
• Participation in unit testing and maintenance of planned and unplanned internally developed applications.
• Evaluation and performance testing of purchased products.
• Including IT Controls to protect the confidentiality, integrity, and availability of the application and data processed or output by the application.
• Assignment to moderately complex development projects.

Essential Functions:

• Write code for moderately complex system designs and programs that span platforms.
• Code and/or create Application Programming Interfaces (APIs).
• Enhance existing programs or develop new programs.
• Review code developed by other IT Developers.
• Provide input to and drive programming standards.
• Write detailed technical specifications for subsystems and identify integration points.
• Report missing elements found in system and functional requirements and explain impacts on subsystems to team members.
• Consult with other IT Developers, Business Analysts, Systems Analysts, Project Managers, and vendors.
• Scope time, resources, etc., required to complete programming projects.
• Seek review from other IT Developers, Business Analysts, Systems Analysts, or Project Managers on estimates.
• Perform unit testing and debugging, setting test conditions based upon code specifications.
• Support transition of application throughout the Product Development life cycle.
• Document what has to be migrated and coordinate points for subsystems.
• Research vendor products/alternatives and conduct vendor product gap analysis/comparison.
• Accountable for including IT Controls and following standard corporate practices.
• The essential functions listed represent the major duties of this role; additional duties may be assigned.

Qualifications

• Experience and understanding with unit testing, release procedures, coding design and documentation protocol as well as change management procedures.
• Proficiency using versioning tools.
• Thorough knowledge of Information Technology fields and computer systems.
• Demonstrated organizational, analytical, and interpersonal skills.
• Flexible team player.
• Ability to manage tasks independently and take ownership of responsibilities.
• Ability to learn from mistakes and apply constructive feedback to improve performance.
• Must demonstrate initiative and effective independent decision-making skills.
• Ability to communicate technical information clearly and articulately.
• Ability to adapt to a rapidly changing environment.
• In-depth understanding of the systems development life cycle.
• Proficiency programming in more than one object-oriented programming language.
• Proficiency using standard desktop applications such as MS Suite and flowcharting tools such as Visio.
• Proficiency using debugging tools.
• High critical thinking skills to evaluate alternatives and present solutions that are consistent with business objectives and strategy.

Requirements

• 5-8+ years related work experience or equivalent combination of transferable experience and education in IT development/programming/coding within a Hadoop environment.
• Experience working with Agile Methodology.
• Related Bachelor's degree in an IT related field or relevant work experience.
• Working knowledge of Spark/Scala/Hadoop.
• Experience in HIVE, Apache Hbase, Mongo A PLUS.
• Spark streaming with Kafka for real-time data A PLUS.
• Processing bulk/large volumes of data A PLUS.