Senior Hadoop Developer

Role Description

A Hadoop/Spark/Scala developer is responsible for the design, development and operations of systems that store and manage large amounts of data. Most Hadoop developers have a computer software background and have a degree in information systems, software engineering, computer science, or mathematics.

IT Developers are responsible for development, programming, coding of Information Technology solutions, including:

• Documenting detailed system specifications.
• Participation in unit testing and maintenance of planned and unplanned internally developed applications.
• Evaluation and performance testing of purchased products.
• Including IT Controls to protect the confidentiality, integrity, and availability of the application and data processed or output by the application.
• Assigned to moderately complex development projects.

Essential Functions:

• Write code for moderately complex system designs and programs that span platforms.
• Code and/or create Application Programming Interfaces (APIs).
• Enhance existing programs or develop new programs.
• Review code developed by other IT Developers.
• Provide input to and drive programming standards.
• Write detailed technical specifications for subsystems and identify integration points.
• Report missing elements found in system and functional requirements and explain impacts on subsystem to team members.
• Consult with other IT Developers, Business Analysts, Systems Analysts, Project Managers, and vendors.
• Scope time, resources, etc., required to complete programming projects and seek review from other IT Developers, Business Analysts, Systems Analysts, or Project Managers on estimates.
• Perform unit testing and debugging, setting test conditions based upon code specifications.
• Support transition of application throughout the Product Development life cycle and document what has to be migrated.
• Research vendor products/alternatives and conduct vendor product gap analysis/comparison.
• Accountable for including IT Controls and following standard corporate practices.
• The essential functions listed represent the major duties of this role; additional duties may be assigned.

Qualifications

• Experience and understanding with unit testing, release procedures, coding design and documentation protocol as well as change management procedures.
• Proficiency using versioning tools.
• Thorough knowledge of Information Technology fields and computer systems.
• Demonstrated organizational, analytical and interpersonal skills.
• Flexible team player.
• Ability to manage tasks independently and take ownership of responsibilities.
• Ability to learn from mistakes and apply constructive feedback to improve performance.
• Must demonstrate initiative and effective independent decision-making skills.
• Ability to communicate technical information clearly and articulately.
• Ability to adapt to a rapidly changing environment.
• In-depth understanding of the systems development life cycle.
• Proficiency programming in more than one object-oriented programming language.
• Proficiency using standard desktop applications such as MS Suite and flowcharting tools such as Visio.
• Proficiency using debugging tools.
• High critical thinking skills to evaluate alternatives and present solutions that are consistent with business objectives and strategy.

Requirements

• HADOOP
• Spark
• Scala

Experience

• 5-8 years related work experience or equivalent combination of transferable experience and education.
• IT development/programming/coding professional within a Hadoop environment.
• Experience with Agile Methodology.

Required Education

• Related Bachelor's degree in an IT related field or relevant work experience.