Sr. Hadoop Developer

Role Description

A Hadoop/Spark/Scala developer is responsible for the design, development and operations of systems that store and manage large amounts of data. Most Hadoop developers have a computer software background and have a degree in information systems, software engineering, computer science, or mathematics.

IT Developers are responsible for development, programming, coding of Information Technology solutions, including:

• Documenting detailed system specifications
• Participation in unit testing and maintenance of planned and unplanned internally developed applications
• Evaluation and performance testing of purchased products
• Including IT Controls to protect the confidentiality, integrity, as well as availability of the application and data processed or output by the application
• Assigned to moderately complex development projects

Essential Functions:

• Write code for moderately complex system designs and programs that span platforms
• Code and/or create Application Programming Interfaces (APIs)
• Enhance existing programs or develop new programs
• Review code developed by other IT Developers
• Provide input to and drive programming standards
• Write detailed technical specifications for subsystems and identify integration points
• Report missing elements found in system and functional requirements and explain impacts on subsystem to team members
• Consult with other IT Developers, Business Analysts, Systems Analysts, Project Managers and vendors
• Scope time, resources, etc., required to complete programming projects
• Seek review from other IT Developers, Business Analysts, Systems Analysts or Project Managers on estimates
• Perform unit testing and debugging, setting test conditions based upon code specifications
• Support transition of application throughout the Product Development life cycle
• Document what has to be migrated and coordinate points for subsystems
• Research vendor products/alternatives and conduct vendor product gap analysis/comparison
• Accountable for including IT Controls and following standard corporate practices
• The essential functions listed represent the major duties of this role, additional duties may be assigned

Qualifications

• Experience and understanding with unit testing, release procedures, coding design and documentation protocol as well as change management procedures
• Proficiency using versioning tools
• Thorough knowledge of Information Technology fields and computer systems
• Demonstrated organizational, analytical and interpersonal skills
• Flexible team player
• Ability to manage tasks independently and take ownership of responsibilities
• Ability to learn from mistakes and apply constructive feedback to improve performance
• Must demonstrate initiative and effective independent decision-making skills
• Ability to communicate technical information clearly and articulately
• Ability to adapt to a rapidly changing environment
• In-depth understanding of the systems development life cycle
• Proficiency programming in more than one object-oriented programming language
• Proficiency using standard desktop applications such as MS Suite and flowcharting tools such as Visio
• Proficiency using debugging tools
• High critical thinking skills to evaluate alternatives and present solutions that are consistent with business objectives and strategy

Requirements

• Specific Tools/Languages Required:
• HADOOP
• Spark
• Scala
• 5-8 years related work experience or equivalent combination of transferable experience and education
• IT development/programming/coding professional within a Hadoop environment
• Experience with Agile Methodology

Required Education

• Related Bachelor's degree in an IT related field or relevant work experience