Developer

Job title: Developer

Duration: 12 months

Location: Hybrid (Newark, NJ)

Designs, implements and manages software programs

Works with client management to identify and specify the business requirements and processes for diverse development platforms, computing environments e.g., host based, distributed systems, client server, software, hardware, technologies and tools

Researches and evaluates alternative solutions, and recommends the most efficient and cost effective solution for the systems program design and develops systems specifications and procedures

Recommends the equipment platform needed for its solution, and prepares logic flow charts and machine instructions

Formulates logical statements of business requirements and with some guidance, devises, tests and implements efficient, cost effective application program solutions e.g., codes and or reuses existing codes through the use of program development software alternatives and or integrates purchased solutions

Devises data verification methods and standard systems procedures and participates in systems testing

Skills

1. Design and development of batch and real-time data pipelines using AWS Data & Analytics Services such as AWS Glue, Athena, Lambda, Redshift etc.,

2. Experience in building complex data processing and ETL jobs using Pyspark and SQL

3. Experience in ingesting and processing structured and semi-structured data

4. Exposure to data warehousing, data lake and lake house architectures

5. Good understanding of different data modeling techniques

6. Ability to optimize cost and improve performance of data pipelines

7. Exposure to CI/CD process

8. Knowledge of best practices in securing data pipelines and data assets in AWS.

9. Knowledge of data quality and data governance processes is a plus.