AWS Data Engineer

AWS Data Engineer

This position is responsible for design, development and management of data workflows and pipelines in our Integrated Data and Analytics environment. The role is a blend of technical leadership, team leadership, and hands-on development.

Responsibilities/Tasks:

• Responsible for collecting, moving, storing, and preparing data for analytics enablement.
• Participates in project planning sessions, working closely with business analysts and team members to analyze requirements and provides design recommendations for complex systems.
• Designs and develops new data pipelines for ingesting high-volume data sets.
• Develops pipelines using disciplined processes, adhering to industry standards and best practices, including complete ease with agile development methods throughout the SDLC.
• Demonstrates processes to all stakeholders.
• Shares knowledge and provide technical guidance to other team members within area of expertise.
• Takes part in reviews of work, e.g. design and code reviews.
• Works with team members to analyze and understand problems with complex systems and resolve them.
• Resolves customer complaints and respond with suggestions for improvements and enhancements.

Employment Qualifications:

Experience:

2 years’ experience in application development. At least five years of experience in AWS big data services/technologies (Spark, Scala, Data Factory, Data Bricks, Synapse Analytics).

Skills/Knowledge/Abilities (SKA) Required:

• Strong analytic skills related to working with structured/unstructured datasets.
• Experience with AWS cloud services like EC2, S3, Glue, SNS, SQS
• Experience with programming languages(like Python, Java)
• Collaborate with data architects from multiple platforms
• Good to have knowledge on Sales Force, Kafka, Informatica Cloud
• Excellent documentation and presentation skills
• Experience with Databricks and Delta Lake
• Strong background in traditional ETL tools (SSIS, Informatica)
• Understanding of Reporting and Data Visualization tools (PowerBI, Tableau, SSRS)
• Agile software process
• Strong coding skills (Python, R, Scala, Java,)
• Working experiences of test-driven development framework.
• Excellent inter-personal and communication skills.
• Ability to multi-task in a fast-paced environment.
• Flexibility to adapt to changing business needs.
• Team player who is delivery-oriented and takes responsibility for the team’s success.
• Enthusiastic, can-do attitude with the drive to continually learn and improve.
• Highly self-motivated, creative and able to dive deep in problem solving.