data engineer

Data Engineer

Data engineer who has worked on setting up data pipeline in analytics projects. Should have strong knowledge of Python, AWS, S3, EMR. Knowledge of Redshift, Athena, Airflow is preferable.

Job Functions:

• Build an understanding of data sources and downstream systems
• Liaise with key stakeholders to understand requirements, business definitions and the potential value of different data sets
• Support, design, implement and document solutions for loading, piping and exposing data from multiple sources
• Support and build well-engineered data systems to support analytical needs using AWS
• Assure accuracy of data processing and outputs through consistently high software development skills, adherence to best practice, thorough testing and peer reviews
• Approach problem solving with creativity and resourcefulness; carefully evaluate risks and determine correct courses of action when completing tasks

Skills/Abilities:

• Demonstrable professional experience designing, building, and maintaining data systems and processes using AWS Big Data Platform
• Demonstrable, hands-on professional Data Analytics skills using Python, SQL. Java is a plus.
• Excellent verbal and written communications skills with the ability to clearly present ideas, concepts, and solutions
• Demonstrated willingness and ability to effectively work with various team members when gathering requirements, delivering solutions, and eliciting suggestions and feedback
• Extremely quick learner both in terms of new technical skills and acquiring domain knowledge

Experience:

• Experience working in Python development environments for Data wrangling and analytics.
• Expertise using cloud-based systems and services to acquire and deliver data via APIs and flat files
• Extensive hands-on experience working with data using SQL.
• Extensive hands-on experience working with AWS S3, EMR, Redshift. [Glue a Plus]

Education:

Bachelor's Degree in Computer Science or closely related discipline