Data Engineer

About the job Data Engineer -


The data engineer designs and develops data models, collects and analyzes data for insights and communicates how those findings improve reliability, customer experience, profitability and other relevant factors. He / She also captures, transforms and stores clean data, leaving it ready for consumption.

This role will be integral in ensuring the quality of the data collected, and the ability to leverage that data to create meaningful information for technical performance and strategic business decision making. It will provide the data insights and trends needed to evolve the product based on user behaviours and data trends.

RESPONSIBILITIES AND DUTIES

Ensure data requirements and delivery of robust and complete roadmap

Assess data to determine strategic approach to data management and identify data dictionary

Identify data security requirements and assess risk to determine security features

Assess computational power required derived from data and analytics technology

Estimate milestones, resources and costs

Produce data via SQL and other programming tools

Develop reports and dashboards

Design and develop data and information structures

Capture data and modify programs to extract information from company databases

Engage with data scientists and translators to understand how data should be presented

Improve data availability, acting as the link between the IT and analytics team

KNOWLEDGE AND SKILLS

SQL knowledge

Deep knowledge of machine learning, statistics and optimization

Advanced knowledge of statistical techniques, data mining, machine learning (regression, decision trees, clustering, random forests, generalized linear models, etc.)

Experience in database development and data model design

QUALIFICATIONS AND EXPERIENCE

BS/BA (preferred MS) degree preferably in computer science, statistics, mathematics or equivalent mix of education and experience

5+ years of experience in analyzing and preparing data, including considerable experience with very large data sets and unstructured data

Strong experience in database development and model design

Experience with R, Python, Matlab, C programming, C++, Java, Hadoop, Hive, Map reduces, Teradata, QSTK

DESIRED ATTRIBUTES AND BEHAVIOURAL COMPETENCIES

Strong business and collaboration skills

Skills to respond to service needs and operational demands

Problem solving skills

Attitude to thrive in a fun, fast rhythm of getting started as an environment

Able to build a sense of trust and rapport that creates a comfortable and effective workplace

SPECIAL CONDITIONS

Regularly work extended and irregular hours.

Pressure/stress from the need to meet tight deadlines

FUNCTIONAL RELATIONSHIPS

External:

Internal: Business leads

PERFORMANCE CRITERIA

Timely delivery of agreed daily, weekly and monthly KPIs