Senior Data Engineer

Senior Data Engineer

As a Senior Data Engineer, the candidate will be responsible in integrating, analyzing raw data, developing, and maintaining datasets and improving data quality and efficiency. The engineer needs to have strong analytical skills and will involve various methods to integrate different data sources, transform data into useful business drivers. Candidate should be intimate with several data stores, integration tools/technologies, data transformation methods, data modelling and analysis. Candidate should be able to work across projects involving multiple stakeholders. Having strong technical and programming skills while working with business, architects, partners to resolve complex system issues.

Responsibilities

• Develops and maintains scalable data pipelines, integration tools and builds out new API integrations to support continuing increases in data usage, volume, and complexity.
• Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition.
• Designs data integrations, data quality framework and integrate it with monitoring services. Strong hands on capabilities across integration toolsets including but not limited to ADF, Replication, CDC etc.
• Integrate data from different SOR's, combine raw information and create resulting models ready for consumption.
• Interpret trends and patterns.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, DB, SQL, and data pipelines performance tuning, optimizing data delivery, and automating manual processes
• Build solution prototypes as needed and write algorithms against data.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
• Works closely with a team of frontend and backend engineers, product managers, and analysts
• Data Management, Modelling, Architecture, and Integration

Experience And Competencies Minimum Requirements

• Bachelor's degree in data analytics or similar field.
• Hands-on 7+ years' experience with SQL, Data integration, Data analysis, Data Modelling, and design
• 4+ years of Python, NodeJs or Java development experience
• 4+ years of experience with schema design and dimensional data modeling
• Experience in technology platforms across Microsoft Azure, Cloud Computing, Software as a Services (SaaS), Integration Platform as a Service (IPaaS), Infrastructure as a Service (IaaS)
• Previous experience as a data engineer or in a similar role
• Technical expertise with data models, data mining, and segmentation techniques
• Experience working and implementing solutions with Microservices Architecture
• Experience working with Data warehousing and Data Lake solutions.
• Demonstrated ability to instrument Data Quality & Management standards and processes.
• 4+ years working with data integration and ETL tools, such as Azure Data Factory, CDC, Replication, Talend, Informatica etc.
• Strong problem-solving and analytical skills

Highly Desired

• Master's degree in data analytics or related field
• Data engineering certifications is a plus

There will be periodic requirements to travel for in-person events, at the discretion of your manager or the requirement of the company.