Data Engineer

Data Engineer

Provide subject matter expertise and hands on delivery of data capture, curation and consumption pipelines on Azure. Delivery of design/architecture for transformations and modernizations of enterprise data solutions using Azure cloud data technologies. Design and Build Modern Data Pipelines and Data Streams. Design and Build Data Service APIs. Design and optimizing data models on Azure cloud using Azure data stores. Experience integrating Azure security services with Azure data services for building secure data solutions. Architecting and operating large production Hadoop/NoSQL clusters on premise or using Cloud services. Expose data to end users using Power BI, Azure API Apps or other modern visualization platform or experience. Mentoring the next wave of data engineers and providing skills and experience to enable clients to enhance their existing data pipelines.

Bachelor's degree in Computer Science, Engineering, Technical Science or 5-7 years of technical architecture and build experience with large scale solutions. At least 5-7 years experience in one or more languages (PowerShell, Python, C#, Open Source). At least 5-7 years of client services delivery experience on Azure. At least 5-7 years of experience in MS PaaS data services, but not limited to, such as Azure data factory, Azure data lake store, Azure function apps, Azure SQL/ Data Warehouse. At least 5-7 years of experience in developing, designing, and deploying end to end batch / real-time solutions. Professional experience in developing optimized stored procedures and performing analytical functions on the data sets. Experienced in enterprise ETL tools like SSIS, Informatica or likewise.

DevOps on an Azure platform. Hadoop experience: Cloudera, Hortonworks or Map R. Real-time ingestion: Kafka, Flume, etc.