Azure Tech Lead with Data Lake

Job Posting

For Onsite Location: New Hyde Park NY Client: B2B Auto part retailer Duration Long Term

Job Description

7+ years of experience in working with Microsoft Azure as tech lead and strong knowledge about Even Hub, ADLS, Blob Storage, Data Factory, Data Bricks, Synapse (SQL WH), IoT Central, C#, PowerShell, etc. 7+ years of strong SQL experience 5+ years of experience in Designing, building and launching extremely efficient & reliable data pipelines for movement of data to and from disparate source systems 5+ years of building and launching new data models that provide intuitive analytics for the analysts and customers Must have strong experience in Data Warehouse ETL design and development, methodologies, tools, processes and best practices Experience in working with Power BI 3+ years of development experience in Open Source technologies like Python preferred Strong Computer Science and Mathematics background preferred Experience in Big Data processing using Apache Hadoop/Spark ecosystem applications like Hadoop, Hive, Spark, Kafka and HDFS preferable preferred Excellent query writing skill and communication skills preferred Familiarity with common APIs: REST, SOAP preferred Data/Data Lake centric solutions and applications Design and create ETL pipelines using Microsoft and Apache Open source technologies Create real time data streaming and processing using Open source technologies like Event Hub, Kafka, Spark etc. Work on creating data pipelines to maintain Data lake and Data Warehouses in Azure Cloud Work with systems that handle sensitive data with strict SOX controls and change management processes Develop collaborative relationships with key business sponsors and IT resources for the efficient resolution of work requests. Provide timely and accurate estimates for newly proposed functionality enhancements Communicate technical and business topics, as appropriate, in a 360-degree fashion, when required; communicate using written, verbal and/or presentation materials as necessary. Utilize technical and domain knowledge to develop and implement effective solutions; provide hands on mentoring to team members through all phases of the Systems Development Life Cycle (SDLC) using Agile practices.