Lead Engineer, Data Platform

Role Description

Lead Engineer, Data Platform

• 8 - 10 years of experience in data engineering and designing scalable ETL pipelines
• Advanced Proficiency in Hadoop, Scala, Spark, Kafka and SQL
• 6+ years of experience with cloud platforms like Azure, AWS, Google
• Skilled at architecting large and complex data pipelines
• Experience performing data analysis and data exploration
• Experience working with Cloud technologies, Azure, Databricks, ADLS, Spark, Cosmos DB, and other big data technologies
• Experience working in an agile delivery environment
• Experience working in multi-developer environment, using version control
• Excellent knowledge in data structures and design patterns
• Preferred experience with data integration tools
• Work with cross-functional agile teams to drive projects through the full development cycle
• Help the team improve with the usage of data engineering best practices
• Write SQL for processing raw data, data validation and QA
• Knowledge working with APIs to collect or ingest data
• Strong Database knowledge, SQL & No-SQL preferred
• Strong communication skills, with the ability to initiate and drive projects proactively and accurately
• Problem-Solving Skills: Ability to look at an issue that needs to be solved and come up with solutions quickly
• Experience integrating and building data platform in support of BI, Analytics, Data Science, and real-time applications

Qualifications

• Strong communication skills
• Problem-solving skills

Requirements

• 8 - 10 years of experience in data engineering
• Advanced proficiency in Hadoop, Scala, Spark, Kafka, and SQL
• 6+ years of experience with cloud platforms
• Experience in agile delivery environments
• Experience in multi-developer environments
• Excellent knowledge in data structures and design patterns
• Experience with data integration tools
• Strong database knowledge

Company Description