Data Engineering Lead

Data Engineering Lead

We are looking for a highly skilled Data Engineering Lead to spearhead the development and optimization of advanced data solutions. This role requires an individual with expertise in Informatica, SQL, and database technologies, who can lead a dynamic team to support business intelligence and analytics initiatives. The successful candidate will be responsible for the end-to-end design, implementation, and maintenance of scalable data systems that align with business needs.

Key Responsibilities:

• Design and Implementation: Lead the creation and optimization of data solutions that support business analytics, including ETL workflows, database management, and data integration using Informatica and PL/SQL.
• Team Leadership: Guide and mentor a team of engineers and developers, offering technical direction, support, and code reviews to ensure the high quality and efficiency of data systems.
• Cross-functional Collaboration: Work closely with business analysts, stakeholders, and product teams to translate business objectives into scalable and efficient data solutions.
• Hands-on Development: Play an active role in hands-on coding, debugging, and troubleshooting of data pipelines and workflows to ensure optimal system performance.
• Documentation & Reporting: Maintain clear and detailed documentation for all data solutions, including data architecture, ETL processes, and performance metrics. Ensure that technical specifications are well-defined and executed.
• Data Governance: Oversee the implementation of data quality standards and governance practices to ensure the integrity and reliability of data across pipelines.
• Incident Resolution: Proactively identify potential issues and lead troubleshooting efforts to resolve incidents related to data systems, collaborating with cross-functional teams to ensure prompt resolution.
• Continuous Improvement: Recommend and implement improvements to existing systems, applying modern tools and technologies to enhance performance, scalability, and security.
• Innovation: Explore and introduce new methodologies and technologies to continuously enhance data management processes and provide innovative solutions to business challenges.

Requirements Skills & Qualifications:

• Expertise in Informatica PowerCenter and other ETL tools, with advanced knowledge of data warehousing and performance optimization techniques.
• Strong command of SQL, PL/SQL, and experience with MSSQL, Teradata, and Oracle databases.
• Proven experience in data integration, ETL design, and database architecture.
• Deep understanding of cloud-based technologies, with experience in Azure, AWS, or GCP being a plus.
• Familiarity with big data technologies such as Hadoop, Hive, and Spark.
• Experience with Agile methodologies and familiarity with DevOps practices for code deployment.
• Strong problem-solving and troubleshooting skills with the ability to resolve complex technical issues.
• Excellent communication skills, with a track record of working effectively with both technical and non-technical stakeholders.
• Ability to lead projects from start to finish while maintaining a focus on quality, deadlines, and stakeholder needs.

Nice-to-Have:

• Experience with Python or Scala, and in-depth knowledge of customer profitability analysis or the financial services domain.

Position Details:

• Hands-on: Approximately 80% of the role will involve hands-on development, debugging, and troubleshooting of data systems.
• Innovation & Leadership: The remaining 20% will be dedicated to leading innovation initiatives, mentoring junior team members, and driving the evolution of our data systems.