Data Engineer / ETL Developer

Position Overview: We are seeking a skilled and motivated Data Warehouse and Reporting Engineer to join our team. The ideal candidate has extensive experience working with databases such as PostgreSQL and MySQL, proficient in Python scripting, possesses expertise in ETL (Extract, Transform, Load) processes, and is well-versed in designing and maintaining data lakes and data warehouses. This role requires a strong foundation in data architecture, data modeling, and reporting to ensure our data infrastructure supports efficient analytics and reporting operations.

Key Responsibilities:

1. Data Warehouse Design and Management:
   • Collaborate with cross-functional teams to design, develop, and optimize data warehouse solutions tailored to business requirements.
   • Create and maintain data models, schemas, and structures for efficient storage and retrieval of data.
   • Monitor and enhance data warehouse performance and scalability to accommodate growing data volumes.
2. ETL Development:
   • Design and implement ETL processes to extract data from various sources, transform it to meet business needs, and load it into the data warehouse.
   • Develop and maintain ETL pipelines using industry best practices and tools.
3. Data Lake Implementation:
   • Work with the team to design and build scalable data lake solutions for storing raw and processed data.
   • Implement data governance and security measures to ensure data integrity and compliance.
4. Reporting and Analytics:
   • Collaborate with stakeholders to understand reporting requirements and design effective dashboards, visualizations, and reports.
   • Develop reporting solutions that provide actionable insights to drive business decisions.
5. Database Management:
   • Administer and optimize PostgreSQL, MySQL, and other database systems to ensure high availability, performance, and data integrity.
   • Monitor database performance and troubleshoot issues as they arise.
6. Scripting and Automation:
   • Utilize Python scripting to automate data processing tasks, data quality checks, and other routine operations.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent experience).
• Proven experience (5-7 years) as a Data Warehouse Engineer, ETL Developer, or similar role.
• Strong proficiency in PostgreSQL, MySQL, and other relational databases.
• Expertise in designing and optimizing data warehouse solutions.
• Proficiency in ETL tools and processes.
• Experience with data lake architecture and management.
• Advanced knowledge of Python programming for data manipulation and automation.
• Familiarity with reporting and analytics tools such as Tableau, Power BI, or similar.
• Strong problem-solving skills and the ability to work in a collaborative team environment.
• Excellent communication skills to interact with technical and non-technical stakeholders.

Preferred:

• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
• Knowledge of data governance, security, and compliance best practices.
• Familiarity with data streaming technologies (e.g., Kafka, Spark Streaming).
• Certification in relevant areas (e.g., AWS Certified Data Analytics, Google Cloud Professional Data Engineer).