Data Engineer

Job Description:
We are seeking experienced Data Engineers in a contract capacity to join our talented Data Engineering team. In this role, you will contribute to designing and building robust, scalable data pipelines that ingest and transform over 30TB of data each day. The ideal candidate will work closely with data scientists, analysts, and engineering teams to ensure reliable data processing, high data quality, and efficient data delivery across the organization. This position requires strong expertise in modern data engineering practices, distributed data processing, and large-scale data pipeline development.


Key Responsibilities:
• Design, develop, and maintain scalable data pipelines for high-volume data ingestion and transformation.
• Build and optimize ETL/ELT workflows for processing large datasets efficiently.
• Work with structured and unstructured data from multiple data sources.
• Ensure data quality, reliability, and performance of data systems.
• Collaborate with data scientists, analysts, and engineering teams to support analytics and machine learning workloads.
• Monitor, troubleshoot, and improve performance of data pipelines and data infrastructure.
• Implement best practices for data modeling, governance, and security.
• Document data architecture, workflows, and operational processes.


Required Skills:
• Strong experience in Data Engineering and large-scale data processing
• Expertise in SQL and relational databases
• Experience with Python, Spark, or similar data processing frameworks
• Experience building ETL/ELT pipelines
• Familiarity with cloud platforms such as AWS, Azure, or GCP


Preferred Skills:
• Experience working with large-scale datasets (10TB+ daily pipelines)
• Knowledge of workflow orchestration tools such as Airflow or Prefect
• Experience with modern data warehousing tools like Snowflake or Databricks
• Familiarity with distributed systems and big data technologies.