Data Engineer

Position: Data Engineer

Location: Toronto (Onsite) possible F2F Interview

Job Description

• 6 8+ years of experience in supporting and managing data pipelines in production (L1/L2 support)
• Experience in Data Collection flows using CDC tools (e.g., Debezium) and file-based ingestion (CSV)
• Hands-on experience with GCP services including Pub/Sub, Dataflow (Apache Beam), and Datastream
• Experience working with Cloud SQL (PostgreSQL) environments
• Experience in CRM data ingestion and extraction into staging and harmonized data layers
• Understanding of API-based data enrichment within ingestion workflows
• Strong knowledge of production monitoring, alerting, and incident management processes
• Programming experience in Java for pipeline support and enhancements

Roles & Responsibilities

• Provide L1 and L2 operational support for data pipelines across staging and harmonized data layers
• Monitor data ingestion and extraction processes including CDC pipelines and CSV-based feeds, identifying failures, delays, and data inconsistencies
• Perform incident triage and analysis using logs, metrics, Pub/Sub events, and alerts; resolve known issues within SLA boundaries
• Support data enrichment workflows ensuring accurate and timely processing before downstream consumption
• Work with GCP Pub/Sub topics, subscriptions, DLQs, alerts, and scheduled jobs for monitoring and operations
• Support minor enhancements and configuration changes under guidance of senior engineers
• Assist in testing and validation in lower environments and support controlled production deployments
• Handle service requests, including data fixes, reruns, reconciliation, and contributing to RCA for recurring issues
• Perform monitoring and housekeeping activities across GCP components
• Maintain and update runbooks, operational procedures, and known issue documentation
• Continuously identify improvement opportunities for stability, reliability, and operational efficiency