GCP Senior Data Engineer

GCP Senior Data Engineer

Role Name: GCP Senior Data Engineer



Work Site: Canada Remote



Start Date: Immediate Availability


Role Summary

We are seeking a GCP Senior Data Engineer with strong expertise in cloud data engineering, distributed processing, and GCP data services. The role will focus on building and optimizing scalable ETL/ELT pipelines, managing data infrastructure, and supporting advanced analytics and ML use cases.

Key Responsibilities

• Build and optimize ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), Pub/Sub, and Cloud Functions.

• Architect and manage BigQuery, Cloud Storage, and Data Fusion for data ingestion, transformation, and storage.

• Implement data validation, lineage, and metadata management using tools such as Data Catalog and dbt .

• Optimize pipeline performance, query efficiency, and GCP costs , including partitioning and slot reservations.

• Establish and maintain CI/CD, Git, infrastructure-as-code, monitoring, and data engineering standards .

• Mentor junior engineers and conduct code reviews.

• Collaborate with data architects, data scientists, and analysts to deliver self-service data platforms.

• Support advanced analytics and machine learning use cases.

• Implement monitoring and operational visibility using Cloud Monitoring and Cloud Logging .

Required Skills Technical

• Strong SQL and Python skills.

• Proficiency in Java/Scala .

• Experience with distributed systems including Spark and Apache Beam .

GCP

• Hands-on experience with:

  • BigQuery

  • Dataflow

  • Dataproc

  • Pub/Sub

  • Composer (Airflow)

  • Terraform

DevOps

• Experience with CI/CD, Git, and Infrastructure as Code .

Nice to Have

• GCP certifications, such as Professional Data Engineer .

• Experience with real-time data processing .

• Experience with Vertex AI .

• Multi-cloud environment experience.