GCP Data Engineer

The GCP Data Engineer will design, develop, and maintain scalable data pipelines and cloud-based data solutions on Google Cloud Platform (GCP). The role will focus on building data ingestion, transformation, batch and real-time processing, data warehousing, and data lake solutions while ensuring high standards of data quality, reliability, security, and performance. The engineer will collaborate with data analysts, data scientists, application teams, and other stakeholders to deliver cloud-native data solutions that support business requirements. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using GCP services. Build and manage data ingestion workflows from multiple structured and unstructured data sources. Develop batch and real-time data processing pipelines. Implement data transformation and orchestration using SQL, Python, and cloud-native tools. Optimize data models and storage solutions for performance and cost efficiency. Develop and maintain data warehouses and data lakes. Monitor, troubleshoot, and optimize data pipelines for reliability and performance. Implement data governance, security, and compliance best practices. Collaborate with data analysts, data scientists, and application teams to support business requirements. Automate deployment processes using CI/CD pipelines and Infrastructure as Code (IaC). Apply data modeling, data warehousing, and dimensional modeling practices to support scalable analytics solutions. Support data integration through REST APIs and other integration technologies. Required Qualifications 8+ years of experience in Data Engineering. Strong hands-on experience with Google Cloud Platform (GCP). Hands-on experience with BigQuery, Cloud Storage, Cloud Composer (Apache Airflow), Cloud Dataflow, Pub/Sub, Dataproc, Cloud Functions, and Cloud Run. Proficiency in Python or Java. Experience with Apache Spark and Apache Beam. Strong understanding of ETL/ELT frameworks and data integration techniques. Experience with Git, CI/CD pipelines, and DevOps practices. Strong understanding of data modeling, data warehousing, and dimensional modeling. Familiarity with REST APIs and data integration. Experience with monitoring and logging tools. Strong analytical and problem-solving skills. Excellent communication and collaboration skills with the ability to work independently and within cross-functional teams. Strong attention to detail and commitment to data quality. Preferred Qualifications Bachelor's degree in Computer Science, Information Technology, or a related field. Experience with Terraform or other Infrastructure as Code tools. Experience working in Agile/Scrum environments. Experience with Linux, Docker, and Kubernetes. Experience with Looker or Tableau. #J-18808-Ljbffr Compunnel