GCP Data Engineer
Akaasa Technologies
Job Title :: GCP Data Engineer
Location :: 100% Remote
Job Description:
- 8+ years of experience in data engineering, with hands-on expertise in designing, building, and maintaining scalable data pipelines.
- Deep expertise in Google Cloud Platform (GCP) services, especially BigQuery, Cloud Storage, Cloud Composer (Airflow), and Dataproc.
- Proficient in building and maintaining ETL/ELT pipelines using Python, SQL, and orchestration tools.
- Strong understanding of distributed data processing frameworks such as Apache Spark and Hadoop.
- Strong understanding of data modeling, data warehousing, and query performance optimization.
- Experience with CI/CD pipelines, infrastructure as code (Terraform, Cloud Deployment Manager), and DevOps practices in a cloud environment.
- Build automated CI/CD pipeline using Cloud Build, GitHub Actions, or Jenkins for deploying data pipeline code and workflows. Set up observability using Cloud Monitoring, Cloud Logging, and Error Reporting to ensure pipeline reliability.
- Develop integrations with external systems (APIs, flat files etc)
- Familiarity with data governance, security, and compliance in cloud-based data platforms.
- Experience with streaming data pipelines using tools like Pub/Sub, Dataflow, or Kafka.
- Required AI background
- Ability to work independently and collaboratively in cross-functional teams, including data scientists, analysts, and product engineers.
- Effective communication skills and a proactive approach to problem-solving.
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GCP Data Engineer. Be the first to apply!
