GCP Data Engineer

Job SummaryLocation - Remote We are looking for a highly skilled GCP Data Engineer with strong expertise in Scala, Apache Spark, and Google Cloud Platform (GCP) to design, develop, and optimize large-scale data processing solutions. The ideal candidate will have experience building cloud-native data pipelines, processing big data workloads, and implementing scalable data architectures on GCP.Key Responsibilities Design, develop, and maintain scalable data pipelines using Scala and Apache Spark.Build and optimize batch and real-time data processing solutions on Google Cloud Platform (GCP).Develop data ingestion, transformation, and orchestration workflows using GCP services.Work with large datasets and implement efficient ETL/ELT processes.Integrate data from various sources including databases, APIs, and streaming platforms.Monitor, troubleshoot, and improve data pipeline performance and reliability.Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.Implement data quality, governance, and security best practices.Participate in code reviews and contribute to engineering standards and best practices.Support production deployments and resolve data pipeline issues.Required Skills Technical SkillsStrong hands-on experience with Scala programming.Extensive experience with Apache Spark (Spark SQL, Spark Streaming, DataFrames, Datasets).Strong understanding of distributed computing concepts.Experience working with Google Cloud Platform (GCP) services such as: BigQueryCloud StorageDataprocDataflowPub/SubComposer (Airflow)Cloud FunctionsCloud RunExperience in ETL/ELT development and data warehousing concepts.Proficiency in SQL and database optimization.Experience with CI/CD pipelines and DevOps practices.Hands-on experience with Git and version control systems.Preferred SkillsExperience with Kafka or other streaming technologies.Knowledge of Python in addition to Scala.Familiarity with containerization technologies such as Docker and Kubernetes (GKE).Knowledge of data modeling and cloud data architecture.Experience with Terraform or Infrastructure as Code (IaC).Qualifications Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.4+ years of experience in Data Engineering, Big Data, or Cloud Data Platforms.Relevant GCP certifications are a plus: Professional Data EngineerAssociate Cloud EngineerNice to Have Experience with machine learning data pipelines.Exposure to multi-cloud environments (AWS/Azure).Experience working in Agile/Scrum teams.Key Competencies Strong analytical and problem-solving skills.Excellent communication and stakeholder management skills.Ability to work independently and collaboratively in a fast-paced environment.Focus on performance optimization and continuous improvement.