GCP Data Engineer

GCP Data Engineer: SAM

The SAM team is seeking an experienced Data Engineer with a passion for developing and implementing data solutions in Google Cloud Platform. The ideal candidate will have hands-on experience working with tools such as Data Flow, Pub/Sub, Cloud Composer (Apache Airflow), and have experience with deploying streaming pipelines.

The candidate must be inquisitive, detail oriented, and highly motivated for delivering high-quality solutions. They must possess excellent communications skills, strong work ethic, and the ability to thrive in a fast paced, changing, high pressure environment.

Responsibilities:

• Design, develop, and maintain data pipelines to move and transform data from various sources into a unified data platform on BigQuery
• Build and maintain scalable data architecture and infrastructure that can handle large volumes of data with high velocity
• Collaborate with data scientists, analysts, and business stakeholders to understand the data needs and provide solutions to enable them to access the data they require
• Monitor and troubleshoot data pipelines to ensure their reliability and performance
• Automate manual processes and tasks, and continuously look for ways to improve efficiency and reduce costs
• Implement and maintain data security and privacy policies to ensure compliance with regulatory requirements
• Stay up to date with industry trends and emerging technologies and evaluate their potential impact on our data platform.