GCP Data Engineer

Job Posting

Principal duties:

• A solid experience and understanding of considerations for largescale solutioning and operationalization of data warehouses, data lakes, and analytics platforms on GCP is a must
• Works on creating a framework for ML and LLM Ops
• Works on processes and flow of AI Compliance Governance framework
• Monitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right times
• Create reports to monitor usage data for billing and SLA tracking
• Work with business and crossfunctional teams to gather and document requirements to meet business needs
• Provide support as required to ensure the availability and performance of ETL/ELT jobs
• Provide technical assistance and cross training to business and internal team members
• Collaborate with business partners for continuous improvement opportunities

Requirements:

Experience Skills Qualifications:

• 6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics
• Very strong hands on Python expertise
• Strong Data and GCP Vertex AI knowledge
• 6 years of experience with one of the leading public clouds
• 6 years of experience in design and build of salable data pipelines that deal with extraction, transformation, and loading
• 6 years of experience with Python, Scala, with working knowledge on Notebooks
• 6 years hands on experience on GCP Cloud data implementation projects Dataflow, DataProc, Cloud Composer, Big Query, Cloud Storage, GKE, Airflow, etc
• At least 5 years of experience in Data governance and Metadata Management
• Ability to work independently, solve problems, update the stakeholders
• Analyze, design, develop, and deploy solutions as per business requirements
• Strong understanding of relational and dimensional data modeling
• Experience in DevOps and CICD related technologies
• Excellent written, verbal communication skills including experience in technical documentation and ability to communicate with senior business managers and executives

Skills:

Mandatory Skills:

AI/GenAI Research

Required Skills:

Architecture

Basic Qualification:

Additional Skills:

Background Check: No

Drug Screen: No