Data Engineer

Consultant, Software Development About the Opportunity We’re looking for a Senior Data Engineer – Snowflake & Azure with 10+ years of experience in database development and data engineering, including 4–5 years hands‑on with Snowflake and building production data pipelines on Azure. The role covers the full data platform stack: Snowflake architecture and development, Azure Data Factory pipelines, cloud integration patterns, and CI/CD practices. The position requires close collaboration with data architects, application engineers, and business stakeholders across our San Francisco and San Ramon offices. Candidate must be local and work from one of our offices in San Francisco or San Ramon. Responsibilities Design, develop, test, deploy, and maintain enterprise‑grade data solutions on Snowflake and Azure. Build and optimize ADF pipelines for ETL, data ingestion, and end‑to‑end orchestration between on‑premises and cloud systems. Configure and manage Azure Integration Runtime and Self‑Hosted Integration Runtime (SHIR) for secure on‑premises data movement. Ingest and transform data from diverse sources including SFTP, File Shares, SQL databases, Snowflake, and ADLS Gen2. Write and optimize Snowflake SQL, stored procedures, and transformation logic for performance and cost efficiency. Implement Snowflake best practices: clustering, partitioning, caching, micro‑partition pruning, and Query Profiler‑based tuning. Manage Snowflake configurations including virtual warehouses, resource monitors, stages, integrations, and RBAC. Automate data ingestion and metadata workflows using SnowSQL, Snowpipe, Streams, Tasks, and Dynamic Tables. Develop Azure Function Apps for event‑driven data integration scenarios. Support CI/CD workflows using Flyway, Git, and Azure DevOps for version control and pipeline deployment. Integrate Snowflake with reporting tools including SSRS and Tableau. Use Cortex AI/SQL to embed AI operations directly into SQL for multimodal data analysis. Use SnowConvert to migrate SQL scripts from SQL Server or Oracle to Snowflake. Stay current with Snowflake and Azure developments; lead proof‑of‑concepts for new capabilities. Write technical documentation and knowledge transfer plans for operational teams. Requirements 10+ years in database development, data engineering, or analytics. 5+ years of hands‑on Snowflake development and administration. 4–5 years building and maintaining ADF pipelines in production Azure environments. Strong SQL and SnowSQL proficiency; extensive T‑SQL stored procedure experience. Deep knowledge of Snowflake internals: Time Travel, Zero Copy Cloning, Streams, Tasks, Dynamic Tables. Solid grasp of data warehousing concepts, data modeling, and metadata management. Expertise in identity and access management, data masking, and security best practices. Demonstrated ability to diagnose and resolve performance and scalability issues in Snowflake and ADF. Preferred SnowPro Advanced Architect or Advanced Data Engineer certification. Experience with Azure SQL MI, ADLS Gen2, and broader Azure cloud services. Familiarity with Snowflake Intelligence for natural language querying and agentic AI workflows. Experience with Semantic Views, dbt Semantic Layer, and Gen2 Warehouses. Familiarity with Jira, ServiceNow, Confluence, and Azure DevOps. Strong communication skills, comfortable working across technical and business‑facing teams. Employee Benefits GSG is excited to offer its consultants excellent compensation and a robust option of benefits which include comprehensive medical, dental, vision and prescription coverage. You will receive company‑paid life insurance. In addition, we hope you will take advantage of eligible commuter benefits‑like paying for work‑related public transit and parking with pre‑tax dollars. Save for your retirement with pre‑tax contributions that go directly into your 401K. We also care about your pets with several options for pet insurance, discount card and prescriptions. GSG’s Commitment to Diversity As a diverse‑owned business, GSG is committed to creating a diverse workforce, and we are proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. #J-18808-Ljbffr