Cloud Data Engineer- Azure/Databricks/Snowflake

Cloud Data Engineer- Azure/Databricks/SnowflakeLocation - NYC, NY or Iselin, NJ12+ months – hybrid 3 days in office / 2 days remoteKey RequirementsMust have pipeline development, platform setup and configuration experienceStrong SQL and PySpark skills (must be able to answer SQL merge statements and SCD-related questions)MUST HAVE Hands-on experience with Databricks, ADF, and Snowflake platform setup and configurationSolid understanding of Azure cloud environment and DevOps/IaC conceptsExperience with pipeline development and platform configuration of Databricks, ADF and SnowflakeAbility to explain how and why solutions were implemented – not just tasks completedStrong problem-solving, communication, and independent working skillsDay to DayDatabricks -must be able toConfigure and manage clusters (auto-scaling, runtime versions, troubleshooting)Build ETL pipelines with PySpark and Databricks notebooksSet up and manage Unity Catalog for data governanceOptimize performance (Delta Lake tuning, caching, partitioning)Azure Data Factory (ADF) – must be able toBuild and manage end-to-end data pipelinesConnect to multiple data sources (SQL, REST APIs, Blob storage, Snowflake)Implement triggers, parameters, variables, and monitoringSnowflake – must be able toDesign and maintain data warehouses and ETL/ELT pipelinesApply SQL and Data Warehousing concepts (SCD Type 1/2, star schema, partitioning)Configure virtual warehouses, access control, and performance tuningIntegrate with Databricks, ADF, and BI toolsMatrix - Information NeededWhere do you live?What is your work auth status?How many years of experience do you have in the following:Platform set up and configuration in Databricks/ADF/SnowflakeDatabricks Configure/manage clustersBuild ETL pipelinesUnity CatalogAzure Data Factory (ADF) Build end to end pipelinesConnect data sourcesSnowflake Design DW and ETL/ELT pipelinesConfigure virtual warehousesIntegration with BI tools and DatabricksSQL