Associate Principal - Architecture

Role description

Role Databricks Architect Sr Data Engineer

Location Edison NJ Rmote


Must Haves

1 Candidate should have at 6 yrs of experience working on data workflow development in Azure stack with Databricks and ADF as Primary skill

2 Strong understanding of Azure service components like SQL DB SQL Server Synapse Data Bricks ADLS Blob storage ADF

3 Candidate should have a good understanding of developing end to end data ingestion pipelines in ADF and using ADF for ETLELT orchestration

4 Very strong experience in Data Bricks Must be able to develop and optimize Data bricks notebooks and jobs Experience in Python Spark Scala would be great

5 Should have excellent SQL skills which includes knowledge of SQL Server DDLs to create the data models and complex SQL calculation scripts for manipulating data per business logic

6 Must have a working experience in Databricks Asset Builder Azure DevOps and CICD tools at each phase of the SDLC cycle

Good to have

7 Should be adept at using tools to migrate existing data structures into SQL Server Synapse for migration projects

8 Should understand data quality concepts and write SQL scripts for specific for DQ checks

9 Exposure to other Azure components like Blob storage Logic Apps AAS Power BI will be beneficial

10 Should be able to direct junior team members for proper design and development

11 Should have good communication skills Candidate if required need to coordinate with Microsoft for issue resolutions