Job Title: Azure Databricks
Location: US NJ Branch
Years of Experience: 7 10 Years
Job Summary:
We are seeking a highly skilled and motivated Technical Team Lead with extensive experience in Azure Databricks to join our dynamic team. The ideal candidate will possess a strong technical background, exceptional leadership abilities, and a passion for driving innovative solutions. As a Technical Team Lead, you will be responsible for guiding a team of developers and engineers in the design, development, and implementation of data driven solutions that leverage Azure Databricks.
Responsibilities:
Lead and mentor a team of technical professionals, fostering a collaborative and high performance culture.
Design and implement data processing solutions using Azure Databricks, ensuring scalability and efficiency.
Collaborate with cross functional teams to gather requirements and translate them into technical specifications.
Oversee the development lifecycle, from planning and design to deployment and maintenance.
Conduct code reviews and provide constructive feedback to team members to ensure code quality and adherence to best practices.
Stay up to date with industry trends and emerging technologies related to Azure Databricks and data engineering.
Facilitate communication between technical and non technical stakeholders to ensure alignment on project goals.
Identify and mitigate risks associated with project delivery and team performance.
Mandatory Skills:
Ingestion with experience in Jason/XML
Experience in medallion architecture and associates to be very clear on different activities in each layer, writing data into bronze layer, flattening data in silver layer etc
PySpark coding skills with sample code tests scenarios.
Databricks UI - like lineage and other features on UI
Data modelling is mandatory for onshore profiles and good to have for offshore profiles.
Autoloader is good to have.
Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes.
Strong programming skills in languages such as Python, Scala, or SQL.
Experience with cloud based data storage solutions, particularly Azure Data Lake Storage and Azure SQL Database.
Solid understanding of data modeling, ETL processes, and data warehousing concepts.
Demonstrated ability to lead technical teams and manage multiple projects simultaneously.
Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field.
7 10 years of experience in data engineering, software development, or a related technical role.
Proven track record of leading technical teams and delivering successful projects.
Relevant certifications in Azure or data engineering are a plus.
If you are a passionate Technical Team Lead with a strong background in Azure Databricks and a desire to drive innovation, we encourage you to apply and join our team at Selective Insurance.
The pay range for this role is
***k - ***k
per annum including any bonuses or variable pay. *** also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate.
*** is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities.
Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at
*** ."

Tech Lead