Data Engineer

Advance Data Engineer We are seeking a highly skilled Advanced Data Engineer with a strong background in Databricks and a passion for data engineering. The ideal candidate will have extensive experience in designing and implementing data solutions using various technologies, including PySpark, Azure Data Factory, and Informatica Data Cloud Management. This role requires a proactive individual who can work independently and collaboratively in a fast paced environment. Responsibilities: Design, develop, and maintain scalable data pipelines using Databricks and PySpark. Implement data integration solutions using Azure Data Factory and manage data storage in Azure Storage Accounts. Utilize Informatica Data Cloud Management for data governance and quality assurance. Work with SQL, NoSQL, DB2, and JDBC to manage and query data effectively. Automate data processes and reporting using Microsoft Excel and Notepad++. Collaborate with cross functional teams to define data requirements and deliver solutions that meet business needs. Utilize version control systems such as GitHub and CI/CD tools like GitHub Actions and Jenkins for code management and deployment. Participate in Agile project management practices using JIRA and Confluence. Document processes and maintain knowledge bases in OneDrive. InterSources