Senior Application Developer

Senior Application DeveloperPosition Specifications:Bachelor's degree in Computer Science, Engineering, or a related fieldMinimum of 5 years' programming experience which includes a minimum of one year working with big data platform, experience in data engineering domain, Python, SQL, and cloud platforms such as AzureFamiliarity with the relevant systems, tools, languages and business domain which includes: Data lakehouse principles, relational and Kimball data models requiredExperience with CI/CD pipelines and version control tools requiredKnowledge of data visualization tools and BI platforms preferredCertification in Databricks or relevant cloud platforms preferredMajor Duties:Design, build, and maintain scalable data pipelines on Databricks (using Spark, Delta Lake, etc.)Write clean, efficient and maintainable PySpark or SQL code for data transformationDesign robust data models for analytics and reportingEnsure data quality, consistency, and governanceHandle batch and streaming data workflowsProvide architectural guidance and support in platform usageDrive best practices in data engineering across the teamMonitor and optimize performance of Spark jobs and cluster usageEnsure compliance with security and data privacy standardsExplanatory Comments:Ability to analyze large datasets and identify patterns, trends, and anomaliesIdentify and troubleshoot issues in data pipelines, workflows, or infrastructureEnsure data accuracy, integrity, and security during processing and transformationManage multiple tasks and deadlines, such as development, testing, and deploymentTranslate technical concepts into actional insights for stakeholdersExcellent problem-solving and debugging skillsStrong communication and stakeholder collaboration abilitiesAbility to lead initiative and mentor junior team members