BI ETL Sr developer /Lead developer

Role: BI ETL Sr /Lead developer

Location: Canada Remote

Mode: Contract

Working closely with application engineering, architecture, data/analytics and vendor teams. The Senior / Lead ETL Developer designs, develops, tests, deploys, and supports enterprise data integration solutions. The role provides hands-on technical leadership for reliable, secure, scalable, and maintainable data pipelines that moves and transforms data across our operational environments. The position leads complex delivery efforts, establishes ETL development standards, performs design and code reviews, mentors developers, troubleshoots production issues, and ensures solutions align with enterprise architecture, data governance, SDLC, DevOps, security, and operational standards.

Platform scope: Snowflake, Matillion ETL/ELT, Microsoft Azure data services, Microsoft SQL Server, Azure SQL, Azure Data Lake Storage, Azure Key Vault, Azure DevOps, secure file and API integrations, and enterprise reporting and analytics touchpoints. Additional technologies may include Power BI, Python, PowerShell, REST APIs, SFTP, event-driven integration, and metadata or data quality tooling.

ESSENTIAL FUNCTIONS:

• Design, develop, test, deploy, and support complex ETL and ELT pipelines using Matillion, Snowflake, Azure services, and SQL Server.
• Serve as the technical lead for assigned data integration initiatives, translating business and technical requirements into scalable solution designs and delivery plans.
• Build reusable ingestion, transformation, orchestration, and publishing patterns for batch, micro-batch, near-real-time, file-based, API-based, and database-source workloads.
• Develop and optimize Snowflake solutions, including SQL transformations, schemas, tables, views, stages, file formats, streams, tasks, stored procedures, and secure data-sharing patterns as applicable.
• Develop and maintain Matillion jobs, components, variables, environments, orchestration workflows, error handling, scheduling, and operational controls.
• Implement Azure-based integration components using services such as Azure Data Lake Storage, Azure Key Vault, Azure Functions, Logic Apps, Azure Data Factory, and related platform capabilities where appropriate.
• Lead source-to-target mapping, data profiling, transformation rule definition, reconciliation design, and technical data lineage documentation.
• Apply data quality controls for completeness, accuracy, validity, timeliness with measurable validation and exception handling.
• Engineer restartable and supportable pipelines with logging, auditability, checkpoints, alerts, dependency management, retry behavior, and recovery procedures.
• Optimize pipeline through query tuning and workload analysis.
• Implement secure data integration practices, including least-privilege access, secrets management, encryption, service account governance and masking.
• Create unit and reconciliation tests.
• Lead peer reviews of solution designs, SQL, Matillion jobs, deployment artifacts, and technical documentation to ensure quality, consistency, supportability, and standards compliance.
• Build and maintain CI/CD practices using Azure DevOps, including source control, branching, pull requests, automated deployment, environment-specific configuration, approvals, and rollback planning.
• Coordinate releases across development, test, user acceptance, and production environments, including readiness reviews and post-deployment validation.
• Troubleshoot failed or delayed pipelines, and upstream or downstream integration failures.
• Create and maintain technical specifications, diagrams, source-to-target mappings, runbooks, support procedures, deployment instructions, and knowledge articles.
• Provide estimates, identify dependencies and risks, break work into actionable deliverables, and communicate progress, blockers, decisions, and technical tradeoffs to delivery stakeholders.
• Collaborate with internal teams, managed service providers, and technology vendors to resolve issues, coordinate delivery, and promote effective knowledge transfer.
• Perform other duties as assigned.

QUALIFICATIONS:

Required Minimum Education and Industry Experience

• Bachelor's degree in Information Technology, Computer Science, Data Engineering, Information Systems, Engineering, or a related field; or an equivalent combination of education and experience.
• 7+ years of progressive experience developing and supporting enterprise ETL, ELT, data integration, data engineering, or data warehouse solutions.
• 3+ years of experience serving as a senior developer, technical lead, workstream lead, or primary technical owner for complex data integration delivery.
• Demonstrated hands-on experience with CI/CD pipelines (Azure DevOps), Snowflake, Matillion, Microsoft Azure, and Microsoft SQL Server in production enterprise environments.
• Experience leading solution design, code review, release coordination, production troubleshooting, and technical mentoring for data integration teams.

• Preferred Education, Additional Qualifications and Experience
• Master's degree in Information Technology, Computer Science, Data Science, Data Engineering, Business Information Systems, Engineering, or a related field.
• Experience in healthcare, insurance, financial services, or another regulated environment with strong privacy, security, auditability, retention, and compliance requirements.
• Experience modernizing legacy ETL platforms and migrating data pipelines or analytical workloads to Snowflake and Azure.
• Experience integrating relational databases, flat files, JSON, XML, REST APIs, SFTP endpoints, SaaS platforms, and external vendor data feeds.
• Relevant certifications such as SnowPro, Matillion, Microsoft Azure Data Engineer, Azure Solutions Architect, or Microsoft data platform certifications.
• Experience working with agile delivery teams, managed service providers, offshore partners, software vendors, and cross-functional enterprise stakeholders.
• Required Knowledge, Skills, and/or Abilities
• Advanced hands-on Snowflake knowledge, including SQL development, virtual warehouses, resource monitors, stages, file formats, data loading and unloading, performance optimization, security concepts, and cost-aware design.
• Advanced Matillion development skills, including orchestration and transformation jobs, reusable components, variables, environments, connectors, scheduling, logging, error handling, and deployment practices.
• Strong knowledge of Microsoft Azure data and integration services, cloud security patterns, managed identities or service principals, secrets management, storage, networking considerations, monitoring, and deployment automation.
• Strong understanding of ETL and ELT architecture, batch and incremental loading, change data capture concepts, slowly changing dimensions, dependency management, orchestration and restart ability.
• Ability to translate functional requirements, data mappings, interface specifications, and business rules into technically sound integration designs.
• Knowledge of enterprise data warehousing, dimensional modeling, normalization, data lakes, analytical platforms, semantic and reporting layers, and data lifecycle management.
• Experience implementing data quality, reconciliation, control totals, balancing, exception processing, lineage, metadata, and audit frameworks.
• Strong understanding of secure engineering practices for sensitive data, including least privilege, encryption, masking, credential management, access logging, retention, and environment separation.
• Experience with Git-based source control and Azure DevOps practices, including branching, pull requests, build and release pipelines, approvals, configuration management, and deployment traceability.
• Ability to diagnose complex data, application, database, network, authentication, and performance issues across multi-platform integration flows.
• Experience applying SDLC, DevOps, change management, incident management, problem management, and production support practices.
• Ability to lead technical design discussions, provide constructive review feedback, establish standards, mentor developers, and influence delivery without direct supervisory authority.
• Strong analytical, organization, and prioritization skills with the ability to manage multiple initiatives, production concerns, and competing deadlines.
• Excellent written and verbal communication skills, including the ability to explain data issues, solution options, risks, dependencies, and tradeoffs to technical and non-technical audiences.
• Ability to operate effectively within agile, waterfall, hybrid, governance-driven, and ITIL-based operating models.