Consultant Data Engineer, Microsoft Fabric

Data Engineer Microsoft Fabric

Job Title: Consultant Data Engineer Microsoft Fabric



Location: Calgary, AB, Canada - Remote



Employment Type: 6 Month to Hire


Job Summary

Lantern is seeking a Consultant Data Engineer Microsoft Fabric to help design, build, and modernize data platforms for clients using the Microsoft data ecosystem.

This is a hands-on data engineering role focused on data ingestion, transformation, Lakehouse development, data modeling, and reporting enablement . The ideal candidate will have experience working with Microsoft Fabric, OneLake, Lakehouse, Warehouse, Data Factory, SQL, Python, Spark, and Power BI .

The Consultant Data Engineer will work closely with architects, senior consultants, delivery managers, and client stakeholders to deliver scalable, secure, and well-governed data solutions. The role will also support modernization initiatives that move clients from legacy data platforms and fragmented reporting environments toward modern Microsoft Fabric-based solutions.

Key Responsibilities

• Design, build, test, and maintain data pipelines and transformations using Microsoft Fabric Data Factory, Dataflows, Notebooks, SQL, Python, and Spark .
• Build and enhance Fabric Lakehouse and Warehouse solutions using Medallion Architecture across Bronze, Silver, and Gold layers.
• Ingest and integrate data from databases, files, APIs, cloud platforms, and business applications.
• Develop reusable, modular, scalable, and maintainable data engineering solutions supporting analytics, reporting, operational insights, and AI use cases.
• Support data modeling and semantic layer development in collaboration with architects, senior consultants, and Power BI developers.
• Implement data validation, reconciliation, data quality checks, monitoring, and error handling throughout ingestion and transformation processes.
• Optimize SQL, Spark, pipeline, and notebook workloads for performance, reliability, cost efficiency, and maintainability.
• Document technical designs, data flows, transformation logic, assumptions, and operational procedures.
• Collaborate with client technical teams and business stakeholders to understand requirements, resolve data issues, and support technical decisions.
• Participate in Agile delivery activities including backlog refinement, sprint planning, demos, retrospectives, and status updates.
• Support migration and modernization initiatives from SQL Server, Azure Synapse, SSIS, Databricks, Snowflake , and legacy reporting/ETL environments into Microsoft Fabric.
• Contribute to data governance practices including workspace organization, access controls, naming standards, lineage, and secure-by-design implementation.
• Stay current with Microsoft Fabric capabilities and contribute recommendations and best practices to delivery teams.

Required Qualifications

• 2+ years of hands-on data engineering experience , preferably in consulting or client-facing environments.
• Experience building data pipelines, transformations, and data models using SQL and at least one programming language such as Python .
• Working knowledge of Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks , or comparable cloud data platforms.
• Experience with Lakehouse, Data Warehouse, or Medallion Architecture concepts.
• Strong SQL skills including data transformation, troubleshooting, query optimization, and data validation.
• Familiarity with Spark, Delta Lake, Notebooks , or distributed data processing technologies.
• Experience working with structured and semi-structured data from multiple source systems.
• Understanding of ETL/ELT, batch ingestion, incremental loads, and data orchestration .
• Ability to create clear technical documentation and communicate delivery progress, blockers, and risks.
• Strong collaboration skills with architects, consultants, project teams, and client stakeholders.
• Experience working in Agile delivery environments with backlog-driven priorities and regular demonstrations.
• Bachelor's degree in Computer Science, Data Engineering, Information Systems, Analytics, or a related field, or equivalent practical experience.

Preferred Qualifications

• Hands-on experience with Microsoft Fabric Lakehouse, Warehouse, OneLake, Data Factory, Notebooks, Dataflows Gen2, and Deployment Pipelines .
• Experience with Power BI Semantic Models, DAX, Power Query , or analytics/reporting enablement.
• Exposure to Microsoft Purview , data governance, security, data lineage, or data cataloging.
• Experience with dbt, Git, Azure DevOps, CI/CD, automated testing , or analytics engineering practices.
• Experience modernizing workloads from Azure Synapse, SSIS, SQL Server, Snowflake, Databricks , or legacy ETL platforms into Microsoft Fabric.
• Exposure to AI-enabled data solutions including Microsoft Foundry, Azure AI Foundry, Copilot Studio, Fabric Data Agents , natural language querying, or agent-assisted analytics.
• Exposure to machine learning, feature engineering, ML data preparation, Azure Machine Learning, MLflow , or collaboration with data science teams.
• Experience working with unstructured or semi-structured data for AI, search, document intelligence, or content understanding use cases.
• Microsoft certifications such as Fabric Analytics Engineer Associate, Azure Data Engineer Associate, or Power BI Data Analyst Associate are a plus.