Microsoft Fabric Data Engineer

Microsoft Fabric Data Engineer

Duration: 06-month contact

Location: Remote

Candidates must have strong hands-on experience with Microsoft Fabric, Python/PySpark notebook development, SQL Server, REST API ingestion, and Azure DevOps or GitHub for source control and deployment.

What You Will Do

• Design and implement data pipelines in Microsoft Fabric to ingest data from SQL Server databases, REST APIs, and other enterprise source systems
• Build and maintain a medallion architecture (Bronze / Silver / Gold) lakehouse following data modeling best practices
• Develop Python and PySpark notebooks for data transformation, JSON parsing, and complex business logic
• Implement and maintain incremental load strategies using watermarking, change data capture (CDC), and partitioning
• Diagnose and resolve pipeline reliability issues including authentication failures, token expiration, and performance bottlenecks
• Design and implement a pipeline logging and monitoring framework with alerting for failures and anomalies
• Manage Fabric workspace capacity, investigate usage issues, and implement job scheduling strategies to prevent capacity overruns
• Establish and maintain a CI/CD deployment process integrating with Git (Azure DevOps or GitHub) across Dev, Test, and Production environments
• Document solutions, deployment runbooks, and engineering standards
• Mentor junior team members and conduct code reviews

What You Bring

• 5-8 years of experience in data engineering or a related field
• 3+ years of experience with data modeling - medallion architecture, star/snowflake schemas, SCD patterns
• 2+ years of hands-on experience with Microsoft Fabric
• 3+ years of Python and PySpark, including notebook-based development
• SQL Server experience -- T-SQL, stored procedures, query optimization, schema design
• Experience building resilient pipelines with retry logic, failure recovery, and performance tuning
• Experience with pipeline logging, monitoring, and alerting
• CI/CD experience with Git-based deployment workflows using Azure DevOps or GitHub

Preferred

• Experience ingesting data from REST APIs
• Experience with Fabric capacity planning and SKU sizing
• Familiarity with service principal-based authentication in Azure
• Experience working in regulated or enterprise utility environments
• Familiarity with Azure Monitor and observability best practices

Compensation: The hourly rate for this position is between $61.00-$67.00 per hour. Factors which may affect starting pay within this range may include [geography/market, skills, education, experience and other qualifications of the successful candidate]. Benefits: Sunrise offers ACA compliant medical coverage/dental insurance/vision insurance to all employees. We also offer Sick time benefits as required per State regulations.

Contact: Jaya Balaji: View email address on click.appcast.io | View phone number on click.appcast.io