Lead Data Engineer - Databricks & Microsoft Fabric

Spyglass , Inc. Defunct

Location: Remote (Preference for candidates located in New England)
Engagement: Contract or Contract-to-Hire

Lead Data Engineer

Databricks & Microsoft Fabric

Overview

Spyglass MTG is seeking a highly skilled Lead Data Engineer with strong expertise in Databricks and Microsoft Fabric to help design, build, and scale modern data platforms in Azure.

This role is both strategic and hands-on. The ideal candidate will lead the development of enterprise data solutions while actively building scalable pipelines, lakehouse architectures, and data platforms that support analytics, reporting, and AI initiatives.

The Lead Data Engineer will work closely with data architects, analysts, and business stakeholders to deliver high-performance data solutions that enable organizations to leverage their data more effectively.

Responsibilities

• Design and implement modern data platforms using Databricks and Microsoft Fabric
• Build and maintain scalable data pipelines and ingestion frameworks
• Develop and optimize Spark and PySpark workloads within Databricks
• Implement lakehouse and data warehouse architectures
• Design and manage data models supporting analytics and reporting
• Collaborate with data scientists and analytics teams to support AI and advanced analytics initiatives
• Implement data quality, governance, and security best practices
• Provide technical leadership and mentorship to data engineering team members
• Optimize performance, reliability, and scalability of data platforms

Requirements

• 7+ years of experience in data engineering or data platform development

• Strong hands-on experience with Databricks and Apache Spark

• Experience implementing Microsoft Fabric data solutions

• Proficiency in Python and PySpark

• Experience working with Azure data services and cloud-based data platforms

• Experience designing modern lakehouse or data warehouse architectures

• Strong understanding of data pipeline design, ETL/ELT processes, and data modeling

Preferred

• Experience supporting AI or machine learning workloads

• Experience working in enterprise data environments

• Familiarity with CI/CD and data platform automation

Apply

Vacancy posted 13 hours ago

Similar jobs that could be interesting for youBased on the Lead Data Engineer - Databricks & Microsoft Fabric in Lincoln, RI vacancy

Senior, Data Engineer
$140k - $160k
...maintain databases and data integration (ETL)... ...and data platforms, leading the creation of technical... ...of working in the Microsoft SQL Server... ...Azure Data Factory, Fabric, Snowflake, or Databricks) to lead and optimize... ...commonly used in data engineering, such as Python or Java...
Databricks
Microsoft
Work experience placement
Remote work
Work from home
Carrington
Providence, RI
1 day ago
Microsoft Fabric Data Engineer
...sport, and we work together to achieve our goals.” ~Jon Fain Position Overview We are seeking a Microsoft Fabric Data Engineer with strong manufacturing industry expertise to lead the design and implementation of enterprise data integration solutions. You will architect...
Microsoft
Teknor Apex
Pawtucket, RI
4 days ago
Manufacturing Data Engineer: Microsoft Fabric & ETL Architect
A leading compound manufacturing company in Pawtucket, Rhode Island, is seeking a Microsoft Fabric Data Engineer with robust manufacturing expertise. This role involves designing and developing enterprise data integration solutions, particularly for manufacturing systems...
Microsoft
Teknor Apex
Pawtucket, RI
4 days ago
Data / AI Subject Matter Expert
...Data / AI Subject Matter Expert Anywhere Type: Permanent... ...Subject Matter Expert to lead presales and consulting for... ...point for Snowflake, Microsoft Fabric, Databricks, and Lakehouse design. Guide... ...Requirements: ~7–10+ years in data engineering, data architecture, or data...
Databricks
Microsoft
Hourly pay
Permanent employment
Full time
Local area
Remote work
Eliassen Group
Providence, RI
8 days ago
Consulting Principal, AI Architect
$122.4k - $194k
...you will make an impact by leading client-facing AI... ...generation (RAG), and advanced data and AI platform solutions... ...solutions, including context engineering, RAG pipelines, and AI platform... ...such as Snowflake, Databricks, or Microsoft Fabric. Proven ability to work directly...
Databricks
Microsoft
Remote work
Cognizant
Providence, RI
2 days ago
Remote Lead Data Engineer, Databricks Lakehouse & Power BI
Humana Inc is seeking a candidate to lead the architecture and operationalization of a centralized Finance reporting data platform. This remote role requires strong expertise in Databricks lakehouse engineering, SQL development, and Power BI reporting optimization. The...
Databricks
Remote job
Humana Inc
Providence, RI
1 day ago
Senior IT Manager (Enterprise Data Architect & Integration Lead)
...seeking an experienced Senior IT Manager (Enterprise Data Architect & Integration Lead) to own and drive our organization’s data... ...with ETL/ELT tools and modern data platforms (e.g., Databricks, Snowflake, Microsoft Fabric) ~ Hands-on experience with API design and integration...
Databricks
Microsoft
Work at office
Local area
Visa sponsorship
Work visa
Flexible hours
3 days per week
PKF O’Connor Davies
Providence, RI
4 days ago
Lead Data Engineer - Primary Care
$142.3k - $195.7k
...Become a part of our caring community The Lead Data Engineer oversees data processing architectures and solutions ensuring the efficient... ...within large organizations. • Advanced in SQL, Snowflake, Databricks, or other data systems. • 2+ years' experience in dbt. •...
Databricks
Full time
Temporary work
Apprenticeship
Remote work
CenterWell
Providence, RI
4 days ago
Data Architect MS Fabric (22561-1) Woonsocket, RI
$95 per hour
Overview Data Architect MS Fabric (22561-1) Woonsocket, RI Responsibilities Solution Architecture: Design end-to-end data and analytics solutions leveraging Microsoft Fabric’s components—including Data Factory, Synapse, Power BI, Data Lake, and Real-Time Analytics. Qualifications...
Microsoft
Hourly pay
Full time
For contractors
Remote work
Visa sponsorship
Relocation package
ESR Healthcare
Woonsocket, RI
3 days ago
Senior Principal Technical Product Marketing Manager - Oracle Autonomous AI Lakehouse
$115.4k - $251.6k
...intersection of deep engineering knowledge and... ...experience within data platforms, cloud databases... ...Snowflake, Databricks, Google BigQuery, Azure Synapse/Fabric, and Amazon Redshift... ...supporting or leading analyst relations... ...AWS Redshift, and Microsoft Fabric. # Lead competitive...
Databricks
Microsoft
Temporary work
Flexible hours
Oracle
Providence, RI
7 days ago
Microsoft Fabric & Analytics Sales Executive - Remote - FS445
...Microsoft Fabric & Analytics Sales Executive At Fresche Solutions, we offer great work-life balance... ...driving Microsoft-focused analytics, data, and AI sales across Fresche Analytics.... ...as a strategic Microsoft partner by leading solution-led sales motions centered on Microsoft...
Microsoft
Remote job
Flexible hours
Fresche Solutions
Franklin, MA
3 days ago
Senior Data Engineer: Scalable Pipelines & Analytics
A leading mutual insurance company in Rhode Island is seeking a Data Engineer III to design and maintain scalable data pipelines. As a critical member of the Information... ...optimize data performance using tools like Microsoft Fabric and Apache Spark. Ideal candidates will have...
Microsoft
Full time
FM
Johnston, RI
3 days ago
Data Engineer III
Data Engineer III FM is a leading mutual insurance company whose capital, scientific research capability and engineering expertise are solely... ...Optimize Performance: Implement modern practices using Microsoft Fabric, SQL Server, SSIS, Power BI Premium, and big data frameworks...
Microsoft
Full time
Work experience placement
Flexible hours
FM
Johnston, RI
3 days ago
AI/ML Engineer - Higher Ed
$101.9k - $163k
...achieve their goals and lead a choice-filled life.... ...are integrated into the fabric of how we work every day... ...please see The AI/ML Engineer - Higher Education builds... ...architectures and data systems Partner with platform... ...Data: Snowflake, Databricks, Postgres, Redis DevOps...
Databricks
Live in
Local area
Worldwide
Cengage Group
Providence, RI
8 days ago
Advanced Analytics - Health Sector - Senior Manager - Consulting
$178.3k - $407k
...to build a better working world. AI & Data, Advanced Analytics - Health Sector - Senior... ...leaders. Your key responsibilities Leading large‑scale client engagements end‑to‑... ...visual storytelling Certifications in Microsoft, Databricks, AWS, ServiceNow, or Snowflake in the...
Databricks
Microsoft
Work experience placement
Summer holiday
Flexible hours
Ernst & Young Oman
Providence, RI
3 days ago
Senior Data Engineer - Data Pipelines & Fabric
FM Global, located in Johnston, Rhode Island, is seeking a Data Engineer III. This role involves designing and maintaining data pipelines, ensuring data quality, and collaborating with product owners and data scientists on various projects. Candidates should possess a Bachelor...
Flexible hours
FM Global
Johnston, RI
13 hours ago
Senior Data Engineer
$160k - $200k
...Datavant is the data collaboration platform trusted for healthcare... ...and impact-driven Senior Data Engineer to strengthen our capabilities... ...you! What You Will Do Lead the design and evolution of scalable... ...Airflow, Kafka, Spark, Databricks, or streaming/event-driven architectures...
Databricks
Datavant
Providence, RI
2 days ago
Lead Data Engineer
...Transform, Load) using Matillion ETL tool Specializes in ETL (Extract, Transform, Load) using DBT ETL tool Experience in Snowflake based data warehouse Azure Data Services such as ADLS, SQL Server (managed and non-managed) Good understanding on latest trends and best...
Work experience placement
TechDigital Group
Providence, RI
3 days ago
Sr. Data Engineer
$150k - $190k
..., customers and partners. The Senior Data Engineer will be responsible for the analysis, design... ..., and testing of applications Lead in the creation and maintenance of technical... ...experience Hands-on experience with Databricks Hands-on experience with PowerBI report...
Databricks
Work experience placement
Worldwide
Flexible hours
Shift work
SHI GmbH
Providence, RI
10 days ago
Databricks Data Engineer - Senior - Consulting - Location OPEN
$106.9k - $176.5k
...are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client... ...solutions that meet their business objectives. Lead end-to-end data pipeline development,...
Databricks
Summer holiday
Flexible hours
EY
Providence, RI
2 days ago
Data Architect - Power & Utilities - Manager - Consulting - Location OPEN
$125.5k - $230.2k
...robust background in Data Architecture, Data Modernization... ...systems / electrical engineering background and having... ...the opportunity to lead and develop your skill... ..., including Data Fabrics, Data Mesh, Lake Houses... ...cloud data platforms like Databricks. Experience in...
Databricks
Summer holiday
Flexible hours
EY
Providence, RI
2 days ago
Senior Data Engineer
$117.6k - $161.7k
Senior Data Engineer Become a part of our caring community. The Senior Data Engineer designs, builds, and maintains data processing solutions... ...maintain scalable data pipelines and workflows using Azure Databricks. Develop and maintain SAS programs and SSIS packages for...
Databricks
Temporary work
Remote work
Work from home
Humana
Providence, RI
5 days ago
Data Engineer - Healthcare
$97.9k - $133.5k
...Become a part of our caring community The Data Engineer 2 will develop scalable data processing... ...of action. You will report to the Lead Data Engineer. You will ingest data from... ...Python. ~ Comprehensive knowledge of Microsoft Office Applications. ~ Assess complex...
Microsoft
Full time
Temporary work
Apprenticeship
Work at office
Remote work
CenterWell
Providence, RI
1 day ago
Data Engineer 1
...Data Engineer I (Rhode Island) Hybrid Freedman HealthCare LLC (FHC) is a growing Massachusetts-based consulting firm with a national... ...Strong proficiency in SQL and data analysis, within Microsoft SQL Server, Oracle SQL Developer, and PL/SQL environments...
Microsoft
Work experience placement
Work at office
Remote work
2 days per week
Freedman Healthcare
Providence, RI
1 day ago
Databricks Data Engineer - Manager - Consulting - Location OPEN
$125.5k - $230.2k
...working world. We are looking for a dynamic and experienced Manager of Data Engineering to lead our team in designing and implementing complex cloud analytics solutions with a strong focus on Databricks. The ideal candidate will possess deep technical expertise in data...
Databricks
Summer holiday
Flexible hours
EY
Providence, RI
2 days ago
Senior Data Scientist - GenAI/Python/AWS/SQL
$89.4k - $183.5k
.... We are seeking a Senior Data Scientist to join our innovation... ...; Azure/GCP comparable) Databricks + PySpark experience is a strong... ..., ML algorithms, and feature engineering Ability to build automated... .... ~ Proven track record leading end-to-end data science projects...
Databricks
Temporary work
Worldwide
Flexible hours
Unum Group
Providence, RI
6 days ago
Remote SharePoint & 365 Automation Engineer
Apex Systems is seeking a SharePoint Engineer to provide engineering and operational support for a cloud-only SharePoint Online and Microsoft 365 environment. The role involves administration, automation, and continuous improvement across these services. Candidates should...
Microsoft
Remote job
Apex Systems
Woonsocket, RI
13 hours ago
AI Automation Engineer, Finance & Accounting
$150k - $200k
...achieve their goals and lead a choice-filled life.... ...are integrated into the fabric of how we work every day... .... The AI Automation Engineer - Finance & Accounting... ...inefficiencies through data analysis and stakeholder... ...Snowflake, PostgreSQL, Databricks Key Competencies...
Databricks
Live in
Local area
Worldwide
Cengage Group
Providence, RI
8 days ago
Data Scientist (Hybrid on-site)
..., managed services, printing and mobile data capture solutions for performance-driven... ...cutting-edge algorithms. Collaborate with engineering and data annotation teams to improve... ...an individual should have knowledge of Microsoft Office suite, Excel, and Word specifically...
Microsoft
Internship
Work at office
PEAK Technologies
Franklin, MA
4 days ago
Quality Control Inspector
$23 - $28 per hour
...candidate will perform detailed inspections of fabricated components, including first article... .... Candidates must be able to interpret engineering drawings, use standard measurement... ...tools Basic computer skills, including Microsoft Office A bachelor’s degree in Engineering...
Microsoft
Temporary work
Work experience placement
Work at office
Immediate start
Manufacturing Inc
Lincoln, RI
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer - Databricks & Microsoft Fabric. Be the first to apply!