Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Azure Databricks & Microsoft Fabric Data Engineer

$80 per hour
Temporary

Donato Technologies, Inc

Job Summary

We are seeking an experienced Senior Data Engineer with strong hands-on expertise in Azure Databricks, Microsoft Fabric, Python, SQL, and modern cloud data engineering technologies. The ideal candidate will be responsible for designing, developing, implementing, and maintaining scalable enterprise data platforms and production-grade data pipelines.

The candidate should have strong experience building modern Lakehouse architectures, implementing data governance, integrating data from enterprise applications, and developing automated CI/CD processes. This role requires someone who can work across Azure Databricks and Microsoft Fabric environments to deliver secure, reliable, and high-performing data solutions.

Key Responsibilities

1. Azure Databricks & Data Engineering

  • Design, develop, and maintain scalable data engineering solutions using Azure Databricks.
  • Implement data governance and access controls using Unity Catalog.
  • Develop and optimize data pipelines using Delta Lake, PySpark, and Lakeflow / Delta Live Tables (DLT).
  • Build and manage automated deployment processes using Databricks Asset Bundles.
  • Implement data quality, monitoring, and performance optimization across data pipelines.
  • Work with large datasets and develop reliable batch and incremental data processing solutions.

2. Microsoft Fabric & Lakehouse Architecture

  • Design and implement modern Lakehouse solutions using Microsoft Fabric.
  • Work with OneLake for centralized enterprise data storage and management.
  • Develop and manage Data Pipelines and Dataflows for data ingestion and transformation.
  • Understand and implement Fabric networking capabilities, including Managed Private Endpoints and VNet Data Gateways.
  • Integrate Microsoft Fabric with Azure Databricks and other enterprise data platforms.
  • Ensure secure, scalable, and efficient data access across cloud environments.

3. SQL, Python & Data Modeling

  • Develop production-ready data pipelines using strong Python and SQL programming skills.
  • Build data transformation workflows using PySpark and SQL.
  • Apply dimensional data modeling techniques to support enterprise reporting and analytics.
  • Implement Medallion Architecture, including Bronze, Silver, and Gold data layers.
  • Develop reusable data transformation frameworks and maintain high-quality data standards.
  • Experience with dbt for data transformation and modeling is highly preferred.

4. Enterprise Data Integration

  • Design and implement data ingestion solutions from REST APIs, enterprise applications, and legacy systems.
  • Integrate data from ERP and enterprise platforms such as:
    • JD Edwards (JDE)
    • IBM DB2 / IBM i
    • Oracle Primavera P6
    • Other ERP and legacy enterprise systems.
  • Develop integrations using Azure services such as Azure Durable Functions, Logic Apps, and Service Bus.
  • Build reliable data ingestion processes with appropriate error handling, logging, retry mechanisms, and monitoring.
  • Work with business and application teams to understand source systems and data requirements.

5. DevOps, CI/CD & Infrastructure as Code

  • Develop and maintain automated CI/CD pipelines using Azure DevOps or GitHub Actions.
  • Implement infrastructure provisioning and configuration using Bicep or Terraform.
  • Manage deployment of data engineering solutions across development, testing, and production environments.
  • Work with service principals and Workload Identity Federation for secure authentication.
  • Implement environment promotion strategies and automated deployment practices.
  • Follow version control, code review, release management, and DevOps best practices.

6. Power BI & Semantic Data Layer

  • Support downstream analytics and reporting solutions using Power BI.
  • Understand and work with Direct Lake semantic models in Microsoft Fabric.
  • Support semantic model development, governance, and performance optimization.
  • Ensure data pipelines deliver reliable, analytics-ready datasets for reporting and business intelligence.
  • Understand data serving requirements and integration between data platforms and reporting layers.
  • Exposure to Microsoft Power Platform and Dataverse is an added advantage.

Required Technical Skills

  • Strong hands-on experience with Azure Databricks.
  • Expertise in Unity Catalog, Delta Lake, PySpark, and Lakeflow / DLT.
  • Experience with Databricks Asset Bundles and deployment automation.
  • Hands-on experience with Microsoft Fabric, OneLake, Lakehouse, Data Pipelines, and Dataflows.
  • Strong programming skills in Python and SQL.
  • Experience with dimensional modeling and Medallion Architecture.
  • Experience developing enterprise data integration solutions using REST APIs.
  • Knowledge of ERP and legacy systems such as JDE, DB2 / IBM i, and Oracle P6.
  • Experience with Azure Durable Functions, Logic Apps, and Service Bus.
  • Strong understanding of CI/CD using Azure DevOps or GitHub.
  • Experience with Terraform or Bicep for Infrastructure as Code.
  • Understanding of secure cloud authentication using service principals and Workload Identity Federation.
  • Knowledge of Power BI and Direct Lake semantic models.

Preferred / Good-to-Have Skills

  • Experience with dbt for data transformation.
  • Exposure to Power Platform and Dataverse.
  • Experience integrating multiple enterprise data sources.
  • Knowledge of enterprise data governance, security, and compliance.
  • Experience optimizing large-scale data processing workloads.
  • Familiarity with hybrid cloud and enterprise networking configurations.

Ideal Candidate Profile

The ideal candidate should be a hands-on Senior Data Engineer who has worked extensively on modern Azure-based data platforms. The candidate must be comfortable developing end-to-end data pipelines, integrating enterprise and legacy systems, implementing data governance, and managing automated deployments.

We are looking for someone with practical project experience in both Azure Databricks and Microsoft Fabric , rather than someone with only theoretical knowledge or exposure to these technologies.

Donato Technologies Inc. is a trusted IT staffing, consulting, and software development partner headquartered in Dallas, Texas. We support clients across industries by understanding their unique business needs and delivering tailored technology and workforce solutions. Our focus is on connecting the right talent with the right opportunity-ensuring clients receive dependable, skilled professionals and candidates receive meaningful career growth and support. We work closely with small to mid-sized organizations to provide flexible, high-quality services that drive performance, innovation, and long-term success.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Azure Databricks & Microsoft Fabric Data Engineer in Houston, TX vacancy
  • Senior Data Engineer - Azure / DatabricksLocation: Houston, TX - HybridPosition Type...  ...with strong experience in Databricks, Python, Azure data...  ...Hands-on experience with the Microsoft Azure data ecosystem, including...  ...Streaming.Microsoft Fabric, Azure Synapse, Azure Functions... 
    Databricks
    Senior
    Microsoft
    Permanent employment
    Work at office

    Technology Recruiting Solutions

    Houston, TX
    9 hours ago
  • $104k - $120k

     ...experience with agile engineering and problem-...  ...across technology, data sciences, consulting...  ...a hands-on Senior Data Engineer with...  ...strong expertise in Databricks, PySpark, Spark SQL...  ...skills.Experience with Azure, AWS, or GCP data...  ..., Google Cloud, Microsoft Azure, Databricks,... 
    Databricks
    Senior
    Microsoft

    Publicis Media

    Houston, TX
    4 days ago
  •  ...challenges? We are looking for a Senior AI / ML Engineer to join our Data, AI & Energy Practice. In this role...  ...and AI-powered services on the Microsoft Azure ecosystem. You will partner with...  ...Data Factory, Azure Synapse and Databricks Implement vector storage, semantic... 
    Databricks
    Senior
    Microsoft

    EPAM Systems

    Houston, TX
    1 day ago
  • $155k - $195k

     ...experience with agile engineering and problem-solving creativity...  ...across technology, data sciences, consulting...  ...- Generative AI & Azure to design and build enterprise...  ...and data solutions on Microsoft Azure.In this role,...  ...Azure Data Factory, Databricks Unity Catalog, data... 
    Databricks
    Microsoft

    Publicis Media

    Houston, TX
    4 days ago
  •  ...a hands-on, enterprise-minded Senior Manager, Data Platform & Engineering to lead the technical foundation...  ...immediate focus on maturing Targa's Microsoft Fabric and Azure-based data environment and...  ...interoperability with platforms such as Databricks and Snowflake.JOB FUNCTIONS AND... 
    Databricks
    Senior
    Microsoft
    For contractors
    Immediate start

    Targa Resources

    Houston, TX
    4 days ago
  • $124k - $280k

     ...OpportunityAs an Applied AI Health Services Data Science-Senior Manager you will lead client-facing...  ...will draw on data and analytics engineering, artificial intelligence, and...  ...platforms, including AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data and AI... 
    Databricks
    Senior
    Microsoft
    Full time
    H1b

    PwC

    Houston, TX
    4 days ago
  •  ...Technology Centers (ATCs) are the engine for reinvention in our clients...  ...are:An experienced, hands-on Data & AI Engineer with deep hands-on expertise in Databricks and Azure data services to design, build...  ...of experience working with Microsoft Azure cloud data services.• A... 
    Databricks
    Senior
    Microsoft
    Work experience placement
    Live in
    Work at office
    Local area
    3 days per week

    Accenture

    Houston, TX
    2 days ago
  •  ...Databricks Data EngineerAbout the Role:We are seeking a highly skilled Databricks Data Engineer to design, build, and optimize our next-generation data architecture. In this role,...  ...Familiarity with cloud infrastructure (AWS, Azure, or GCP) and infrastructure-as-code (... 
    Databricks
    Senior

    Alephys

    Houston, TX
    4 days ago
  • $86.7k - $170.9k

    Position Summary As a Data Engineer II on the AI & Data team,...  ...engineering solutions using Databricks, Apache Spark, Python, and...  ...Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (...  ...From entry-level employees to senior leaders, we believe there’s... 
    Databricks
    Microsoft
    Local area

    Deloitte

    Houston, TX
    1 day ago
  • $90 - $110 per hour

     ...: We are seeking a Data Bricks Solution Expert who can...  ...role involves designing Azure Databricks environments from scratch, making...  ...Databricks Certified Data Engineer Professional or Databricks...  ...advanced credentials. Microsoft Azure Solutions Architect Expert... 
    Databricks
    Senior
    Microsoft

    The Brixton Group

    Houston, TX
    2 days ago
  • $132.23k - $176.31k

     ...connecting people, data, and applications...  ...The Role The Senior Lead Marketing Data...  ...partnership with engineering, analytics, Adobe,...  ...operational strategy of Databricks as the strategic...  ...environments. ~ Azure platform expertise...  ...Databricks, Microsoft Azure, Adobe, or Salesforce... 
    Databricks
    Senior
    Microsoft
    Full time
    Temporary work

    Lumen

    Houston, TX
    5 days ago
  • $8.62k

     ...Tech SolutionsJob Title : Senior AI Engineer No. Of Openings: 2Job Location...  ...AI architectures using Microsoft Azure services and established AI...  ...design patternsCollaborate with Data Scientists and other AI...  ...engineering tools such as Databricks, Spark, Azure Data FactoryExperience... 
    Databricks
    Senior
    Microsoft
    Hourly pay
    Full time
    Contract work
    For contractors
    Work from home

    SRI Tech

    Houston, TX
    1 day ago
  • $88k - $122k

     ...create custom software, data, AI, and cloud...  ...Our Data Architecture & Engineering team sees data as the foundation...  ...Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks, and Snowflake, along with...  ..., Synapse, Microsoft Fabric, Delta Lake, Unity Catalog... 
    Databricks
    Microsoft
    Temporary work
    Work at office
    Local area

    Slalom

    Houston, TX
    2 days ago
  • $91.1k - $179.5k

     ...0/2026. Work you'll do The Data Engineer Consultant will support data...  ..., including proficiency in Databricks or Snowflake.Ability to...  ...Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (...  ...From entry-level employees to senior leaders, we believe there’s... 
    Databricks
    Microsoft
    Local area

    Deloitte

    Houston, TX
    4 days ago
  •  ...advanced analytics solutions using Azure Databricks / Fabric. The ideal candidate will have a deep understanding of big data technologies, data engineering, and cloud computing, with a...  ...for dashboarding and reporting. Microsoft Fabric for analytics and integration... 
    Databricks
    Microsoft
    Permanent employment
    Contract work
    Local area

    Valiant Technologies LLC

    Houston, TX
    5 days ago
  •  ...platforms, and modern data tooling to join our multidisciplinary...  ...work alongside AI engineers/developers and...  ...Core: Python .NET Azure Databricks (data platform) AI stack...  ...Azure AI Search Microsoft Copilot Studio Semantic...  ...related experience. The Senior Specialist level... 
    Databricks
    Senior
    Microsoft
    Work experience placement
    Work at office
    Night shift

    Energy Transfer

    Houston, TX
    9 hours ago
  • $175k - $275k

     ...Senior AI Engineering East West Bank is seeking an experienced Senior...  ..., FastAPI or Flask, Azure OpenAI, Azure ML, Databricks, ADLS, and modern cloud-...  ...Partner with business, data, cybersecurity, risk, compliance...  ...Claude, Google Gemini, Microsoft Copilot/Azure OpenAI,... 
    Databricks
    Senior
    Microsoft

    East West Bank

    Houston, TX
    3 days ago
  •  ...the line.Job Title: Senior Software...  ...Conga's B2B Platform Engineering organization. This...  ...product, platform, and data initiatives, ensuring...  ...cloud-native, Azure-based, API-first,...  ...platforms, preferably Microsoft Azure, Kubernetes,...  ...objects, such as Databricks, including their... 
    Databricks
    Senior
    Microsoft
    Immediate start
    Worldwide

    Conga

    Houston, TX
    9 hours ago
  •  ...Azure Data Engineer Location: Spring Texas (On-Site) Need Only Local to Houston, TX Experience; 10+ Years Responsibilities Perform...  ...Required Proficiency: Advanced SQL Snowflake Tamr Python GitHub Intermediate Databricks Airflow... 
    Databricks
    Work experience placement
    Local area

    Cedent Life Talent

    Houston, TX
    14 hours ago
  • $116.2k - $229.1k

    Position Summary Data-driven organizations need modern...  ...Experience with Snowflake and Databricks Experience with Google Cloud...  ...cloud platforms, including Microsoft Azure and Amazon Web Services...  ...From entry-level employees to senior leaders, we believe there’s... 
    Databricks
    Microsoft
    Local area
    Visa sponsorship

    Deloitte

    Houston, TX
    2 days ago
  • $105.4k - $207.8k

    Position Summary Cyber Data Protection Senior ConsultantAre you...  ...Security (e.g., AWS security, Azure/M365 security, Databricks, Snowflake)2+ years of...  ...with tools such as Microsoft Purview, Cyera, Securiti...  ..., Information Security, Engineering, Computer Science, Information... 
    Databricks
    Senior
    Microsoft
    Local area

    Deloitte

    Houston, TX
    9 hours ago
  •  ...remote position. Role:   Cloud and Data Platform Engineer Location: Remote (U.S.)...  ...administers, and optimizes the company’s Azure cloud and enterprise analytics platforms, including Microsoft Fabric and Azure Databricks. The role combines day-to-day cloud infrastructure... 
    Databricks
    Microsoft
    Contract work
    Remote work

    Indigo Beam

    Houston, TX
    17 days ago
  • $214k - $261k

    Senior Principal, Informatica MDMJob Title:Senior Principal, Market SolutionsThe Data Foundation team within our Enterprise capability helps...  ...and ecosystems such as AWS, Microsoft Azure, Google Cloud, Snowflake, Databricks, or Microsoft Fabric.* Experience in a regulated... 
    Databricks
    Senior
    Microsoft
    Temporary work
    Local area

    Slalom

    Houston, TX
    2 days ago
  • $115k - $135k

     ...hands-on cloud and platform engineering role with a strong focus...  ..., primarily within Microsoft Azure.The CCSI Systems Senior Engineer is a full-time...  ...supporting AI-enabled or data-intensive platforms, including...  ...(e.g., Microsoft Fabric, Databricks) preferred.Familiarity with... 
    Databricks
    Senior
    Microsoft
    Full time
    Work at office
    Remote work
    Relocation package
    Monday to Friday

    AlixPartners

    Houston, TX
    3 days ago
  •  ...The beginning of a new Data & AI decade that will...  ...are seeking a Data Engineering, Management & Governance...  ...the rigor of a data fabric architect with the...  ...platforms (Snowflake, Databricks, Azure Synapse, BigQuery), pipeline...  ..., Databricks, AWS, Microsoft Azure, or Google... 
    Databricks
    Microsoft
    Live in
    Work at office
    Local area

    Accenture

    Houston, TX
    3 days ago
  •  ...is currently seeking a Senior Associate, Data Strategy Enablement and...  ...data solutions using the Azure and Google ecosystems,...  ...a role such as AI/Data Engineering, Software Development,...  ...required experience in Microsoft Azure (including Azure Databricks) and a strong preference... 
    Databricks
    Senior
    Microsoft
    H1b
    Local area

    KPMG

    Houston, TX
    9 hours ago
  • $105.4k - $207.8k

     ...Sr Consultant: AI Data Security in Deloitte...  ...with hands-on engineering to translate requirements...  ...patterns in AWS, Azure, or Google Cloud....  ...AI Vector Search, Databricks, or SnowflakeData...  ...Knowledge Bases, Microsoft Foundry with Azure...  ...employees to senior leaders, we believe... 
    Databricks
    Senior
    Microsoft
    Local area
    Visa sponsorship

    Deloitte

    Houston, TX
    2 days ago
  •  ...information, visit . The Senior AI Architect...  ...automation workflows, and data-processing...  ...computer science, engineering, data science, information...  ...platforms such as Microsoft Azure or Amazon Web...  ...platforms, such as Databricks or Microsoft Fabric. Knowledge of enterprise... 
    Databricks
    Senior
    Microsoft
    Work at office
    Local area

    JB Poindexter & Co

    Houston, TX
    3 days ago
  • $168k - $231k

     ...11Perficient is seeking a senior, commercially minded Strategy...  ..., including Google Cloud, Microsoft (Azure), AWS, Databricks and/or Salesforce....  ...professional experience in cloud, data, enterprise architecture,...  .... We imagine, create, engineer, and run digital transformation... 
    Databricks
    Senior
    Microsoft
    Full time
    Work at office
    Local area
    Flexible hours

    Perficient

    Houston, TX
    9 hours ago
  •  ...you will lead the development of a robust data ecosystem that transforms drilling,...  ...actionable insights. You will work closely with engineers, data scientists, and operational...  ...with platforms and technologies such as Databricks, Spark, SQL Server, Data Lakes, and SQL/... 
    Databricks
    Senior

    National Oilwell Varco

    Houston, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Azure Databricks & Microsoft Fabric Data Engineer. Be the first to apply!