Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Azure Databricks Engineer

Diverse Lynx

Azure Databricks Engineer

Location: Houston TX- Hybrid

Level: 5

Exp: 10+ Years

Core Responsibilities

Design and implement scalable data platforms and pipelines using Azure Databricks, Apache Spark, Pyspark, Delta Lake, and MLflow.

Design and implement data pipelines using Databricks, Spark, and Delta Lake for batch and streaming data.

Optimize Spark jobs for performance, scalability, and cost efficiency.

Develop and maintain Lakehouse architecture leveraging Databricks and cloud storage solutions.

Lead the migration from legacy platforms to Lakehouse architecture.

Develop batch and streaming data pipelines for ingestion, transformation, and analytics.

Establish standards for data governance, quality, and security.

Collaborate with stakeholders to align architecture with business goals.

Mentor data engineers and developers on Databricks best practices.

Integrate Databricks with tools like Power BI, Tableau, Kafka, Snowflake, and Azure Data Factory.

Required Skills & Experience

8–10+ years in data engineering or architecture roles.

8+ years of hands-on experience with Databricks and Azure.

Strong command of SQL, Python, Scala, and Spark.

Experience with CI/CD pipelines, DevOps, and orchestration tools like Airflow or Data Factory.

Familiarity with Azure cloud platforms.

Deep understanding of distributed computing, performance tuning, and data security.

Preferred Qualifications

Bachelor's or Master's in Computer Science, Data Science, or related field.

Certifications such as Azure Solution Architect, Azure Data Engineer, or Databricks Certified Data Engineer or Solutions Architect.

Experience with data mesh, data fabric, or enterprise data architectures.

Domain knowledge in finance, healthcare, or public sector is a plus.

Hadoop & Scala experience

Additional Insights from Internal Communications

Emphasis on DataOps, data orchestration, and data modeling.

Strong ERP knowledge (e.g., SAP, Salesforce) is valued.

Candidates should be hands-on, capable of self-exploration, and able to drive analytics adoption across business teams.

A structured questionnaire is often used to assess candidates on areas like Unity Catalog, Spark optimization, partitioning techniques, and data security.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Azure Databricks Engineer in Houston, TX vacancy
  •  ...Azure Data Engineer Houston TX - Onsite from day 1 Project Overview: New project- credit card settlement system ( CCSS) to support...  ...: • Full stack experience, Azure functions, Datalake, Databricks logic app, tableau • Experience communicating with... 
    Databricks

    Netorbit

    Houston, TX
    1 day ago
  •  ...Azure Data Engineer Location: Spring Texas (On-Site) Need Only Local to Houston, TX Experience; 10+ Years Responsibilities Perform...  ...Required Proficiency: Advanced SQL Snowflake Tamr Python GitHub Intermediate Databricks Airflow... 
    Databricks
    Work experience placement
    Local area

    Cedent Life Talent

    Houston, TX
    5 days ago
  •  ...NAVA Software solutions is looking for a Azure Architect Details: Azure Integration Architect Location: Houston...  ...in Azure Integration Services such as: Service Bus, Event Hub, DataBricks, Data Factory, Azure Storage, Key Vault, App Insights, API... 
    Databricks

    Nava Software Solutions

    Houston, TX
    2 days ago
  •  ...experience in designing and developing scalable data solutions using Azure Databricks Design develop and optimize scalable data pipelines...  ...team members on Azure Databricks and best practices in data engineering Document data processes architectures and workflows to... 
    Databricks

    Cloud Analytics Technologies LLC

    Houston, TX
    8 days ago
  •  ...NAVA Software solutions is looking for an Azure Cloud Engineer Details: Azure Cloud Engineer Location: Houston TX - Hybrid Duration: Full time /Direct Hire KEY RESPONSIBILITIES Develop and implement a comprehensive cloud... 
    Suggested
    Full time

    Nava Software Solutions

    Houston, TX
    4 days ago
  •  ...AWS Cloud Engineer Location: Seattle, WA/St. Louis, MO/Plano, TX/Dallas, TX/Houston, TX Duration: Fulltime Job Description:...  ...: Design, develop, and optimize ETL/ELT pipelines using AWS & Databricks services such as Unity Catalog, Pyspark, AWS Glue, Lambda, Step... 
    Databricks
    Full time
    Immediate start
    Relocation

    JConnect Infotech

    Houston, TX
    11 days ago
  • $60 - $65 per hour

     ...hands-on analytics and modeling. Adhere to our culture of humility, curiosity, and impact Process data using Python, PySpark, and Databricks Develop models and dashboards Learn the job while performing hands-on analytics and modeling Help business partners make more... 
    Databricks
    Contract work
    Remote work

    Compunnel

    Houston, TX
    7 hours ago
  •  ...Job Description Job Description Azure Network Engineer (Junior to Mid-Level) Location: Houston, TX (Downtown – 100% On-Site) Employment Type: 6-12 month contract with possibility to extend each 6 months. Position Summary ioSpjere is seeking an Azure Network... 
    Contract work
    Remote work

    iSphere

    Houston, TX
    6 days ago
  •  ...Job Title - Azure Cloud Engineer - In person interview required Duration - 6 Months Location - Houston, TX (Day 1 Onsite) Job Description: Desired Technical Skills: • Solid understanding of Google Cloud and Microsoft Azure product offerings... 

    Maintec Technologies

    Houston, TX
    5 days ago
  •  ...Azure Engineer - Integrations Position Summary: We are looking for a mid to senior-level Azure Integration Engineer to support enterprise integration projects using Microsoft Azure services. In this role, you'll help build and maintain integration solutions between... 

    3B Staffing LLC

    Houston, TX
    5 days ago
  •  ...architecture, design, and implementation of advanced  analytics solutions using Azure  Databricks / Fabric. The ideal candidate will have a deep understanding of big  data technologies,  data engineering, and cloud computing, with a strong focus on Azure  Databricks along... 
    Databricks

    Cloud Analytics Technologies LLC

    Houston, TX
    8 days ago
  •  ...measures are in place and aligned with enterprise architecture standards and principles. About The Role The Azure Infrastructure Engineer will design, build, secure, and automate enterprise-grade Azure platforms. Resource will own core platform engineering... 
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work
    Relocation

    Corebridge Financial

    Houston, TX
    5 days ago
  •  ...About the Role We're looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data...  ...and maintain data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics Build and optimize data models... 
    Databricks

    Attractivate Consulting Solutions

    Houston, TX
    3 days ago
  •  ...Design and develop end-to-end ETL pipelines using Azure Data Factory and Azure Databricks. Implement copy activities, data flows, error handling, dynamic...  ...across multiple systems. Cloud Integration and Data Engineering Integrate diverse data sources including Oracle, SQL... 
    Databricks

    Arthatech

    Houston, TX
    5 days ago
  •  ...data ecosystem. Their broader technology direction includes Databricks, AWS S3, Redshift, Athena, Power BI, Apache Iceberg, and more...  ...capabilities. AWS is heavily involved in the initiative alongside engineering/data teams. The ideal candidate will have strong... 
    Databricks
    Local area

    Tiger Analytics Inc.

    Houston, TX
    2 days ago
  •  ...Job Title: Technology Lead | SAP Tableau | SAP BI - Data Engineer Work Location & Reporting Address: Houston, TX 77077 (Onsite...  ...willing to relocate to client's location) Must Have Skills: • Databricks • Pyspark Nice to Have Skills: • Tableau... 
    Databricks
    Relocation

    Diverse Lynx

    Houston, TX
    1 day ago
  •  ...making. The role performs exploratory data analysis, feature engineering, data pipeline development, and predictive modeling, working...  ...control (e.g., GitHub) and cloud analytics platforms (e.g., Databricks). Understanding ofAgile or SDLC practices. Domain Knowledge Familiarity... 
    Databricks
    Full time

    W. R. Berkley

    Houston, TX
    3 days ago
  •  ...optimization, and operational efficiency. You will work closely with engineers, data scientists, and operational experts to translate...  ...experience with modern data platforms and technologies (e.g., Databricks, SQL Server, SQL/NoSQL databases). Strong understanding of relational... 
    Databricks

    NOV

    Houston, TX
    2 days ago
  • $100k

     ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply...  ...Preferred skills: NLP, Text mining, Tableau, PowerBI, Databricks, Tensorflow REQUIRED SKILLS For Java /Full stack/Software... 
    Databricks
    Full time
    H1b

    SynergisticIT

    Houston, TX
    5 days ago
  •  ...TX, US 77010 Position Summary The Data Engineer is responsible for building, maintaining...  ...Build and manage ETL/ELT workflows using Databricks, Spark, Python and SQL. Design and maintain...  ...working with cloud storage systems (Azure, AWS S3, Google Cloud Storage) Experience... 
    Databricks

    Direct Energy Marketing Limited

    Houston, TX
    3 days ago
  •  ...stories and acceptance criteria for data engineers; maintain a prioritized, groomed backlog...  ...(e.g., MS Project or Smartsheet, Jira/Azure DevOps, Confluence, PowerPoint). Ability...  ...to Lakehouse technologies (e.g., Azure Databricks, Delta Lake, Synapse, Snowflake) and basic... 
    Databricks
    Permanent employment
    Contract work
    Local area

    Robotics Technologies LLC

    Houston, TX
    2 days ago
  •  ...the migration from a SQL Server-based architecture to a modern Databricks lakehouse, with a strong emphasis on reducing technical debt and...  ...field, with a preference for technical certifications in Azure and related disciplines. A minimum of 10 years' experience in data... 
    Databricks

    Confidential

    Houston, TX
    2 days ago
  •  ...Minimum of 5 years of hands-on experience working with Azure Virtual Desktops. Minimum of 5 years of experience as an Endpoint...  ...knowledge of the ITIL framework. Expert End Point Protection Engineering. Experience with Windows 10/11, Active Directory Structure,... 

    The Dignify Solutions, LLC

    Houston, TX
    4 days ago
  •  ...entire IBM Storage brand – product managers, engineers, technologists, researchers, marketers,...  ...Cloud Foundation, Microsoft Hyper‑V / Azure Stack HCI (Azure Local), Nutanix AOS,...  ...Management, Analytics & Lakehouse Platforms: Databricks, Snowflake, OpenText (Vertica), IBM Db2,... 
    Databricks
    Temporary work
    Work experience placement
    Local area
    Worldwide

    IBM Computing

    Houston, TX
    1 day ago
  •  ...product-led growth (PLG) Familiarity with modern data stack ecosystems, including cloud data platforms such as Snowflake, Databricks, AWS, Azure, and Google Cloud Exposure to AI and machine learning use cases, particularly how data integrity enables trustworthy AI... 
    Databricks
    Work experience placement
    Remote work
    Shift work

    GrabJobs

    Houston, TX
    2 days ago
  •  ...Quanex Quanex is looking for a Sr. Data Engineer to join our team located in Houston, Texas...  .... Experience with cloud platforms (Azure preferred). Experience with Microsoft Fabric...  ...to big data technologies (Spark, Databricks). Understanding of EDI or structured data... 
    Databricks
    Local area
    Relocation

    Quanex

    Houston, TX
    2 days ago
  • $80k - $110k

     ...Platforms: MLflow, Kubeflow, Amazon SageMaker, Azure ML, Google Vertex AI • Model Monitoring:...  ...SageMaker, Azure ML, Google Vertex AI, Databricks) • Knowledge of AI compliance frameworks...  ...Learning, Google Cloud Professional ML Engineer, Azure AI Engineer • Security... 
    Databricks
    Part time
    Flexible hours

    Alvarez & Marsal

    Houston, TX
    3 days ago
  •  ...Control Managers, as well as partner with our Technology software engineers to perform analysis and develop solutions to turn complex,...  ...services is preferred Utilize technologies like Alteryx, SQL, Databricks, ThoughtSpot and Tableau. Experience with tools and... 
    Databricks
    Work visa

    J.P. Morgan

    Houston, TX
    16 days ago
  •  ...Integration: Collaborate with cross-functional teams such as IT and engineering to integrate data from various sources into the customer data...  ...Python. Experience working within data platforms like Databricks/Snowflake, and analytics modeling platforms such as Tableau... 
    Databricks
    Full time

    FocusKPI

    Houston, TX
    2 days ago
  •  ...in these accounts. While you work with a team that includes hands-on resources who will build proofs of concept and demonstrate Databricks' products, you need to be technical and must understand the relevance and application of ML & AI within a range of use cases important... 
    Databricks
    Worldwide

    Colorwave

    Houston, TX
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Azure Databricks Engineer. Be the first to apply!