Azure Databricks Engineer
Diverse Lynx
Azure Databricks Engineer
Location: Houston TX- Hybrid
Level: 5
Exp: 10+ Years
Core Responsibilities
Design and implement scalable data platforms and pipelines using Azure Databricks, Apache Spark, Pyspark, Delta Lake, and MLflow.
Design and implement data pipelines using Databricks, Spark, and Delta Lake for batch and streaming data.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Develop and maintain Lakehouse architecture leveraging Databricks and cloud storage solutions.
Lead the migration from legacy platforms to Lakehouse architecture.
Develop batch and streaming data pipelines for ingestion, transformation, and analytics.
Establish standards for data governance, quality, and security.
Collaborate with stakeholders to align architecture with business goals.
Mentor data engineers and developers on Databricks best practices.
Integrate Databricks with tools like Power BI, Tableau, Kafka, Snowflake, and Azure Data Factory.
Required Skills & Experience
8–10+ years in data engineering or architecture roles.
8+ years of hands-on experience with Databricks and Azure.
Strong command of SQL, Python, Scala, and Spark.
Experience with CI/CD pipelines, DevOps, and orchestration tools like Airflow or Data Factory.
Familiarity with Azure cloud platforms.
Deep understanding of distributed computing, performance tuning, and data security.
Preferred Qualifications
Bachelor's or Master's in Computer Science, Data Science, or related field.
Certifications such as Azure Solution Architect, Azure Data Engineer, or Databricks Certified Data Engineer or Solutions Architect.
Experience with data mesh, data fabric, or enterprise data architectures.
Domain knowledge in finance, healthcare, or public sector is a plus.
Hadoop & Scala experience
Additional Insights from Internal Communications
Emphasis on DataOps, data orchestration, and data modeling.
Strong ERP knowledge (e.g., SAP, Salesforce) is valued.
Candidates should be hands-on, capable of self-exploration, and able to drive analytics adoption across business teams.
A structured questionnaire is often used to assess candidates on areas like Unity Catalog, Spark optimization, partitioning techniques, and data security.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
- ...Azure Data Engineer Houston TX - Onsite from day 1 Project Overview: New project- credit card settlement system ( CCSS) to support... ...: • Full stack experience, Azure functions, Datalake, Databricks logic app, tableau • Experience communicating with...Databricks
- ...Azure Data Engineer Location: Spring Texas (On-Site) Need Only Local to Houston, TX Experience; 10+ Years Responsibilities Perform... ...Required Proficiency: Advanced SQL Snowflake Tamr Python GitHub Intermediate Databricks Airflow...DatabricksWork experience placementLocal area
- ...NAVA Software solutions is looking for a Azure Architect Details: Azure Integration Architect Location: Houston... ...in Azure Integration Services such as: Service Bus, Event Hub, DataBricks, Data Factory, Azure Storage, Key Vault, App Insights, API...Databricks
- ...experience in designing and developing scalable data solutions using Azure Databricks Design develop and optimize scalable data pipelines... ...team members on Azure Databricks and best practices in data engineering Document data processes architectures and workflows to...Databricks
- ...NAVA Software solutions is looking for an Azure Cloud Engineer Details: Azure Cloud Engineer Location: Houston TX - Hybrid Duration: Full time /Direct Hire KEY RESPONSIBILITIES Develop and implement a comprehensive cloud...SuggestedFull time
- ...AWS Cloud Engineer Location: Seattle, WA/St. Louis, MO/Plano, TX/Dallas, TX/Houston, TX Duration: Fulltime Job Description:... ...: Design, develop, and optimize ETL/ELT pipelines using AWS & Databricks services such as Unity Catalog, Pyspark, AWS Glue, Lambda, Step...DatabricksFull timeImmediate startRelocation
$60 - $65 per hour
...hands-on analytics and modeling. Adhere to our culture of humility, curiosity, and impact Process data using Python, PySpark, and Databricks Develop models and dashboards Learn the job while performing hands-on analytics and modeling Help business partners make more...DatabricksContract workRemote work- ...Job Description Job Description Azure Network Engineer (Junior to Mid-Level) Location: Houston, TX (Downtown – 100% On-Site) Employment Type: 6-12 month contract with possibility to extend each 6 months. Position Summary ioSpjere is seeking an Azure Network...Contract workRemote work
- ...Job Title - Azure Cloud Engineer - In person interview required Duration - 6 Months Location - Houston, TX (Day 1 Onsite) Job Description: Desired Technical Skills: • Solid understanding of Google Cloud and Microsoft Azure product offerings...
- ...Azure Engineer - Integrations Position Summary: We are looking for a mid to senior-level Azure Integration Engineer to support enterprise integration projects using Microsoft Azure services. In this role, you'll help build and maintain integration solutions between...
- ...architecture, design, and implementation of advanced analytics solutions using Azure Databricks / Fabric. The ideal candidate will have a deep understanding of big data technologies, data engineering, and cloud computing, with a strong focus on Azure Databricks along...Databricks
- ...measures are in place and aligned with enterprise architecture standards and principles. About The Role The Azure Infrastructure Engineer will design, build, secure, and automate enterprise-grade Azure platforms. Resource will own core platform engineering...Work experience placementWork at officeLocal areaImmediate startRemote workRelocation
- ...About the Role We're looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data... ...and maintain data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics Build and optimize data models...Databricks
- ...Design and develop end-to-end ETL pipelines using Azure Data Factory and Azure Databricks. Implement copy activities, data flows, error handling, dynamic... ...across multiple systems. Cloud Integration and Data Engineering Integrate diverse data sources including Oracle, SQL...Databricks
- ...data ecosystem. Their broader technology direction includes Databricks, AWS S3, Redshift, Athena, Power BI, Apache Iceberg, and more... ...capabilities. AWS is heavily involved in the initiative alongside engineering/data teams. The ideal candidate will have strong...DatabricksLocal area
- ...Job Title: Technology Lead | SAP Tableau | SAP BI - Data Engineer Work Location & Reporting Address: Houston, TX 77077 (Onsite... ...willing to relocate to client's location) Must Have Skills: • Databricks • Pyspark Nice to Have Skills: • Tableau...DatabricksRelocation
- ...making. The role performs exploratory data analysis, feature engineering, data pipeline development, and predictive modeling, working... ...control (e.g., GitHub) and cloud analytics platforms (e.g., Databricks). Understanding ofAgile or SDLC practices. Domain Knowledge Familiarity...DatabricksFull time
- ...optimization, and operational efficiency. You will work closely with engineers, data scientists, and operational experts to translate... ...experience with modern data platforms and technologies (e.g., Databricks, SQL Server, SQL/NoSQL databases). Strong understanding of relational...Databricks
$100k
...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply... ...Preferred skills: NLP, Text mining, Tableau, PowerBI, Databricks, Tensorflow REQUIRED SKILLS For Java /Full stack/Software...DatabricksFull timeH1b- ...TX, US 77010 Position Summary The Data Engineer is responsible for building, maintaining... ...Build and manage ETL/ELT workflows using Databricks, Spark, Python and SQL. Design and maintain... ...working with cloud storage systems (Azure, AWS S3, Google Cloud Storage) Experience...Databricks
- ...stories and acceptance criteria for data engineers; maintain a prioritized, groomed backlog... ...(e.g., MS Project or Smartsheet, Jira/Azure DevOps, Confluence, PowerPoint). Ability... ...to Lakehouse technologies (e.g., Azure Databricks, Delta Lake, Synapse, Snowflake) and basic...DatabricksPermanent employmentContract workLocal area
- ...the migration from a SQL Server-based architecture to a modern Databricks lakehouse, with a strong emphasis on reducing technical debt and... ...field, with a preference for technical certifications in Azure and related disciplines. A minimum of 10 years' experience in data...Databricks
- ...Minimum of 5 years of hands-on experience working with Azure Virtual Desktops. Minimum of 5 years of experience as an Endpoint... ...knowledge of the ITIL framework. Expert End Point Protection Engineering. Experience with Windows 10/11, Active Directory Structure,...
- ...entire IBM Storage brand – product managers, engineers, technologists, researchers, marketers,... ...Cloud Foundation, Microsoft Hyper‑V / Azure Stack HCI (Azure Local), Nutanix AOS,... ...Management, Analytics & Lakehouse Platforms: Databricks, Snowflake, OpenText (Vertica), IBM Db2,...DatabricksTemporary workWork experience placementLocal areaWorldwide
- ...product-led growth (PLG) Familiarity with modern data stack ecosystems, including cloud data platforms such as Snowflake, Databricks, AWS, Azure, and Google Cloud Exposure to AI and machine learning use cases, particularly how data integrity enables trustworthy AI...DatabricksWork experience placementRemote workShift work
- ...Quanex Quanex is looking for a Sr. Data Engineer to join our team located in Houston, Texas... .... Experience with cloud platforms (Azure preferred). Experience with Microsoft Fabric... ...to big data technologies (Spark, Databricks). Understanding of EDI or structured data...DatabricksLocal areaRelocation
$80k - $110k
...Platforms: MLflow, Kubeflow, Amazon SageMaker, Azure ML, Google Vertex AI • Model Monitoring:... ...SageMaker, Azure ML, Google Vertex AI, Databricks) • Knowledge of AI compliance frameworks... ...Learning, Google Cloud Professional ML Engineer, Azure AI Engineer • Security...DatabricksPart timeFlexible hours- ...Control Managers, as well as partner with our Technology software engineers to perform analysis and develop solutions to turn complex,... ...services is preferred Utilize technologies like Alteryx, SQL, Databricks, ThoughtSpot and Tableau. Experience with tools and...DatabricksWork visa
- ...Integration: Collaborate with cross-functional teams such as IT and engineering to integrate data from various sources into the customer data... ...Python. Experience working within data platforms like Databricks/Snowflake, and analytics modeling platforms such as Tableau...DatabricksFull time
- ...in these accounts. While you work with a team that includes hands-on resources who will build proofs of concept and demonstrate Databricks' products, you need to be technical and must understand the relevance and application of ML & AI within a range of use cases important...DatabricksWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks Engineer. Be the first to apply!




