Azure Databricks Engineer
Cloud Analytics Technologies LLC
Job description:
Seeking a Specialist with 7 years of experience in designing and developing scalable data solutions using Azure Databricks
Design develop and optimize scalable data pipelines leveraging Azure Databricks to support enterprise level data processing and analytics Implement and maintain ETL workflows ensuring high performance data quality and reliability Integrate Azure Databricks with various Azure data services to build robust and scalable data platforms Monitor and optimize data workflows for scalability cost effectiveness and operational efficiency Collaborate with cross functional teams to align data solutions with business objectives and technical requirements Stay updated with the latest advancements in Azure Databricks and recommend best practices for continuous improvement
Roles and Responsibilities
Lead the design development and enhancement of complex data pipelines using Azure Databricks Write clean maintainable and efficient PySpark and Python code to support data ingestion transformation and analytics Troubleshoot and resolve issues related to data pipelines and workflows to ensure minimal downtime and high availability Collaborate with data architects analysts and stakeholders to gather requirements and deliver scalable data solutions Mentor and guide junior team members on Azure Databricks and best practices in data engineering Document data processes architectures and workflows to ensure knowledge sharing and compliance Participate actively in design discussions code reviews and agile ceremonies to foster a collaborative and highperforming team environment
Mandatory Skills : Databricks
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Azure Databricks Engineer in Houston, TX vacancy
- ...Employment Type: Full-Time About the Role We are seeking a highly skilled, hands-on Databricks Lead with 8+ years of experience in data engineering , including deep expertise in Azure Databricks, PySpark, and Structured Streaming. This role is ideal for a senior...DatabricksFull time
ZEUS SOLUTIONS INC
Houston, TXa month ago - ...experience in designing and developing scalable data solutions using Azure Databricks Design develop and optimize scalable data pipelines... ...team members on Azure Databricks and best practices in data engineering Document data processes architectures and workflows to...Databricks
Cloud Analytics Technologies LLC
Houston, TX1 day ago - ...Azure Data Engineer Houston TX - Onsite from day 1 Project Overview: New project- credit card settlement system ( CCSS) to support... ...: • Full stack experience, Azure functions, Datalake, Databricks logic app, tableau • Experience communicating with...Databricks
Netorbit
Houston, TX4 days ago - ...Azure Data Engineer Location: Spring Texas (On-Site) Need Only Local to Houston, TX Experience; 10+ Years Responsibilities Perform... ...Required Proficiency: Advanced SQL Snowflake Tamr Python GitHub Intermediate Databricks Airflow...DatabricksWork experience placementLocal area
Cedent Life Talent
Houston, TX3 days ago - Senior Data Engineer Key Accountabilities: Tech stack: Azure AD, Azure Key Vault, API Management, Azure Data Factor (ADF), Azure Databricks (DBX), Azure Storage, Azure SQL DB, Azure App Insights, Azure App Monitor, PowerBI (Power BI) Architects, designs, implements and...Databricks
- Azure Databricks Architect with Oil & Gas ExpLocation Houston TX onsite Role SummaryLead the design development and optimization of enterprisescale... ...and analytics solutions using Azure Databricks Drive data engineering best practices mentor team members and collaborate with...Databricks
- ...architecture, design, and implementation of advanced analytics solutions using Azure Databricks / Fabric. The ideal candidate will have a deep understanding of big data technologies, data engineering, and cloud computing, with a strong focus on Azure Databricks along...Databricks
Cloud Analytics Technologies LLC
Houston, TX1 day ago - Senior Data Engineer - Azure / DatabricksLocation: Houston, TX - HybridPosition Type: Full-TimeA well-established Houston-based company is... ...role for a senior data engineer with strong experience in Databricks, Python, Azure data technologies, and enterprise data integration...DatabricksPermanent employmentWork at office
- ...NAVA Software solutions is looking for an Azure Cloud Engineer Details: Azure Cloud Engineer Location: Houston TX - Hybrid Duration: Full time /Direct Hire KEY RESPONSIBILITIES Develop and implement a comprehensive cloud...Full time
Nava Software Solutions
Houston, TX2 days ago - ...Job Title : Lead Cloud Engineer Location : Houston, TX Job Description: Architects and manage the Azure cloud infrastructure for end user device management like hardware... ...solutions, using Azure functions, Azure Databricks, CI/CD pipelines and technical...DatabricksWork experience placement
United IT Solutions
Houston, TX3 days ago - ...AWS Cloud Engineer Location: Seattle, WA/St. Louis, MO/Plano, TX/Dallas, TX/Houston, TX (Onsite) Duration: Full-time only Job... ...: Design, develop, and optimize ETL/ELT pipelines using AWS & Databricks services such as Unity Catalog, Pyspark, AWS Glue, Lambda,...DatabricksFull time
JConnect Infotech
Houston, TX3 days ago - ...discuss end-to-end problem solving, feature engineering, predictive analytics, model selection,... ...cloud AI platforms such as AWS Bedrock, Azure OpenAI, or Vertex AI We are looking... ...Quality metrics Exposure to Databricks, Spark, Vector Databases, APIs, Cloud Platforms...DatabricksFull time
- ...EngineerPosition OverviewWe are seeking an experienced Systems Engineer to design, deploy, and maintain reliable, secure, and... ...supporting ETL/ELT pipelines Experience with Microsoft Fabric, Azure Databricks, and other modern cloud data platforms (preferred)QualificationsBachelor...Databricks
- ...Data Engineer Location: Houston, TX. Onsite Client: SMBC Key Responsibilities:... ...experience Extensive experience with Databricks, including ETL processes and data migration... ...additional cloud platforms like AWS, Azure, or GCP Knowledge of big data technologies...Databricks
Kasmo Global
Houston, TX3 days ago $80 - $95 per hour
...SRI Tech SolutionsJob Title : Senior AI Engineer No. Of Openings: 2Job Location: Houston,... ...native AI architectures using Microsoft Azure services and established AI design patternsCollaborate... ...with data engineering tools such as Databricks, Spark, Azure Data FactoryExperience...DatabricksHourly payFull timeContract workFor contractorsWork from home$153.6k - $207.8k
...professional or military experience- 5+ years of experience in data engineering, data architecture, and/or data platform development, with... ...preferred- Hands-on experience with Apache Iceberg, Spark, Databricks, Snowflake, Kafka, or equivalent distributed data processing...DatabricksFlexible hoursShift work$123k - $163k
...Requirements: Over 5 years of experience in data engineering or platform engineering, with a minimum of 2-3 years specifically in Databricks administration In-depth knowledge of... ...Spark Unity GameDev AWS Azure Cloud DevOps GitHub LESS More...DatabricksFull timeKforce Technology Staffing
Houston, TX13 days ago- Publicis Sapient in Houston, TX is seeking a Manager, Data Engineering to design and build the data foundation powering enterprise analytics... ..., and real-time pipelines, lakehouse architectures with Databricks and cloud tech, data governance, and data products. #J-18808...Databricks
- ...workshops, define AI strategy and work with engineering teams to bring high-value solutions from... ...LLMOps and cloud platforms such as AWS, Azure or GCP Working knowledge of Python,... ...SDLC practices and technologies such as Databricks, Snowflake, LangChain or Semantic Kernel...Databricks
EPAM Systems
Houston, TX4 days ago - ...data products for the enterprise. The Data Engineer,Senior will report to the Sr Manager,... ...automation Expertise with cloud platforms (Azure preferred) and services such as ADLS,... ...stack tools such as dbt, Snowflake, Databricks, Airflow, or Tidal Solid knowledge...Databricks
Blue Shield of CA
Houston, TX3 days ago $153.6k - $207.8k
...implementing AWS and/or third-party data analytics services (e.g. Redshift, Glue, LakeFormation, Databricks, dbt, Spark)Preferred qualification - Knowledge of data engineering pipelines, cloud solutions, ETL management, databases, visualizations and analytical platforms-...DatabricksFlexible hoursShift work- ...Architecture, emerging technologies and data engineering teams to enable data integration... ...environments - Hadoop (Apache, Cloudera), Cloud (Azure, Amazon, GCP) and messaging protocols -... ...in Cloud computing, Microsoft Azure - Databricks, Azure IoT, Kafka and Scada systems....DatabricksInterim role
- ...ecosystems, experience working closely with engineers and data scientists, and the ability to... ...Data Pipelines Cloud data platforms (Azure, AWS, or GCP) Analytics & BI... ...Data-related certifications (Azure, AWS, Databricks, etc.) are a plus Ideal Candidate Profile...Databricks
E-Solutions
Houston, TX1 day ago - ...Platforms Support implementation and optimization of Lakehouse architectures utilizing cloud-native technologies and Databricks. Collaborate with engineering teams to define data ingestion, transformation, storage, and consumption strategies. Ensure solutions are...DatabricksTemporary work3 days per week
Scadea
Houston, TX9 days ago - ...EngineerPosition OverviewWe are seeking a Database Systems Engineer to design, build, and maintain scalable, secure data... ...pipelines, managing relational and cloud-native databases in Azure, and integrating Databricks and Microsoft Fabric to deliver reliable data to BI...Databricks
- ...Support implementation and optimization of Lakehouse architectures utilizing cloud-native technologies and Databricks. Collaborate with engineering teams to define data ingestion, transformation, storage, and consumption strategies. Ensure solutions are scalable...Databricks
Tekwissen
Houston, TX1 day ago - ...you can push the limits of what's possible.As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology - Consumer and... ...data platforms including on premise Hadoop servers, AWS, Databricks and KubernetesPerforming unit test cases and integration testing...Databricks
- ...SORs, Data Lakes or Data WarehousesConfigure data pipelines using Azure Synapse Analytics or Data BricksConfigure Azure SQL or... ...- Azure Data Lake, Azure Data Factory, Azure Functions, Azure Databricks, SQL Database, Logic apps.Understanding on ansible pipeline for...Databricks
$173.46k - $231.98k
...one or more of the following areas: data architecture & engineering, data lakehouse & cloud warehouse platforms, enterprise... ...data warehouse and lakehouse platforms (Snowflake, Databricks, BigQuery, Redshift, Azure Synapse, or equivalent)Strong SQL skills and comfort with...DatabricksFull timeRemote work- ...data ecosystem. Their broader technology direction includes Databricks, AWS S3, Redshift, Athena, Power BI, Apache Iceberg, and more... ...capabilities. AWS is heavily involved in the initiative alongside engineering/data teams. The ideal candidate will have strong...DatabricksLocal area
Tiger Analytics Inc.
Houston, TXa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Databricks Engineer. Be the first to apply!
