Senior Data Engineer (Azure Databricks)
Akaasa Technologies
Senior Data Engineer (Azure Databricks)
Location: Houston, TX (Onsite)
Duration: 6 10 Months Contract
Interview: Virtual
Technical Skills: Azure Databricks | Delta Lake | PySpark | SQL | Scala | Databricks Workflows | Databricks Jobs | Unity Catalog | Azure DevOps | CI/CD | YAML Pipelines | Data Migration | ETL/ELT | Data Governance | Data Lineage | Alteryx Conversion | Azure Data Platform
Note:
- Must be local with DL copy
- LinkedIn with location and photo (before 2023)
Position Overview
Our client is seeking a Senior Data Engineer with deep hands-on expertise in Azure Databricks to design, develop, and manage enterprise-scale data platforms. The ideal candidate will have strong experience with Databricks Workflows, Delta Lake, PySpark, Unity Catalog, Azure DevOps, and CI/CD automation .
This role will focus on building code-driven data solutions, modernizing legacy data platforms, and migrating existing workflows into scalable Databricks-based architectures.
Required Skills & Experience
- Strong hands-on experience with Azure Databricks engineering and development .
- Expertise in building data pipelines using:
- PySpark
- SQL
- Scala
- Delta Lake
- Experience with Databricks Workflows and Jobs for production orchestration.
- Strong knowledge of Databricks Unity Catalog including governance, security, and lineage.
- Experience with Azure DevOps, CI/CD pipelines, YAML, and deployment automation .
- Experience migrating legacy data solutions into modern cloud data platforms.
- Strong understanding of enterprise data architecture and data engineering best practices.
Others Qualifications / Certifications
- Databricks certifications highly preferred:
- Databricks Certified Data Engineer Associate
- Databricks Certified Data Engineer Professional
- Microsoft certifications preferred:
- Azure Data Engineer Associate (DP-203)
- Azure Fundamentals (AZ-900) or equivalent Azure knowledge
- Experience converting Alteryx workflows into PySpark/SQL solutions is a major plus.
- Familiarity with legacy ETL modernization and reverse-engineering existing workflows.
Key Responsibilities
- Design, develop, and optimize end-to-end data pipelines using Azure Databricks, Delta Lake, PySpark, SQL, and Scala .
- Build and manage production workflows using Databricks Workflows and Jobs for pipeline orchestration and automation.
- Lead migration efforts from legacy data platforms into modern Databricks environments.
- Convert legacy ETL workflows (including Alteryx workflows) into scalable PySpark/SQL-based solutions .
- Implement data governance, security, access controls, schemas, and lineage using Databricks Unity Catalog .
- Develop and maintain CI/CD processes for Databricks deployments using Azure DevOps, YAML pipelines, and automation frameworks .
- Optimize data processing performance, reliability, and scalability across enterprise data platforms.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer (Azure Databricks) in Houston, TX vacancy
- ...Job Description Job Description Job Title: Sr. Data Engineer Location: Houston, TX Length: 6-10 months Job Summary... ...Data Engineer with extensive, hands-on expertise in Azure Databricks to design, develop, and manage our enterprise data platform...DatabricksSenior
$95k - $150k
...work in a collaborative environment? As an experienced Senior Data Engineer you will have the ability to share new ideas and... ...Design, develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks Write and tune PySpark / Spark SQL notebooks for large...DatabricksSeniorPermanent employment- ...Your Role The Data Services team is responsible for technical... ...for the enterprise. The Data Engineer, Senior will report to the Sr... ...Expertise with cloud platforms (Azure preferred) and services such... ...tools such as dbt, Snowflake, Databricks, Airflow, or Tidal. Solid knowledge...DatabricksSenior
Blue Shield of CA
Houston, TX2 days ago $80k - $133k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability... ...You Will Do:Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern... ...data platforms leveraging AWS, Azure, Databricks, and other modern technologies.Design...DatabricksSeniorFull timeContract workFlexible hours$77k - $202k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging... ...architecture strategies. As a Senior Associate you analyze complex... ...Data Engineer Microsoft Azure Solutions Architect, Azure... ...Snowflake Core, Snowflake Databricks Data Engineer Associate]...DatabricksSeniorFull timeH1b$124k - $280k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging... ...future business needs. As a Senior Manager you lead large projects... ...Data Engineer Microsoft Azure Solutions Architect, Azure... ..., Snowflake Architect, Databricks Data Engineer Associate] is...DatabricksSeniorFull timeH1b- ...is advancing Marathon Petroleum’s data ecosystem through trusted, governed... ...excellence and AI-driven innovation. The Senior Data Operations Engineer is a senior technical leader... ...on cloud-native platforms including Databricks, Azure, Cognite, streaming technologies, observability...DatabricksSeniorFull timeLocal area
$77k - $202k
...LevelSenior AssociateJob Description & SummaryAt PwC, our people in data and analytics focus on leveraging data to drive insights and... ...solutions to build and manage the advanced Data ecosystem. As a Senior Associate you are responsible for analyzing complex problems, mentoring...DatabricksSeniorFull timeH1b- ...Quanex Quanex is looking for a Sr. Data Engineer to join our team located in Houston, Texas... ...architectures. Experience with cloud platforms (Azure preferred). Experience with Microsoft... ...to big data technologies (Spark, Databricks). Understanding of EDI or structured data...DatabricksSeniorLocal areaRelocation
Quanex
Houston, TX5 days ago - Position Overview We are seeking a Senior Data Engineer to design, build, and operate cloud-scale... ...distributed processing frameworks (Spark, Databricks, Flink, Beam). Implement lakehouse/... .... Utilize cloud data services (Azure Data Lake/Databricks/Synapse; AWS S3/EMR...DatabricksSenior
- ...Services Network as a contract Sr Data Engineer . This is a Houston based... ...client is seeking an experienced Senior Data Engineer to design, build,... ...with cloud-based data platforms (Azure preferred) Hands-on experience with Databricks, Spark, SQL, and Python Experience...DatabricksSeniorPermanent employmentContract work
- The Senior Data Engineer will design, implement, and sustain RectorSeal's Azure cloud data platform and medallion architecture to support the Data & BI team. This delivery... ...architectures and ELT/ETL workflows using Databricks, Lakeflow, Azure Data Factory, FiveTran, and...DatabricksSeniorFor contractors
- Job DescriptionAs a Senior Lead Software Engineer at JPMorganChase within the Corporate... ...integral part of an agile data engineering team. To... ...cloud-native experience (AWS, Azure, or GCP)Ability to present... ...modern data platforms such as Databricks or SnowflakeDeep hands-on experience...DatabricksSeniorWork at office
- ...join our team today. Position Specific Description As a Senior Data Engineer, you will be responsible for designing, building, and... ...-on with modern data technologies such as Amazon Redshift, Databricks, and cloud-based data processing frameworks to ensure reliable...DatabricksSeniorFull timeFor contractorsWork experience placementLocal areaRelocation
$118k - $196.7k
...on building scalable, enterprise-grade data platforms that support complex... ...enterprise data architecture patterns across Azure and Databricks environments. Establish scalable data... ...end-to-end delivery of complex data engineering initiatives from requirements through...DatabricksSeniorFull timeTemporary workFlexible hours$30 - $35 per hour
Data Engineer- DatabricksLocation: Remote - CST HoursEmployment Type: Full-Time ConsultantDuration: Project Based Contract Through... ...running smoothly. In this role, you’ll support a modern Databricks + Snowflake + Azure Data Factory (ADF) Enterprise Data Warehouse (EDW)...DatabricksFull timeContract workLocal areaRemote workShift work$100.79k - $160.26k
...s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates... ...and implement data pipelines using Azure data technologies (e.g., Azure Data Factory, Azure Databricks, Azure Event Hubs, SSIS) to ingest, process, and...DatabricksFull timeWork at officeRemote workRelocationVisa sponsorshipRelocation package$103k - $170k
...depends on a trustworthy, well-governed data foundation that turns raw sensor... ..., decision-ready information. The Data Engineer, within the Data & AI team, designs, builds... ...linkage, and self-service analytics on our Azure, Databricks, and Snowflake stack. Success requires...DatabricksTemporary workWork at officeLocal areaRemote workFlexible hours- ...Stanford Climate Ventures is seeking a Data Engineer to join their Data & AI team in Houston, TX. In this role, you will design, build,... ...skills in Python and SQL, and experience with Apache Spark and Databricks. The position offers some hybrid work flexibility and a...Databricks
Stanford Climate Ventures
Houston, TX4 days ago - The Senior Data Engineer supports the planning, development and use of middleware technologies and services for integrating systems and exposing, transporting, and consuming data in a secure and reliable manner across a hybrid of applications, services and trading partners...SeniorFull timeFlexible hours
$128k - $252.5k
...our clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with... ...team of interdisciplinary data scientists, engineers, architects, and consultants, our work... ...in leveraging cloud environments (AWS, Azure, or GCP) to deploy AI/ML workloadsLive within...SeniorLocal area- ...successfully tripled the size of our company since going public in December 2021 while maintaining a strong balance sheet. The Sr. Data Engineer- Operationsis responsible for designing, building, and operating scalable, reliable, and secure data pipelines that support...SeniorFull timeWork at officeRemote work
$80 - $95 per hour
...SRI Tech SolutionsJob Title : Senior AI Engineer No. Of Openings: 2Job... ...architectures using Microsoft Azure services and established AI... ...design patternsCollaborate with Data Scientists and other AI Engineers... ...engineering tools such as Databricks, Spark, Azure Data...DatabricksSeniorHourly payFull timeContract workFor contractorsWork from home$128k - $249k
...and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the... ...implementation, and optimization of Lakehouse, Warehouse, and Azure AI Foundry data pipelines. Role involves mentoring staff,...SeniorFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift- ...development expertise to include but not limited toProvides technical support and development expertise for Data Warehouse technologies Snowflake Microsoft SQL Azure HANA and other on premise cloud environments in Global Trading portfolioDevelop or enhance visualizations...Senior
- ...Senior Data Engineer Location: Houston, TX Contract Length: 12+ Months Job Ref: 247245 Seeking a... ...pipelines Strong experience with AWS, Azure, or GCP Experience with distributed data... ...technologies such as Spark or Databricks Experience with data modeling, data architecture...DatabricksContract work
Strategic Staffing Solutions
Houston, TX2 days ago - ...SCM Data, Innovation & analytics is seeking a Data modeler with strong Databricks expertise to design, build, and operationalize scalable Supply Chain data products that... ...processing. Hands‑on knowledge with prompt engineering Hands‑on experience in developing solutions using...Databricks
Integrated Resources
Houston, TX4 days ago - ...Blue Shield of CA is seeking a Senior Data Engineer to lead the design, build, and operation of complex data pipelines and cloud data solutions across the enterprise. This hands-on technical leader will contribute to engineering best practices and drive production readiness...Senior
Blue Shield of CA
Houston, TX4 days ago - Job Family:Data Science & AnalysisTravel Required:Up... ...seeks a Data Engineer to support the development... ...under the guidance of senior engineers.Develop and maintain... ...and services in AWS and Azure.Assist with the... ...and agenciesExposure to Databricks, Spark, or large-scale...DatabricksPermanent employmentFull timeInternshipWork at officeFlexible hours
- ...Overview Databricks, Python, Statistics (especially Monte Carlo simulation), building viz to support findings, along with communication with the lead data analytics and risk department would be key skills. Understanding the business (i.e., O&G) would be a plus Responsibilities...DatabricksPermanent employmentContract workLocal area
Quantum Technologies USA
Houston, TX2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer (Azure Databricks). Be the first to apply!
Related searches
- aws data engineer Houston, TX
- big data devops engineer Houston, TX
- big data developer Houston, TX
- software data engineer Houston, TX
- data center engineer Houston, TX
- big data cloud engineer Houston, TX
- director data engineering Houston, TX
- big data engineer Houston, TX
- senior data integration developer Houston, TX
- data developer Houston, TX