Data Engineer Azure Databricks
Transcend IT Solutions
Job description
Data Engineer (Azure Databricks)
Philadelphia, PA (Hybrid)
Summary
Seeking a Data Engineer with 7+ years of experience to build and support cloud-based data platforms using Azure and Databricks. The role focuses on developing scalable data pipelines, supporting analytics and reporting, and enabling data-driven decision-making in a healthcare environment.
Key Responsibilities
-
Build and maintain ETL/ELT data pipelines.
-
Develop data solutions using Azure Databricks, ADF, and ADLS.
-
Create and optimize PySpark and SQL-based data processing frameworks.
-
Implement Delta Lake and Lakehouse architectures.
-
Support data migration, modernization, and cloud transformation projects.
-
Ensure data quality, reliability, and performance.
-
Build data models and curated datasets for reporting and analytics.
-
Implement CI/CD, monitoring, and DevOps best practices.
-
Collaborate with business users, architects, and product teams in an Agile environment.
Required Skills
-
Azure Databricks
-
Azure Data Factory (ADF)
-
Azure Data Lake Storage (ADLS Gen2)
-
PySpark
-
Python
-
SQL
-
Delta Lake
-
Data Modeling
-
ETL/ELT Development
-
Azure Cloud Platform
-
Git & CI/CD
-
Agile/Scrum
-
Preferred Skills
-
Azure Synapse Analytics
-
Power BI
-
Azure DevOps
-
Infrastructure as Code (IaC)
-
FHIR/HL7
-
AI/ML Data Pipelines
Required Experience
-
7+ years in Data Engineering
-
5+ years with Azure Data Technologies
-
2+ years in Healthcare, Payer, Health Plan, or Managed Care domains
-
Experience with large-scale data pipelines and integration solutions
Nice to Have
-
Claims Data
-
Membership Data
-
Provider Data
-
Care Management Data
- ...across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and... ...Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)... ...Jenkins Additional Technologies: Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR Popular...DatabricksWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and... ...cloud-based solution/platform (AWS, Azure, GCP) Advanced level proficiency with at... ...solutions like Snowflake, Redshift, Databricks 5+ years of experience with SQL or NoSQL...DatabricksWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...Resource Groups (ERGs) to support employees. Data Engineer / AI Engineer (Co-op) We are seeking... ...to refine their usage in a modern Databricks environment. If you are passionate... ...building on Cloud/SaaS infrastructure (e.g., Azure, Databricks, Snowflake)....DatabricksTemporary workInternshipImmediate start
- ...Good to have Scala • Proven experience (6+ years) as a data engineer and data scientist, preferably in a fast-paced technology or... ...ETL Development background needed. Cloud Technologies - AWS S3, AWS Athena SQL - Hive,Teradata,Spark SQL Databricks...Databricks
- ...Overview We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application... ...experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars,...Databricks
- ...delivering solutions around data-driven enterprise, IT modernization... ..., including Fabric and Databricks for our customers. As a technical... ...~ Expertise with Microsoft Azure infrastructure and data... ...working environments for data engineers and scientists, and general knowledge...Databricks
- ...Corporate Services Department: PennDNA Data Management and Ops Location: Remote... ...Days Summary : This Senior Data Engineer role will be a key contributor to Penn... ...work within Cloud technology such as Azure and Databricks to ensure efficient data extraction, transformation...DatabricksRemote work
- ...Entity: Corporate Department: PennDNA Data Mgmt and Ops Location: Remote based... ...Days Summary : The Lead Data Engineer- People will be responsible for... ...within Cloud technology such as AWS, Azure and/or Databricks to ensure efficient data extraction, transformation...DatabricksRemote work
$100.79k - $160.26k
...see what we can achieve. Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates... ...Design and implement data pipelines using Azure data technologies (e.g., Azure Data Factory, Azure Databricks, Azure Event Hubs, SSIS) to ingest, process, and...DatabricksFull timeWork at officeRemote workVisa sponsorship- ...Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our... ...level data platforms (e.g., AWS, Azure, GCP). Designing, developing,... ...environments such as Snowflake, Databricks, Azure SQL, Amazon RDS Comfort...DatabricksFull timeWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...for our employees! Job Overview We're looking for a Principal Data Engineer who brings strong technical judgment, a product-oriented... ...Required) Data Architecture (Required) Data Engineering (Required) Databricks DBRX (Required) Engineering Leadership (Required) Project...DatabricksFull timeTemporary workPart timeWork experience placementLocal areaFlexible hours
- ...Enterprise AI (EAI) builds the data foundations that GSKs AI systems depend our operating... ...digital workers do the hands-on data engineering. They generate pipelines test and deploy... ...and streaming architectures such as Databricks BigQuery Airflow dbt or Spark. ~ Experience...DatabricksPermanent employmentFull timeLocal areaRemote workFlexible hours
$95k - $120k
...the fiscal year ended May 31, 2024. The Data Solutions Engineer is responsible for developing,... ...transforming and integrating data within Databricks, and creating trusted, business-ready... ...scalable data solutions on Microsoft Azure and related enterprise platform Essential...DatabricksFull timeFor contractorsWork visa- We are looking for a Data Engineer to join a Contract engagement supporting people analytics and HR-focused data initiatives in Philadelphia... ...scalable data pipelines and curated data assets using Azure Databricks and Azure Data Factory. The ideal candidate will be...DatabricksContract work
$85 - $90 per hour
...Job Description Job Description Principal Data Engineer Location: Philadelphia, PA Onsite Flexibility: Hybrid Job Details... ...a primary emphasis on real-time streaming, IoT telemetry, Databricks, Azure, data services for APIs and microservices, and reliable...DatabricksContract workRemote workWork visa- ...innovate and inspire. Make history with us.Operational Support Data Engineer - Agentic AI & ML Ops (Co-op)We are seeking a motivated... ...AI, and Agentic AI solutions.You will work with Databricks, Snowflake, Azure, ADLS, ADF, Power BI, Python, PySpark, SQL, LLMs, and modern...DatabricksFull time
- ...innovate and inspire. Make history with us.Operational Support Data Engineer (Co-op)We are seeking a motivated and curious Data... ..., and AI/ML solutions.You will work with tools such as Databricks, Snowflake, Azure, ADLS, ADF, Power BI, and SAP integrations in an Agile environment...DatabricksFull time
$176k - $179.5k
...will design and manage scalable data pipelines and secure... ...scientists, machine learning engineers, and industry experts to develop... ...major cloud platforms (AWS, Azure, GCP) A strong foundation in... ...commonly used data platforms (Databricks, Databricks Asset Bundles, Snowflake...DatabricksApprenticeshipEasy workShift work$116.2k - $229.1k
...Summary Join Deloitte’s AI & Engineering practice and help... ...technology platforms, modernize data environments, and unlock value through innovation. As a Databricks Engineer in our AI & Data practice... ...practices with tools such as Azure DevOps, AWS Code Pipeline, Jenkins...DatabricksLocal areaVisa sponsorship- ...Slalom, we co-create custom software, data, AI, and cloud solutions with... ...organizations.Our Data Architecture & Engineering team sees data as the foundation... ...Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks, and Snowflake, along with the technologies...DatabricksTemporary workWork at officeLocal area
$91.1k - $179.5k
...ends on 10/30/2026. Work you'll do The Data Engineer Consultant will support data architecture... ...wrangling, including proficiency in Databricks or Snowflake.Ability to travel 0-25%, on... ...of Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP),...DatabricksLocal area- We Are:The beginning of a new Data & AI decade that will reshape work and society has... ..., and Power Ecosystem.You Are:As a Data Engineering, Management & Governance professional, you... ...and data warehouse solutions, Databricks or Snowflake.Ability to lead and effectively...DatabricksWork experience placementLive inWork at officeLocal area
$158k - $178k
...all.Job Title: Senior Principal, Data Architecture & EngineeringWho You’... ...organizations.Our Data Architecture & Engineering team sees data as the foundation... ...Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks, and Snowflake, along with the technologies...DatabricksTemporary workLocal areaFlexible hours- ...is currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.Responsibilities... ...AI service providers (e.g., AWS, GCP, Azure) to provide a first-in-market solution... ...on expertise in Python, PySpark, SQL, Databricks, and Snowflake, while partnering with...DatabricksH1bLocal area
- ...Job Description Job Description Job Title: Senior Azure Databricks Engineer Work Location & Reporting Address: Philadelphia, PA 19113 (Onsite... ...Must Have Skills: 8-10 years of experience in data operations with strong focus on Azure Databricks. EDWH,...DatabricksContract workImmediate startRelocation
- Position Summary Senior Data Engineer -Sr Consultant- AI&EAre you an experienced, passionate pioneer in technology who wants... ...domains. Ability to deliver cloud-based data products using Azure Databricks, PySpark, Python, AWS services, Teradata Vantage,...Databricks
$95k - $112k
...collaborative environment? As an experienced Data Engineer-Consultant you will have the ability to... ...level data pipeline specifications in Databricks and Apache Hadoop using SparkUnit test... ...in Data engineeringTechnical - SQL, Azure Databricks, Apache Spark* Bachelor's...DatabricksLocal area$116.2k - $229.1k
Position Summary Cloud Data Engineer Join our AI & Engineering team in transforming technology platforms... ...Big Data, cloud, and AI/ML platforms across Azure, AWS, GCP, and on-premises environments, with deep Databricks Lakehouse expertise: Delta Lake, Delta Live...DatabricksLocal area$116.2k - $229.1k
Position Summary Data-driven organizations need modern cloud analytics solutions... ...Preferred: Experience with Snowflake and Databricks Experience with Google Cloud Platform... ...other cloud platforms, including Microsoft Azure and Amazon Web Services Google Cloud Platform...DatabricksLocal areaVisa sponsorship$112.8k - $153.7k
...your ideas. This is a senior engineering role. You will architect, operate... ...continuously improve cloud data and analytics platforms (e.g.... ...Microsoft Fabric, Snowflake, Databricks) and own BI delivery... ...follow.Relevant certifications (Azure, Snowflake, Databricks, etc.)...DatabricksFull timeContract workLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer Azure Databricks. Be the first to apply!
- junior data engineer remote Philadelphia, PA
- principal data engineer Philadelphia, PA
- data engineer analytics Philadelphia, PA
- data science developer Philadelphia, PA
- data engineer manager Philadelphia, PA
- big data developer Philadelphia, PA
- big data devops engineer Philadelphia, PA
- data center engineer Philadelphia, PA
- big data cloud engineer Philadelphia, PA
- big data engineer Philadelphia, PA






