Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer Azure Databricks

Temporary

Transcend IT Solutions

Job description

Data Engineer (Azure Databricks)
Philadelphia, PA (Hybrid)

Summary

Seeking a Data Engineer with 7+ years of experience to build and support cloud-based data platforms using Azure and Databricks. The role focuses on developing scalable data pipelines, supporting analytics and reporting, and enabling data-driven decision-making in a healthcare environment.

Key Responsibilities

  • Build and maintain ETL/ELT data pipelines.

  • Develop data solutions using Azure Databricks, ADF, and ADLS.

  • Create and optimize PySpark and SQL-based data processing frameworks.

  • Implement Delta Lake and Lakehouse architectures.

  • Support data migration, modernization, and cloud transformation projects.

  • Ensure data quality, reliability, and performance.

  • Build data models and curated datasets for reporting and analytics.

  • Implement CI/CD, monitoring, and DevOps best practices.

  • Collaborate with business users, architects, and product teams in an Agile environment.

Required Skills

  • Azure Databricks

  • Azure Data Factory (ADF)

  • Azure Data Lake Storage (ADLS Gen2)

  • PySpark

  • Python

  • SQL

  • Delta Lake

  • Data Modeling

  • ETL/ELT Development

  • Azure Cloud Platform

  • Git & CI/CD

  • Agile/Scrum

  • Preferred Skills

  • Azure Synapse Analytics

  • Power BI

  • Azure DevOps

  • Infrastructure as Code (IaC)

  • FHIR/HL7

  • AI/ML Data Pipelines

Required Experience

  • 7+ years in Data Engineering

  • 5+ years with Azure Data Technologies

  • 2+ years in Healthcare, Payer, Health Plan, or Managed Care domains

  • Experience with large-scale data pipelines and integration solutions

Nice to Have

  • Claims Data

  • Membership Data

  • Provider Data

  • Care Management Data

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer Azure Databricks in Philadelphia, PA vacancy
  •  ...across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and...  ...Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)...  ...Jenkins Additional Technologies: Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR Popular... 
    Databricks
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    CapTech

    Philadelphia, PA
    5 days ago
  •  ...across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and...  ...cloud-based solution/platform (AWS, Azure, GCP) Advanced level proficiency with at...  ...solutions like Snowflake, Redshift, Databricks 5+ years of experience with SQL or NoSQL... 
    Databricks
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    CapTech

    Philadelphia, PA
    5 days ago
  •  ...Resource Groups (ERGs) to support employees. Data Engineer / AI Engineer (Co-op) We are seeking...  ...to refine their usage in a modern Databricks environment. If you are passionate...  ...building on Cloud/SaaS infrastructure (e.g., Azure, Databricks, Snowflake).... 
    Databricks
    Temporary work
    Internship
    Immediate start

    The Campbell's Company

    Camden, NJ
    5 days ago
  •  ...Good to have Scala • Proven experience (6+ years) as a data engineer and data scientist, preferably in a fast-paced technology or...  ...ETL Development background needed. Cloud Technologies - AWS S3, AWS Athena SQL - Hive,Teradata,Spark SQL Databricks... 
    Databricks

    United IT Solutions

    Philadelphia, PA
    4 days ago
  •  ...Overview We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application...  ...experience with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars,... 
    Databricks

    Susquehanna International Group, LLP

    Bala Cynwyd, PA
    1 day ago
  •  ...delivering solutions around data-driven enterprise, IT modernization...  ..., including Fabric and Databricks for our customers. As a technical...  ...~ Expertise with Microsoft Azure infrastructure and data...  ...working environments for data engineers and scientists, and general knowledge... 
    Databricks

    Reply

    Philadelphia, PA
    2 days ago
  •  ...Corporate Services Department: PennDNA Data Management and Ops Location: Remote...  ...Days Summary : This Senior Data Engineer role will be a key contributor to Penn...  ...work within Cloud technology such as Azure and Databricks to ensure efficient data extraction, transformation... 
    Databricks
    Remote work

    Penn Medicine

    Philadelphia, PA
    3 days ago
  •  ...Entity: Corporate Department: PennDNA Data Mgmt and Ops Location: Remote based...  ...Days Summary : The Lead Data Engineer- People will be responsible for...  ...within Cloud technology such as AWS, Azure and/or Databricks to ensure efficient data extraction, transformation... 
    Databricks
    Remote work

    Penn Medicine

    Philadelphia, PA
    4 days ago
  • $100.79k - $160.26k

     ...see what we can achieve. Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates...  ...Design and implement data pipelines using Azure data technologies (e.g., Azure Data Factory, Azure Databricks, Azure Event Hubs, SSIS) to ingest, process, and... 
    Databricks
    Full time
    Work at office
    Remote work
    Visa sponsorship

    DLA Piper

    Philadelphia, PA
    5 days ago
  •  ...Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our...  ...level data platforms (e.g., AWS, Azure, GCP). Designing, developing,...  ...environments such as Snowflake, Databricks, Azure SQL, Amazon RDS Comfort... 
    Databricks
    Full time
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    CapTech

    Philadelphia, PA
    5 days ago
  •  ...for our employees! Job Overview We're looking for a Principal Data Engineer who brings strong technical judgment, a product-oriented...  ...Required) Data Architecture (Required) Data Engineering (Required) Databricks DBRX (Required) Engineering Leadership (Required) Project... 
    Databricks
    Full time
    Temporary work
    Part time
    Work experience placement
    Local area
    Flexible hours

    T-Mobile

    Philadelphia, PA
    5 days ago
  •  ...Enterprise AI (EAI) builds the data foundations that GSKs AI systems depend our operating...  ...digital workers do the hands-on data engineering. They generate pipelines test and deploy...  ...and streaming architectures such as Databricks BigQuery Airflow dbt or Spark. ~ Experience... 
    Databricks
    Permanent employment
    Full time
    Local area
    Remote work
    Flexible hours

    GSK

    Philadelphia, PA
    21 days ago
  • $95k - $120k

     ...the fiscal year ended May 31, 2024. The Data Solutions Engineer is responsible for developing,...  ...transforming and integrating data within Databricks, and creating trusted, business-ready...  ...scalable data solutions on Microsoft Azure and related enterprise platform Essential... 
    Databricks
    Full time
    For contractors
    Work visa

    Stonhard

    Maple Shade, NJ
    4 days ago
  • We are looking for a Data Engineer to join a Contract engagement supporting people analytics and HR-focused data initiatives in Philadelphia...  ...scalable data pipelines and curated data assets using Azure Databricks and Azure Data Factory. The ideal candidate will be... 
    Databricks
    Contract work

    Robert Half

    Philadelphia, PA
    16 hours ago
  • $85 - $90 per hour

     ...Job Description Job Description Principal Data Engineer Location: Philadelphia, PA Onsite Flexibility: Hybrid Job Details...  ...a primary emphasis on real-time streaming, IoT telemetry, Databricks, Azure, data services for APIs and microservices, and reliable... 
    Databricks
    Contract work
    Remote work
    Work visa

    GTT, LLC

    Philadelphia, PA
    a month ago
  •  ...innovate and inspire. Make history with us.Operational Support Data Engineer - Agentic AI & ML Ops (Co-op)We are seeking a motivated...  ...AI, and Agentic AI solutions.You will work with Databricks, Snowflake, Azure, ADLS, ADF, Power BI, Python, PySpark, SQL, LLMs, and modern... 
    Databricks
    Full time

    Campbell Soup Company

    Camden, NJ
    1 day ago
  •  ...innovate and inspire. Make history with us.Operational Support Data Engineer (Co-op)We are seeking a motivated and curious Data...  ..., and AI/ML solutions.You will work with tools such as Databricks, Snowflake, Azure, ADLS, ADF, Power BI, and SAP integrations in an Agile environment... 
    Databricks
    Full time

    Campbell Soup Company

    Camden, NJ
    3 days ago
  • $176k - $179.5k

     ...will design and manage scalable data pipelines and secure...  ...scientists, machine learning engineers, and industry experts to develop...  ...major cloud platforms (AWS, Azure, GCP) A strong foundation in...  ...commonly used data platforms (Databricks, Databricks Asset Bundles, Snowflake... 
    Databricks
    Apprenticeship
    Easy work
    Shift work

    McKinsey & Company

    Philadelphia, PA
    4 days ago
  • $116.2k - $229.1k

     ...Summary Join Deloitte’s AI & Engineering practice and help...  ...technology platforms, modernize data environments, and unlock value through innovation. As a Databricks Engineer in our AI & Data practice...  ...practices with tools such as Azure DevOps, AWS Code Pipeline, Jenkins... 
    Databricks
    Local area
    Visa sponsorship

    Deloitte

    Philadelphia, PA
    4 days ago
  •  ...Slalom, we co-create custom software, data, AI, and cloud solutions with...  ...organizations.Our Data Architecture & Engineering team sees data as the foundation...  ...Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks, and Snowflake, along with the technologies... 
    Databricks
    Temporary work
    Work at office
    Local area

    Slalom

    Philadelphia, PA
    2 days ago
  • $91.1k - $179.5k

     ...ends on 10/30/2026. Work you'll do The Data Engineer Consultant will support data architecture...  ...wrangling, including proficiency in Databricks or Snowflake.Ability to travel 0-25%, on...  ...of Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP),... 
    Databricks
    Local area

    Deloitte

    Philadelphia, PA
    3 days ago
  • We Are:The beginning of a new Data & AI decade that will reshape work and society has...  ..., and Power Ecosystem.You Are:As a Data Engineering, Management & Governance professional, you...  ...and data warehouse solutions, Databricks or Snowflake.Ability to lead and effectively... 
    Databricks
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Philadelphia, PA
    2 days ago
  • $158k - $178k

     ...all.Job Title: Senior Principal, Data Architecture & EngineeringWho You’...  ...organizations.Our Data Architecture & Engineering team sees data as the foundation...  ...Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), Databricks, and Snowflake, along with the technologies... 
    Databricks
    Temporary work
    Local area
    Flexible hours

    Slalom

    Philadelphia, PA
    3 days ago
  •  ...is currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.Responsibilities...  ...AI service providers (e.g., AWS, GCP, Azure) to provide a first-in-market solution...  ...on expertise in Python, PySpark, SQL, Databricks, and Snowflake, while partnering with... 
    Databricks
    H1b
    Local area

    KPMG

    Philadelphia, PA
    1 day ago
  •  ...Job Description Job Description Job Title: Senior Azure Databricks Engineer Work Location & Reporting Address: Philadelphia, PA 19113 (Onsite...  ...Must Have Skills: 8-10 years of experience in data operations with strong focus on Azure Databricks. EDWH,... 
    Databricks
    Contract work
    Immediate start
    Relocation

    Diverse Lynx

    Philadelphia, PA
    22 days ago
  • Position Summary Senior Data Engineer -Sr Consultant- AI&EAre you an experienced, passionate pioneer in technology who wants...  ...domains. Ability to deliver cloud-based data products using Azure Databricks, PySpark, Python, AWS services, Teradata Vantage,... 
    Databricks

    Deloitte

    Philadelphia, PA
    1 day ago
  • $95k - $112k

     ...collaborative environment? As an experienced Data Engineer-Consultant you will have the ability to...  ...level data pipeline specifications in Databricks and Apache Hadoop using SparkUnit test...  ...in Data engineeringTechnical - SQL, Azure Databricks, Apache Spark* Bachelor's... 
    Databricks
    Local area

    Deloitte

    Philadelphia, PA
    3 days ago
  • $116.2k - $229.1k

    Position Summary Cloud Data Engineer Join our AI & Engineering team in transforming technology platforms...  ...Big Data, cloud, and AI/ML platforms across Azure, AWS, GCP, and on-premises environments, with deep Databricks Lakehouse expertise: Delta Lake, Delta Live... 
    Databricks
    Local area

    Deloitte

    Philadelphia, PA
    1 day ago
  • $116.2k - $229.1k

    Position Summary Data-driven organizations need modern cloud analytics solutions...  ...Preferred: Experience with Snowflake and Databricks Experience with Google Cloud Platform...  ...other cloud platforms, including Microsoft Azure and Amazon Web Services Google Cloud Platform... 
    Databricks
    Local area
    Visa sponsorship

    Deloitte

    Philadelphia, PA
    1 day ago
  • $112.8k - $153.7k

     ...your ideas. This is a senior engineering role. You will architect, operate...  ...continuously improve cloud data and analytics platforms (e.g....  ...Microsoft Fabric, Snowflake, Databricks) and own BI delivery...  ...follow.Relevant certifications (Azure, Snowflake, Databricks, etc.)... 
    Databricks
    Full time
    Contract work
    Local area
    Flexible hours

    Armanino

    Philadelphia, PA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer Azure Databricks. Be the first to apply!