Data Engineer - Databricks
System One
Job Description
Job Description
Data Engineer – Azure Databricks Contract-to-Hire Pittsburgh, PA – Onsite Job ID J0726-0569 Visa : USC, GC, EAD (No Sponsorship) Position Overview
- Seeking an experienced Data Engineer to join a high-performing data engineering team responsible for building modern, cloud-native data platforms on Microsoft Azure.
- This role will focus on designing and implementing scalable, secure, and high-performance data solutions using Azure Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Unity Catalog. The position requires strong expertise in enterprise data governance, metadata management, security, and access control within the Investment Banking, Securities, or Capital Markets domain.
- The ideal candidate is passionate about cloud data engineering, enjoys solving complex data challenges, and thrives in a collaborative Agile environment.
- Apache Spark
- Required
- Expert
- Microsoft Azure
- Required
- Advanced
- Investment Banking and Securities
- Required
- Advanced
- Structured Query Language – SQL
- Required
- Expert
- Unity Catalog
- Required
- Advanced
- Databricks
- Required
- Expert
- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Build and optimize ETL and ELT workflows using PySpark, SQL, Apache Spark, and Delta Lake.
- Implement and manage Unity Catalog for enterprise data governance, metadata management, security, and fine-grained access control.
- Develop cloud-native data engineering solutions on the Microsoft Azure platform.
- Collaborate with architects, business analysts, and cross-functional teams to translate business requirements into technical solutions.
- Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency.
- Ensure data quality, reliability, governance, and regulatory compliance through validation, monitoring, and engineering best practices.
- Support production deployments, troubleshooting, root-cause analysis, and performance tuning.
- Participate in code reviews, technical documentation, and continuous improvement initiatives.
- Apply cloud data engineering, security, CI/CD, and DevOps best practices within Azure environments.
- 8+ years of overall data engineering or related technology experience preferred.
- Minimum 5 years of hands-on Azure Databricks experience.
- Mandatory hands-on experience implementing and managing Unity Catalog.
- Expert-level experience with Apache Spark, PySpark, and SQL.
- Strong experience developing enterprise-scale data engineering solutions on Microsoft Azure.
- Strong experience with Delta Lake, ETL/ELT development, and data pipeline implementation.
- Experience with Azure Data Factory and Azure Data Lake Storage Gen2.
- Strong knowledge of the Microsoft Azure data ecosystem.
- Strong understanding of data governance, metadata management, data security, and access control.
- Mandatory experience within Investment Banking, Securities, or Capital Markets.
- Experience using Git and implementing CI/CD practices.
- Experience working in Agile/Scrum delivery environments.
- Excellent analytical, communication, and problem-solving skills.
- Must be willing to work onsite in Pittsburgh, PA.
- Must be willing and eligible to convert to full-time employment after six months.
- Databricks Certified Data Engineer Associate or Professional certification.
- Microsoft Certified Azure Data Engineer Associate, DP-203.
- Experience with Infrastructure as Code using Terraform or Bicep.
- Experience implementing DevOps practices for Azure Databricks environments.
- Familiarity with Microsoft Purview or Azure Purview.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Databricks in Pittsburgh, PA vacancy
- ...Data Engineer Location || Onsite - Warrendale, PA / Pittsburgh, PA (U.S.) This role requires core experience and expertise on - Databricks (advanced, hands-on), Python, ETL/ELT pipeline development, Spark (SQL/PySpark). Job purpose ~ The...DatabricksTemporary work
SysMind Tech
Pittsburgh, PA4 days ago - ...Responsibilities Kforce has a client that is seeking a Senior Data Engineer on a contract to hire basis in Pittsburgh, PA.Summary:The... ...will need to have strong hands-on experience in Azure Databricks, data pipeline development, and modern cloud-based data architecture...DatabricksHourly payContract work
Kforce
Pittsburgh, PA1 day ago - ...Data Engineer Founded in 2019 and headquartered in Pittsburgh, PA, Free Market Health supports forward-thinking payers and specialty... ...technologies: Azure, Azure SQL, ADLS SQL, Python, Scala Databricks/Delta Lake, dbt/dbt Cloud ~ Ability to work within a...DatabricksTemporary work
Free Market Health
Pittsburgh, PA4 days ago - ...Job Title: Data Engineer - Databricks Duration : Contract to Hire Location : Pittsburgh, PA Work Mode : 5 Days Onsite Job Description: Join a high performing data engineering team responsible for building modern, cloud native data platforms on Microsoft...DatabricksFull timeContract workLocal area
System One
Pittsburgh, PA3 days ago - ...Senior Data Engineer PANTHERx is the nation's largest rare disease pharmacy, and we put the patient experience at the top of everything... ...data warehouse and core data pipelines on PANTHERx's Databricks platform. This role is responsible for EDW architecture, ingress...DatabricksFull timeContract workTemporary workPart timeWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
PANTHERx Rare Pharmacy
Pittsburgh, PA2 days ago $99k - $232k
...Managed Services Industry/Sector: Not Applicable Time Type: Full time Travel Requirements: Up to 60% At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics...DatabricksFull timeH1bPwC
Pittsburgh, PA23 hours ago- ...Status: Full-Time Reports to : Senior Director, Data & Analytics Purpose The Manager, Analytics Engineering leads the Analytics Engineering track within the... ...logic, and data product development in a Databricks-native environment. By establishing governed, reusable...DatabricksFull timeTemporary workPart timeWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
Pantherx Specialty LLC
Pittsburgh, PA4 days ago $124k - $280k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Health Services... ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...warehouse technology including Snowflake or Databricks Experience working with Anthropic -...DatabricksFull timeH1bPwC
Pittsburgh, PA3 days ago$80 per hour
Kforce has a client that is seeking a Senior Data Engineer on a contract to hire basis in Pittsburgh, PA. Summary: The Senior Data Engineer will need to have strong hands-on experience in Azure Databricks, data pipeline development, and modern cloud-based data architecture...DatabricksContract work$79.6k - $139.3k
Data Engineer - Databricks - Local to Pittsburgh, PA Position Description Join a high performing data engineering team responsible for building modern, cloud native data platforms on Microsoft Azure. This role offers the opportunity to design and implement scalable...DatabricksLocal area- ...Status: Full-Time Reports to : Senior Director, Data & Analytics Purpose The Manager, Data Engineering leads the Data Engineering track within the Data... ...logic, EDW design and operations, and the Databricks platform infrastructure. This role is responsible...DatabricksFull timeContract workTemporary workPart timeWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
- ...challenges. Our services span AI, IT staffing, cloud computing, engineering, mobility, testing, and more. Certified with CMMI Level 3 and... ...more . Must Have Skills: Strong experience in data engineering and ETL development Strong experience with...Local areaWorldwide
V2soft
Pittsburgh, PA3 days ago - ...months ~ No sponsorship; no future sponsorship allowed Day-to-Day Responsibilities / Project Details: Support Data Engineering initiatives across two Data Engineering Teams: Prospect Team Student Team ~ Contribute to stabilizing and scaling...Contract work
Saxon Global
Pittsburgh, PA4 days ago - ...Technology Solutions. We have an opportunity for Performance Engineer for one of my clients. Here I am sharing the details below.... ...performance logs using ELK/Splunk • Strong analyzing/data mining skills using SQL. • Experience on Kafka/messaging performance...Contract workRemote work
Texas State Library and Archives Commision
Millvale, PA11 hours ago - ...Data Scientist Role at SEI Data Scientists at the SEI use advanced statistics, data... ...(fine-tuning, RAG, evaluation, prompt engineering) Causal inference / uplift modeling /... ...data (Spark, Trino, Snowflake, BigQuery, Databricks) Desired Experience: Experience...DatabricksFull timePart time
Software Engineering Institute
Pittsburgh, PA4 days ago - ...Position Title: Data Engineer Location: PA – Pittsburgh (Locals Preferred) Work Status : Onsite 5 days a week Duration : Contract to Hire Years Of Experience Required : 6+ Years Industry Background: Finance / Banking Function of the Group: Support Costing...Full timeContract workLocal areaFlexible hours
System One
Pittsburgh, PA1 day ago - Job Posting The salary range for this role is an estimate based on a wide range of compensation factors including but not limited to specific skills, experience and expertise, role location, certifications, licenses, and business needs. The estimated compensation range...
Motional
Pittsburgh, PA1 day ago - 37066895 - Data Engineer I Onsite- Pittsburgh, PA 5+ months is duration JD:- Minimum Qualifications 2-3 Years of experience We primarily require an individual who is: • Dedicated to delivering results on time. • Flexible in support of the iterative...Flexible hours
3B Staffing LLC
Pittsburgh, PA2 days ago $50.5k - $112.5k
...Description & Summary The Opportunity As an AI Engineer, you will be at the forefront of transforming raw data into actionable insights, enabling informed... ..., including AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data and AI credentials...DatabricksFull timeWork experience placementH1bLocal area$100k
...one (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... .../ Data Scientists, and Machine Learning engineers for full-time positions with clients.... ...skills: NLP, Text mining, Tableau, PowerBI, Databricks, Tensorflow REQUIRED SKILLS For Java...DatabricksFull timeH1bSynergisticIT
Pittsburgh, PA2 days ago- ...Description Job Description Presales AI Engineer CEI America — Digital Tech & AI... ...business problems into AI/ML, GenAI, and data platform solutions Design and deliver... ...platforms (Azure, AWS, GCP), data platforms (Databricks, Fabric, Snowflake), and GenAI...Databricks
CEI
Pittsburgh, PA14 days ago $104k - $210k
...member for the role of Forward Deployed Engineer to join our Engineering Hub Team. This... ...build, and harden AI-first solutions across data, APIs, services, and workflow... ...modern data platforms such as Snowflake, Databricks, or comparable cloud-scale data ecosystems...DatabricksTemporary workWork experience placementWorldwideFlexible hoursBNY
Pittsburgh, PA-42- ...Job Description Job Description Databricks MVP Architect Location: Pittsburgh, PA (Hybrid... ...design and evolution of our enterprise data platform. This role combines strategic... ...to drive data strategy. Mentor engineering teams and provide technical leadership....DatabricksFull timeRemote work
CEI
Pittsburgh, PA11 days ago $172k - $229k
...critical intelligence hidden within petabytes of multimodal sensor data. Our next-generation autonomous driving stack depends on... ...Omnitag [ our ML-powered multimodal data mining framework, is the engine that powers this discovery. As a Senior Machine Learning...Full timeWork at officeRemote workMotional
Pittsburgh, PA23 hours ago- ...Job Description Job Description Job Title: Industrial Engineering Analytics Engineer (Manufacturing Systems & Modeling) Required Skills... ...cost analysis experience Experience with MES, shop-floor data integration, and business case development Looking for strong...
ClinDCast LLC
Pittsburgh, PA12 days ago - ...improvements. This position manages the installation and maintenance of mechanical systems at Data Centers and operations of specialized cooling systems. Acts as an Engineering resource for the complete H5 portfolio of mission critical facilities. Plans and monitors...Work at officeImmediate start
H5 Data Centers
Pittsburgh, PA11 days ago $175.3k - $322.9k
...and eager to develop and maintain a highly desired knowledge of Databricks solutions and Business Use Cases in the Consumer Industry.... ...2026Work You’ll Do: We help our clients leverage the power of data, analytics, robotic process automation, and ML/AI technologies...DatabricksPart timeLocal areaDeloitte
Pittsburgh, PA3 hours ago- ...DevOps Engineer The Pittsburgh Pirates are a storied franchise in Major League Baseball... ...you build will enable our analysts, data scientists, engineers, and front office... ...analytics infrastructure (e.g., Snowflake, Databricks, Airflow). # Familiarity with secrets...DatabricksWork at office
MLB - Pittsburgh Pirates
Pittsburgh, PA2 days ago - ...assignment supporting an Advanced Technology project, which includes our Data Center, Pharmaceutical, Industrial/Manufacturing, and EV/Battery... ...value of scheduling. Collaborate with project team (e.g., Engineer and Superintendent) to confirm Contract Item List (CIL), develop...Permanent employmentFull timeContract workTemporary workFor subcontractorWork at officeRemote workLong distance
Turner Corporation
Pittsburgh, PA23 hours ago - ...Microsoft Fabric Data Architect Position Overview We are seeking an experienced... ...business value from unified data engineering, data science, and BI practices. You... ...Azure Data Factory, Azure SQL, Power BI, Databricks, and modern data architecture patterns....DatabricksWork at officeHome office
iVision
Pittsburgh, PA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Databricks. Be the first to apply!
Related searches
- finance data engineer Pittsburgh, PA
- sr information security engineer Pittsburgh, PA
- senior data engineer Pittsburgh, PA
- data engineer contract Pittsburgh, PA
- data developer Pittsburgh, PA
- sr data engineer Pittsburgh, PA
- junior data engineer remote Pittsburgh, PA
- senior data quality engineer Pittsburgh, PA
- data engineer Pittsburgh, PA
- data engineering intern summer Pittsburgh, PA