Data Engineer - Databricks
System One
Job Description
Job Description
Job Title: Data Engineer – Databricks Duration : Contract to Hire Location : Pittsburgh, PA Work Mode : 5 Days Onsite Job Description: Join a high performing data engineering team responsible for building modern, cloud native data platforms on Microsoft Azure . This role offers the opportunity to design and implement scalable, secure, and high performance data solutions using Azure Databricks, with a strong focus on Unity Catalog, data governance, and enterprise analytics within the Investment/Capital Markets domain. The ideal candidate is passionate about cloud data engineering, enjoys solving complex data challenges, and thrives in a collaborative Agile environment . This position provides the opportunity to work with the latest Azure data technologies while delivering impactful business solutions. Duties and Responsibilities . Design, develop, and maintain scalable data pipelines using Azure Databricks. . Build and optimize ETL/ELT workflows leveraging PySpark, SQL, and Delta Lake. . Implement and manage Unity Catalog to support enterprise data governance, security, metadata management, and fine-grained access control. . Develop cloud native data engineering solutions on the Microsoft Azure platform. . Collaborate with architects, business analysts, and cross functional teams to gather and translate business requirements into technical solutions. . Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency. . Ensure data quality, reliability, and compliance through validation, monitoring, and best practices. . Support production deployments, troubleshooting, and performance tuning. . Participate in code reviews, technical documentation, and continuous improvement initiatives. . Apply best practices for cloud data engineering, security, and DevOps within Azure environments . Required qualifications to be successful in this role . Minimum 5 years of hands-on experience with Azure Databricks. . Hands on experience with Unity Catalog is mandatory. . Strong experience building enterprise scale data engineering solutions on Microsoft Azure. . Expert level experience with Apache Spark (PySpark) and SQL. . Strong experience with Delta Lake, ETL/ELT development, and data pipeline implementation. . Experience with Azure data services such as Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), and related Azure ecosystem services. . Strong understanding of data governance, metadata management, security, and access control. . Mandatory experience in the Investment/Capital Markets domain. . Experience with Git and CI/CD practices. . Excellent analytical, communication, and problem solving skills. . Experience working in Agile/Scrum delivery environments. Preferred Qualifications . Databricks Certified Data Engineer (Associate or Professional) . . Microsoft Azure Data Engineer Associate (DP 203) certification . . Experience with Infrastructure as Code (Terraform/Bicep) . . Experience implementing DevOps practices for Azure Databricks environments . . Familiarity with Azure Purview/Microsoft Purview is a plus.
Ref: #404-IT Pittsburgh$116.2k - $229.1k
Position Summary Join Deloitte’s AI & Engineering practice and help organizations transform enterprise technology platforms, modernize data environments, and unlock value through innovation. As a Databricks Engineer in our AI & Data practice, you will design, build...DatabricksLocal areaVisa sponsorship- ...Data Engineer – Azure Databricks Contract-to-HirePittsburgh, PA – OnsitePosition OverviewSeeking an experienced Data Engineer to join a high-performing data engineering team responsible for building modern, cloud-native data platforms on Microsoft Azure.This role will...DatabricksFull timeContract work
System One Holdings, LLC
Pittsburgh, PA3 days ago - ...POSITION Data Engineer LOCATION Pittsburgh, PA (hybrid 3 days per week) REQUIRED SKILLS #3-5 years of Azure Databricks experience. # Strong SQL, Python and PySpark skills. # Experience designing, building, and tuning complex...Databricks3 days per week
Akaasa Technologies
Pittsburgh, PA1 day ago $124k - $280k
...LevelSenior ManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...Engineer Associate, Snowflake Core, Snowflake Architect, Databricks Data Engineer Associate] is a plus- Designing and...DatabricksFull timeH1b$101.14k - $174.59k
...Data Engineer - Clearance Required Job Locations US-PA-Pittsburgh | US-Remote ID 2026-14307 # of Openings 1 Overview LMI is seeking a skilled... ...(Vantage), with secondary responsibilities extending into Databricks for large-scale data processing and analytics engineering....DatabricksContract workWork experience placementLocal areaRemote workFlexible hoursLMI Consulting, LLC
Pittsburgh, PA1 day ago$77k - $202k
Industry/SectorNot ApplicableSpecialismManaged ServicesManagement LevelSenior AssociateJob Description & SummaryAt PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics...DatabricksFull timeH1b$134.5k - $265.1k
...sports industry experience with proprietary data, AI-native decision intelligence, and... ...works across Product Management, Data Engineering, Data Science, Software Engineering, Forward... ...product technologies such as Snowflake, Databricks, AWS, Azure, GCP, Kafka, dbt, REST APIs,...DatabricksLocal area- ...Status: Full-Time Reports to : Senior Director, Data & Analytics Purpose The Manager, Analytics Engineering leads the Analytics Engineering track within the... ...logic, and data product development in a Databricks-native environment. By establishing governed, reusable...DatabricksFull timeTemporary workWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
Pantherx Specialty LLC
Pittsburgh, PA14 days ago - We are looking for a Data Engineer to support client initiatives in Pittsburgh, Pennsylvania by building dependable data solutions that enable reporting, analytics, and operational insight. This Long-term Contract position is ideal for someone who is detail oriented and...Long term contract
$128k - $249k
...search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group, designing scalable...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift$191k - $299k
...Staff Software Engineer, Data PlatformAgility's commercially deployed humanoids operate alongside teams in warehouses, manufacturing facilities... ...is nice-to-have.Data catalog experience (Datahub, Amundsen, Databricks Unity Catalog)Experience with DatabricksExperience with...DatabricksFull timeTemporary workRemote workRelocation packageFlexible hoursAgility Robotics
Pittsburgh, PA2 days ago- What We Do:Data Scientists at the SEI use advanced statistics, data analytics, machine... ...(fine-tuning, RAG, evaluation, prompt engineering)Causal inference / uplift modeling / synthetic... ...(Spark, Trino, Snowflake, BigQuery, Databricks)Desired Experience:Experience in...DatabricksFull timeWork experience placement
- ...embedding advanced AI, machine learning, and data products across multiple domains,... ...data science, applied AI, and software engineering, delivering solutions that are both scientifically... ...AI)Distributed data systems (Spark, Databricks)Experience leading or mentoring teams...DatabricksRemote workMonday to ThursdayFlexible hours
- ...experience with an associate degree, or four (4) years of commensurate experience without a bachelor’s degree.**We are seeking a Data and Analytics Engineer with strong experience across modern and legacy data environments. This role requires hands-on expertise in AI...Full timeWork at officeLocal areaRelocation
- ...Data EngineerLocation: PA – Pittsburgh (Locals Preferred) Work Status: Onsite 5 days a week Duration: Contract to Hire Years Of Experience... ...can tackle complex data challenges.Mentor who can guide junior engineers and contributes to team growth.Proposes & designs data...Contract workLocal area
System One Holdings, LLC
Pittsburgh, PA3 days ago - ...Health is seeking a skilled and dedicated developer to join our Engineering team. As a software engineer at Karoo Health, you show a clear... ...'re interested in this role.What You'll DoDesign and Architect Data Systems: Lead the design, construction, installation, and optimization...Remote workFlexible hours
Karoo Health
Pittsburgh, PA2 days ago - ...Job Title: Senior AWS Data Engineer Location: Knoxville, TN, Columbia SC or Lafayette, LA or Birmingham, AL Description: Senior AWS Data Engineer to support the development, enhancement, and maintenance of enterprise risk analytics applications...
System One Holdings, LLC
Pittsburgh, PA2 days ago $100k - $130k
...Big Data EngineerWe are looking for an experienced Big Data Engineer with 7–10 years of hands-on experience to design, build, and maintain scalable data pipelines and processing systems in an on-premises Big Data environment. Beyond strong individual contribution, the...EXL
Pittsburgh, PA3 days ago$70.8k - $156.7k
...Senior Data EngineerThis role will require someone at our client site 5 days a week in Pittsburgh, PA. We are seeking a Data Engineer with 6+ years of experience to design and maintain scalable data pipeline supporting analytics, reporting, and operational needs. The...Hourly payCGI
Pittsburgh, PA5 days ago- ...to handle all the database storage and retrieval mechanisms on Data Lake Platforms and extensive experience in handling. Extensive... ...architecture and the threading limitations of Python. Pyspark data engineering skills Experience using libraries like Pandas, NumPy and...
ShiftCode Analytics
Pittsburgh, PA2 days ago - ...Data EngineerWolfe is a Pittsburgh-based FinTech company embedding AI across its product, its internal processes, and the way its teams work day-to-day, and the Data Engineer supports that shift. Working within the Data Platform team, this role builds and maintains the...Shift work
Wolfe
Pittsburgh, PA2 days ago - ...)Why Confluence?At Confluence, we've always been driven by a commitment to innovation, precision, and partnership in the investment data space. Our global footprint now spans multiple countries, giving our employees the opportunity to get exposure to other countries and...Remote work
Confluence Technologies
Pittsburgh, PA2 days ago - ...Datacenter Engineer The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The... ...cohesive package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead...For contractorsWork at officeLocal area
ADEX
Pittsburgh, PA1 day ago $82.6k - $162.8k
...business rules (calculations, validations, allocations, and transformations) using OneStream development tools and best practices.Support data management activities including data loads, mappings, transformations, reconciliations, and error handling within OneStream (and/or...Local areaRemote work$99k - $232k
...SummaryThe OpportunityAs an AI & GenAI Data Scientist - Manager, you will play a pivotal... ...apply data, algorithms, and software engineering to build and deploy software and platform... ...AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data and AI credentials...DatabricksFull timeH1b- ...Python Data Engineer Strong Python and SQL skills, ETL development experience with Microsoft SSIS, and familiarity with Agile, GitLab, and JIRA in a large enterprise environment. Location: Hybrid - Lake Mary, FL or Pittsburgh, PA (Onsite 4x/week)...Contract workLocal area
3B Staffing LLC
Pittsburgh, PA13 hours ago - ...Senior AWS Data Engineer Full-time Hybrid – Lafayette, LA | Knoxville, TN | Birmingham, AL | Columbia, SC Position Overview Seeking a Senior AWS Data Engineer to develop, enhance, and maintain enterprise risk analytics applications in a financial services...Full timeLocal area
System One
Pittsburgh, PA8 days ago - ...Data Ideology At DI, we provide Data & Analytics expertise to drive measurable business outcomes, often solving complex business... ...curious. For more information about Data Ideology, visit Sr. Data Engineer - (Snowflake) Data Ideology is seeking a Sr. Snowflake Data...Full timeWork at officeRemote workWork from homeMonday to FridayFlexible hours
Data Ideology
Pittsburgh, PAa month ago - Title: Manager - Data EngineeringReports To: Director - Data EngineeringLocation: Pittsburgh, PA or New York, NYAmerican Eagle is a... ...confident.Get to Know the Role:We are seeking a results-driven Data Engineering Manager to lead the Consumer Data Engineering Team,...Full timeTemporary workPart timeCasual workLocal area
$80k - $202.15k
...have an opportunity to contribute to the company’s success. As a Data Manager Senior within PNC's Data Product organization, you will... ...or Philadelphia, PA.We are seeking a highly accomplished Data Engineering Leader to lead the design, development, and delivery of...Full timeTemporary workPart timeWork experience placementWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Databricks. Be the first to apply!
- data engineer analytics Pittsburgh, PA
- senior cloud data engineer Pittsburgh, PA
- data center engineer Pittsburgh, PA
- big data devops engineer Pittsburgh, PA
- sr data engineer Pittsburgh, PA
- data engineer Pittsburgh, PA
- sr information security engineer Pittsburgh, PA
- junior data engineer remote Pittsburgh, PA
- data developer Pittsburgh, PA
- etl data engineer Pittsburgh, PA