Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer - Databricks

System One

Job Description

Job Description

Job Title: Data Engineer – Databricks Duration : Contract to Hire Location : Pittsburgh, PA Work Mode : 5 Days Onsite Job Description: Join a high performing data engineering team responsible for building modern, cloud native data platforms on Microsoft Azure . This role offers the opportunity to design and implement scalable, secure, and high performance data solutions using Azure Databricks, with a strong focus on Unity Catalog, data governance, and enterprise analytics within the Investment/Capital Markets domain. The ideal candidate is passionate about cloud data engineering, enjoys solving complex data challenges, and thrives in a collaborative Agile environment . This position provides the opportunity to work with the latest Azure data technologies while delivering impactful business solutions. Duties and Responsibilities . Design, develop, and maintain scalable data pipelines using Azure Databricks. . Build and optimize ETL/ELT workflows leveraging PySpark, SQL, and Delta Lake. . Implement and manage Unity Catalog to support enterprise data governance, security, metadata management, and fine-grained access control. . Develop cloud native data engineering solutions on the Microsoft Azure platform. . Collaborate with architects, business analysts, and cross functional teams to gather and translate business requirements into technical solutions. . Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency. . Ensure data quality, reliability, and compliance through validation, monitoring, and best practices. . Support production deployments, troubleshooting, and performance tuning. . Participate in code reviews, technical documentation, and continuous improvement initiatives. . Apply best practices for cloud data engineering, security, and DevOps within Azure environments . Required qualifications to be successful in this role . Minimum 5 years of hands-on experience with Azure Databricks. . Hands on experience with Unity Catalog is mandatory. . Strong experience building enterprise scale data engineering solutions on Microsoft Azure. . Expert level experience with Apache Spark (PySpark) and SQL. . Strong experience with Delta Lake, ETL/ELT development, and data pipeline implementation. . Experience with Azure data services such as Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), and related Azure ecosystem services. . Strong understanding of data governance, metadata management, security, and access control. . Mandatory experience in the Investment/Capital Markets domain. . Experience with Git and CI/CD practices. . Excellent analytical, communication, and problem solving skills. . Experience working in Agile/Scrum delivery environments. Preferred Qualifications . Databricks Certified Data Engineer (Associate or Professional) . . Microsoft Azure Data Engineer Associate (DP 203) certification . . Experience with Infrastructure as Code (Terraform/Bicep) . . Experience implementing DevOps practices for Azure Databricks environments . . Familiarity with Azure Purview/Microsoft Purview is a plus.

Ref: #404-IT Pittsburgh

Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Databricks in Pittsburgh, PA vacancy
  • We’re seeking a future team member for the role of Data Engineer to join our Data Innovation team. In this role, you will design and build...  ....Expertise with modern data platforms (e.g., Snowflake, AWS, Databricks), lakehouse architectures, and API-based data integration.... 
    Databricks
    Work experience placement
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    Pittsburgh, PA
    4 days ago
  • $77k - $202k

     ...AssociateJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus- Designing and implementing... 
    Databricks
    Full time
    H1b

    PwC

    Pittsburgh, PA
    4 days ago
  • $124k - $280k

     ...LevelSenior ManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...Engineer Associate, Snowflake Core, Snowflake Architect, Databricks Data Engineer Associate] is a plus- Designing and... 
    Databricks
    Full time
    H1b

    PwC

    Pittsburgh, PA
    4 days ago
  • $99k - $232k

     ...LevelManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...Data Engineer Associate, or Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus- Designing and implementing... 
    Databricks
    Full time
    H1b

    PwC

    Pittsburgh, PA
    4 days ago
  • $101.14k - $174.59k

    Data Engineer - Clearance Required Job Locations US-PA-Pittsburgh | US-Remote Job ID 2026-14307 # of Openings 1 Benefit...  ...Foundry (Vantage), with secondary responsibilities extending into Databricks for large-scale data processing and analytics engineering.... 
    Databricks
    Full time
    Contract work
    Work experience placement
    Local area
    Remote work
    Flexible hours

    LMI Consulting, LLC

    Pittsburgh, PA
    2 days ago
  • $118.7k - $218.6k

    Position Summary Lead AI and Data Science Engineer II Drive the design and delivery of advanced analytics, artificial intelligence (AI...  ..., clustering, and dimension reduction, in Apache Spark or Databricks environmentsExperience developing artificial intelligence (... 
    Databricks

    Deloitte

    Pittsburgh, PA
    3 days ago
  • $77k - $202k

    Industry/SectorNot ApplicableSpecialismManaged ServicesManagement LevelSenior AssociateJob Description & SummaryAt PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics... 
    Databricks
    Full time
    H1b

    PwC

    Pittsburgh, PA
    3 days ago
  • $99k - $232k

    Industry/SectorNot ApplicableSpecialismManaged ServicesManagement LevelManagerJob Description & SummaryAt PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to... 
    Databricks
    Full time
    H1b

    PwC

    Pittsburgh, PA
    3 days ago
  • $60k - $100k

     ...year Requirements: Strong background in Python, SQL, and core data engineering practices Hands-on experience building ETL/ELT solutions Practical knowledge of Apache Spark, PySpark, or Databricks Understanding of data warehousing principles and dimensional... 
    Databricks
    Full time
    Contract work

    QTech US Inc

    Pittsburgh, PA
    7 days ago
  •  ...Data Engineer – Azure Databricks Contract-to-Hire Pittsburgh, PA – Onsite Job ID J0726-0569 Visa : USC, GC, EAD (No Sponsorship) Position Overview Seeking an experienced Data Engineer to join a high-performing data engineering team responsible for building... 
    Databricks
    Full time
    Contract work
    Temporary work
    Local area

    System One

    Pittsburgh, PA
    18 days ago
  •  ...Status: Full-Time Reports to : Senior Director, Data & Analytics Purpose The Manager, Analytics Engineering leads the Analytics Engineering track within the...  ...logic, and data product development in a Databricks-native environment. By establishing governed, reusable... 
    Databricks
    Full time
    Temporary work
    Part time
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    Pantherx Specialty LLC

    Pittsburgh, PA
    12 days ago
  •  ...McNees. McNees, Wallace & Nurick is actively seeking a Data Platform & Integration Engineer to join our Information Technology department. At...  ...or comparable cloud data warehouse platforms such as Databricks, Redshift, or BigQuery, including administration, performance... 
    Databricks
    Remote work

    McNees Wallace & Nurick LLC

    Pittsburgh, PA
    7 days ago
  • $79.6k - $139.3k

    Data Engineer - Databricks - Local to Pittsburgh, PA Position Description Join a high performing data engineering team responsible for building modern, cloud native data platforms on Microsoft Azure. This role offers the opportunity to design and implement scalable... 
    Databricks
    Local area
    Pittsburgh, PA
    a month ago
  • $116.2k - $229.1k

    Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant...  ...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions... 
    Local area
    Visa sponsorship

    Deloitte

    Pittsburgh, PA
    1 day ago
  • $128k - $252.5k

     ...that transform our clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with clients to design and develop...  ....Working with a team of interdisciplinary data scientists, engineers, architects, and consultants, our work includes novel areas... 
    Local area

    Deloitte

    Pittsburgh, PA
    3 days ago
  • $128k - $249k

     ...search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group, designing scalable... 
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours
    Afternoon shift

    K&L Gates

    Pittsburgh, PA
    1 day ago
  •  ...embedding advanced AI, machine learning, and data products across multiple domains,...  ...data science, applied AI, and software engineering, delivering solutions that are both scientifically...  ...AI)Distributed data systems (Spark, Databricks)Experience leading or mentoring teams... 
    Databricks
    Remote work
    Monday to Thursday
    Flexible hours

    PPG Industries

    Pittsburgh, PA
    4 days ago
  • $100k - $130k

    Job Description: Big Data Engineer SummaryWe are looking for an experienced Big Data Engineer with 7-10 years of hands-on experience to design, build, and maintain scalable data pipelines and processing systems in an on-premises Big Data environment. Beyond strong individual... 

    EXL Service

    Pittsburgh, PA
    7 hours ago
  • What We Do:Data Scientists at the SEI use advanced statistics, data analytics, machine...  ...(fine-tuning, RAG, evaluation, prompt engineering)Causal inference / uplift modeling / synthetic...  ...(Spark, Trino, Snowflake, BigQuery, Databricks)Desired Experience:Experience in... 
    Databricks
    Full time
    Work experience placement

    Carnegie Mellon University

    Pittsburgh, PA
    1 day ago
  • $134.5k - $265.1k

    Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant...  ...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions... 
    Local area
    Visa sponsorship

    Deloitte

    Pittsburgh, PA
    4 days ago
  •  ...experience with an associate degree, or four (4) years of commensurate experience without a bachelor’s degree.**We are seeking a Data and Analytics Engineer with strong experience across modern and legacy data environments. This role requires hands-on expertise in AI... 
    Full time
    Work at office
    Local area
    Relocation

    First National Bank

    Pittsburgh, PA
    1 day ago
  •  ...Summary: The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The engineer...  ...cohesive package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead... 
    For contractors
    Work at office
    Local area

    ADEX

    Carnegie, PA
    2 days ago
  •  ...Data Engineer Location: Pittsburgh, PA, Onsite 5 days a week. Length of Assignment: 2 months contract to hire role. Pay Rate: $45 to 50/hr. on W2 ONLY. Function of the Group: Support Costing and Profitability for Line of Business Initiatives/Projects: Costing for Customer... 
    Contract work
    Flexible hours

    Artech

    Pittsburgh, PA
    18 hours ago
  • $116.1k - $170.28k

     ...About the Role: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map Reduce... 
    Remote work

    GrabJobs

    Pittsburgh, PA
    3 days ago
  • $131k - $218.3k

    Position Summary Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant...  ...the possible, and fulfill their mission promise. Our AI & Data offering provides a full spectrum of solutions for designing, developing... 
    Local area

    Deloitte

    Pittsburgh, PA
    1 day ago
  •  ...Software Engineer Karoo Health is seeking a skilled and dedicated developer to join our Engineering team. As a software engineer at Karoo...  ...in this role. What You'll Do Design and Architect Data Systems: Lead the design, construction, installation, and optimization... 
    Work experience placement
    Remote work
    Flexible hours

    Karoo Health

    Pittsburgh, PA
    4 days ago
  •  ...Design, build, and implement generalized large-scale, sophisticated data pipelines using Nifi for downstream analytics and data science...  ...and depth of the underlying issues. Collaborate with other engineering teams to adopt standard methodologies, drive scalability, and increase... 
    Remote work
    Flexible hours

    GrabJobs

    Pittsburgh, PA
    1 day ago
  • Roles and Responsibilities: Work on agile crews, meet deliverables, work with product owners to collaborate on deliverables Potential for escalation from RTO team 2 people to help lead a crew of offshore developers that will be developing and leading ...
    Flexible hours

    3B Staffing LLC

    Pittsburgh, PA
    3 days ago
  • Title: Manager - Data EngineeringReports To: Director - Data EngineeringLocation: Pittsburgh, PA or New York, NYAmerican Eagle is a...  ...confident.Get to Know the Role:We are seeking a results-driven Data Engineering Manager to lead the Consumer Data Engineering Team,... 
    Full time
    Temporary work
    Part time
    Casual work
    Local area

    American Eagle Outfitters

    Pittsburgh, PA
    7 hours ago
  • $150k - $180k

     ...diverse, and we are therefore committed to embracing diversity of thought and experience within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You will... 
    Remote work

    GrabJobs

    Pittsburgh, PA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - Databricks. Be the first to apply!