Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer (Azure & Databricks)

SOCOTEC

  • Full-time
  • Department: US - Corporate IT
Company Description

SOCOTEC is a provider of niche consulting services within the architecture, engineering and construction industries focusing on high-performance buildings and specialty structures. Through an integrated, holistic approach, our professionals provide solutions for building envelope, energy efficiency, sustainability, code advisory and construction advisory projects.

SOCOTEC’s combination of expertise, experience and methods are increasingly recognized as best-in-class fueling significant growth.

SOCOTEC is proud to announce that it has been officially certified as a Great Place to Work by the renowned global authority on workplace culture, Great Place to Work.

Job Description

As a Senior Data Engineer, you will design and build scalable data systems that power SOCOTEC’s digital platforms and enterprise analytics. You will play a key role in architecting our modern data stack, enabling reliable ingestion, transformation, and modeling of data across multiple enterprise systems.
This role requires strong experience in Databricks, distributed data processing, and enterprise data architecture, along with the ability to lead large data initiatives and collaborate with engineering and business teams.
You will work closely with software engineers and platform teams to ensure SOCOTEC’s data ecosystem is reliable, scalable, and optimized for both operational systems and advanced analytics.

Key Responsibilities

Build SOCOTEC’s Enterprise Data Platform

  • Design and implement scalable data pipelines that ingest and transform data from enterprise systems such as ERP, CRM, and operational databases.
  • Develop and maintain data pipelines in Databricks using Spark and Delta Lake.
  • Build and maintain data models that support analytics, AI applications, and operational systems.

Lead Master Data Management (MDM) Initiatives

  • Architect and implement SOCOTEC’s custom MDM platform using Databricks.
  • Design data models that establish consistent “golden records” across multiple enterprise systems.
  • Implement data governance, lineage, and quality frameworks.
  • Build reliable ingestion pipelines for large-scale structured and semi-structured data.
  • Implement batch and near-real-time data processing pipelines.
  • Optimize large-scale data processing jobs for performance and cost efficiency.

Enable Data for AI and Advanced Analytics

  • Partner with AI and software engineering teams to deliver high-quality datasets for machine learning and AI applications.
  • Build data pipelines that support SOCOTEC’s digital products, analytics dashboards, and operational platforms.

Drive Data Architecture and Best Practices

  • Define standards for data modeling, pipeline design, and data quality.
  • Implement monitoring, observability, and alerting data systems.
  • Ensure scalability, reliability, and security across the data platform.
Qualifications
  • 3-6 years with hands on experience with Databricks
  • Experience designing and owning large enterprise data projects
  • Strong hands-on experience with Databricks, Apache Spark, and Delta Lake
  • Experience building enterprise-scale ETL/ELT pipelines
  • Experience working in enterprise environments with complex data systems
  • Strong SQL and Python skills

Preferred Experience

  • Experience building Master Data Management (MDM) systems
  • Experience with modern cloud data stacks (AWS, Azure, or GCP)
  • Experience integrating data from ERP systems such as Deltek, SAP, or Oracle
  • Experience with data governance, data lineage, and metadata management
  • Familiarity with lakehouse architectures and modern data platforms

Technical Skills

  • Databricks
  • Python
  • SQL
  • Data modeling
  • Data architecture and distributed systems

We are looking for someone who:

  • Has owned and delivered large-scale data platforms
  • Is comfortable working in complex enterprise environments
  • Can design systems that scale across multiple business units and data sources
  • Is passionate about building reliable data infrastructure that enables analytics and AI

This role requires both deep technical expertise and architectural thinking, as you will play a key role in shaping SOCOTEC’s long-term data strategy.

Why Join SOCOTEC Digital Assurance:
You will be joining a growing technology group building advanced platforms for the built environment, including:

  • AI-powered compliance systems
  • Enterprise analytics platforms

Our goal is to transform how data and expertise flow across the built environment, enabling smarter decisions, faster compliance, and more efficient infrastructure.
If you are passionate about building modern data platforms and solving complex data challenges at scale, we’d love to hear from you.

Additional Information

Additional information

For more information, please visit

Job Type: Full-Time

Applicants must be legally authorized to work in the United States without the need for current or future employer sponsorship.

All your information will be kept confidential according to EEO guidelines.

SOCOTEC is an Equal Opportunity Employer.

#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer (Azure & Databricks) in Boston, MA vacancy
  •  ...SOCOTEC US in Boston is looking for a Senior Data Engineer to design and build scalable data systems that power our digital platforms. This...  ...systems. The ideal candidate has extensive experience with Databricks, Apache Spark, and building data pipelines, ensuring a... 
    Databricks
    Senior
    Full time

    SOCOTEC US

    Boston, MA
    2 days ago
  •  ...SOCOTEC is seeking a Senior Data Engineer to design and build scalable data systems that power our digital platforms and analytics. You will...  .... The ideal candidate has 3-6 years of experience with Databricks, strong SQL and Python skills, and experience in enterprise... 
    Databricks
    Senior

    SOCOTEC

    Boston, MA
    2 days ago
  • $117.6k - $161.7k

    Senior Data Engineer Become a part of our caring community. The Senior Data Engineer designs, builds, and maintains data processing solutions...  ...and maintain scalable data pipelines and workflows using Azure Databricks. Develop and maintain SAS programs and SSIS packages for... 
    Databricks
    Senior
    Remote job
    Temporary work
    Work from home

    Humana

    Boston, MA
    4 days ago
  •  ...is seeking a highly experienced Cloud DevOps Engineer with over 10 years of expertise in cloud...  ...candidate will architect and manage scalable data solutions within an Azure Data Lakehouse environment, focusing on Databricks and other Azure services. Responsibilities include... 
    Databricks
    Senior

    Compunnel

    Quincy, MA
    4 days ago
  • $90k - $157.5k

     ...STATE STREET CORPORATION is looking for a Sr. Databricks Data Engineer in Quincy, Massachusetts, to develop and optimize high throughput data pipelines. The role requires extensive experience with Databricks, SQL, and Scala/PySpark, along with cloud-based development... 
    Databricks
    Senior

    State Street Corporation

    Quincy, MA
    2 days ago
  • A leading consulting firm is seeking a Senior Data Engineer to design and implement scalable data solutions. In this role, you will collaborate...  ...ideal candidate will have expertise in cloud computing, Databricks, and strong programming skills. This position requires at... 
    Databricks
    Senior

    Ernst & Young Oman

    Boston, MA
    3 days ago
  • Beaconcure Inc. is hiring a Senior Data Engineer in Needham, Massachusetts. This role involves designing and implementing scalable data pipelines...  ..., proficiency with modern data engineering tools like Databricks, and strong problem-solving skills. Join a tech-forward... 
    Databricks
    Senior

    Beaconcure Inc.

    Needham Heights, MA
    2 days ago
  •  ...Role: Senior Data Engineer Location: Quincy, MA Type: Contract Advanced Power BI expertise, including:...  ...reporting Preferred / Additional Skills Experience with Databricks, Azure Synapse, AWS, or GCP data platforms. Familiarity... 
    Databricks
    Senior
    Contract work

    VBeyond

    Quincy, MA
    3 days ago
  •  ...Publicisgroupe is seeking a Senior Software Engineer in Boston, MA, to drive the delivery of scalable cloud-native data platforms. You will utilize advanced technologies such as Databricks and AWS, ensuring high-performance distributed systems. The ideal candidate... 
    Databricks
    Senior

    Publicis Groupe

    Boston, MA
    2 days ago
  • $120k - $202.5k

     ...STATE STREET CORPORATION is seeking a Lead Software Engineer to contribute to the development of its Enterprise Investment...  ...in architecture, system design, and scalable data pipelines, specifically using Azure, DataBricks, and Snowflake. The position involves collaboration... 
    Databricks
    Senior
    Work at office

    State Street Corporation

    Quincy, MA
    2 days ago
  •  ...We are looking for a highly skilled Senior Manager Data Engineer to join the team of our exceptional client...  ...data ingestion pipelines using Azure Data Factory and API-based integrations...  ...preferred) or similar platforms such as Databricks or Snowflake Proficiency in Python... 
    Databricks
    Senior

    Market Street Talent

    Boston, MA
    4 days ago
  • $100.2k - $150.2k

     ...experienced individual for its Enterprise Data & Engineering team. This position involves designing and...  ...have extensive experience in SQL, DBT, and Databricks, as well as strong skills in Python and cloud platforms like Azure or AWS. The role offers a comprehensive benefits... 
    Databricks
    Senior

    Hasbro

    Boston, MA
    4 days ago
  • $125k - $200k

    A leading data platform company is seeking an experienced Software Engineer (Data Platform) to build and scale data systems and APIs. This role entails developing...  ...with technologies such as Python, PySpark, and Databricks. Ideal candidates will have 4 to 5+ years of relevant... 
    Databricks
    Senior
    Full time
    Remote work

    The Recruiting Guy

    Boston, MA
    18 days ago
  •  ...A cybersecurity company based in Boston is seeking a Senior Data Engineer. The ideal candidate will be responsible for integrating diverse...  ...quality within a high-performance environment using AWS and Databricks. Strong skills in Python and extensive experience in data governance... 
    Databricks
    Senior
    Contract work

    CeDent

    Boston, MA
    2 days ago
  •  ...Epsilon is seeking a Senior Software Engineer in Boston to lead development for cloud-native data platforms. You will be responsible for defining engineering standards...  ...in data engineering, experience with AWS and Databricks, and a Bachelor's degree in Computer Science.... 
    Databricks
    Senior
    Flexible hours

    Epsilon

    Boston, MA
    2 days ago
  • $160k - $190k

     ...Senior Data Engineer The Senior Data Engineer will help transform our cloud data systems by designing and operating architectures...  ...selecting and applying the right technologies-across Snowflake, Databricks, Azure data services, and traditional databases-based on... 
    Databricks
    Senior

    Diamond Generating Corporation

    Boston, MA
    2 days ago
  •  ...Senior Data Engineer, CASM Platform As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate...  ..., develop, and optimize large-scale ETL/ELT pipelines on Databricks to efficiently process and transform cybersecurity data. Utilize... 
    Databricks
    Senior

    Cedent Life Talent

    Boston, MA
    a month ago
  •  ...come build the future together. The Crown Is Yours As a Senior Data Platform Engineer, you’ll help build the backbone of DraftKings’ machine learning...  ...capabilities. You’ll design, scale, and operate the Databricks and cloud infrastructure that powers automated, reproducible... 
    Databricks
    Senior
    Immediate start

    DraftKings

    Boston, MA
    2 days ago
  •  ...TetraScience is the Scientific Data and AI Company building Tetra...  ...partners includes NVIDIA, Databricks, Thermo Fisher Scientific, Snowflake...  ...leading the Scientific Data Engineering (SDE) Team and helping build...  ...to junior team members. As a Senior Scientific Data Engineer, you... 
    Databricks
    Senior
    Immediate start
    Visa sponsorship

    TetraScience

    Cambridge, MA
    5 days ago
  • A leading consulting firm is seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, particularly Databricks. The role involves designing and building analytics solutions, managing client relationships, and ensuring data architecture... 
    Databricks
    Senior

    EY

    Boston, MA
    4 days ago
  •  ...Senior Data Engineer Fully Remote-United States Job Type Full-time Description Overview...  ...cloud infrastructure (AWS Bedrock, Azure OpenAI). Collaborate with Data...  ...ETL/ELT frameworks: Airflow, Spark, Databricks Data modeling, schema design, and optimization... 
    Databricks
    Senior
    Full time
    Contract work
    Local area
    Remote work

    St. George Tanaq Corporation

    Boston, MA
    4 days ago
  • McKinsey & Company is seeking a Data Engineer in Boston. This role involves developing and maintaining scalable data pipelines using Databricks on Azure, optimizing ETL processes, and mentoring junior engineers. The ideal candidate has a master’s or bachelor’s degree in... 
    Databricks

    McKinsey & Company

    Boston, MA
    2 days ago
  • Ernst & Young Oman is looking for a Senior Data Engineer to design and build analytics solutions that deliver significant business value. Collaborate...  ...data flows, and develop engineering solutions using Databricks. Strong programming skills in Python, Scala, or SQL are... 
    Databricks
    Senior

    Ernst & Young Oman

    Boston, MA
    3 days ago
  •  ...Data Engineer with Databricks & Azure Quincy, MA onsite Contract. Role Description: • Hands on experience with Cloud data migration on Azure/AWS using Databricks/Snowflake and maintaining cloud-based database systems. • Proficient in Oracle RDBMS... 
    Databricks
    Contract work
    Immediate start

    Syntricate Technologies

    Quincy, MA
    7 days ago
  • $150k - $170k

     ...Senior Data Engineer At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of...  ...batch + streaming) data pipelines, currently based both on Databricks and on-prem Spark infrastructure, primarily using Scala Streaming... 
    Databricks
    Senior
    Hourly pay
    Work experience placement
    Summer work
    Seasonal work
    Local area
    Shift work

    Magnite

    Boston, MA
    3 days ago
  • $120k - $160k

     ...excellence, collaboration, and passion. Role Overview Senior Data Engineer – Platform Engineering team, Boston, MA. You’ll design...  ..., develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and SQL Server (T‑SQL). Implement configuration‑... 
    Databricks
    Senior
    Temporary work
    Worldwide
    Flexible hours

    Berkshire Hathaway Specialty Insurance

    Boston, MA
    2 days ago
  •  ...analysis of clinical research data is critical to helping...  ...highly motivated and experienced Senior Data Engineer to join our team. As a...  ...). Hands-on experience with Databricks, or other distributed data processing...  ...cloud services (AWS and/or Azure). Hands-on experience with... 
    Databricks
    Senior

    Beaconcure Inc.

    Needham Heights, MA
    2 days ago
  •  ...mindset. The Platform Engineering Team at ABCorp builds the data infrastructure layer that...  ...ABCorp is seeking a Senior Data Engineer to own the...  ...pipeline orchestration using Azure Data Factory (ADF), applying...  ...Synapse Analytics, Azure Databricks, ADLS, compute resources,... 
    Databricks
    Senior
    Contract work
    Worldwide
    Visa sponsorship

    ABCorp

    West Roxbury, MA
    4 days ago
  • $90k - $180k

     ...perspectives with those of our clients. About the Role Senior Data Engineer POSITION Tracing our roots to 1928, we are one of...  ...with one or more modern data architectures (Snowflake, DataBricks, Fabric). ~ Strong understanding of data modeling, data warehousing... 
    Databricks
    Senior
    Remote work
    Flexible hours
    1 day per week

    Wellington Management

    Boston, MA
    1 day ago
  • $140k - $160k

     ...develop, and maintain databases and data integration (ETL) systems to...  ...and integration services (e.g., Azure Data Factory, Fabric, Snowflake, or Databricks) to lead and optimize data integration...  ...is commonly used in data engineering, such as Python or Java Our Company... 
    Databricks
    Senior
    Work experience placement
    Remote work
    Work from home

    Carrington

    Boston, MA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer (Azure & Databricks). Be the first to apply!