Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Databricks Data Engineer

3B Staffing LLC

We're looking for a Senior Databricks Data Engineer to support a cloud modernization initiative where legacy SQL Server/SSIS pipelines are being rebuilt on a modern Databricks Lakehouse platform. This is a hands-on engineering role with the opportunity to influence standards, build net-new pipelines, and help shape a scalable cloud data environment.


Key experience we're seeking:
• Hands-on Databricks development (SQL + PySpark)
• Strong data warehousing fundamentals (facts, dimensions, modeling)
• Experience modernizing or migrating ETL pipelines
• Cloud experience (Azure or AWS)
• Comfort working in an early-phase, fast-evolving environment

Senior Data Engineer (Databricks / Cloud Migration)

Summary

This role supports an early-phase cloud modernization initiative focused on retiring legacy SQL Server/SSIS pipelines and building a new enterprise data platform in Databricks. The engineer will be hands-on in Databricks development and must have a strong understanding of data warehouse concepts, dimensional modeling, and scalable data transformation patterns. While Databricks is the primary skill, SQL and Python remain foundational components of the work.

Responsibilities

Develop, optimize, and maintain data pipelines within Databricks using SQL, PySpark, and Delta Lake


Translate existing SQL Server/SSIS logic into Databricks-based modern cloud architecture


Apply data warehouse concepts (star schemas, slowly changing dimensions, fact/dimension modeling) to pipeline and table design


Build scalable, reliable ETL/ELT processes to support analytics, reporting, and downstream systems


Participate in cloud migration activities and support integration across data, BI, and application teams


Partner with data architects and engineering leads to design and implement Lakehouse solutions


Contribute to standards for coding, documentation, testing, and performance optimization


Support data validation and QA processes to ensure accuracy during and after migration


Participate in ongoing development phases as the platform expands to new domains and workloads

Required Skills

Hands-on experience with Databricks (not just exposure)


Strong understanding of data warehousing concepts including dimensional modeling


Proficiency with SQL for transformations, performance tuning, and pipeline logic


Experience with Python and/or PySpark in a data engineering environment


Experience migrating or modernizing legacy ETL processes (SSIS experience a plus)


Background in building scalable pipelines in cloud environments (Azure or AWS)


Ability to work in an early-stage environment with evolving requirements


Strong communication skills and ability to collaborate with architecture, BI, and integration teams

Nice to Have

Experience with Delta Live Tables or Databricks Workflows


Experience with Power BI or similar BI tools


Familiarity with DevOps practices for data (CI/CD, Git, testing frameworks)


Experience supporting data validation or automated QA frameworks


Exposure to professional services, legal, or real estate environments (not required)

Critical Success Factors

Comfortable working hands-on and iteratively as the cloud platform matures


Ability to interpret legacy ETL logic and redesign it for Databricks and Spark


Strong grounding in SQL and Python as core languages within Databricks


Ability to deliver high-quality pipelines with accuracy, reliability, and performance


Collaborative mindset and willingness to work across multiple technical teams
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Senior Databricks Data Engineer in Boston, MA vacancy
  • As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate diverse cybersecurity data sources using variety...  ..., develop, and optimize large-scale ETL/ELT pipelines on Databricks to efficiently process and transform cybersecurity data.... 
    Databricks
    Senior
    Contract work

    Cedent Consulting

    Boston, MA
    1 day ago
  • Beaconcure Inc. is hiring a Senior Data Engineer in Needham, Massachusetts. This role involves designing and implementing scalable data pipelines...  ..., proficiency with modern data engineering tools like Databricks, and strong problem-solving skills. Join a tech-forward... 
    Databricks
    Senior

    Beaconcure Inc.

    Needham Heights, MA
    2 days ago
  • $90k - $180k

     ...those of our clients.About the RoleSenior Data EngineerPOSITIONTracing our roots to 1...  ..., a new opportunity has arisen for a Senior Data Engineer. As a member of the Science Research...  ...modern data architectures (Snowflake, DataBricks, Fabric).Strong understanding of data... 
    Databricks
    Senior
    Full time
    Remote work
    Flexible hours
    1 day per week

    Wellington Management

    Boston, MA
    1 day ago
  • Tech Observer is seeking a highly skilled Data Engineer in Cambridge, MA to design, develop, and maintain scalable data platforms and automated...  ...science pipelines for Discovery R&D. You will work across Databricks, Nextflow Tower, and cloud-native architectures with cross-... 
    Databricks
    Senior

    Tech Observer

    Cambridge, MA
    3 days ago
  •  ...Accurate analysis of clinical research data is critical to helping millions of...  ...seeking a highly motivated and experienced Senior Data Engineer to join our team. As a Senior Data...  ...SQLAlchemy). Hands-on experience with Databricks, or other distributed data processing... 
    Databricks
    Senior

    Beaconcure Inc.

    Needham Heights, MA
    3 days ago
  • $124k - $280k

     ...Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced...  ...current and future business needs. As a Senior Manager you lead large projects,...  ...Snowflake Core, Snowflake Architect, Databricks Data Engineer Associate] is a plus-... 
    Databricks
    Senior
    Full time
    H1b

    PwC

    Boston, MA
    1 day ago
  • Who we are looking for We are looking for a Senior SIEM Data Engineer reporting directly to the Cyber Data Engineering Manager. You will lead...  ...high-value data into cyber data platforms such as Splunk, Databricks, and other SIEM or cyber analytics platforms. You will work... 
    Databricks
    Senior
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Flexible hours

    State Street Bank

    Quincy, MA
    4 days ago
  • $166k - $220k

     ...operating system that turns thousands of data streams into a realtime, 3D command and...  ...data platform and tooling, advocating for engineering best practices, automation, and a...  ...Snowflake, Google BigQuery, AWS Redshift, Databricks/Delta Lake) and data lake technologies (... 
    Databricks
    Senior
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Boston, MA
    20 hours ago
  • Sr. Data Engineer * This is a remote or work-from-home role! * About Us: We’re on a mission to improve health equity and drive improved...  ...cloud-based modern data pipelines Amazon Redshift, Databricks, Snowflake, or other similar technologies dbt, Apache Airflow... 
    Databricks
    Senior
    Remote job
    Work from home

    Roberts Recruiting, LLC

    Boston, MA
    2 days ago
  • HIRING: Senior Data Engineer | W2 Only | Hybrid | Salem, NH | Locals ONLY We're urgently hiring a Senior Data Engineer to join a high-impact...  ...models and structures Work with tools like Snowflake , Databricks , or Microsoft Fabric Ensure data quality , availability,... 
    Databricks
    Senior
    Start working today
    Local area
    Immediate start
    3 days per week

    HCL Global Systems Inc

    Boston, MA
    2 days ago
  • State Street is seeking a highly skilled Data Engineer to design, build, and optimize data infrastructure and analytics initiatives. This...  ..., you will work with cloud data lake activities in AWS and Databricks, implement CI/CD pipelines, and guide a global team of engineers... 
    Databricks
    Senior

    State Street

    Quincy, MA
    7 hours ago
  •  ...and evolving the firm's next-generation data platform. The team is focused on designing...  ...technologies. This is a hands‑on engineering role working on large‑scale data ingestion...  ...technologies such as Iceberg, Snowflake, Databricks, or similar platforms. Experience developing... 
    Databricks
    Senior
    Contract work
    Work at office
    Local area
    3 days per week

    DeWinter Group

    Boston, MA
    2 days ago
  • DraftKings in the United States is seeking a Senior Data Engineer to build scalable data infrastructure and transform complex transactional...  ...analytics, and cross-functional teams, leveraging Snowflake, Databricks, Kafka, and cloud tools, while mentoring teammates to... 
    Databricks
    Senior

    National Geographic

    Boston, MA
    3 days ago
  • The Senior Data Engineer will help transform our cloud data systems by designing and operating architectures that drive analytical and business...  ...and applying the right technologies—across Snowflake, Databricks, Azure data services, and traditional databases—based on workload... 
    Databricks
    Senior

    Boston Energy Trading and Marketing

    Boston, MA
    4 days ago
  • $182.3k - $291.5k

     ...Join Global Partners as Senior Director of Data Engineering to lead the architecture, development, and optimization of our enterprise data platform...  ...), and a cloud lakehouse pattern; working knowledge of Databricks/SageMaker, Fivetran, Hightouch/Census, DataHub (or... 
    Databricks
    Senior
    Permanent employment
    Full time
    Local area
    Shift work

    Global Partners

    Newton, MA
    2 days ago
  • Lead/Senior Data Engineer - Financial Services Equity Research Fulltime role with Vacation & Holidays & Company Benefits - Onsite in Boston...  ...Experience with one or more modern data architectures ( Snowflake, DataBricks, Fabric). Strong understanding of data modeling, data... 
    Databricks
    Senior
    Full time
    H1b

    Confidential Company

    Boston, MA
    1 day ago
  • $140k - $200k

     ...TetraScience is the Scientific Data and AI Company building Tetra...  ...partners includes NVIDIA, Databricks, Thermo Fisher Scientific, Snowflake...  ...leading the Scientific Data Engineering (SDE) Team and helping build...  ...to junior team members. As a Senior Scientific Data Engineer, you... 
    Databricks
    Senior
    Immediate start
    Visa sponsorship

    TetraScience

    Cambridge, MA
    14 days ago
  • $132.5k - $172.5k

     ...of the firm.Position SummaryBrown Advisory is seeking a Senior Addepar Data Engineer / Analyst to help advance the firm’s Wealth and Asset Management...  ...:Experience integrating Addepar with Snowflake, Databricks, enterprise data warehouses, BI/reporting tools, CRM platforms... 
    Databricks
    Senior
    Full time
    Temporary work
    H1b
    Work at office
    Worldwide
    3 days per week

    Brown Advisory

    Boston, MA
    20 hours ago
  • $116.8k - $146k

     ...operations, and unlock new possibilities. What you’ll do as a Senior Data Engineer Build scalable, high-performance data infrastructure that...  ...streaming solutions using technologies such as Snowflake, Databricks, Kafka, or similar distributed data platforms. Drive engineering... 
    Databricks
    Senior
    Full time
    Immediate start

    National Geographic

    Boston, MA
    3 days ago
  • $90k - $180k

    Senior Data Engineer As a member of the Science Research Technology team, you will help design, build, and scale data-driven solutions for...  ...Batch). Experience with modern data architectures: Snowflake, Databricks, Fabric. Strong understanding of data modeling, data... 
    Databricks
    Senior
    Work at office
    Remote work
    Flexible hours

    Wellington Management Company

    Boston, MA
    1 day ago
  • $100.2k - $150.2k

     ...lifetime. We are growing our Enterprise Data & Engineering team, and we are investing in marketing analytics! We’re hiring a Senior Marketing Analytics Engineer dedicated to...  ...scalable transformation frameworks using dbt, Databricks, and cloud-native technologies.... 
    Databricks
    Senior

    Hasbro, Inc.

    Boston, MA
    1 day ago
  •  ...startup mindset. The Platform Engineering Team at ABCorp builds the data infrastructure layer that powers our...  ...The Role ABCorp is seeking a Senior Data Engineer to own the data infrastructure...  ...Azure Synapse Analytics, Azure Databricks, ADLS, compute resources, access... 
    Databricks
    Senior
    Contract work
    Worldwide
    Visa sponsorship

    ABCorp NA Inc.

    West Roxbury, MA
    6 days ago
  • $90k - $157.5k

    Seeking a highly skilled data engineer, to design, build, and optimize our data infrastructure...  .... This hands-on role will partner with senior-level development managers, architects...  ...experience with Cloud platforms, AWS, Databricks.Experience in building systems using modern... 
    Databricks
    Senior
    Temporary work
    Flexible hours

    STATE STREET CORPORATION

    Quincy, MA
    20 hours ago
  • $120k - $160k

     ...company in the world? Berxi has an exciting opportunity for a Senior Data Engineer to join its Platform Engineering team in Boston, MA,...  ...maintain scalable data pipelines using Azure Data Factory, Databricks, and SQL Server (T-SQL). Implement configuration-driven ingestion... 
    Databricks
    Senior
    Temporary work
    Flexible hours

    BERKSHIRE HATHAWAY SPEC INS

    Boston, MA
    1 day ago
  •  ...degree in Computer Science, Information Technology, Engineering, or related field. • 7+ years of experience in QA, Data Warehouse Testing, ETL Testing, or Data Quality...  ...• Strong experience with: • Snowflake • Databricks • Azure Data Factory (ADF) • Azure Data Lake... 
    Databricks
    Senior

    Syncreon Consulting

    Boston, MA
    4 days ago
  • $100k - $160k

    Job Description Senior Consultant Data Engineer , you will be a key contributor within Kearney Activate’s Solutions Architecture and Data Engineering...  ...such as AWS S3, Azure Data Lake, Snowflake, and Databricks. Contribute to the development of modern data architectures... 
    Databricks
    Senior
    For contractors
    Immediate start
    Remote work
    Home office
    Flexible hours
    Shift work

    Kearney

    Boston, MA
    2 days ago
  • $116.2k - $229.1k

     ...Join Deloitte’s AI & Engineering practice and help organizations...  ...technology platforms, modernize data environments, and unlock value through innovation. As a Databricks Engineer in our AI & Data practice...  ...entry-level employees to senior leaders, we believe there’s always... 
    Databricks
    Senior
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    20 hours ago
  • $120k - $202.5k

     ...develop challenging new products in the financial space using cutting edge technology.What you will be responsible forAs Sr. Databricks Data Engineer you willDesign, build and test end to end data pipeline including data ingestion (streaming, events, and batch) on cloud-... 
    Databricks
    Senior
    Full time
    Temporary work
    Work at office
    Flexible hours

    State Street Bank

    Quincy, MA
    3 days ago
  • $188k - $282k

     ...unique individual with a passion for data and AI technology who can help our team...  ...support AI adoption at scale. As a Senior Principal AI Engineer in the Data Platforms team, you will...  ...methodologies. Experience with Snowflake or Databricks is required. Workflow Tools - Working... 
    Databricks
    Senior
    Full time
    Summer work

    Vertex Pharmaceuticals

    Boston, MA
    3 days ago
  • $137k - $215.27k

     ...Development and Implementation team at Takeda is in search of a data Sr. Staff Engineer to contribute to the design, implementation, and...  ...technologies in the data & analytics engineering domain (Spark, Databricks, data lakes, data QA tools, ML tools) are a plus but not... 
    Databricks
    Senior
    Minimum wage
    Temporary work
    Local area
    Remote work

    Takeda

    Boston, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Databricks Data Engineer. Be the first to apply!