Data Engineer - Intersystems to Cloud Migration (Snowflake/Databricks)

Saviance

Data Engineer - Intersystems to Cloud Migration (Snowflake/Databricks)

Location: Remote NYC

Contract: Ongoing Contract-Part-time

About BigRio

BigRio is a Boston-headquartered, remote-first technology consulting firm specializing in AI/ML, Cloud Transformation, Data Engineering, Healthcare Modernization, and Digital Innovation .

We partner with leading healthcare, life sciences, and enterprise organizations to modernize legacy systems, build intelligent data platforms, and accelerate their path to AI-driven operations.

As part of our expanding Cloud & Data Engineering practice, we are looking for a talented Data Engineer to support a high-impact healthcare data migration initiative. At BigRio, you'll work with a collaborative, cross-functional global team while leveraging cutting-edge technologies to solve complex real-world challenges.

About the Role

We are seeking a highly skilled Data Engineer with hands-on experience migrating data from InterSystems to modern cloud data platforms, specifically Snowflake and Databricks . This role focuses on building secure, scalable pipelines to migrate large-volume datasets (5M+ records) , including accurate de-identification of PHI , ensuring compliance with healthcare privacy standards.

You will be a core contributor to BigRio's cloud modernization solutions, working closely with internal stakeholders and client teams.

Key Responsibilities

Lead end-to-end migration of datasets from InterSystems (Caché/IRIS) to Snowflake and Databricks within BigRio's cloud modernization framework.
Build, optimize, and maintain large-scale ETL pipelines supporting 5M+ records with high performance and reliability.
Implement PHI de-identification and masking processes aligned with HIP nd BigRio security best practices.
Develop scalable data processing jobs using Databricks (Spark, PySpark, Delta Lake) .
Integrate data workflows with AWS RDS, Snowflake, and Databricks .
Work with BigRio's architecture and AI engineering teams to support analytics, reporting, and ML/GenAI initiatives.
Ensure data quality, monitoring, and validation throughout migration cycles.
Maintain documentation of architecture, data lineage, transformation logic, and operational procedures.
Collaborate with distributed BigRio and client teams across the U.S. and India.

Required Skills & Experience

5+ years as a Data Engineer , with strong cloud engineering experience.
Hands-on expertise with InterSystems (Caché/IRIS) - extraction, schema mapping, transformations.
Strong experience building solutions with Snowflake and cloud-native data warehousing.
Expertise with Databricks , Spark, and PySpark for large-scale processing.
Proven ability to build and optimize ETL pipelines handling 5M+ record volumes .
Strong understanding of PHI de-identification , HIPAA compliance, and healthcare data workflows.
Experience with AWS RDS , SQL, Python, and cloud orchestration tools.
Strong foundation in data modeling, performance tuning, and scalable architecture.
Excellent communication skills and comfortable working with global remote teams.

Preferred Qualifications

Experience with HL7, FHIR, CCD, or healthcare data interoperability.
Exposure to dbt, Airflow, Step Functions, or similar orchestration tools.
Experience in healthcare data modernization or cloud migrations.

Apply

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Data Engineer - Intersystems to Cloud Migration (Snowflake/Databricks) in Boston, MA vacancy

Senior Data Quality & Snowflake Migration Engineer
$71 - $80 per hour
DescriptionKforce has a client in need of a Senior Data Quality & Snowflake Migration Engineer in Boston, MA.Responsibilities:* Design and implement data quality and validation processes for large-scale cloud data migrations* Profile source data to identify accuracy, completeness...
Suggested
KForce
Boston, MA
3 days ago
Data Engineer 4: Python & AWS Cloud Solutions
...Capital One seeks a Data Engineer 4 to join Risk Tech in Cambridge, MA. You’ll design, build and operate cloud-native data solutions using Python, Spark, Databricks and Snowflake, collaborating with Agile teams to deliver scalable data platforms that empower risk management...
Databricks
Jobleads-US
Cambridge, MA
3 days ago
Data Engineer - East Region
...-create custom software, data, AI, and cloud solutions with clients who... ....Our Data Architecture & Engineering team sees data as the... ...Google Cloud Platform (GCP), Databricks, and Snowflake, along with the... ...legacy data environments or migrating workloads to cloud platforms...
Databricks
Temporary work
Work at office
Local area
Slalom
Boston, MA
20 hours ago
Senior Data Engineer
...mindset. The Platform Engineering Team at ABCorp builds the data infrastructure... ...platforms - into Snowflake with reliability, observability... ..., treating every migration as an opportunity... ...Analytics, Azure Databricks, ADLS, compute... ...infrastructure in a modern cloud environment. ~...
Databricks
Contract work
Worldwide
Visa sponsorship
ABCorp
West Roxbury, MA
2 days ago
Director, Data Architecture and Engineering
$207k - $259k
...WithAs a Director of Data Systems & Platforms at... ...’ data platform, engineering, and architecture priorities... ..., internal experts, cloud providers, and data... ..., architecture, migration, integration, governance... ...across AWS, Azure, GCP, Databricks, Snowflake, and the broader...
Databricks
Temporary work
Local area
Slalom
Boston, MA
1 day ago
Data Engineering and Development VP
...business to deliver data and insights to... ...technologies such as cloud, artificial... ...responsible forAs Data Engineering Lead you will:· Lead... ...with data migration, integration, and... ...on experience with Snowflake, including data warehousing... ..., PySpark, and Databricks for large-scale data...
Databricks
Full time
Flexible hours
State Street Bank
Quincy, MA
3 days ago
Senior Data Engineer: Cloud Data Lake & ELT Architect
...State Street Corporation is seeking a Senior hands-on Data Engineer for Cloud Data Lake design and development in Massachusetts. You will drive... ...experience with PL/SQL, Java/J2EE, Python, Scala, and cloud platforms (Databricks preferred). #J-18808-Ljbffr Jobleads-US
Databricks
Jobleads-US
Quincy, MA
4 days ago
Sr. Data Engineering Lead, Onsite, VP
$120k - $202.5k
...opportunities available.As a Data Engineer Lead, you will be... ...development experience with Databricks. You will help to migrate existing on-prem applications to cloud (Azure preferred), create and... ...relational databases such as Snowflake, SQLServer, OracleKnowledge...
Databricks
Full time
Temporary work
Work at office
Flexible hours
State Street Bank
Quincy, MA
4 days ago
Principal Data Engineer - US
...outcomes. Our AI-powered engine learns, adapts, and... ...As our Principal Data Engineer, you will help... ...best-in-class tooling (Databricks, Snowflake, dbt, Kafka, etc.)... ...at scale, including cloud data architecture, cost... ...reviews, or platform migrations. ~ Strong grasp of...
Databricks
Hourly pay
Full time
Remote work
Flexible hours
JobGet
Boston, MA
16 days ago
Senior Data Quality & Snowflake Engineer
$123k - $163k
...: Strong experience with Snowflake and advanced SQL development... ...on background in enterprise data migration, integration, and reconciliation... ...with AWS or comparable cloud-based storage and data environments... ...Collaborate with data engineers, architects, analysts, and business...
Hourly pay
Full time
Contract work
Kforce Technology Staffing
Boston, MA
7 days ago
Snowflake Data Engineer
...We are seeking an experienced Snowflake Data Engineer with strong expertise in Snowflake, Python, SQL, Snowpark, and ELT pipeline development.... ...engineering, data warehousing, data modeling, and enterprise cloud data architectures. Responsibilities Design, develop...
Contract work
Neshent Technologies
Boston, MA
21 days ago
Data Engineer II - QuantumBlack, AI by McKinsey (Critical Industries)
...will build the foundational data infrastructure that powers cutting... ...simple hypotheses into engineered features, manage secure data... ...used data platforms (Databricks, Snowflake, BigQuery, PSQL, etc.) and data... ...and deploying across major cloud platforms (AWS, Azure, GCP)Exceptional...
Databricks
Apprenticeship
Work at office
Local area
Easy work
McKinsey & Company
Boston, MA
1 day ago
Senior Data Engineer - Life Sciences.AI
$176k - $179.5k
...McKinsey, as a senior software engineer, building AI that... ...design and manage scalable data pipelines and secure analytics... ...deploying across major cloud platforms (AWS, Azure,... ...commonly used data platforms (Databricks, Databricks Asset Bundles, Snowflake, BigQuery, PSQL, etc.)...
Databricks
Apprenticeship
Easy work
Shift work
McKinsey & Company
Boston, MA
1 day ago
Senior Data Engineer
$90k - $180k
...clients.About the RoleSenior Data EngineerPOSITIONTracing our... ...has arisen for a Senior Data Engineer. As a member of the Science... ...frameworks.Proficiency with cloud platforms, especially AWS (S... ...modern data architectures (Snowflake, DataBricks, Fabric).Strong understanding...
Databricks
Full time
Remote work
Flexible hours
1 day per week
Wellington Management
Boston, MA
4 days ago
Snowflake Data Engineer
$90 per hour
...of Housing and Livable Communities (EOHLC) is looking for a Snowflake Data Engineer. Must be able to be onsite day 1 and Hybrid in Boston, MA... ...standards as they relate to Snowflake. ~ Experience with cloud platforms like AWS, Azure. ~ SnowPro Advanced...
Work at office
Monday to Friday
Shift work
3B Staffing LLC
Boston, MA
3 days ago
Data Analytics - Snowflake Technical Engineering Lead, AVP
$120k - $202.5k
...important to usWe are looking for a Data Analytics (Snowflake) Technical Engineering Lead, AVP to join our Data... ...Work with production management and cloud teams to analyze and provide solutions... ...SnowSQL, SnowPipe, other bigdata migration techniques using scripting (python...
Full time
Temporary work
Flexible hours
State Street Bank
Quincy, MA
1 day ago
Senior Databricks Data Engineer
...We're looking for a Senior Databricks Data Engineer to support a cloud modernization initiative where legacy SQL Server/SSIS pipelines are being rebuilt... ..., dimensions, modeling) • Experience modernizing or migrating ETL pipelines • Cloud experience (Azure or AWS) •...
Databricks
3B Staffing LLC
Boston, MA
3 days ago
Job opening of SNOWFLAKE DATA ENGINEER - W2 POSITION (Remote)
...an exciting job opportunity with one of our clients.Position: Snowflake Data EngineerContract: WRequirements:Candidates must have... ...implementation experience to be involved in the actual data migration from AWS databases-- S3 buckets-- Snowflake.[You can reply to...
Remote work
Software Technology Inc
Boston, MA
3 hours ago
Senior Data Engineer
$145k - $160k
...Velir acquired Brooklyn Data Company, a premier data... ...Overview Senior Data Engineers play a crucial role in helping... ...(e.g. SQL, Python) Cloud-based data warehouses (e.g., Snowflake, Google BigQuery)... ...warehouse (Snowflake,BigQuery, Databricks, or similar)....
Databricks
Remote work
Velir
Somerville, MA
20 hours ago
Senior Analytics Engineer, People Data
$166k - $220k
...that turns thousands of data streams into a realtime,... ...tooling, advocating for engineering best practices, automation... ...Extensive experience with cloud-based data warehousing solutions (e.g., Snowflake, Google BigQuery, AWS Redshift, Databricks/Delta Lake) and data lake...
Databricks
Full time
Work experience placement
Immediate start
Anduril Industries
Boston, MA
3 days ago
Principal Data Engineer
...and enhance enterprise-grade data platforms, including... ...secure access Establish engineering standards for development,... ...Hands-on experience with major cloud platforms such as AWS, Azure... ...modern data platforms such as Databricks or Snowflake Experience with...
Databricks
Curate Partners
Boston, MA
4 days ago
PROJECT - Data Engineer II
$71.3k - $140.6k
...Summary Our Deloitte AI & Engineering team works to transform... ...Work you'll do As a PROJECT - Data Engineer II on the AI & Data... ...unstructured sources across cloud and on-premises... ...clientsExperience with Apache Spark, Databricks, Snowflake, or Apache AirflowExperience...
Databricks
Local area
Deloitte
Boston, MA
2 days ago
Slalom Flex (Project Based)- Data Migration Engineer
Database Migration EngineerLocation: Remote, aligned to EST working hoursEmployment... ...a Senior Database Migration Engineer to support the development of... ...will partner closely with cloud architects, AI engineers, and... ...outcomes, and ensure data integrity throughout the migration...
Local area
Remote work
Flexible hours
Slalom
Boston, MA
2 days ago
Data Migration / Modernization Presales Solution Architect
Data Migration / Modernization Presales Solution Architect, L6Location... ...platform modernization, cloud migration of legacy data... ...emerging technologies like Databricks, Snowflake, GenAI, Agents — preparing... ...technical architecture (data engineering, data visualization, AI,...
Databricks
Full time
Work experience placement
Live in
Work at office
Local area
Accenture
Boston, MA
20 hours ago
BI Data Engineer II
$77k - $136k
...currently hiring a Full-Time BI Data Engineer II in Boston, MA.Join our... ...Data Platform with a Databricks-first approach. This position... ...Delta Lake, Python, SQL, and cloud-based data integrations while... ...usability.Support data ingestion, migration, and integration between...
Databricks
Full time
Currently hiring
The Boston Beer Company
Boston, MA
1 day ago
AI Data Engineer - QuantumBlack, AI by McKinsey
...Bachelor's program with a degree an engineering discipline.Who you'll work... ...doYou will build the foundational data infrastructure that powers cutting... ...with commonly used data platforms (Databricks, Snowflake, BigQuery, PSQL, etc.), cloud platforms (AWS, Azure, GCP) and engineering...
Databricks
Apprenticeship
Internship
Work at office
Local area
Easy work
McKinsey & Company
Boston, MA
1 day ago
Senior Data Platform Architect (Snowflake, Databricks, Open Platforms & Data Virtualization), VP I - State Street Investment Management
$120k - $202.5k
Role PurposeThe Senior Data Platform Architect is... ...platform spanning Snowflake, Databricks, open data platforms... ...layer with Databricks' engineering, streaming, and ML capabilitiesEstablish... ..., Folder Structures, Cloud Storage... ...batch applications migrating from legacy platforms...
Databricks
Full time
Temporary work
Flexible hours
State Street Bank
Boston, MA
20 hours ago
Data Operations Engineer
...Reporting to the Head of Data Management, the Senior Data Operations Engineer is responsible for... ...in a data engineering, cloud-based data architecture... ...technical issues with data migration and transformation... ...Azure environment such as DataBricks, Data Factory, bespoke...
Databricks
CERES Group
Boston, MA
3 days ago
Managing Director, Data Engineering & AI
Managing Director, Data Engineering & AIWho You'll Work WithAs a Managing Director in Slalom... ...through modern data platforms, cloud technologies, analytics, and AI.What... ...solutions leveraging technologies such as Databricks, Snowflake, dbt, Dataiku, Fivetran, Matillion, and...
Databricks
Temporary work
Slalom
Boston, MA
3 days ago
Data Pipeline Engineer
...Data Pipeline Engineer Location: Remote (US / India / Global - based on... ...trusted data, analytics, AI, and cloud consulting partner... ...such as Azure Data Factory, Databricks, Spark, Airflow, or similar... ...Kinesis, etc.) Exposure to Snowflake, BigQuery, Redshift, or...
Databricks
Full time
Contract work
Remote work
Flexible hours
Saviance
Boston, MA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - Intersystems to Cloud Migration (Snowflake/Databricks). Be the first to apply!