Data Engineer - Pipeline Migration

US Citizenship is required for this position







Data Engineer Pipeline Migration (Req.# 7695) Fort Walton Beach, FL

Pay Rate: $50.88/Hr on W2

Shift: 1 st Shift , 08:00AM-04:00PM.

Position Description

We seek a pragmatic specialist to migrate existing analytical pipelines from Alteryx and R into Dataiku.

The focus is on executing validated, documented translations-not building platform extensions or innovating on tooling. Success = production-ready SQL/Dataiku pipelines handed off to internal teams with clear lineage and zero regression in business logic.

Key Responsibilities:

1. Pipeline Translation: Convert R (dplyr/data.table) and Alteryx workflows into modular, optimized SQL (CTEs, window functions, set-based logic) and/or Dataiku visual/SQL recipes-prioritizing correctness over elegance.

2. Cloud Warehouse Execution: Deploy/test translated logic on one primary cloud platform (Redshift or Snowflake or Athena)-no need for multi-cloud expertise.

3. Validation & Handoff: Run unit-style validation against source pipelines; document assumptions, lineage, and deployment steps for internal teams.

4. Knowledge Transfer: Conduct 2 3 focused sessions (max 1 hr each) walking data science/analytics team members through migrated pipelines and validation reports.

5. Documentation: Maintain a living wiki/OneNote page with transformation logic, test results, and known limitations-not formal data governance artifacts.

Skills Required:

1. Core SQL: Fluency in writing/optimizing queries (JOINs, CTEs, window functions) for cloud warehouses and traditional databases (Redshift/SQL Server).

2. Translation Ability: Proven track record converting R/Alteryx logic to SQL or equivalent experiences (KNIME, Informatica, etc).

3. Validation Mindset: Comfort building simple row-count/checksum tests to verify migration fidelity.

4. Clear Communication: Ability to explain technical steps to non-engineers and document assumptions plainly.

5. Self-Starter: Comfort working with minimal daily supervision; flags blockers early.

Skills Preferred:

1. Familiarity with Dataiku DSS interface (visual recipes, project structure)-learnable in < 1 week.

2. Exposure to DBT concepts (understands why modular SQL matters for handoff).

3. Experience with Git for version control (basic branching/PRs).

Experience Required:

2 4 years in data engineering with direct pipeline migration/replatforming experience (e.g., moved Alteryx to Dataiku; converted R to SQL/Python; packaged SQL to DBT, other equivalent experience).

Education Required:

Bachelor's degree in CS, IS, Data Engineering, or equivalent practical experience (e.g., 3+ years hands-on SQL/data pipeline work).

Education Preferred

Bachelor's degree in CS, IS, Data Engineering

.

.

.

.

.

#DataEngineer #DataEngineering #SQL #ETL #ELT #DataMigration #PipelineMigration #Replatforming #Alteryx #RProgramming #Snowflake #Redshift #AmazonAthena #Informatica #SSIS #DataValidation #DataQuality #Dataiku #dbt #Git #CloudDataEngineering #DataPipelines #SQLServer #AWS #CloudMigration #ETLDeveloper #AnalyticsEngineer #DataWarehouse