Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Migration & Batch Engineer

United IT

Data Migration & Batch Engineer Locations are Austin, Charlotte, San Diego, NYC-Onsite Responsibilities Own schema-drift detection and reconciliation (Red Gate / SQL comparison) — the deterministic ground truth on which every downstream decision rests. Build the deterministic rule ladder for table and job dispositions: staging / truncate-and-reload detection, dead-table detection, target-equivalent matching, straight-through repoint, duplicate-job merge. Own the ID-collision engine: a full (never sampled) overlap scan across every shared ID space; classification into true collision, phantom and historical overlap; analysis of the resolution strategy; and a non-bypassable validation harness on every script that touches an ID column. Own data reconciliation: row counts, column checksums, referential integrity, stored-procedure output parity, business-key parity; staging promotion gates and validated rollback scripts. Batch: build the dependency graph, blast-radius (butterfly) scoring, Simple/Medium/Complex classification, and the migration approach per job. Own the SLA validation harness — proving every migrated job and every SLA chain runs within its window under combined nightly volume. Emit the downstream artifacts: migration scripts, job modifications, rollback scripts, reconciliation specifications. Qualifications SQL Server (2024) — deep: DDL, stored procedures, indexing, referential integrity, query performance. Relational data migration at scale — Red Gate, AWS DMS or equivalent; cutover, reconciliation and rollback delivered in production. Identity and key-collision resolution — surrogate versus natural keys, reconciliation and historical-mapping tables, preserving referential integrity under a merge. Rare, and highly valued for this role. Informatica PowerCenter; ETL dependency analysis; SLA and batch-window modelling. Python and strong SQL; data-quality and validation frameworks. The discipline to keep correctness-critical steps deterministic while working alongside an LLM reasoning layer. Working knowledge Informatica IDMC and/or Apache Airflow; PySpark. Graph queries; handling of regulated / PII data. United IT

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Migration & Batch Engineer in New York, NY vacancy
  • M365 Migration Engineer Role: M365 Migration Engineer Location: USA/Remote Duration: 6+ Months Job Description: JD Overview: Responsible for...  ...migrations. Work independently, should be able to handle the batch migration without any support. Creation of console application... 
    Suggested
    Work at office
    Remote work
    Weekend work

    Zortech Solutions

    New York, NY
    2 days ago
  •  ...required The Systems Manager, GCP Data Engineering, Enterprise Data & Analytics, leads the...  ...Oversee the secure onboarding of diverse batch and streaming datasets from legacy on-...  ..., platform operations, legacy migration workstreams, and business stakeholders... 
    Data
    Full time
    Work experience placement
    Immediate start
    3 days per week

    Vertex Solutions Inc.

    New York, NY
    17 days ago
  •  ...looking for a hands-on Quality Engineer to help rebuild and modernize...  .... This role will focus on migrating an existing Selenium test suite...  ...automation development, end-to-end data validation, and AI-assisted...  ...involving email, EDI, batch files, or other structured data... 
    Data
    Full time

    Atlas Search

    New York, NY
    3 days ago
  • $90k - $180k

     ...The Staff Systems Mainframe Engineer is responsible for leading a team...  ...trends and behavioral data to identify strategic opportunities...  ...JCL, IPL, JES2 commands, and batch management. Software installation...  ...Insight for DB2, RC tools (RC/Migrator, RC/Compare), Log Analyzer,... 
    Data
    Remote job
    Work experience placement
    Local area

    Home Depot

    New York, NY
    2 days ago
  •  ...We are seeking an experienced Exchange Engineer to manage, maintain, and support our enterprise...  ...messaging infrastructure, Microsoft 365 migrations, email security, and advanced...  ...security teams to implement and enforce email data loss prevention (DLP), encryption, and... 
    Data

    PRI Technology

    New York, NY
    a month ago
  •  ...Senior MDM/MAM Engineer *US Citizens or GC Holders *Hybrid in any of the listed locations...  ...Enterprise Define and enforce mobile data protection controls through Intune App Protection...  ...On-premises to Exchange Online Migration High level of comfort with Entra ID (Azure... 
    Data
    Work at office

    Stone Search, LLC

    New York, NY
    10 days ago
  • $65k - $75k

     ...Help Desk Engineer Level 2 (MSP / Hybrid WFH) Location: New York City Work Model: Hybrid WFH, 3 to 4 days remote with 1 to 2 days...  ...endpoint configuration • Assist with firewall upgrades, data migrations, and other infrastructure projects • Communicate directly with... 
    Data
    Temporary work
    Live in
    Local area
    Immediate start
    Remote work
    Work from home
    Home office
    Flexible hours
    2 days per week
    3 days per week
    1 day per week

    Bowman Williams

    New York, NY
    16 days ago
  •  ...solutions, optimize test environments, batch processing, test-data operations, change control,...  ...Bachelor’s degree in Computer Science, Engineering, Information Systems, a related field...  ...Supporting mainframe upgrades, application migrations, disaster recovery/business... 
    Data
    Remote job
    Permanent employment
    Full time
    Part time
    H1b
    Work visa
    Shift work
    Day shift

    Truist Inc

    New York, NY
    2 days ago
  • $120k - $200k

     ...MARC is hiring a Founding Engineer to help scale an AI-native product that already runs...  ...verification pipelines, and the search and data layer that lets customers query,...  ...PostgreSQL: schema design, query optimisation, migrations Elasticsearch: production experience... 
    Data
    Full time
    Contract work
    Work at office

    MARC

    New York, NY
    5 days ago
  • $37.87 - $45.45 per hour

     ...7.87 - 45.45/hr. Role Name - Senior Data Engineer Job Description: We are looking for...  .... •Build ingestion frameworks for batch and incremental data loads. •Implement...  ...reusable data pipeline components. •Support migration of SQL Server databases, stored... 
    Data

    Varite, Inc

    New York, NY
    25 days ago
  • We are looking for an Expert RAG Engineer to design, build, and own the retrieval-augmented...  ...including structured and semi-structured data (XML/XSD, Office formats, PDFs, scanned documents...  ...: quantization (GGUF), GPU/CUDA tuning, batching, caching, and offline/air-gapped... 
    Data
    Work at office
    Remote work

    Salvo Software

    New York, NY
    2 days ago
  •  ...Databricks Engineer Location: Englewood Cliffs, New Jersey / New York, NY (final approved...  ...Experience: 5+ Years of Relevant Data Engineering Experience Overview: The Databricks...  ...30–60 days, build or enhance assigned batch and, where required, streaming pipelines... 
    Data
    Immediate start
    Remote work

    CoSourcing Partners - Enterprise-AI and IT Services Company

    New York, NY
    5 days ago
  • $100 - $114 per hour

     ...IAM Engineer Cloud Engineering/DevOps IAM Engineer | Location: Hybrid - Boston, MA; New...  .... Provide technical leadership for migrations to colocation or cloud-adjacent environments...  ...Delphi's core technical focus includes Data Intelligence Engineering & Analytics, AI... 
    Data
    Hourly pay
    Contract work
    Shift work

    Delphi-US, LLC - Peacemakers in the Talent War

    New York, NY
    4 days ago
  • We are looking for a Systems Engineer to support and enhance core infrastructure environments...  ...systems, applications, and business data.• Troubleshoot network and infrastructure...  ....• Assist with server and infrastructure migration projects, including directory services, file... 
    Data
    Full time
    Remote work

    Robert Half

    New York, NY
    3 days ago
  •  ...THE ROLE   The Sales Engineer provides technical support across the sales cycle, from post...  ..., covering current-state architecture, data landscape, integration constraints, security...  ...integration), working knowledge of cloud migration and application modernization, and enough... 
    Data
    Full time

    Saige Consulting

    New York, NY
    9 hours ago
  •  ...Customer Success Engineer San Francisco, CA & New York, NY At Pave, we're building the industry's leading compensation platform...  ...on the technical needs of the customer with integrations, data migration and configurations. You have 2+ years of experience as a customer... 
    Data
    Immediate start
    Flexible hours
    3 days per week

    Pave

    New York, NY
    2 days ago
  •  ...IN NEW YORK CITY. The Senior Systems Engineer is a senior-level technical consulting role...  ...ground up, leading infrastructure migrations and modernization initiatives, troubleshooting...  ...and controls to manage the firm’s data security with a goal of protecting the... 
    Data
    Remote work
    Weekend work
    Afternoon shift

    Perennial Resources International

    New York, NY
    17 days ago
  • $80 - $95 per hour

     ...Senior Systems Engineer – Construction Estimating & Digital Systems Location: New York,...  ...develop cost estimates, analyze project data, integrate enterprise systems, and improve...  ...techniques to improve operational efficiency. Migrate historical estimating data into... 
    Data
    Hourly pay
    Contract work
    Monday to Friday
    Shift work

    Equiliem

    New York, NY
    5 days ago
  •  ...right time.Google Workspace Administration & Engineering (Complex Environment Focus):Serve as the Tier...  ...managed before rolling out to the user base.Migration & Project Leadership:Lead and execute full-scale, end-to-end data migrations, including email, calendar, and file... 
    Data
    Full time
    Remote work

    Tempus

    New York, NY
    1 day ago
  • $175k - $250k

     ...and trading capabilities. The End User Engineering team engineers and supports the firm’s desktop...  ...assurance, and analyze performance data to improve workspace reliability and resource...  ...with Microsoft Intune, including migration from JAMF Pro to Intune.Strong macOS and... 
    Data
    Work at office
    Flexible hours

    Millennium Management

    New York, NY
    1 day ago
  • $119.2k - $159.8k

     ...Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working to build and advance...  ...management. * Exposure to large-scale storage migrations and modernization initiatives. * Exposure to... 
    Data

    Disney Entertainment and ESPN Product & Technology Careers

    New York, NY
    17 days ago
  •  ...-oriented Senior Performance Advertising Engineer to own and drive theoptimization of our buyer...  ...for designing algorithms, building data systems, and refining optimization loops...  ...implement scalable, low-latency streamingand batch data pipelines that ingest, validate, and... 
    Data
    Work at office
    Remote work

    PubMatic

    New York, NY
    2 days ago
  • $130k - $180k

     ...and we are looking for a Forward Deployed Engineer to join our Professional Services team!...  ...scale, security, user governance, and data architecture.Engineer complex and agentic...  ...MCP, and apps framework, to deliver data migrations, integrations, and custom applications.... 
    Data
    Work at office
    Flexible hours
    3 days per week

    monday.com

    New York, NY
    1 day ago
  • $154k - $205k

     ...accelerate time to value.As a Forward Deployed Engineer, you'll be the hands-on technical engine...  ...customer environments to deploy Datadog, migrate customers off legacy platforms, and...  ...It brings applications, infrastructure, data, models, and security into one place, using... 
    Data
    Work at office

    Datadog

    New York, NY
    3 days ago
  •  ...Skills' Details 1. Broadcom Proxy - Proxy engineer uses the platform daily to inspect,...  ...Broadcom DLP to detect and prevent sensitive data from leaving the organization through web...  ...uploads, cloud apps, or encrypted channels. 2. Migration Experience - Hands-on experience... 
    Data
    Remote job

    STI

    New York, NY
    2 days ago
  •  ...looking for a hands-on BI Platform Operations Engineer to provide production operational...  ...services, RESTful APIs, AWS serverless and data services, and a web-based user interface...  .... Assist with platform upgrades, migrations, configuration changes, and infrastructure... 
    Data
    For subcontractor

    Luxoft

    New York, NY
    28 days ago
  • Mainframe MQ Engineer Ongoing contract (Client maintains right to hire after 3 months though...  ...channels, queues, etc) • Knowledge of MQ Data Sharing in a large Sysplex environment •...  ...application developers in the use of MQ in batch and CICS environments. • Individual will... 
    Data
    Ongoing contract
    Work at office

    3B Staffing LLC

    New York, NY
    2 days ago
  • F5 Engineer Duration - 6 months Rate: $Open to Discuss /hr. all inclusive Client - Bank of...  ...the design, implementation, configuration, migration, and support of F5 BIG IP platforms. The...  ...with a strong background in enterprise and data center networking, application delivery,... 
    Data
    Contract work
    3 days per week

    Anveta

    New York, NY
    2 days ago
  •  ...code on Express (WordPress multisite on WP Engine), including GPT, ExpressAds.js, slot...  ...Exchange, and Amazon TAM/UAM. Execute technical migrations and updates for header bidding wrappers,...  ...commercial leaders and developers to data, audience, and ad tech squad members. What... 
    Data
    Work at office
    Immediate start
    Remote work
    Work from home
    Monday to Friday
    Shift work

    ConnectOS

    New York, NY
    2 days ago
  •  ...that hardware - we buy the racks, find the data center space, and run it for our...  ...live customer request: request scheduling, batching, KV-cache management, autoscaling across...  ...roadmap, not just the backlog. As a founding engineer, you'll help decide what we build next in... 
    Data

    General Compute

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Migration & Batch Engineer. Be the first to apply!