Data Migration & Batch Engineer
United IT
Data Migration & Batch Engineer Locations are Austin, Charlotte, San Diego, NYC-Onsite Responsibilities Own schema-drift detection and reconciliation (Red Gate / SQL comparison) — the deterministic ground truth on which every downstream decision rests. Build the deterministic rule ladder for table and job dispositions: staging / truncate-and-reload detection, dead-table detection, target-equivalent matching, straight-through repoint, duplicate-job merge. Own the ID-collision engine: a full (never sampled) overlap scan across every shared ID space; classification into true collision, phantom and historical overlap; analysis of the resolution strategy; and a non-bypassable validation harness on every script that touches an ID column. Own data reconciliation: row counts, column checksums, referential integrity, stored-procedure output parity, business-key parity; staging promotion gates and validated rollback scripts. Batch: build the dependency graph, blast-radius (butterfly) scoring, Simple/Medium/Complex classification, and the migration approach per job. Own the SLA validation harness — proving every migrated job and every SLA chain runs within its window under combined nightly volume. Emit the downstream artifacts: migration scripts, job modifications, rollback scripts, reconciliation specifications. Qualifications SQL Server (2024) — deep: DDL, stored procedures, indexing, referential integrity, query performance. Relational data migration at scale — Red Gate, AWS DMS or equivalent; cutover, reconciliation and rollback delivered in production. Identity and key-collision resolution — surrogate versus natural keys, reconciliation and historical-mapping tables, preserving referential integrity under a merge. Rare, and highly valued for this role. Informatica PowerCenter; ETL dependency analysis; SLA and batch-window modelling. Python and strong SQL; data-quality and validation frameworks. The discipline to keep correctness-critical steps deterministic while working alongside an LLM reasoning layer. Working knowledge Informatica IDMC and/or Apache Airflow; PySpark. Graph queries; handling of regulated / PII data. United IT
- M365 Migration Engineer Role: M365 Migration Engineer Location: USA/Remote Duration: 6+ Months Job Description: JD Overview: Responsible for... ...migrations. Work independently, should be able to handle the batch migration without any support. Creation of console application...SuggestedWork at officeRemote workWeekend work
- ...required The Systems Manager, GCP Data Engineering, Enterprise Data & Analytics, leads the... ...Oversee the secure onboarding of diverse batch and streaming datasets from legacy on-... ..., platform operations, legacy migration workstreams, and business stakeholders...DataFull timeWork experience placementImmediate start3 days per week
- ...looking for a hands-on Quality Engineer to help rebuild and modernize... .... This role will focus on migrating an existing Selenium test suite... ...automation development, end-to-end data validation, and AI-assisted... ...involving email, EDI, batch files, or other structured data...DataFull time
$90k - $180k
...The Staff Systems Mainframe Engineer is responsible for leading a team... ...trends and behavioral data to identify strategic opportunities... ...JCL, IPL, JES2 commands, and batch management. Software installation... ...Insight for DB2, RC tools (RC/Migrator, RC/Compare), Log Analyzer,...DataRemote jobWork experience placementLocal area- ...We are seeking an experienced Exchange Engineer to manage, maintain, and support our enterprise... ...messaging infrastructure, Microsoft 365 migrations, email security, and advanced... ...security teams to implement and enforce email data loss prevention (DLP), encryption, and...Data
- ...Senior MDM/MAM Engineer *US Citizens or GC Holders *Hybrid in any of the listed locations... ...Enterprise Define and enforce mobile data protection controls through Intune App Protection... ...On-premises to Exchange Online Migration High level of comfort with Entra ID (Azure...DataWork at office
$65k - $75k
...Help Desk Engineer Level 2 (MSP / Hybrid WFH) Location: New York City Work Model: Hybrid WFH, 3 to 4 days remote with 1 to 2 days... ...endpoint configuration • Assist with firewall upgrades, data migrations, and other infrastructure projects • Communicate directly with...DataTemporary workLive inLocal areaImmediate startRemote workWork from homeHome officeFlexible hours2 days per week3 days per week1 day per week- ...solutions, optimize test environments, batch processing, test-data operations, change control,... ...Bachelor’s degree in Computer Science, Engineering, Information Systems, a related field... ...Supporting mainframe upgrades, application migrations, disaster recovery/business...DataRemote jobPermanent employmentFull timePart timeH1bWork visaShift workDay shift
$120k - $200k
...MARC is hiring a Founding Engineer to help scale an AI-native product that already runs... ...verification pipelines, and the search and data layer that lets customers query,... ...PostgreSQL: schema design, query optimisation, migrations Elasticsearch: production experience...DataFull timeContract workWork at office$37.87 - $45.45 per hour
...7.87 - 45.45/hr. Role Name - Senior Data Engineer Job Description: We are looking for... .... •Build ingestion frameworks for batch and incremental data loads. •Implement... ...reusable data pipeline components. •Support migration of SQL Server databases, stored...Data- We are looking for an Expert RAG Engineer to design, build, and own the retrieval-augmented... ...including structured and semi-structured data (XML/XSD, Office formats, PDFs, scanned documents... ...: quantization (GGUF), GPU/CUDA tuning, batching, caching, and offline/air-gapped...DataWork at officeRemote work
- ...Databricks Engineer Location: Englewood Cliffs, New Jersey / New York, NY (final approved... ...Experience: 5+ Years of Relevant Data Engineering Experience Overview: The Databricks... ...30–60 days, build or enhance assigned batch and, where required, streaming pipelines...DataImmediate startRemote work
$100 - $114 per hour
...IAM Engineer Cloud Engineering/DevOps IAM Engineer | Location: Hybrid - Boston, MA; New... .... Provide technical leadership for migrations to colocation or cloud-adjacent environments... ...Delphi's core technical focus includes Data Intelligence Engineering & Analytics, AI...DataHourly payContract workShift work- We are looking for a Systems Engineer to support and enhance core infrastructure environments... ...systems, applications, and business data.• Troubleshoot network and infrastructure... ....• Assist with server and infrastructure migration projects, including directory services, file...DataFull timeRemote work
- ...THE ROLE The Sales Engineer provides technical support across the sales cycle, from post... ..., covering current-state architecture, data landscape, integration constraints, security... ...integration), working knowledge of cloud migration and application modernization, and enough...DataFull time
- ...Customer Success Engineer San Francisco, CA & New York, NY At Pave, we're building the industry's leading compensation platform... ...on the technical needs of the customer with integrations, data migration and configurations. You have 2+ years of experience as a customer...DataImmediate startFlexible hours3 days per week
- ...IN NEW YORK CITY. The Senior Systems Engineer is a senior-level technical consulting role... ...ground up, leading infrastructure migrations and modernization initiatives, troubleshooting... ...and controls to manage the firm’s data security with a goal of protecting the...DataRemote workWeekend workAfternoon shift
$80 - $95 per hour
...Senior Systems Engineer – Construction Estimating & Digital Systems Location: New York,... ...develop cost estimates, analyze project data, integrate enterprise systems, and improve... ...techniques to improve operational efficiency. Migrate historical estimating data into...DataHourly payContract workMonday to FridayShift work- ...right time.Google Workspace Administration & Engineering (Complex Environment Focus):Serve as the Tier... ...managed before rolling out to the user base.Migration & Project Leadership:Lead and execute full-scale, end-to-end data migrations, including email, calendar, and file...DataFull timeRemote work
$175k - $250k
...and trading capabilities. The End User Engineering team engineers and supports the firm’s desktop... ...assurance, and analyze performance data to improve workspace reliability and resource... ...with Microsoft Intune, including migration from JAMF Pro to Intune.Strong macOS and...DataWork at officeFlexible hours$119.2k - $159.8k
...Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working to build and advance... ...management. * Exposure to large-scale storage migrations and modernization initiatives. * Exposure to...Data- ...-oriented Senior Performance Advertising Engineer to own and drive theoptimization of our buyer... ...for designing algorithms, building data systems, and refining optimization loops... ...implement scalable, low-latency streamingand batch data pipelines that ingest, validate, and...DataWork at officeRemote work
$130k - $180k
...and we are looking for a Forward Deployed Engineer to join our Professional Services team!... ...scale, security, user governance, and data architecture.Engineer complex and agentic... ...MCP, and apps framework, to deliver data migrations, integrations, and custom applications....DataWork at officeFlexible hours3 days per week$154k - $205k
...accelerate time to value.As a Forward Deployed Engineer, you'll be the hands-on technical engine... ...customer environments to deploy Datadog, migrate customers off legacy platforms, and... ...It brings applications, infrastructure, data, models, and security into one place, using...DataWork at office- ...Skills' Details 1. Broadcom Proxy - Proxy engineer uses the platform daily to inspect,... ...Broadcom DLP to detect and prevent sensitive data from leaving the organization through web... ...uploads, cloud apps, or encrypted channels. 2. Migration Experience - Hands-on experience...DataRemote job
- ...looking for a hands-on BI Platform Operations Engineer to provide production operational... ...services, RESTful APIs, AWS serverless and data services, and a web-based user interface... .... Assist with platform upgrades, migrations, configuration changes, and infrastructure...DataFor subcontractor
- Mainframe MQ Engineer Ongoing contract (Client maintains right to hire after 3 months though... ...channels, queues, etc) • Knowledge of MQ Data Sharing in a large Sysplex environment •... ...application developers in the use of MQ in batch and CICS environments. • Individual will...DataOngoing contractWork at office
- F5 Engineer Duration - 6 months Rate: $Open to Discuss /hr. all inclusive Client - Bank of... ...the design, implementation, configuration, migration, and support of F5 BIG IP platforms. The... ...with a strong background in enterprise and data center networking, application delivery,...DataContract work3 days per week
- ...code on Express (WordPress multisite on WP Engine), including GPT, ExpressAds.js, slot... ...Exchange, and Amazon TAM/UAM. Execute technical migrations and updates for header bidding wrappers,... ...commercial leaders and developers to data, audience, and ad tech squad members. What...DataWork at officeImmediate startRemote workWork from homeMonday to FridayShift work
- ...that hardware - we buy the racks, find the data center space, and run it for our... ...live customer request: request scheduling, batching, KV-cache management, autoscaling across... ...roadmap, not just the backlog. As a founding engineer, you'll help decide what we build next in...Data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Migration & Batch Engineer. Be the first to apply!
- junior data engineer remote New York, NY
- data platform engineer New York, NY
- principal data engineer New York, NY
- data engineer analytics New York, NY
- data science developer New York, NY
- data engineer manager New York, NY
- big data developer New York, NY
- big data devops engineer New York, NY
- data center engineer New York, NY
- staff data engineer New York, NY




