Senior Data Engineer

Role Overview 

We are looking for a Senior Data Engineer (15+ years) with deep hands-on experience in database development, Oracle PL/SQL, and large-scale Azure cloud migration to independently own and deliver complex migration and integration workstreams with minimal supervision. The role covers reverse-engineering legacy database logic, designing and implementing Azure-based data pipelines, and ensuring functional equivalence, data integrity, and traceability throughout the migration lifecycle. 

Scope of Work 

• Independently analyze, interpret, and reverse-engineer existing PL/SQL code, database objects, and data processing logic from legacy systems. 

• Adapt, refactor, or rewrite extracted logic to support Azure-based data migration and integration workflows, ensuring functional equivalence, data integrity, and traceability. 

• Design and implement data movement, transformation, and orchestration pipelines using Azure Data Factory and related Azure services. 

• Perform detailed source-to-target mapping, data transformation analysis, reconciliation, and validation as part of large-scale data migration initiatives. 

• Collaborate with data modelers and architects to align conceptual, logical, and physical data models with migration and integration requirements. 

• Produce and maintain migration design documents, Low-Level Design (LLD), mapping specifications, unit test plans, and validation reports. 

• Provide technical guidance to testing, integration, and downstream teams on migration logic, data validation strategies, and testing expectations. 

• Support integration testing and UAT by validating data consistency and correctness across upstream and downstream systems. 

• Perform in-depth troubleshooting, root cause analysis, and resolution of migration-related data issues across environments. 

• Ensure adherence to data governance standards, security controls, performance guidelines, and cloud best practices. 

• Proactively manage work items, timelines, dependencies, and risks; communicate issues and trade-offs to technical and business stakeholders. 

• Participate in SCRUM ceremonies; work closely with onsite and offshore teams while maintaining ownership of assigned deliverables. 

• Assist with documentation and artifacts for security clearance, release readiness, and production deployment. 

Skills & Experience Required 

• 15+ years of overall professional experience with strong focus on enterprise data migration, system modernization, and integration initiatives. 

• 8–10 years of experience in Data Modelling, Data/Information Architecture, Metadata Management, Master Data Management, Data Governance, and Data Quality. 

• Deep understanding of Oracle PL/SQL logic and database behavior; demonstrated ability to analyze and reverse-engineer complex legacy implementations. 

• Expertise in Azure platforms — Azure Databricks, ADLS, Delta Lake, and their various components. 

• In-depth hands-on experience with the Microsoft Azure data stack: Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic Apps, Event Hubs, Function Apps, APIM, and Web Apps. 

• Strong experience designing ETL/ELT pipelines and data flows using Azure Data Factory (primary); SSIS and Informatica as additional skills. 

• In-depth knowledge of designing ETL pipelines for batch and real-time processing in Azure Data Factory. 

• Thorough understanding of data lakes, Delta Lakes, and raw/enriched/curated layer concepts and ETL within the Azure framework; experience executing end-to-end projects focusing on Azure Synapse and Delta Lake. 

• Proficiency in Python, SQL, Spark notebooks, and Scala; strong development and design skills in MS SQL Server and Oracle. 

• Experience with Big Data architecture concepts, data sourcing, ingestion, curation, and storage mechanisms; real-time and near-real-time data warehousing concepts. 

• Experience leveraging Azure Automation, Azure PowerShell scripting, AzCopy, Azure DevOps, and ARM Templates. 

• Experience handling large-volume data migrations, reconciliation, validation, and cross-system data consistency checks. 

• Strong understanding of data modelling concepts — relational structures, surrogate and composite keys, cross-reference tables, and migration-friendly data designs. 

• Experience with Salesforce migration is a plus. 

• Demonstrated ability to work as a senior individual contributor, independently owning complex migration workstreams. 

• Strong analytical and root cause analysis skills; excellent written and verbal communication with technical and non-technical stakeholders. 

• Highly organized with strong ownership of deliverables, documentation, and timelines.