Data Pipeline Engineer

ON SITE 4 DAYS A WEEK IN WASHINGTON, D.C.

Background and Context Focuses explicitly on the one-time and phased mass migration efforts, ensuring zero data loss, strict adherence to mapping rules, and the successful execution of technical cutover protocols. Scope of Work Pipeline Development and Implementation Build automated ETL/ELT pipelines to extract legacy data (Oracle, SharePoint) and load it into AWS RDS and Azure ADLS Gen2. Program data cleansing, standardization, and validation logic into the pipelines based on the Data Quality Rulebook. Execute the physical data extraction and load during pre-production and production cutovers. Solution Design and Optimization Tune extraction queries to minimize performance impacts on legacy production systems during sync operations. Implement physical data models for the target databases. Code and automate the technical rollback mechanisms and data reconciliation scripts. Stakeholder Engagement and Change Management Collaborate directly with the Business Analyst to interpret and implement STTM documents. Provide feedback on technical feasibility and performance implications of proposed data transformation rules. Participate in daily agile ceremonies and sprint planning. Governance, Ethics, and Risk Embed automated pre- and post-migration data quality checks directly into the ETL scripts. Implement encryption standards at rest (AWS KMS) and in transit (TLS 1.2+). Apply role‑based access control (RBAC) schemas within the database layers via IAM and Microsoft Entra ID. Documentation and Reporting Document migration code repositories, operational runbooks, and cutover execution scripts. Generate automated migration success/failure logs for auditing. Required Qualifications and Experience Education Bachelor's or Master’s in Computer Science, Data Engineering, or a related quantitative field. Certifications (Preferred) AWS Certified Data Engineer – Associate or Microsoft Certified Azure Data Engineer. Mandatory Experience 5+ years building ETL pipelines, with heavy emphasis on one‑time mass data migrations from legacy relational databases. Technical Knowledge Expert SQL and Python. Hands‑on experience with database migration tools (e.g., AWS DMS), Databricks, and legacy Oracle ecosystems. Core Competencies Rigorous attention to detail regarding data integrity, strong problem‑solving skills for schema mismatches, and ability to work under strict cutover deadlines. Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status. #J-18808-Ljbffr Dexian