Lead Data Engineer (Snowflake, AWS, StreamSets)

Role Overview We are looking for an experienced Lead Data Engineer to lead data migration and modernization initiatives for multiple client environments. The primary focus of this role will be migrating data from AWS S3 to Snowflake using StreamSets , while ensuring scalable, reliable, and secure data movement. The ideal candidate will have strong hands‑on expertise in Snowflake, StreamSets, Python , and cloud engineering concepts, along with the ability to lead technical delivery across client‑facing data engineering engagements. This is a fully onsite role based in Dallas, Texas , requiring the selected candidate to work from the office 5 days per week . Key Responsibilities Lead migration initiatives for multiple clients, moving data from AWS S3 to Snowflake using StreamSets . Design, develop, and maintain scalable batch and near‑real‑time data pipelines using StreamSets and Python. Assess existing client data environments, identify migration dependencies, and define implementation plans. Build reusable ingestion frameworks to support efficient and repeatable migration across client projects. Validate data completeness, accuracy, schema mapping, and reconciliation during migration. Build and optimize data models, ingestion frameworks, and transformation workflows in Snowflake . Drive Snowflake performance optimization, workload tuning, and cost management. Implement monitoring, error handling, audit logging, and data quality controls. Apply cloud engineering concepts while designing resilient, secure, and scalable data solutions. Collaborate with client stakeholders, architects, product owners, analysts, and engineering teams. Mentor data engineers, conduct code reviews, and provide technical direction. Troubleshoot production issues and lead root‑cause analysis and preventive‑action initiatives. Ensure compliance with data governance, security, and access‑control standards. Contribute to release planning, effort estimation, risk management, and delivery tracking. Mandatory Technical Skills Strong hands‑on experience with Snowflake , including data loading, data modelling, query optimization, performance tuning, resource monitoring, cost optimization, and role‑based access control. Practical experience with StreamSets for building and managing data ingestion and migration pipelines. Strong programming skills in Python for data processing, automation, validation, and pipeline development. Solid understanding of cloud engineering concepts , including scalable architecture, storage and compute patterns, identity and access management, security, monitoring, fault tolerance, and cost optimization. Strong knowledge of SQL and data engineering fundamentals. Experience with ETL/ELT design patterns and data integration frameworks. Understanding of data migration best practices, including schema mapping, reconciliation, data validation, and cutover planning. Understanding of data quality, observability, and production support practices. #J-18808-Ljbffr