Senior Lead Data Engineer

Senior Lead Data Engineer Experience 15+ Years (Data Engineering, Cloud Data Platform & Architecture Experience) Employment Type Full-Time (W2 Only) Location USA (Hybrid / Onsite) Work Authorization H4 EAD, L2S, GC EAD, Green Card, US Citizen Job Summary We are seeking a highly accomplished Senior Lead Data Engineer to lead the architecture, design, development, and modernization of enterprise-scale data platforms. The ideal candidate will possess deep expertise in Cloud Data Engineering, Data Architecture, Big Data Technologies, ETL/ELT Frameworks, Data Warehousing, Lakehouse Platforms, and Distributed Data Processing, along with proven leadership experience driving enterprise data transformation initiatives. This role requires ownership of data platform architecture, cloud modernization, large-scale data processing, data governance, performance optimization, and engineering excellence across enterprise environments. Key Responsibilities Lead the design and implementation of enterprise-scale cloud data platforms supporting analytics, reporting, AI/ML, and business intelligence initiatives. Architect and develop scalable ETL/ELT frameworks, Data Lakes, Data Warehouses, and Lakehouse solutions . Design high-performance data pipelines supporting batch, near real-time, and streaming workloads. Lead cloud migration and modernization initiatives across Azure, AWS, or GCP environments. Define enterprise standards for data architecture, engineering practices, governance, and platform scalability. Build and optimize distributed data processing frameworks using modern big data technologies. Collaborate with Data Architects, Data Scientists, BI teams, Product Owners, and executive stakeholders. Implement robust monitoring, observability, alerting, and data quality frameworks. Drive performance tuning, cost optimization, workload management, and platform reliability initiatives. Mentor and lead Data Engineering teams while conducting architecture reviews and technical governance. Ensure enterprise compliance, security, data lineage, metadata management, and operational excellence. Required Technical Skills Data Engineering & Architecture Data Engineering Data Architecture ETL / ELT Development Data Integration Data Modeling Data Warehousing Data Lake Architecture Lakehouse Architecture Enterprise Data Platforms Programming & Big Data Python PySpark Spark SQL SQL Apache Spark Hadoop Ecosystem Distributed Data Processing Cloud Data Platforms Microsoft Azure Amazon Web Services (AWS) Google Cloud Platform (GCP) Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics AWS Glue AWS Redshift Snowflake Microsoft Fabric (Preferred) Data Storage Technologies Azure Data Lake Storage (ADLS Gen2) Amazon S3 Delta Lake SQL Server PostgreSQL Oracle MongoDB Streaming & Real-Time Processing Apache Kafka Azure Event Hubs Spark Streaming Real-Time Data Pipelines DevOps & Automation Azure DevOps Git CI/CD Pipelines Jenkins GitHub Actions Terraform Infrastructure as Code (IaC) Governance & Data Quality Data Governance Data Lineage Metadata Management Master Data Management (MDM) Data Quality Frameworks Monitoring & Alerting Security & Compliance Leadership & Architecture Expectations Proven experience leading enterprise Data Engineering teams and large-scale cloud transformation initiatives. Strong expertise in architecting scalable and highly available cloud-native data platforms. Experience defining engineering standards, architecture frameworks, and governance processes. Ability to translate business requirements into enterprise-level data solutions. Strong stakeholder management, executive communication, and leadership capabilities. Experience mentoring engineers and driving technical excellence across organizations. Preferred Qualifications Experience with Databricks Lakehouse Platform and Delta Lake. Exposure to AI/ML, GenAI, and advanced analytics platforms. Azure, AWS, Databricks, Snowflake, or Fabric Certifications. Experience in BFSI, Healthcare, Insurance, Retail, Telecom, or Financial Services domains. Strong understanding of enterprise architecture and cloud modernization strategies. Eligibility & Compliance W2 Full-Time Only No C2C No Consultancy or Vendor Profiles #J-18808-Ljbffr Socket.dev