Lead Data Engineer

Lead Data Engineer We are seeking a Lead Data Engineer with expertise in Apache Spark, Apache Iceberg, Apache Airflow, and AWS to design and build the next generation of our finance data platform. You will own finance‑focused data products while contributing to foundational platform capabilities and engineering standards that scale across the enterprise. The ideal candidate is a hands‑on engineer who thrives in modern lakehouse architecture, large‑scale pipeline development, and an analytical mindset. Key Responsibilities Data Products Design, develop, and maintain data products Ensure data products meet quality, auditability, lineage, and compliance standards Platform Engineering & Framework Development Build reusable data engineering frameworks and accelerators used across multiple teams Develop standardized patterns for ingestion, transformation, orchestration, monitoring, and data quality Establish and enforce best practices for Spark, Iceberg, Airflow, and cloud‑native engineering Drive adoption of self‑service platform capabilities and common engineering standards Build and optimize Apache Iceberg‑based lakehouse solutions for analytical and operational workloads Cloud Engineering Build cloud‑native solutions on AWS—S3, EMR, Glue, Lambda, ECS/EKS, CloudWatch Implement CI/CD pipelines, automated testing, and infrastructure‑as‑code Qualifications 8+ years of experience in data engineering, data platform development, or related technical roles Leading design and implementation of scalable enterprise data solutions and reusable engineering frameworks Knowledge of data mesh or data product architectures in enterprise settings Advanced hands‑on experience with Apache Spark (PySpark) and distributed data processing at enterprise scale Deep hands‑on experience with Apache Iceberg or similar open table formats Solid understanding of CI/CD pipelines, infrastructure‑as‑code, and DevOps practices Experience with data governance, data quality frameworks, and metadata management tools Strong experience with AWS Cloud services, including Amazon S3, EMR, Glue, Lambda, ECS/EKS, and CloudWatch for developing, deploying, and managing cloud‑native data solutions Equal Opportunity Employer Mastercard is a merit‑based, inclusive, equal‑opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disability, veteran status, or any other characteristic protected by law. Pay Ranges (Miami, Florida) $140,000 - $231,000 USD per year. Benefits Insurance (medical, prescription drug, dental, vision, disability, life) Flexible spending account and health savings account Paid leaves: 16 weeks of new parent leave, up to 20 days of bereavement leave, 80 hours of paid sick and safe time, 25 days of vacation time and 5 personal days (pro‑rated based on hire date) 10 annual paid U.S. observed holidays 401(k) with a best‑in‑class company match Deferred compensation for eligible roles Fitness reimbursement or on‑site fitness facilities Eligibility for tuition reimbursement Other benefits as provided to full‑time employees Intern Benefits 56 hours of paid sick and safe time Jury duty leave On‑site fitness facilities (in some locations) For more information about how we use technology to innovate and create opportunities for our people, customers, and communities, visit our site or contact our recruiting team in the U.S. or Canada. #J-18808-Ljbffr