Lead Data Engineer
Mastercard
Lead Data Engineer
Position Overview
Have you ever wanted to be part of something BIG?
Now is the time to make an immediate impact at a leading global technology company, Mastercard.
This role is part of the AI&DPE Data Engineering platform team, responsible for building and evolving large scale backend data systems, real time and batch pipelines, and AI enabled services that power analytics, decisioning, and automation across the organization.
This is a backend engineering role, focused on Scala/Python/Java, distributed data platforms (Cloudera/Spark), and cloud based architectures, with a strong emphasis on AI agent creation and intelligent automation. Visualization tools (e.g., Qlik) are consumers of the platform, not the core focus of this role.
You will work with massive transactional datasets, modern big data and cloud platforms, and AI driven workflows to transform how Mastercard processes, enriches, and operationalizes data at global scale.
Backend & Data Platform Engineering Design, develop, and maintain backend services and data pipelines using Scala, Python and Java
Build and optimize batch and streaming workloads on Cloudera Data Platform (CDP) using Spark
Work with Cloudera Manager to support platform configuration, monitoring, performance tuning, and operational stability
Design and implement high quality datamarts and curated datasets with strong emphasis on data integrity, performance, and reliability AI Agents & Intelligent Automation Design, build, and integrate AI powered agents that operate to support: Anomaly detection and operational intelligence
workflow automation Apply generative AI driven, or rule based agents to reduce manual effort and improve scalability across backend systems Cloud & Modern Data Architecture Build and support data and compute workloads in AWS environments
Leverage Databricks for large scale data processing, advanced analytics
Contribute to cloud native and hybrid architectures integrating on prem and cloud platforms Integration & Downstream Enablement Enable downstream consumers (analytics, visualization, reporting tools such as Qlik) through well designed, reliable backend data interfaces
Partner with analytics, fraud, and business teams to ensure backend systems meet evolving needs without compromising platform stability Documentation & Collaboration Create clear technical documentation, including architecture diagrams, data flows, and design specifications
Participate in Agile/Scrum ceremonies and cross functional design reviews
Mentor and upskill team members in backend engineering, big data, and AI agent concepts KNOWLEDGE AND SKILL REQUIREMENTS
Required BS/BA degree in Computer Science, Engineering, Information Systems, or related field
Strong handson experience with Scala,Python/Java in backend or data intensive systems
Experience working with Cloudera Data Platform (CDP) and Spark
Familiarity with Cloudera Manager for cluster administration, monitoring, or troubleshooting
Strong understanding of data modeling concepts, distributed systems, and large scale data processing
Excellent problem solving skills and ability to work independently in complex environments GOOD TO HAVE / STRONGLY PREFERRED Hands on experience building, integrating, or supporting AI driven agents or intelligent automation solutions
Experience with Databricks for data engineering or ML workloads
Experience working in AWS (e.g., S3, EC2, EMR, Glue, Lambda, IAM, or equivalent services)
Knowledge of streaming and big‑data technologies:
Kafka
Hadoop ecosystem
Hive/Impala
Exposure to model monitoring, or AI platform enablement
Experience with ETL tools such as Informatica
Experience working in Agile / Scrum teams within large enterprises Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power...SuggestedFull timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer Lead Data Engineer Overview: We are seeking an experienced Lead Data Engineer to lead the design, delivery, modernization...SuggestedFull timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power...SuggestedFull timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer (Data Platforms) Role Summary We are looking for a Lead Software Engineer to design, build, and scale cloud-based data and...SuggestedFull timeWorldwide
- ...company. The Role At Nium, we’re revolutionising the global payments industry — and data sits at the core of everything we do. We’re looking for a passionate and skilled Data Engineer to join our India-based Data Engineering team. This is more than a purely...SuggestedFull timeWork at officeLocal areaWorldwideFlexible hours3 days per week
- ...set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Data Engineer II (Data Warehouse, Big Data, Spark with Scala/Python/Java on Hadoop, Oracle/SQL) Who is Mastercard? Mastercard is a global...Full timeWorldwide
- ...realize their greatest potential. Title and Summary Senior Data Engineer-1 Who is Mastercard? Mastercard is a global technology company... ...quality, freshness, lineage, and anomaly detection. Lead the design of real-time data streaming pipelines (e.g., using...Full timeWorldwide
- ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer - Spark / Kafka / NiFi Job Posting Title: Senior Data Engineer - Spark / Kafka / NiF Who is Mastercard? Mastercard is a...Full timeWorldwide
- ...set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Data Engineer II Data Engineer, DPO Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission...Full timeLocal areaWorldwideFlexible hours
- ...Atlassian, and Citi who want to take control of how they hire top engineers, elevate their teams and contractors, and stay ahead. At the... ...Our Engineering team builds the infrastructure, reporting, and data products that turn Karat’s unique interview and performance data...Full timeFor contractorsCurrently hiringRemote work
- ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer, Data Engineering Job Description Summary Who is Mastercard? Mastercard is a global technology company in the payments...Full timeWorldwide
- ...governments realize their greatest potential. Title and Summary Data Engineer II Overview We are looking for a Data Engineer to join... ...and database updates to meet project deliverables • Leads database security posture, which includes proactively identifying...Full timeWorldwide
- ...realize their greatest potential. Title and Summary Senior Data Engineer Overview Mastercard powers the global economy by enabling... ...compute architectures. Delivery & Technical Leadership • Lead end-to-end development activities including requirement analysis...Full timeWorldwide
- ...greatest potential. Title and Summary Senior Information Security Engineer Who is Mastercard? Mastercard is a global technology... ...transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions...Full timeWorldwide
- ...realize their greatest potential. Title and Summary Principal Data Engineer (AWS, Databricks, Ai, ML Flow, Data Architecture, Apache... ...delivery of innovative products. Role What You'll Do • Lead the architecture, design, and engineering of scalable batch, streaming...Worldwide
- ...their greatest potential. Title and Summary Information Security Engineer II Overview Who is Mastercard? Mastercard is a global... ...transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships, and passion, our innovations and solutions...Full timeWorldwide
- ...their greatest potential. Title and Summary Vice President, Data Engineering Our Purpose Mastercard powers economies and empowers people... ...an experienced and visionary Vice President to build and lead a Multi-Agent ETL Platform team. This role will design, develop...Full timeWorldwide3 days per week
- ...security and integrity of our systems and data in an increasingly complex digital... ...are looking for an Information Security Engineer, SaaS & Integration Security, to join our... ...activities as an L2 Incident Responder. Lead incidents through all stages: identification...Full timeWork experience placementWork at officeRemote workRelocationHome officeFlexible hours
- ...of Gen. About the Role We are seeking an exceptional Staff Data Engineer to join our team as a senior technical leader responsible for... ...marketing attribution vendor or automating LTV calculation. Lead evaluation and implementation of cutting-edge technologies...Full timeFlexible hours
- ...governments realize their greatest potential. Title and Summary Senior AI Data Engineer Overview As a Senior AI Data Engineer within Mastercard's AI Center of Excellence, you will lead the design, development, and optimization of enterprise data platforms and pipelines...Full timeWorldwide
- ...greatest potential. Title and Summary Senior Data Scientist Job Title: Senior Data... ...conceptualization, KPI framework design, data engineering, dashboard development, stakeholder... ...accuracy, and operational scalability. • Lead finance automation initiatives that...Full timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Scientist Our Vision AI Garage is responsible for establishing Mastercard as an AI powerhouse. AI will be leveraged and implemented...Full timeImmediate startWorldwide
- ...governments realize their greatest potential. Title and Summary Data Scientist (Data Visualisation) Overview • The... ...Mastercard’s Economics Institute, reporting to the team lead for Data Systems Engineering. An individual who will: • create clear, compelling data...Full timeWorldwide
- ...people, businesses and governments realize their greatest potential. Title and Summary Senior Data Scientist Overview Mastercard company is seeking a Senior Software Engineer, which serves various client-tele such as Merchants, Financial Institutions (Issuer,...Full timeWork experience placementWorldwide
- ...governments realize their greatest potential. Title and Summary Data Scientist II Role Overview Build and productionize... ...AI solutions for Mastercard. This role combines strong software engineering with model fine-tuning, Databricks-based ML engineering, AWS deployment...Full timeWorldwide
- ...governments realize their greatest potential. Title and Summary Data Scientist II Overview • Are you excited about Data Assets... ...practices to support trusted data products. • Apply engineering best practices including version control, CI/CD, DataOps, and automated...Full timeWorldwide
- ...governments realize their greatest potential. Title and Summary Data Scientist II Job Description – Data & Product Analytics Team... ...master’s degree in a Computer Science, Information Technology, Engineering, Mathematics, Statistics, M.S./M.B.A. preferred Additional...Full timeWorldwide
- ...governments realize their greatest potential. Title and Summary Data Scientist II-3 Job Description Summary We are the global... ...products (Credit, Debit, Prepaid) and services (recommendation engine, anti-money laundering, fraud risk management, cybersecurity)...Full timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Scientist, Business Insights Job Title: Senior Data Scientist Overview: Our Purpose: Mastercard powers economies and...Full timeWorldwide
- ...governments realize their greatest potential. Title and Summary Data Scientist I Who is Mastercard? Mastercard is a global... ...generative AI, and apply them to real-world problems. • Promote engineering best practices and contribute to a culture of innovation and...Full timeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!

