Sr. Data Engineer (Big Data & Analytics Engineering)
Full-time
Mastercard
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere—by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact—inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all. About the Role
The Sr. Data Engineer will design, build, and operate scalable data pipelines and curated datasets that power analytics products, reporting, and advanced modeling. Working closely with the Lead and cross-functional partners (Product, Data Science, and Platform teams), this role focuses on reliability, performance, data quality, and governance across batch and (where applicable) streaming workloads. Key Responsibilities
• Build and maintain robust ETL/ELT pipelines for ingestion, transformation, and aggregation of large-scale datasets on Hadoop and enterprise data platforms.
• Develop high-performance data processing jobs using PySpark/Spark, Python, and SQL (including engines such as Impala where applicable).
• Partner with Product and Analytics stakeholders to translate requirements into reusable, governed data models (facts/dimensions, curated layers, and semantic-ready datasets).
• Implement and automate data quality checks, reconciliation, lineage documentation, and monitoring to ensure trust in downstream analytics and AI use cases.
• Optimize pipeline performance and cost through partitioning, file formats, compute tuning, and efficient query patterns.
• Optimize pipeline performance and cost through partitioning strategies, columnar file formats (Parquet, ORC, Delta), compute tuning, caching, and efficient query patterns.
• Contribute to CI/CD for data workflows (testing, code reviews, deployment automation), promoting engineering best practices and maintainable codebases.
• Support data governance, privacy, and security requirements (PII handling, access controls, auditability) in collaboration with platform and risk partners.
• Collaborate with data scientists to publish analysis-ready and ML-ready datasets, including feature generation and repeatable data preparation processes.
• Troubleshoot production issues, participate in on-call/operational rotations, and drive root-cause fixes to improve reliability.
• Communicate data platform capabilities, limitations, and trade-offs clearly to technical and non-technical stakeholders.
• Strong problem-solving skills with ability to debug complex distributed data issues independently.
• Clear written and verbal communication with both technical engineers and non-technical business stakeholders. All About You
Technical Skills & Experience
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and/or cloud data platforms).
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem: HDFS, Hive, Impala, YARN, Oozie).
• Proficiency in PySpark and Python and strong SQL skills across distributed and relational data stores.
• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.
• Solid understanding of data modeling, incremental processing patterns (CDC, SCD Type 1/2), and building curated datasets for analytics and reporting
• Experience with cloud services (Azure/AWS/GCP) for data lakes, compute, and storage is preferred.
• Proficiency in columnar and open table formats: Parquet, ORC, Delta Lake, Apache Iceberg, or Apache Hudi.
• Strong knowledge of distributed computing patterns: partitioning, bucketing, broadcast joins, shuffle optimization.
• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.
• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.
• Bachelor’s degree in computer science, Engineering, or equivalent practical experience.
• 5+ years of relevant experience in data engineering or big data analytics engineering (flexible based on depth of expertise).
GenAI / LLM Data Enablement (Preferred)
• Experience preparing curated, governed datasets (including semi-structured/unstructured) for AI/GenAI consumption with attention to privacy, quality, and reproducibility
Corporate Security Responsibility
Sr. Data Engineer (Big Data & Analytics Engineering)
Job Posting Title: Sr. Data Engineer (Big Data & Analytics Engineering)
About MastercardMastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere—by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact—inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all. About the Role
The Sr. Data Engineer will design, build, and operate scalable data pipelines and curated datasets that power analytics products, reporting, and advanced modeling. Working closely with the Lead and cross-functional partners (Product, Data Science, and Platform teams), this role focuses on reliability, performance, data quality, and governance across batch and (where applicable) streaming workloads. Key Responsibilities
• Build and maintain robust ETL/ELT pipelines for ingestion, transformation, and aggregation of large-scale datasets on Hadoop and enterprise data platforms.
• Develop high-performance data processing jobs using PySpark/Spark, Python, and SQL (including engines such as Impala where applicable).
• Partner with Product and Analytics stakeholders to translate requirements into reusable, governed data models (facts/dimensions, curated layers, and semantic-ready datasets).
• Implement and automate data quality checks, reconciliation, lineage documentation, and monitoring to ensure trust in downstream analytics and AI use cases.
• Optimize pipeline performance and cost through partitioning, file formats, compute tuning, and efficient query patterns.
• Optimize pipeline performance and cost through partitioning strategies, columnar file formats (Parquet, ORC, Delta), compute tuning, caching, and efficient query patterns.
• Contribute to CI/CD for data workflows (testing, code reviews, deployment automation), promoting engineering best practices and maintainable codebases.
• Support data governance, privacy, and security requirements (PII handling, access controls, auditability) in collaboration with platform and risk partners.
• Collaborate with data scientists to publish analysis-ready and ML-ready datasets, including feature generation and repeatable data preparation processes.
• Troubleshoot production issues, participate in on-call/operational rotations, and drive root-cause fixes to improve reliability.
• Communicate data platform capabilities, limitations, and trade-offs clearly to technical and non-technical stakeholders.
• Strong problem-solving skills with ability to debug complex distributed data issues independently.
• Clear written and verbal communication with both technical engineers and non-technical business stakeholders. All About You
Technical Skills & Experience
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and/or cloud data platforms).
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem: HDFS, Hive, Impala, YARN, Oozie).
• Proficiency in PySpark and Python and strong SQL skills across distributed and relational data stores.
• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.
• Solid understanding of data modeling, incremental processing patterns (CDC, SCD Type 1/2), and building curated datasets for analytics and reporting
• Experience with cloud services (Azure/AWS/GCP) for data lakes, compute, and storage is preferred.
• Proficiency in columnar and open table formats: Parquet, ORC, Delta Lake, Apache Iceberg, or Apache Hudi.
• Strong knowledge of distributed computing patterns: partitioning, bucketing, broadcast joins, shuffle optimization.
• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.
• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.
• Bachelor’s degree in computer science, Engineering, or equivalent practical experience.
• 5+ years of relevant experience in data engineering or big data analytics engineering (flexible based on depth of expertise).
GenAI / LLM Data Enablement (Preferred)
• Experience preparing curated, governed datasets (including semi-structured/unstructured) for AI/GenAI consumption with attention to privacy, quality, and reproducibility
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer (Big Data & Analytics Engineering) in India vacancy
- ...their greatest potential. Title and Summary Senior Analyst, Big Data Analytics & Engineering About Mastercard: Mastercard is a global technology... ...for various offerings in Services business unit. As a Sr. Analyst, you will be responsible for creating and optimizing...SeniorBig dataFull timeWorldwide
- ...services that help people, businesses and governments realize their greatest potential. Title and Summary Analyst, Big Data Analytics & Engineering Overview: About Mastercard Mastercard is a global technology leader in the payments industry, committed to powering...Big dataFull timeWorldwide
Mastercard
India13 days ago - ...potential. Title and Summary Senior Data Engineering Overview Ethoca, a Mastercard company... ...data pipelines, data products, analytics capabilities, and AI-ready data platforms... ...years of experience in Data Engineering, Big Data, Data Warehousing, or Analytics Engineering...SeniorBig dataFull timeWorldwide
- ...greatest potential. Title and Summary Senior Data Engineer Overview We are the global... ...grow their businesses. Focused on thinking big and scaling fast around the globe, this... ...and risk management services. Data Analytics and AI Solutions (DAAI) Program: Within...SeniorBig dataFull timeWorldwideFlexible hours
- ...their greatest potential. Title and Summary Data Engineer II Data Engineer, DPO Who is... ...space. Services Technology Team provides analytic software tools that enable large, consumer-focused businesses to seize the Big Data analytics opportunity by triangulating...Big dataFull timeLocal areaWorldwideFlexible hours
- ...greatest potential. Title and Summary Lead Data Engineer Who is Mastercard? Mastercard is a... ...Data Solutions team is looking for a Big Data Engineer to drive our mission to... ...Data Engineering solutions in the data and analytics domain. Role • Develop high quality...Big dataFull timeWorldwide
- ...greatest potential. Title and Summary Lead Data Engineer Position Overview Have you ever wanted to be part of something BIG? Now is the time to make an immediate... ...pipelines, and AI enabled services that power analytics, decisioning, and automation across the...Big dataFull timeImmediate startWorldwide
- ...someone with ETL tool experience, since they don't use any ETL tools. Their platform is homegrown, so they need someone with strong data platform development skills, particularly in SQL and Python, who can easily navigate a large codebase and take ownership of managing...Senior
NTT DATA, Inc.
Indiaa month ago - ...realize their greatest potential. Title and Summary Senior Data Engineer Role: Senior Data Engineer Role Overview We are seeking... ...Data Engineer to drive AI-led transformation across our analytics and data platforms. This role is designed for a hands-on engineer...SeniorFull timeWorldwide
- .... Title and Summary Senior Data Scientist Our Purpose:... ..., you will leverage advanced analytics, data science, machine learning... ...products using modern cloud and big data technologies. • Apply... ...Science, Statistics, Mathematics, Engineering, Economics, Finance, or a...SeniorBig dataFull timeWorldwide
- ...seeking an experienced Senior Manager, Data Engineering to serve as a technical people leader responsible... ...Digital towards an agentic AI-first analytics and development lifecycle. Key... ...~ Familiarity with AWS is a big plus ~ Experience in planning day to...SeniorRemote jobFull timeFlexible hours
- ...enables intelligent decision-based products through streaming analytics with the ability to govern decisions and manage outcomes... ...agility. • This program leverages business rules and AI engines, streaming big data platforms, in-memory data grids, APIs, cloud-native...SeniorBig dataFull timeWorldwide
- ...potential. Title and Summary Principal Data Engineer Who is Mastercard? Mastercard is a... ...and implement key projects related to Big Data solutions across Mastercard’s cloud... ...highly motivated, intellectually curious, analytical with a passion for reliability,...Big dataFull timeWorldwide
- ...potential. Title and Summary Data Scientist II Job Description – Data & Product Analytics Team – Data Visualization Expert... ...Python/ R • Experience using big data batch and streaming tools... ...Science, Information Technology, Engineering, Mathematics, Statistics, M.S./...Big dataFull timeWorldwide
- ...and Summary Senior Software Engineer Overview We are the global... ...within Mastercard: The Data & Services team is a key differentiator... .... Focused on thinking big and scaling fast around the globe... ...services. Advance Analytics Program: Within the D&S Technology...SeniorBig dataFull timeWorldwideFlexible hours
- ...realize their greatest potential. Title and Summary Senior Data Engineer - Spark / Kafka / NiFi Job Posting Title: Senior Data Engineer... ...Linux, Git, shell scripting, and CI/CD pipelines. Strong analytical, problem-solving, and communication skills. Experience...SeniorFull timeWorldwide
Mastercard
India13 days ago - ...that help people, businesses and governments realize their greatest potential. Title and Summary Manager, Data Engineering Overview The GBSC Analytics & Automation team enables data-driven decision-making through scalable data platforms, automation, and analytics...Full timeWorldwide
- ...inspired is expected and making a meaningful impact is rewarded. About the role: Corporate Title: Analyst Functional Title : EMEA Data Privacy Analyst Department and Division: Core Compliance EMEA Reporting to: EMEA Head of Data Privacy Location: Bangalore...SeniorFull timeWork experience placementWork at officeLocal area
MUFG Bank, Ltd.
India13 days ago - ...About the Role We are seeking an experienced Senior Principal Data Engineer to serve as a technical leader responsible for architecting... ...with Apache Kafka, event-driven architectures, and real-time analytics pipelines Modern Data Architecture: Familiarity with Apache...SeniorRemote jobFull timeFlexible hours
- ...and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Principal Data Engineer Job Overview: Leads software / data engineering projects and creates the development and delivery of enhanced solutions....SeniorFull timeWorldwide
- ...realize their greatest potential. Title and Summary Senior Data Engineer Data Engineer / Machine Learning Engineer Level 7 | FTE... ...team builds trusted, scalable datasets and pipelines that power analytics, BI, and machine learning use cases across Mastercard. This...SeniorFull timeWorldwide
- ...realize their greatest potential. Title and Summary Senior Data Engineer, Data Engineering Job Description Summary Who is Mastercard... .... • Strong understanding of the application of analytical methods and data visualization to support business decisions....SeniorFull timeWorldwide
- ...realize their greatest potential. Title and Summary Senior Data Engineer Job Description Summary We believe in power of data. We... ...actionable insights. The Global Business Services Center (GBSC) Analytics and Automation team is built upon strong contributors with...SeniorFull timeTemporary workWork experience placementWorldwide
- ...greatest potential. Title and Summary Senior Data Scientist Job Description Summary -... ...and businesses. The Data Science and Analytics team is looking for a Senior Data... ...practices in machine learning and data engineering to develop scalable solutions. Identify...SeniorFull timeWorldwide
- ...greatest potential. Title and Summary Senior Data Scientist, Business Insights Job Title... ...our customers grow. Focused on thinking big and scaling fast around the globe, this... ...platforms. This role combines advanced analytics, data science, process intelligence, and...SeniorFull timeWorldwide
- ...that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Scientist-2 Overview Product Data & Analytics is a centralized global team that enables Mastercard product business units to make better data‑driven decisions...SeniorFull timeWorldwideFlexible hours
- ...greatest potential. Title and Summary Senior Data Scientist Overview Mastercard company is seeking a Senior Software Engineer, which serves various client-tele such as... ...confidence. Our solution provides data analytics, visualization & data marketplace capabilities...SeniorFull timeWork experience placementWorldwide
- ...Title and Summary Director Software Engineer Who is Mastercard? Mastercard is... ...simple, smart, and accessible. Using secure data and networks, partnerships and passion,... ...application frameworks and tools. • Big Data & Analytics Expertise: o Experience designing...Big dataFull timeWorldwide
- ...Francisco and Singapore. About the role Nium is seeking a motivated Sr Reporting Analyst to join our dynamic global finance team. This... ...location, certain laws may regulate the way Nium manages the data of candidates. By submitting your job application, you are...SeniorFull timeWork at officeFlexible hours3 days per week
- ...greatest potential. Title and Summary Senior Analyst, AI & Data Strategy-1 Sr. Analyst, Master Data Management Location: Gurgaon,... ...Informatica, along with familiarity with data warehousing, analytics and ERP systems. • Technical & Analytical Skills: Experienced...SeniorFull timeWork at officeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer (Big Data & Analytics Engineering). Be the first to apply!
Related searches
- senior performance engineer India
- senior performance tester India
- senior vice president of operations India
- srs India
- senior implementation engineer India
- senior cloud network engineer India
- senior application administrator India
- senior financial analyst fp&a India
- senior cloud service delivery manager India
- senior level India