Sr. Data Engineer (Big Data & Analytics Engineering)
Full-time
Mastercard
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere—by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact—inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all. About the Role
The Sr. Data Engineer will design, build, and operate scalable data pipelines and curated datasets that power analytics products, reporting, and advanced modeling. Working closely with the Lead and cross-functional partners (Product, Data Science, and Platform teams), this role focuses on reliability, performance, data quality, and governance across batch and (where applicable) streaming workloads. Key Responsibilities
• Build and maintain robust ETL/ELT pipelines for ingestion, transformation, and aggregation of large-scale datasets on Hadoop and enterprise data platforms.
• Develop high-performance data processing jobs using PySpark/Spark, Python, and SQL (including engines such as Impala where applicable).
• Partner with Product and Analytics stakeholders to translate requirements into reusable, governed data models (facts/dimensions, curated layers, and semantic-ready datasets).
• Implement and automate data quality checks, reconciliation, lineage documentation, and monitoring to ensure trust in downstream analytics and AI use cases.
• Optimize pipeline performance and cost through partitioning, file formats, compute tuning, and efficient query patterns.
• Optimize pipeline performance and cost through partitioning strategies, columnar file formats (Parquet, ORC, Delta), compute tuning, caching, and efficient query patterns.
• Contribute to CI/CD for data workflows (testing, code reviews, deployment automation), promoting engineering best practices and maintainable codebases.
• Support data governance, privacy, and security requirements (PII handling, access controls, auditability) in collaboration with platform and risk partners.
• Collaborate with data scientists to publish analysis-ready and ML-ready datasets, including feature generation and repeatable data preparation processes.
• Troubleshoot production issues, participate in on-call/operational rotations, and drive root-cause fixes to improve reliability.
• Communicate data platform capabilities, limitations, and trade-offs clearly to technical and non-technical stakeholders.
• Strong problem-solving skills with ability to debug complex distributed data issues independently.
• Clear written and verbal communication with both technical engineers and non-technical business stakeholders. All About You
Technical Skills & Experience
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and/or cloud data platforms).
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem: HDFS, Hive, Impala, YARN, Oozie).
• Proficiency in PySpark and Python and strong SQL skills across distributed and relational data stores.
• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.
• Solid understanding of data modeling, incremental processing patterns (CDC, SCD Type 1/2), and building curated datasets for analytics and reporting
• Experience with cloud services (Azure/AWS/GCP) for data lakes, compute, and storage is preferred.
• Proficiency in columnar and open table formats: Parquet, ORC, Delta Lake, Apache Iceberg, or Apache Hudi.
• Strong knowledge of distributed computing patterns: partitioning, bucketing, broadcast joins, shuffle optimization.
• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.
• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.
• Bachelor’s degree in computer science, Engineering, or equivalent practical experience.
• 5+ years of relevant experience in data engineering or big data analytics engineering (flexible based on depth of expertise).
GenAI / LLM Data Enablement (Preferred)
• Experience preparing curated, governed datasets (including semi-structured/unstructured) for AI/GenAI consumption with attention to privacy, quality, and reproducibility
Corporate Security Responsibility
Sr. Data Engineer (Big Data & Analytics Engineering)
Job Posting Title: Sr. Data Engineer (Big Data & Analytics Engineering)
About MastercardMastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere—by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact—inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all. About the Role
The Sr. Data Engineer will design, build, and operate scalable data pipelines and curated datasets that power analytics products, reporting, and advanced modeling. Working closely with the Lead and cross-functional partners (Product, Data Science, and Platform teams), this role focuses on reliability, performance, data quality, and governance across batch and (where applicable) streaming workloads. Key Responsibilities
• Build and maintain robust ETL/ELT pipelines for ingestion, transformation, and aggregation of large-scale datasets on Hadoop and enterprise data platforms.
• Develop high-performance data processing jobs using PySpark/Spark, Python, and SQL (including engines such as Impala where applicable).
• Partner with Product and Analytics stakeholders to translate requirements into reusable, governed data models (facts/dimensions, curated layers, and semantic-ready datasets).
• Implement and automate data quality checks, reconciliation, lineage documentation, and monitoring to ensure trust in downstream analytics and AI use cases.
• Optimize pipeline performance and cost through partitioning, file formats, compute tuning, and efficient query patterns.
• Optimize pipeline performance and cost through partitioning strategies, columnar file formats (Parquet, ORC, Delta), compute tuning, caching, and efficient query patterns.
• Contribute to CI/CD for data workflows (testing, code reviews, deployment automation), promoting engineering best practices and maintainable codebases.
• Support data governance, privacy, and security requirements (PII handling, access controls, auditability) in collaboration with platform and risk partners.
• Collaborate with data scientists to publish analysis-ready and ML-ready datasets, including feature generation and repeatable data preparation processes.
• Troubleshoot production issues, participate in on-call/operational rotations, and drive root-cause fixes to improve reliability.
• Communicate data platform capabilities, limitations, and trade-offs clearly to technical and non-technical stakeholders.
• Strong problem-solving skills with ability to debug complex distributed data issues independently.
• Clear written and verbal communication with both technical engineers and non-technical business stakeholders. All About You
Technical Skills & Experience
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and/or cloud data platforms).
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem: HDFS, Hive, Impala, YARN, Oozie).
• Proficiency in PySpark and Python and strong SQL skills across distributed and relational data stores.
• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.
• Solid understanding of data modeling, incremental processing patterns (CDC, SCD Type 1/2), and building curated datasets for analytics and reporting
• Experience with cloud services (Azure/AWS/GCP) for data lakes, compute, and storage is preferred.
• Proficiency in columnar and open table formats: Parquet, ORC, Delta Lake, Apache Iceberg, or Apache Hudi.
• Strong knowledge of distributed computing patterns: partitioning, bucketing, broadcast joins, shuffle optimization.
• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.
• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.
• Bachelor’s degree in computer science, Engineering, or equivalent practical experience.
• 5+ years of relevant experience in data engineering or big data analytics engineering (flexible based on depth of expertise).
GenAI / LLM Data Enablement (Preferred)
• Experience preparing curated, governed datasets (including semi-structured/unstructured) for AI/GenAI consumption with attention to privacy, quality, and reproducibility
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer (Big Data & Analytics Engineering) in India vacancy
- ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Sr. Data Engineer (Big Data & Analytics Engineering) Job Posting Title: Sr. Data Engineer (Big Data & Analytics Engineering) About Mastercard...SeniorBig dataFull timeWorldwideFlexible hours
- ...greatest potential. Title and Summary Sr Data Engineer Overview The AI Innovation at... ...excellence • Work with cutting-edge big data platforms (e.g., Databricks, Apache... ...Bachelor’s degree in Computer Science, Data Analytics, Mathematics, Software Engineering, or...SeniorBig dataFull timeWorldwide
- ...potential. Title and Summary Senior Data Engineering Overview Ethoca, a Mastercard company... ...data pipelines, data products, analytics capabilities, and AI-ready data platforms... ...years of experience in Data Engineering, Big Data, Data Warehousing, or Analytics Engineering...SeniorBig dataFull timeWorldwide
- ...greatest potential. Title and Summary Senior Data Engineer Overview We are the global... ...grow their businesses. Focused on thinking big and scaling fast around the globe, this... ...and risk management services. Data Analytics and AI Solutions (DAAI) Program: Within...SeniorBig dataFull timeWorldwideFlexible hours
- We are looking for Senior Data Engineers to join our AdTech team and build scalable, high-performance... ...that power advertising insights and analytics. The ideal candidate will have strong... ...distributed data processing, ETL pipelines, and Big Data technologies, with hands-on...SeniorBig dataFull time
Prox Works
India7 days ago - ...greatest potential. Title and Summary Senior Data Engineer Senior Data Engineer - SSO10369... ...to drive data enablement and explore big data solutions within our technology landscape... ..., contributing to a state-of-the-art analytics foundation. You’ll also plan and...SeniorBig dataFull timeWorldwide
- ...realize their greatest potential. Title and Summary Senior Data Engineer Role: Senior Data Engineer Role Overview We are seeking... ...Data Engineer to drive AI-led transformation across our analytics and data platforms. This role is designed for a hands-on engineer...SeniorFull timeWorldwide
- .... Title and Summary Senior Data Scientist Our Purpose:... ..., you will leverage advanced analytics, data science, machine learning... ...products using modern cloud and big data technologies. • Apply... ...Science, Statistics, Mathematics, Engineering, Economics, Finance, or a...SeniorBig dataFull timeWorldwide
- ...pharmaceutical logistics scale-up engineering next-generation smart... ...cutting-edge IoT sensor arrays and data-driven infrastructure to... ...to join our Data Platforms & Analytics team. In this specialized systems... ...canvas to deploy big-data analytics and shape sustainable...SeniorBig dataFull timeWork at officeLocal areaRemote workVisa sponsorshipFlexible hours
SkyCell
Indiaa month ago - ...Req ID: 383431 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to... ...thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Remote or PAN India NTT...SeniorWork at officeRemote workFlexible hours
- ...and real-world evidence (RWE) analytics leader on an absolute mission... ...registries and structured patient data into actionable intelligence... ...consultants, and data engineers to solve the industry’s most intricate... ...canvas to leverage modern big data tools, manipulate multi-million...SeniorBig dataFull timeWork at officeRemote workWork from homeWorldwideHome officeShift work
Precision AQ
Indiaa month ago - ...seeking an experienced Senior Manager, Data Engineering to serve as a technical people leader responsible... ...Digital towards an agentic AI-first analytics and development lifecycle. Key... ...~ Familiarity with AWS is a big plus ~ Experience in planning day to...SeniorFull timeFlexible hours
- ...entrepreneurs. This specific engineering track powers QuillBot , an... ...scale, and modernize the core Data Platform infrastructure powering... ...-volume batch processing. Analytical Systems Design: Design and... ...platforms or distributed big-data systems. ~ Hands-on programming...Big dataFull timeRemote workWork from homeFlexible hours
- ...potential. Title and Summary Principal Data Engineer Who is Mastercard? Mastercard is a... ...and implement key projects related to Big Data solutions across Mastercard’s cloud... ...highly motivated, intellectually curious, analytical with a passion for reliability,...Big dataFull timeWorldwide
- ...We are looking for an experienced Data Engineer to design, develop, and optimize scalable data platforms and modern cloud-based data... ...requirements into scalable, high-performance data solutions that enable analytics and informed business decision-making. Key...Full time
- ...potential. Title and Summary Data Scientist II Data Scientist II, Product Data & Analytics Our Vision: Product Data... ...insights. We are a team on analytics engineers, data architects, BI developers... ...Environments: Cloudera Hadoop, Big data technology stack, SQL...Big dataFull timeWorldwide
- ...greatest potential. Title and Summary Data Engineer || Who is Mastercard? Mastercard is... ...engineering standards and best practices in the Big Data ecosystem. We are looking for a... ...process data from multiple systems for analytics and business use cases. • Contribute...Big dataFull timeWorldwide
- ...and Summary Senior Software Engineer Overview We are the global... ...within Mastercard: The Data & Services team is a key differentiator... .... Focused on thinking big and scaling fast around the globe... ...services. Advance Analytics Program: Within the D&S Technology...SeniorBig dataFull timeWorldwideFlexible hours
- ...realize their greatest potential. Title and Summary Director, Data Engineering Director – GBSC Insights We believe in the power of... ...MS SQL Server, Fabric, Dataverse Role • Lead multiple analytics projects and initiatives within GBSC and Mastercard. • Identify...Full timeTemporary workWorldwide
- ...that help people, businesses and governments realize their greatest potential. Title and Summary Manager, Data Engineering Overview The GBSC Analytics & Automation team enables data-driven decision-making through scalable data platforms, automation, and analytics...Full timeWorldwide
- The Role We’re seeking a highly skilled, execution-focused Senior Data Scientist with a minimum of 5 years of experience. This role... ...optimizing machine learning models at scale, while working with big data technologies and modern cloud platforms. You will be responsible...SeniorBig dataFull time
Proximity
India7 days ago - ...skilled, execution-focused Senior Data Scientist with a minimum of 5... ...at scale, while working with big data technologies and modern... ...systems. Develop advanced analytics and predictive models using... .... Collaborate with engineering teams to integrate models into...SeniorBig dataFull time
- ...Databricks: Databricks is the data and AI company. More than 10,... ...unify and democratize data, analytics, and AI. Founded by the... ...work with clients on technical big data challenges using the Databricks... ...where you will provide data engineering, data science, and cloud...Big dataFull timeWorldwide
Databricks
Indiaa month ago - ...designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade... .... Collaborate with engineering, product, and analytics teams to deliver robust data solutions....SeniorFull time
Proximity
India7 days ago - ...About the Role We are seeking an experienced Senior Principal Data Engineer to serve as a technical leader responsible for architecting... ...with Apache Kafka, event-driven architectures, and real-time analytics pipelines Modern Data Architecture: Familiarity with Apache...SeniorRemote jobFull timeFlexible hours
- ...design, develop, and optimize modern data platforms on Databricks . The... ...have strong expertise in data engineering, cloud technologies, ETL development, and big data processing. You will collaborate... ...data solutions that support analytics, AI , and business intelligence...SeniorBig dataFull time
Unison Group
India7 days ago - ...and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Principal Data Engineer Job Overview: Leads software / data engineering projects and creates the development and delivery of enhanced solutions....SeniorFull timeWorldwide
- ...smart, and accessible. Using secure data and networks, partnerships and passion... ...and shares user stories with engineering teams • Acts as the voice of the business... ...• Experiences with Cloud, Big Data, Data Science/Analytics, Microservices are a big plus • BS...Big dataFull timeWorldwide
- ...realize their greatest potential. Title and Summary Senior Data Engineer Data Engineer / Machine Learning Engineer Level 7 | FTE... ...team builds trusted, scalable datasets and pipelines that power analytics, BI, and machine learning use cases across Mastercard. This...SeniorFull timeWorldwide
- ...Join us! We are looking for a Senior Data Scientist to join our Agentic Solutions... ...oriented, and excited about applying advanced analytics, machine learning , large language... ...-functional teams, including product, engineering, solutions, and customer-facing stakeholders...SeniorFull time
Netomi
India16 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer (Big Data & Analytics Engineering). Be the first to apply!
