Sr. Data Engineer (Big Data & Analytics Engineering)
Full-time
Mastercard
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere—by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact—inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all. About the Role
The Sr. Data Engineer will design, build, and operate scalable data pipelines and curated datasets that power analytics products, reporting, and advanced modeling. Working closely with the Lead and cross-functional partners (Product, Data Science, and Platform teams), this role focuses on reliability, performance, data quality, and governance across batch and (where applicable) streaming workloads. Key Responsibilities
• Build and maintain robust ETL/ELT pipelines for ingestion, transformation, and aggregation of large-scale datasets on Hadoop and enterprise data platforms.
• Develop high-performance data processing jobs using PySpark/Spark, Python, and SQL (including engines such as Impala where applicable).
• Partner with Product and Analytics stakeholders to translate requirements into reusable, governed data models (facts/dimensions, curated layers, and semantic-ready datasets).
• Implement and automate data quality checks, reconciliation, lineage documentation, and monitoring to ensure trust in downstream analytics and AI use cases.
• Optimize pipeline performance and cost through partitioning, file formats, compute tuning, and efficient query patterns.
• Optimize pipeline performance and cost through partitioning strategies, columnar file formats (Parquet, ORC, Delta), compute tuning, caching, and efficient query patterns.
• Contribute to CI/CD for data workflows (testing, code reviews, deployment automation), promoting engineering best practices and maintainable codebases.
• Support data governance, privacy, and security requirements (PII handling, access controls, auditability) in collaboration with platform and risk partners.
• Collaborate with data scientists to publish analysis-ready and ML-ready datasets, including feature generation and repeatable data preparation processes.
• Troubleshoot production issues, participate in on-call/operational rotations, and drive root-cause fixes to improve reliability.
• Communicate data platform capabilities, limitations, and trade-offs clearly to technical and non-technical stakeholders.
• Strong problem-solving skills with ability to debug complex distributed data issues independently.
• Clear written and verbal communication with both technical engineers and non-technical business stakeholders. All About You
Technical Skills & Experience
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and/or cloud data platforms).
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem: HDFS, Hive, Impala, YARN, Oozie).
• Proficiency in PySpark and Python and strong SQL skills across distributed and relational data stores.
• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.
• Solid understanding of data modeling, incremental processing patterns (CDC, SCD Type 1/2), and building curated datasets for analytics and reporting
• Experience with cloud services (Azure/AWS/GCP) for data lakes, compute, and storage is preferred.
• Proficiency in columnar and open table formats: Parquet, ORC, Delta Lake, Apache Iceberg, or Apache Hudi.
• Strong knowledge of distributed computing patterns: partitioning, bucketing, broadcast joins, shuffle optimization.
• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.
• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.
• Bachelor’s degree in computer science, Engineering, or equivalent practical experience.
• 5+ years of relevant experience in data engineering or big data analytics engineering (flexible based on depth of expertise).
GenAI / LLM Data Enablement (Preferred)
• Experience preparing curated, governed datasets (including semi-structured/unstructured) for AI/GenAI consumption with attention to privacy, quality, and reproducibility
Corporate Security Responsibility
Sr. Data Engineer (Big Data & Analytics Engineering)
Job Posting Title: Sr. Data Engineer (Big Data & Analytics Engineering)
About MastercardMastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere—by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact—inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all. About the Role
The Sr. Data Engineer will design, build, and operate scalable data pipelines and curated datasets that power analytics products, reporting, and advanced modeling. Working closely with the Lead and cross-functional partners (Product, Data Science, and Platform teams), this role focuses on reliability, performance, data quality, and governance across batch and (where applicable) streaming workloads. Key Responsibilities
• Build and maintain robust ETL/ELT pipelines for ingestion, transformation, and aggregation of large-scale datasets on Hadoop and enterprise data platforms.
• Develop high-performance data processing jobs using PySpark/Spark, Python, and SQL (including engines such as Impala where applicable).
• Partner with Product and Analytics stakeholders to translate requirements into reusable, governed data models (facts/dimensions, curated layers, and semantic-ready datasets).
• Implement and automate data quality checks, reconciliation, lineage documentation, and monitoring to ensure trust in downstream analytics and AI use cases.
• Optimize pipeline performance and cost through partitioning, file formats, compute tuning, and efficient query patterns.
• Optimize pipeline performance and cost through partitioning strategies, columnar file formats (Parquet, ORC, Delta), compute tuning, caching, and efficient query patterns.
• Contribute to CI/CD for data workflows (testing, code reviews, deployment automation), promoting engineering best practices and maintainable codebases.
• Support data governance, privacy, and security requirements (PII handling, access controls, auditability) in collaboration with platform and risk partners.
• Collaborate with data scientists to publish analysis-ready and ML-ready datasets, including feature generation and repeatable data preparation processes.
• Troubleshoot production issues, participate in on-call/operational rotations, and drive root-cause fixes to improve reliability.
• Communicate data platform capabilities, limitations, and trade-offs clearly to technical and non-technical stakeholders.
• Strong problem-solving skills with ability to debug complex distributed data issues independently.
• Clear written and verbal communication with both technical engineers and non-technical business stakeholders. All About You
Technical Skills & Experience
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and/or cloud data platforms).
• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem: HDFS, Hive, Impala, YARN, Oozie).
• Proficiency in PySpark and Python and strong SQL skills across distributed and relational data stores.
• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.
• Solid understanding of data modeling, incremental processing patterns (CDC, SCD Type 1/2), and building curated datasets for analytics and reporting
• Experience with cloud services (Azure/AWS/GCP) for data lakes, compute, and storage is preferred.
• Proficiency in columnar and open table formats: Parquet, ORC, Delta Lake, Apache Iceberg, or Apache Hudi.
• Strong knowledge of distributed computing patterns: partitioning, bucketing, broadcast joins, shuffle optimization.
• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.
• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.
• Bachelor’s degree in computer science, Engineering, or equivalent practical experience.
• 5+ years of relevant experience in data engineering or big data analytics engineering (flexible based on depth of expertise).
GenAI / LLM Data Enablement (Preferred)
• Experience preparing curated, governed datasets (including semi-structured/unstructured) for AI/GenAI consumption with attention to privacy, quality, and reproducibility
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer (Big Data & Analytics Engineering) in India vacancy
- ...greatest potential. Title and Summary Sr Data Engineer Overview The AI Innovation at... ...excellence • Work with cutting-edge big data platforms (e.g., Databricks, Apache... ...Bachelor’s degree in Computer Science, Data Analytics, Mathematics, Software Engineering, or...SeniorBig dataFull timeWorldwide
- ...greatest potential. Title and Summary Senior Data Engineer-2 Senior Data Engineer, DPO Who is... ...space. Services Technology Team provides analytic software tools that enable large, consumer-focused businesses to seize the Big Data analytics opportunity by...SeniorBig dataFull timeLocal areaWorldwideFlexible hours
- ...greatest potential. Title and Summary Data Engineer II Your Role As a Data Engineer II... ...reliable, scalable data pipelines and enable analytics and machine learning use cases. Key... ..., or Java) • Experience working with big data technologies such as Spark, Hadoop,...Big dataFull timeWorldwide
- ...greatest potential. Title and Summary Senior Data Engineer What is Data & Services? The Data... ...our customers grow. Focused on thinking big and scaling fast around the globe, this... ...strategic goals • Technical & Analytical Skills and Problem Solving • Work on ingesting...SeniorBig dataFull timeWorldwide
- ...greatest potential. Title and Summary Senior Data Engineer Senior Data Engineer - SSO10369... ...to drive data enablement and explore big data solutions within our technology landscape... ..., contributing to a state-of-the-art analytics foundation. You’ll also plan and...SeniorBig dataFull timeWorldwide
- ...realize their greatest potential. Title and Summary Senior Data Engineer Role: Senior Data Engineer Role Overview We are seeking... ...Data Engineer to drive AI-led transformation across our analytics and data platforms. This role is designed for a hands-on engineer...SeniorFull timeWorldwide
- ...that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer-3 Overview Product Data & Analytics is a centralized global team that enables Mastercard product business units to make better data‑driven decisions...SeniorFull timeWorldwideFlexible hours
- ...pharmaceutical logistics scale-up engineering next-generation smart... ...cutting-edge IoT sensor arrays and data-driven infrastructure to... ...to join our Data Platforms & Analytics team. In this specialized systems... ...canvas to deploy big-data analytics and shape sustainable...SeniorBig dataFull timeWork at officeLocal areaRemote workVisa sponsorshipFlexible hours
SkyCell
India22 days ago - ...and real-world evidence (RWE) analytics leader on an absolute mission... ...registries and structured patient data into actionable intelligence... ...consultants, and data engineers to solve the industry’s most intricate... ...canvas to leverage modern big data tools, manipulate multi-million...SeniorBig dataFull timeWork at officeRemote workWork from homeWorldwideHome officeShift work
Precision AQ
India21 days ago - ...entrepreneurs. This specific engineering track powers QuillBot , an... ...scale, and modernize the core Data Platform infrastructure powering... ...-volume batch processing. Analytical Systems Design: Design and... ...platforms or distributed big-data systems. ~ Hands-on programming...Big dataFull timeRemote workWork from homeFlexible hours
Learneo
India22 days ago - ...Senior Specialist, Product Management - Data Analytics Overview The Payment... ...partner closely with the Product Manager and engineering teams to drive data analysis, define user... ...Hive, Impala, Spark) • Experience with big data platforms (e.g., Hadoop, Oracle) for...SeniorBig dataFull timeWorldwide
- ...potential. Title and Summary Data Scientist II Data Scientist II, Product Data & Analytics Our Vision: Product Data... ...insights. We are a team on analytics engineers, data architects, BI developers... ...Environments: Cloudera Hadoop, Big data technology stack, SQL...Big dataFull timeWorldwide
- ...We are looking for an experienced Data Engineer to design, develop, and optimize scalable data platforms and modern cloud-based data... ...requirements into scalable, high-performance data solutions that enable analytics and informed business decision-making. Key...Full time
Weekday
India9 days ago - ...greatest potential. Title and Summary Data Engineer || Who is Mastercard? Mastercard is... ...engineering standards and best practices in the Big Data ecosystem. We are looking for a... ...process data from multiple systems for analytics and business use cases. • Contribute...Big dataFull timeWorldwide
- ...and Summary Senior Software Engineer Overview We are the global... ...within Mastercard: The Data & Services team is a key differentiator... .... Focused on thinking big and scaling fast around the globe... ...services. Advance Analytics Program: Within the D&S Technology...SeniorBig dataFull timeWorldwideFlexible hours
- ...potential. Title and Summary Director, Data Engineering Who is Mastercard? Mastercard is... ...eliminating friction in how we manage big data assets, store those assets, accessibility... ...services (Glue, Lake Formation) and analytics engines (Databricks, EMR, Athena). •...Big dataFull timeWorldwide
- ...realize their greatest potential. Title and Summary Director, Data Engineering Director – GBSC Insights We believe in the power of... ...MS SQL Server, Fabric, Dataverse Role • Lead multiple analytics projects and initiatives within GBSC and Mastercard. • Identify...Full timeTemporary workWorldwide
- ...skilled, execution-focused Senior Data Scientist with a minimum of 5... ...at scale, while working with big data technologies and modern... ...systems. Develop advanced analytics and predictive models using... .... Collaborate with engineering teams to integrate models into...SeniorBig dataFull time
Proximity
India9 hours ago - ...Databricks: Databricks is the data and AI company. More than 10,... ...unify and democratize data, analytics, and AI. Founded by the... ...work with clients on technical big data challenges using the Databricks... ...where you will provide data engineering, data science, and cloud...Big dataFull timeWorldwide
Databricks
India21 days ago - ...smart, and accessible. Using secure data and networks, partnerships and passion... ...and shares user stories with engineering teams • Acts as the voice of the business... ...• Experiences with Cloud, Big Data, Data Science/Analytics, Microservices are a big plus • BS...Big dataFull timeWorldwide
- ...Join us! We are looking for a Senior Data Scientist to join our Agentic Solutions... ...oriented, and excited about applying advanced analytics, machine learning , large language... ...-functional teams, including product, engineering, solutions, and customer-facing stakeholders...SeniorFull time
Netomi
India2 days ago - ...realize their greatest potential. Title and Summary Senior Data Engineer, Data Engineering Job Description Summary Who is Mastercard... .... • Strong understanding of the application of analytical methods and data visualization to support business decisions....SeniorFull timeWorldwide
- ..., transparency, and dependability. About the Role We are looking for a Senior BI Engineer to join our team and lead the analytics and reporting workstream of a large-scale AWS data platform modernization. You will be responsible for designing semantic data models, standardizing...SeniorContract work
Tech Holding
India12 days ago - ...design, develop, and optimize modern data platforms on Databricks . The... ...have strong expertise in data engineering, cloud technologies, ETL development, and big data processing. You will... ...performance data solutions that support analytics, AI , and business...SeniorBig dataFull time
Unison Group
India16 days ago - ...Title and Summary Senior Analyst, AI & Data Strategy Senior Analyst, AI & Data Strategy... ...with GCO Compliance, data strategy, engineering, and business teams to ensure high-... ...security capabilities to enable advanced analytics and innovation. Create training materials...SeniorFull timeTemporary workWork at officeWorldwide
- ...more information, visit [ BitGo is looking for a Data Scientist who will join our Data Science and Analytics Team and help us continuously refine the... ...idea generation and refinement Collaborate with engineering teams and stakeholders to build and improve on the...Full timeWork at officeWorldwideMonday to Friday
- ...greatest potential. Title and Summary Data Scientist II Who is Mastercard? Mastercard... ...and businesses. The Data Science and Analytics team is looking for a Data Scientist II.... ...practices in machine learning and data engineering to develop scalable solutions....Full timeWorldwide
- ...greatest potential. Title and Summary Data Scientist 2-2 Job Description: Who... ...consumers and businesses. The Data Science and Analytics team is looking for a Senior Data... ...versioning, monitoring) in partnership with engineering. Communicate technical problems,...Full timeWorldwide
- ...realize their greatest potential. Title and Summary Principal Data Engineer Role Summary Join the Data Commercialization Platform (... ...cloud-based architectures for Business Intelligence and analytics, leveraging Databricks and Snowflake on AWS, with multi-cloud...Full timeWorldwide
- ...realize their greatest potential. Title and Summary Principal Data Engineer Overview We are seeking a highly experienced and... ...engineering frameworks that support financial transformation, analytics, regulatory reporting, and operational excellence. The ideal...Full timeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer (Big Data & Analytics Engineering). Be the first to apply!
