Senior Data Engineer
Full-time
Mastercard
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary
Lead AI ideation by identifying opportunities to eliminate manual effort, reduce operational friction, and improve decision-making.
Design and implement agentic AI solutions, including:
Multi-agent orchestration for task delegation and workflow execution
AI agents for monitoring, diagnostics, reconciliation, and data reasoning
Build end-to-end GenAI / LLM-powered workflows, including prompt engineering, chaining, tool use, and evaluation.
Design and maintain data pipelines specifically for AI workloads, supporting:
Training, fine-tuning, and inference
Vector storage, retrieval-augmented generation (RAG), and embeddings
Integrate AI solutions with existing data platforms while ensuring governance, observability, and cost control.
Apply responsible AI principles, access controls, and auditability for AI-driven systems. 2️⃣ Python Engineering, APIs & PySpark Development
Develop production-grade Python applications supporting data, AI, and automation use cases.
Design and expose REST APIs using Flask or FastAPI for model inference, AI services, and data access.
Improve and refactor existing Python codebases for maintainability, performance, and scalability.
Migrate legacy logic and scripts into PySpark-based implementations on Databricks.
Follow best practices in:
Modular architecture and design patterns
Logging, monitoring, and exception handling
Unit and integration testing 3️⃣ Analytics Platforms – Databricks & Snowflake Expertise
Act as an expert practitioner for Databricks and Snowflake, supporting both analytics and AI-driven workloads.
Perform advanced problem solving related to:
Performance tuning
Cost optimization
Query optimization and data layout
Define and enforce standards and best practices for analytics and AI workloads on these platforms.
Support administration and daily management activities, including:
Workspace and resource governance
User access and role management
Platform usage optimization
Enable analytics teams through reusable patterns, templates, and documentation. 4️⃣ ETL & Cloud Data Engineering (AWS)
Architect and implement scalable ETL pipelines using modern cloud-native patterns.
Apply expert knowledge of ETL frameworks and design principles, including incremental processing and fault tolerance.
Build and maintain pipelines using AWS Glue, interacting with S3, IAM, and related AWS services.
Ensure reliable orchestration, monitoring, and error handling across data pipelines.
Optimize ETL workloads for performance, scalability, and cost efficiency. 5️⃣ DBA Concepts & Data Storage Expertise
Apply strong DBA fundamentals to analytics and operational systems.
Work with relational and NoSQL databases, including:
Amazon RDS (MySQL, PostgreSQL)
MongoDB Atlas
Apply best practices in:
Indexing and query optimization
Backup, recovery, and high availability
Capacity planning and performance troubleshooting
Collaborate with infrastructure and database teams on design and operational improvements. Cloud-Based AI Services & Platforms (Cross-Cutting Skill Area)
Hands-on experience or strong familiarity with cloud AI and compute services, including:
AWS Bedrock for foundation models and GenAI applications
AWS SageMaker for training, experimentation, and deployment
AWS Lambda for event-driven AI and data automation
Databricks AI for ML/GenAI workloads and platform integration
Microsoft Copilot and related AI tooling for productivity enablement and integration scenarios
Evaluate, integrate, and operationalize AI services based on cost, security, scalability, and use-case fit. Must‑Have Skills
6+ years of experience in Data Engineering / Analytics Engineering roles.
Strong hands-on experience with GenAI, LLMs, agentic AI, and multi-agent orchestration.
Advanced Python development experience, including Flask or FastAPI.
Strong experience in PySpark and distributed data processing.
Expert-level proficiency with Databricks and Snowflake.
Deep understanding of ETL architecture, AWS Glue, and cloud-native data pipelines. Good‑to‑Have Skills
Experience with vector databases and RAG architectures.
Exposure to ML lifecycle management, MLOps, and experiment tracking.
Infrastructure-as-Code (Terraform or similar).
Working knowledge of DBA concepts and databases on AWS.
Experience working in regulated domains (banking, fintech, healthcare).
CI/CD practices for data, AI, and analytics pipelines. Corporate Security Responsibility
Senior Data Engineer
Role: Senior Data Engineer
Role Overview
We are seeking a Senior Data Engineer to drive AI-led transformation across our analytics and data platforms. This role is designed for a hands-on engineer who can ideate, design, and implement AI-driven solutions, modernize Python and data pipelines, and maintain best-in-class analytics environments.
The role combines agentic AI concepts, cloud-based AI services, strong Python/PySpark engineering, and deep analytics expertise across Databricks and Snowflake, while applying solid ETL and DBA fundamentals in AWS.
Lead AI ideation by identifying opportunities to eliminate manual effort, reduce operational friction, and improve decision-making.
Design and implement agentic AI solutions, including:
Multi-agent orchestration for task delegation and workflow execution
AI agents for monitoring, diagnostics, reconciliation, and data reasoning
Build end-to-end GenAI / LLM-powered workflows, including prompt engineering, chaining, tool use, and evaluation.
Design and maintain data pipelines specifically for AI workloads, supporting:
Training, fine-tuning, and inference
Vector storage, retrieval-augmented generation (RAG), and embeddings
Integrate AI solutions with existing data platforms while ensuring governance, observability, and cost control.
Apply responsible AI principles, access controls, and auditability for AI-driven systems. 2️⃣ Python Engineering, APIs & PySpark Development
Develop production-grade Python applications supporting data, AI, and automation use cases.
Design and expose REST APIs using Flask or FastAPI for model inference, AI services, and data access.
Improve and refactor existing Python codebases for maintainability, performance, and scalability.
Migrate legacy logic and scripts into PySpark-based implementations on Databricks.
Follow best practices in:
Modular architecture and design patterns
Logging, monitoring, and exception handling
Unit and integration testing 3️⃣ Analytics Platforms – Databricks & Snowflake Expertise
Act as an expert practitioner for Databricks and Snowflake, supporting both analytics and AI-driven workloads.
Perform advanced problem solving related to:
Performance tuning
Cost optimization
Query optimization and data layout
Define and enforce standards and best practices for analytics and AI workloads on these platforms.
Support administration and daily management activities, including:
Workspace and resource governance
User access and role management
Platform usage optimization
Enable analytics teams through reusable patterns, templates, and documentation. 4️⃣ ETL & Cloud Data Engineering (AWS)
Architect and implement scalable ETL pipelines using modern cloud-native patterns.
Apply expert knowledge of ETL frameworks and design principles, including incremental processing and fault tolerance.
Build and maintain pipelines using AWS Glue, interacting with S3, IAM, and related AWS services.
Ensure reliable orchestration, monitoring, and error handling across data pipelines.
Optimize ETL workloads for performance, scalability, and cost efficiency. 5️⃣ DBA Concepts & Data Storage Expertise
Apply strong DBA fundamentals to analytics and operational systems.
Work with relational and NoSQL databases, including:
Amazon RDS (MySQL, PostgreSQL)
MongoDB Atlas
Apply best practices in:
Indexing and query optimization
Backup, recovery, and high availability
Capacity planning and performance troubleshooting
Collaborate with infrastructure and database teams on design and operational improvements. Cloud-Based AI Services & Platforms (Cross-Cutting Skill Area)
Hands-on experience or strong familiarity with cloud AI and compute services, including:
AWS Bedrock for foundation models and GenAI applications
AWS SageMaker for training, experimentation, and deployment
AWS Lambda for event-driven AI and data automation
Databricks AI for ML/GenAI workloads and platform integration
Microsoft Copilot and related AI tooling for productivity enablement and integration scenarios
Evaluate, integrate, and operationalize AI services based on cost, security, scalability, and use-case fit. Must‑Have Skills
6+ years of experience in Data Engineering / Analytics Engineering roles.
Strong hands-on experience with GenAI, LLMs, agentic AI, and multi-agent orchestration.
Advanced Python development experience, including Flask or FastAPI.
Strong experience in PySpark and distributed data processing.
Expert-level proficiency with Databricks and Snowflake.
Deep understanding of ETL architecture, AWS Glue, and cloud-native data pipelines. Good‑to‑Have Skills
Experience with vector databases and RAG architectures.
Exposure to ML lifecycle management, MLOps, and experiment tracking.
Infrastructure-as-Code (Terraform or similar).
Working knowledge of DBA concepts and databases on AWS.
Experience working in regulated domains (banking, fintech, healthcare).
CI/CD practices for data, AI, and analytics pipelines. Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in India vacancy
- The Role You will work on designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions. Key Responsibilities Design, develop, and maintain scalable...SeniorFull time
Proximity
India1 day ago - We are looking for Senior Data Engineers to join our AdTech team and build scalable, high-performance data platforms that power advertising insights and analytics. The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data...SeniorFull time
Prox Works
India1 day ago - ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer, Data Engineering Job Description Summary Who is Mastercard? Mastercard is a global technology company in the payments...SeniorFull timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer-2 Senior Data Engineer, DPO Who is Mastercard? Mastercard is a global technology company in the payments industry. Our...SeniorFull timeLocal areaWorldwideFlexible hours
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer Senior Data Engineer - SSO10369 Mastercard is a global technology company in the payments industry. Our mission is to...SeniorFull timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer Role: Senior Data Engineer Role Overview We are seeking a Senior Data Engineer to drive AI-led transformation across...SeniorFull timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineering Overview Ethoca, a Mastercard company, is seeking a Senior Data Engineer to join the First Party Trust (FPT) team....SeniorFull timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer Overview We are the global technology company behind the world’s fastest payments processing network. We are a vehicle...SeniorFull timeWorldwideFlexible hours
- ...governments realize their greatest potential. Title and Summary Sr Data Engineer Overview The AI Innovation at Scale team is seeking a... ...management and continuous improvement. Role As a Senior AI Engineer, you will: • Be an integral part of a creative and...SeniorFull timeWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Sr. Data Engineer (Big Data & Analytics Engineering) Job Posting Title: Sr. Data Engineer (Big Data & Analytics Engineering) About Mastercard...SeniorFull timeWorldwideFlexible hours
- ...realize their greatest potential. Title and Summary Principal Data Engineer Overview We are seeking a highly experienced and... ...processing solutions. Engineering Leadership • Mentor and guide senior engineers and technical teams across the organization. •...Full timeWorldwide
- ...realize their greatest potential. Title and Summary Principal Data Engineer Who is Mastercard? Mastercard is a global technology... ...• Strong communication skills / experience communicating with senior leaders and executives • Previous leadership experience leading...Full timeWorldwide
- We are looking for a skilled Data Engineer with strong experience in AWS, SQL, Snowflake, BI Connector to snowflake migration . The candidate will be responsible for building data pipelines, migrating BI workloads to Snowflake, optimizing data solutions, and ensuring seamless...Full time
3pillarglobal
India1 day ago - ...governments realize their greatest potential. Title and Summary Data Engineer II Your Role As a Data Engineer II, you will contribute... ...and public cloud environments. You will work closely with senior engineers, data scientists, and cross-functional teams to build...Full timeWorldwide
- We are looking for an experienced Data Engineer to design, develop, and optimize scalable data platforms and modern cloud-based data solutions. This role is ideal for professionals with strong expertise in Microsoft Azure Fabric and Databricks , along with a passion for...Full time
Weekday
India1 day ago - ...About the Role: phData is a dynamic leader in the modern data stack and a 6x Snowflake Partner of the Year. We are looking for a Data Engineer to join our team, where you will design, build, and productionize modern cloud data platforms and pipelines that enable reliable...Full timeRemote work
Phdata
India27 days ago - ...governments realize their greatest potential. Title and Summary Data Engineer || Who is Mastercard? Mastercard is a global technology... ...with others. The individual will work closely with senior engineers and cross-functional teams to develop and maintain scalable...Full timeWorldwide
- ...set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Data Engineer ( AI/ML ) Overview- Mastercard is a global technology company powering one of the world’s fastest payment networks. Our Data...Full timeWorldwide
- ...set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Data Engineer II Overview Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect...Full timeWorldwide
- ...Combinator , and Index Ventures , we help enterprises drive efficiency, lower costs, and deliver higher quality customer experiences. Want to be part of the AI revolution and transform how the world’s largest global brands do business? Join us! We are looking for a Senior D...SeniorFull time
Netomi
India1 day ago - The Role We’re seeking a highly skilled, execution-focused Senior Data Scientist with a minimum of 5 years of experience. This role demands hands-on expertise in building, deploying, and optimizing machine learning models at scale, while working with big data technologies...SeniorFull time
Proximity
India1 day ago - ...performance mathematical solvers and distributed cloud systems, this engine helps operations teams maximize field efficiency and lower... ...We are seeking a deeply technical, algorithmically driven Python Data Engineer to completely own the core engine processing layer of our...Full timeLocal areaRemote workWork from homeFlexible hours
Flatgigs
India29 days ago - ...The Role We’re seeking a highly skilled, execution-focused Senior Data Scientist with a minimum of 5 years of experience. This role... ...AWS EMR for automation and orchestration. Collaborate with engineering teams to integrate models into cloud-based applications on AWS...SeniorFull time
Proximity
India8 days ago - ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer Job Title Lead Data Engineer Overview Who is Mastercard? Mastercard is a global technology company in the...Full timeWorldwide
- ...global brands do business? Join us! We are looking for a Senior Data Scientist to join our Agentic Solutions team, focused on driving... ...work closely with cross-functional teams, including product, engineering, solutions, and customer-facing stakeholders, to prototype,...SeniorFull time
Netomi
India10 days ago - ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer Job Description Summary Who is Mastercard? Mastercard is a global technology company in the payments industry. Our...Full timeWorldwide
- ...governments realize their greatest potential. Title and Summary Senior Data Scientist Overview Our International, Open Banking,... ...development to deployment support. 2. Work closely with data engineers and developers to build and deploy interactive dashboards, providing...SeniorFull timeWorldwide
- ...governments realize their greatest potential. Title and Summary Senior Data Scientist Our Purpose: Mastercard powers economies and... ...in Data Science, Computer Science, Statistics, Mathematics, Engineering, Economics, Finance, or a related field required; Master's...SeniorFull timeWorldwide
- The Role: We are seeking a Senior Principal Engineer to drive the architectural strategy and technical execution across our 80+ engineer Application Portfolio, encompassing all Web, Mobile, and Headless surfaces. This is a high-impact, individual contributor role where...SeniorFull time
AlphaSense
India1 day ago - ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Director, Data Engineering Director – GBSC Insights We believe in the power of data. We think creatively, and design smart, simple to use and cost-...Full timeTemporary workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
