Senior Data Engineer
Mastercard
Senior Data Engineer
Job Overview
The Senior Software Engineer will do the design, development, and delivery of advanced big data solutions within the Hadoop ecosystem.
This role involves architecting and implementing scalable data processing frameworks, ensuring high performance and reliability across distributed systems.
The engineer will research and evaluate emerging technologies to optimize data workflows and meet evolving business needs.
Additionally, the position requires hands-on expertise in Cloudera distribution and related tools, ensuring seamless orchestration and integration of data pipelines.
The Senior Software Engineer will also be responsible for maintaining operational excellence, meeting SLA requirements, and mentoring team members to drive technical innovation and best practices.
Role
Contribute individually to the design, development, and implementation of large-scale data engineering solutions within the Hadoop ecosystem, ensuring high performance, scalability, and reliability.
Drive end-to-end technical delivery for projects involving Cloudera distribution, Apache Ozone, Apache Iceberg, Apache Airflow, Apache NiFi, and Apache Spark.
Collaborate with cross-functional teams to define architecture, technical standards, and best practices for big data platforms and workflows.
Perform rigorous performance benchmarking and optimization for newly developed distributed frameworks, ensuring efficient parallel processing and scalable storage solutions across large datasets.
Research and evaluate emerging technologies in distributed data storage, orchestration, and processing frameworks to optimize data pipelines and improve operational efficiency.
Develop strategic technical plans and create architecture proposals addressing solution gaps and business requirements.
Provide technical leadership in planning, design, and implementation phases, ensuring compliance with security, quality, and performance standards.
Ensure adherence to SLAs, manage production incidents, and drive root cause analysis and remediation for complex issues.
Conduct Proof of Concepts (PoCs) for new technologies and contribute to technology roadmaps for the organization.
6+ years of experience in related field, including 4-5 years of experience in delivering secure solutions in Financial Services Sector is preferred.
Advanced knowledge and understanding of Software Engineering Concepts and Methodologies is required.
Demonstrate MC Core Competencies. About You
High-energy, detail-oriented, and proactive, with the ability to work independently under pressure while driving results with initiative and self-motivation.
Strong aptitude for quickly learning and implementing new big data technologies, frameworks, and tools, and performing Proof of Concepts (PoCs) to identify optimal solutions.
6+ years of overall experience in software engineering with 5+ years of hands-on experience in Hadoop ecosystem projects, including Cloudera distribution.
Proven expertise in building distributed data pipelines and frameworks using Apache Spark (Scala/Python/Java) for massive parallel processing.
Hands-on experience with Apache Ozone and Apache Iceberg for distributed storage and table formats.
Skilled in designing and managing orchestration workflows using Apache Airflow and Apache NiFi for complex data integration scenarios.
Strong analytical and problem-solving skills for debugging production issues, performing root cause analysis, and implementing mitigation plans.
Excellent communication skills—both verbal and written—with strong collaboration and organizational abilities to work in diverse, geographically distributed teams.
Ability to multitask across multiple projects, provide technical leadership, and mentor junior team members.
Flexible and adaptable to evolving technologies and business needs, with a passion for innovation in big data solutions. Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer Overview Mastercard is the global technology company behind the worlds fastest payments processing network. We are a vehicle...SeniorFull timeWork experience placementWorldwide
- ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Data Engineer - Data & AI Platform Senior Data Engineer – Data & AI Platform Who is Mastercard? Mastercard is a global technology...SeniorFull timeWorldwide
- ...set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Data Engineer II "Who is Mastercard? We are the global technology company behind the world’s fastest payments processing network. We are...SuggestedFull timeWork experience placementWorldwide
- ...governments realize their greatest potential. Title and Summary Senior Data Scientist Job Description Summary - Who is Mastercard?... .... Leverage best practices in machine learning and data engineering to develop scalable solutions. Identify areas where...SeniorFull timeWorldwide
- ...Who We Are: **Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate... ...Build Dream Teams. Who You Are: Galaxy is hiring a Data Engineering Manager to lead and grow our Data Engineering team. This role...SuggestedFull timeWork at officeLocal area
- ...services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Research Manager – Primary Market Research, Data Scientist (L6) Job Description: Senior Research Manager – Quantitative Primary Research, Data Science...SeniorFull timeWorldwide
- ...governments realize their greatest potential. Title and Summary Senior Engineer, Machine Learning Engineering-2 Overview Mastercard’s... ...to achieve growth & innovation goals by providing unparalleled data-driven insights and advanced analytics. By leveraging...SeniorFull timeWork experience placementWorldwide
- ...governments realize their greatest potential. Title and Summary Senior AI Engineer Who is Mastercard? Mastercard is a global technology... ...safe, simple, smart, and accessible. Using secure data and networks, partnerships, and passion, our innovations and...SeniorFull timeWorldwide
- ...governments realize their greatest potential. Title and Summary Senior AI Engineer Who is Mastercard? Mastercard is a global technology... ...safe, simple, smart, and accessible. Using secure data, advanced technology, and strong partnerships, we help individuals...SeniorFull timeWorldwide
- ...greatest potential. Title and Summary Data Scientist 2-1 Job Description: Who is... ...Science and Analytics team is looking for a Senior Data Scientist. The Data Science team... ...versioning, monitoring) in partnership with engineering. Communicate technical problems, trade...Full timeWorldwide
- ...governments realize their greatest potential. Title and Summary Data Scientist I Overview Product Data & Analytics team builds... ...Master’s Degree in a Computer Science, Information Technology, Engineering, Mathematics, Statistics, M.S./M.B.A. preferred Additional...Full timeWorldwide
- ...experienced solution architect specializing in technology based business process solutions to join our dynamic Digital BPS team at NTT DATA. As an SME (subject matter expert), you will closely work with NTT DATA’s customers to understand their business problems and engage...Senior
- ...unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior Vice President, Workplace Experience, Asia Pacific Overview This role will be responsible for leading the regional team of...SeniorFull timeWork experience placementLocal areaWorldwide
- ...greatest potential. Title and Summary Senior Specialist, Product Management We are looking for a Product Manager within the Data Analytics & AI Product Management team to... ...Digital Players, Fintechs) • Partner with Engineering and Program management teams to support...SeniorFull timeWorldwide
- ...governments realize their greatest potential. Title and Summary Senior Analyst, Mastercard Value Quantification (MVQ) Program Senior... ...transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships, and innovation, we help individuals,...SeniorFull timeWorldwide
- ...day operations. The Role We are looking for an experienced Senior Flights & Reservations Manager to lead and develop a team of 12... ...finding smarter ways of doing the job , using technology and data to improve outcomes Help the team embrace change and new ways...SeniorPermanent employmentFull timeRemote workFlexible hoursShift workAfternoon shift
- ...governments realize their greatest potential. Title and Summary Senior Specialist, Product Management (Cross-functional / Payments... ...transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions...SeniorFull timeWorldwide
- ...governments realize their greatest potential. Title and Summary Senior Specialist, Product Management Overview: The Senior... ...This role blends product strategy support, advanced financial and data analysis, commercialization planning, and executive communication...SeniorFull timeWork experience placementWorldwide
- ...Title and Summary Sr. Principal Software Engineer Mastercard is a global technology... ...simple, smart, and accessible. Using secure data and networks, partnerships and passion, our... ...• Ability to lead and manage senior technical individual contributor and management...SeniorFull timeContract workWorldwide
- ...users. We are trusted by 300+ million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education...SeniorFull timeWork from homeFlexible hours
- ...evolving cryptocurrency landscape. Role Overview As the Senior Manager of Digital Asset & Treasury Operations, you will lead... ...leadership role sitting at the intersection of Finance, Product, and Engineering. What Problem This Role Solves In the fast-moving...SeniorFull timeTemporary workLocal area
- ...governments realize their greatest potential. Title and Summary Senior Software Engineer Who is Mastercard Mastercard is a global technology... ...safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and...SeniorFull timeWorldwide
- ...governments realize their greatest potential. Title and Summary Senior Analyst Overview The Senior Analyst provides operational,... ...event dashboards and reports to track registration and attendee data • Develop and monitor post-event surveys (e.g., Leadership...SeniorFull timeContract workWorldwide
- ...Senior Business Analyst — Reservation Systems Travelopia is a leading conglomerate... ...technical depth to bridge business needs and engineering delivery. What We Offer Competitive... ...reservation workflows from stakeholders. Data & Database Analysis: Perform SQL-based...SeniorPermanent employmentFull timeWorldwideFlexible hours
- ...governments realize their greatest potential. Title and Summary Senior Software Engineer Who is Mastercard? Mastercard is a global technology... ...safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and...SeniorFull timeWorldwide
- ...governments realize their greatest potential. Title and Summary Senior Software Engineer (Mainframe Developer) Who is Mastercard? Mastercard is... ...safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and...SeniorFull timeWorldwide
- ...greatest potential. Title and Summary Senior Technical Program Manager-2 Job Description... ..., smart, and accessible. Using secure data and networks, partnerships and passion, our... ...You will own the end-to-end delivery of engineering projects • Responsible for planning,...SeniorFull timeTemporary workWorldwide
- ...greatest potential. Title and Summary Senior Product Manager Technical (Cloud) Who is... ...simple, smart, and accessible. Using secure data and networks, partnerships and passion,... ...features, and user stories) that enable engineering teams to deliver high-quality outcomes at...SeniorFull timeWorldwide
- ...governments realize their greatest potential. Title and Summary Senior Technical Program Manager Who is Mastercard? Mastercard is... ...individuals and industries worldwide. Our people, technology, data, and brand provide the capabilities that drive our success. We believe...SeniorFull timeWorldwide
- ...worldwide. For more information, visit Follow Shield AI on LinkedIn, X , Instagram , and YouTube . The Field Applications Engineer will provide technical expertise and support to customers during the implementation and use of Shield AI enterprise software...SeniorWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
- senior performance engineer India
- senior software design engineer India
- senior tableau developer India
- senior magento developer India
- senior sas developer India
- senior mainframe developer India
- senior leadership India
- senior cloud service delivery manager India
- senior vice president of operations India
- senior software engineer remote India
