Senior Data Engineer

Senior Data Engineer

 Job Overview
 The Senior Software Engineer will do the design, development, and delivery of advanced big data solutions within the Hadoop ecosystem.
 This role involves architecting and implementing scalable data processing frameworks, ensuring high performance and reliability across distributed systems.
 The engineer will research and evaluate emerging technologies to optimize data workflows and meet evolving business needs.
 Additionally, the position requires hands-on expertise in Cloudera distribution and related tools, ensuring seamless orchestration and integration of data pipelines.
 The Senior Software Engineer will also be responsible for maintaining operational excellence, meeting SLA requirements, and mentoring team members to drive technical innovation and best practices.
 Role
 Contribute individually to the design, development, and implementation of large-scale data engineering solutions within the Hadoop ecosystem, ensuring high performance, scalability, and reliability.
 Drive end-to-end technical delivery for projects involving Cloudera distribution, Apache Ozone, Apache Iceberg, Apache Airflow, Apache NiFi, and Apache Spark.
 Collaborate with cross-functional teams to define architecture, technical standards, and best practices for big data platforms and workflows.
 Perform rigorous performance benchmarking and optimization for newly developed distributed frameworks, ensuring efficient parallel processing and scalable storage solutions across large datasets.
 Research and evaluate emerging technologies in distributed data storage, orchestration, and processing frameworks to optimize data pipelines and improve operational efficiency.
 Develop strategic technical plans and create architecture proposals addressing solution gaps and business requirements.
 Provide technical leadership in planning, design, and implementation phases, ensuring compliance with security, quality, and performance standards.
 Ensure adherence to SLAs, manage production incidents, and drive root cause analysis and remediation for complex issues.
 Conduct Proof of Concepts (PoCs) for new technologies and contribute to technology roadmaps for the organization.

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard’s security policies and practices;


• Ensure the confidentiality and integrity of the information being accessed;


• Report any suspected information security violation or breach, and


• Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.