Lead Data Engineer
Full-time
Mastercard
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary
The role is responsible for providing technical leadership across Data Engineering, Database Administration, Cloud Data Platforms, and Data Warehouse operations while ensuring the reliability, scalability, security, and cost efficiency of the organization's data ecosystem.
The ideal candidate will possess strong expertise in data engineering, database technologies, cloud platforms, data warehousing, ETL/ELT, CDC, and platform operations, combined with proven leadership experience in managing projects, driving strategic initiatives, mentoring teams, and collaborating across multiple technology functions.
This role will partner closely with Data Engineering, DBA, Cloud Engineering, SRE, Security, Analytics, and Business teams to deliver scalable and business-aligned data solutions. Key Responsibilities Technical Leadership & Architecture Provide technical leadership for Data Engineering, Data Warehouse, and Database initiatives.
Define and drive architecture standards, engineering best practices, and platform governance.
Design scalable, secure, and high-performance data solutions across cloud and on-premise environments.
Lead technical design reviews, solution assessments, and modernization initiatives.
Mentor engineers and foster a culture of engineering excellence and continuous improvement. Data Engineering & Data Warehouse Design, develop, and oversee enterprise ETL/ELT and CDC pipelines.
Manage data integration across relational, NoSQL, SaaS, and cloud-based platforms.
Design and optimize data warehouse, lakehouse, and analytical solutions using technologies such as Snowflake, Databricks, Apache Iceberg, and Amazon S3.
Ensure data quality, reliability, observability, and operational readiness of all data products.
Drive adoption of reusable frameworks, automation, and standardized engineering practices. Database & Platform Management Provide oversight of enterprise database environments including PostgreSQL, MySQL, Aurora PostgreSQL, Aurora MySQL, MongoDB Atlas, and DynamoDB.
Ensure database availability, performance, security, backup, recovery, and capacity planning.
Collaborate with DBA, SRE, and Cloud teams on performance tuning, incident resolution, disaster recovery, and operational improvements.
Establish monitoring, alerting, and operational processes for critical platforms. Project Delivery & Operations Ensure successful and timely delivery of projects through effective planning, prioritization, and execution.
Track project progress, dependencies, risks, and milestones.
Proactively identify and remove blockers impacting team productivity and project delivery.
Lead incident management and root cause analysis activities while driving preventive actions.
Continuously improve operational processes, runbooks, and service reliability. Strategic Initiatives & Optimization Drive modernization initiatives including migration from legacy platforms to cloud-native solutions.
Evaluate emerging technologies and conduct proof-of-concepts to support business objectives.
Lead cost optimization efforts across cloud platforms, licenses, and data infrastructure.
Partner with FinOps and platform teams to improve platform utilization and operational efficiency.
Identify opportunities to simplify architecture, reduce technical debt, and improve scalability. Resource & Capacity Planning Support workforce planning by forecasting resource needs for BAU activities and project initiatives.
Align team objectives with business priorities, strategic initiatives, and individual development plans.
Participate in hiring, onboarding, and succession planning activities.
Balance workloads and capacity across multiple projects and operational responsibilities. Stakeholder & People Leadership Foster strong collaboration across Data Engineering, DBA, SRE, Cloud, Security, BI, and application teams.
Establish regular stakeholder engagement to provide project updates, address challenges, and align priorities.
Conduct performance reviews, career development discussions, coaching, and mentoring activities.
Promote a culture of accountability, inclusion, innovation, and continuous learning.
Recognize and encourage outstanding team contributions and achievements. Required Skills & Experience Core Requirements:
8+ years of experience in Data Engineering, Database Engineering, Data Warehousing, or related disciplines.
Strong experience with Python, SQL, PySpark, ETL/ELT, and CDC-based architectures.
Expertise in relational databases including PostgreSQL, MySQL, Aurora PostgreSQL, and Aurora MySQL.
Strong understanding of database administration concepts including performance tuning, indexing, partitioning, backup/recovery, replication, and capacity planning.
Experience designing and managing enterprise data warehouses, data lakes, and lakehouse platforms.
Experience with cloud-based data services and modern analytics platforms.
Cloud & Data Platforms:
Strong expertise in AWS services including AWS Glue, S3, DMS, DynamoDB, IAM, VPC, and CloudWatch.
Hands-on experience with Snowflake, Databricks, Apache Iceberg, or equivalent modern data platforms.
Understanding of cloud security, governance, and cost optimization practices.
Leadership & Operations:
Proven experience leading technical teams and complex cross-functional projects.
Strong stakeholder management and communication skills.
Experience managing incidents, RCAs, service reliability, and production support activities.
Experience with Agile delivery methodologies, CI/CD, GitLab, and Infrastructure as Code (Terraform). Corporate Security Responsibility
Lead Data Engineer
Lead Data Engineer
Overview: We are seeking an experienced Lead Data Engineer to lead the design, delivery, modernization, and operational management of enterprise data platforms, databases, data warehouses, and data engineering solutions.The role is responsible for providing technical leadership across Data Engineering, Database Administration, Cloud Data Platforms, and Data Warehouse operations while ensuring the reliability, scalability, security, and cost efficiency of the organization's data ecosystem.
The ideal candidate will possess strong expertise in data engineering, database technologies, cloud platforms, data warehousing, ETL/ELT, CDC, and platform operations, combined with proven leadership experience in managing projects, driving strategic initiatives, mentoring teams, and collaborating across multiple technology functions.
This role will partner closely with Data Engineering, DBA, Cloud Engineering, SRE, Security, Analytics, and Business teams to deliver scalable and business-aligned data solutions. Key Responsibilities Technical Leadership & Architecture Provide technical leadership for Data Engineering, Data Warehouse, and Database initiatives.
Define and drive architecture standards, engineering best practices, and platform governance.
Design scalable, secure, and high-performance data solutions across cloud and on-premise environments.
Lead technical design reviews, solution assessments, and modernization initiatives.
Mentor engineers and foster a culture of engineering excellence and continuous improvement. Data Engineering & Data Warehouse Design, develop, and oversee enterprise ETL/ELT and CDC pipelines.
Manage data integration across relational, NoSQL, SaaS, and cloud-based platforms.
Design and optimize data warehouse, lakehouse, and analytical solutions using technologies such as Snowflake, Databricks, Apache Iceberg, and Amazon S3.
Ensure data quality, reliability, observability, and operational readiness of all data products.
Drive adoption of reusable frameworks, automation, and standardized engineering practices. Database & Platform Management Provide oversight of enterprise database environments including PostgreSQL, MySQL, Aurora PostgreSQL, Aurora MySQL, MongoDB Atlas, and DynamoDB.
Ensure database availability, performance, security, backup, recovery, and capacity planning.
Collaborate with DBA, SRE, and Cloud teams on performance tuning, incident resolution, disaster recovery, and operational improvements.
Establish monitoring, alerting, and operational processes for critical platforms. Project Delivery & Operations Ensure successful and timely delivery of projects through effective planning, prioritization, and execution.
Track project progress, dependencies, risks, and milestones.
Proactively identify and remove blockers impacting team productivity and project delivery.
Lead incident management and root cause analysis activities while driving preventive actions.
Continuously improve operational processes, runbooks, and service reliability. Strategic Initiatives & Optimization Drive modernization initiatives including migration from legacy platforms to cloud-native solutions.
Evaluate emerging technologies and conduct proof-of-concepts to support business objectives.
Lead cost optimization efforts across cloud platforms, licenses, and data infrastructure.
Partner with FinOps and platform teams to improve platform utilization and operational efficiency.
Identify opportunities to simplify architecture, reduce technical debt, and improve scalability. Resource & Capacity Planning Support workforce planning by forecasting resource needs for BAU activities and project initiatives.
Align team objectives with business priorities, strategic initiatives, and individual development plans.
Participate in hiring, onboarding, and succession planning activities.
Balance workloads and capacity across multiple projects and operational responsibilities. Stakeholder & People Leadership Foster strong collaboration across Data Engineering, DBA, SRE, Cloud, Security, BI, and application teams.
Establish regular stakeholder engagement to provide project updates, address challenges, and align priorities.
Conduct performance reviews, career development discussions, coaching, and mentoring activities.
Promote a culture of accountability, inclusion, innovation, and continuous learning.
Recognize and encourage outstanding team contributions and achievements. Required Skills & Experience Core Requirements:
8+ years of experience in Data Engineering, Database Engineering, Data Warehousing, or related disciplines.
Strong experience with Python, SQL, PySpark, ETL/ELT, and CDC-based architectures.
Expertise in relational databases including PostgreSQL, MySQL, Aurora PostgreSQL, and Aurora MySQL.
Strong understanding of database administration concepts including performance tuning, indexing, partitioning, backup/recovery, replication, and capacity planning.
Experience designing and managing enterprise data warehouses, data lakes, and lakehouse platforms.
Experience with cloud-based data services and modern analytics platforms.
Cloud & Data Platforms:
Strong expertise in AWS services including AWS Glue, S3, DMS, DynamoDB, IAM, VPC, and CloudWatch.
Hands-on experience with Snowflake, Databricks, Apache Iceberg, or equivalent modern data platforms.
Understanding of cloud security, governance, and cost optimization practices.
Leadership & Operations:
Proven experience leading technical teams and complex cross-functional projects.
Strong stakeholder management and communication skills.
Experience managing incidents, RCAs, service reliability, and production support activities.
Experience with Agile delivery methodologies, CI/CD, GitLab, and Infrastructure as Code (Terraform). Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Vacancy posted 15 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Remote vacancy
$140k - $190k
...employee engagement across the enterprise.Join our team as the expert you are now and create your future.The Huron Data Engineering team is looking to hire a Lead Data Engineer who is experienced in developing new features and improvements for data-driven web applications...SuggestedFull timeWork experience placementLocal areaRemote workHuron Consulting Group
Chicago, IL2 days ago- ...a specialist technical consultancy delivering bespoke technology and data solutions to solve complex operational challenges. Due to continued growth, they are looking for an experienced Data Engineer to join their growing engineering team.This is an exciting opportunity...SuggestedWork at officeRemote workWork from homeVisa sponsorshipFree visaFlexible hours
NPAworldwide
Birmingham, AL4 days ago $120.9k - $187k
...from the world and each other.POSITION TITLELead Data EngineerThis role is not eligible for employment... ...end data architecture, data governance, and data engineering from source systems to data consumers—is seeking a Lead Data Engineer with strong Databricks expertise and...SuggestedFull timeWork at officeLocal areaRemote workWork visaGenworth Financial
Richmond, VA4 days ago$92k - $138k
Lead Data Engineer Lead II - Data EngineeringWho We Are:Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative experiences...SuggestedFull timeTemporary workPart timeWork at officeLocal areaRemote workFlexible hoursUST Global
Chicago, IL3 days ago$151k - $168k
Job DescriptionWho We AreCreative Artists Agency (CAA) is the leading entertainment and sports agency, with global expertise in filmed... ...other locations globally. Job SummaryCAA is seeking a Lead Data Engineer with deep expertise in data engineering, data architecture, database...SuggestedPermanent employmentFull timeWork at officeLocal areaRemote work2 days per weekCreative Artists Agency
Nashville, TN3 days ago$140k - $200k
Manchester, New HampshireHybridFull Time$140k - $200k Job Description A leading technology organization serving the life sciences industry is hiring a Lead Data Engineer to help build and scale data solutions that power research, development, and scientific operations....Full timeTemporary workRemote workMotion Recruitment
Manchester, NH4 days ago$205.32k
...USAJob Family GroupEngineering / Product DevelopmentJob ProfileSr Lead Data EngineerManagement LevelSr Manager - Non People LeaderFlexible... ..., LLCSr. Lead Data EngineerJob Description: Sr. Lead Data Engineer positions offered by Cox Automotive Corporate Services, LLC (Atlanta...Full timeWork at officeLocal areaRemote workFlexible hoursCox Enterprises
Atlanta, GA5 days ago$119.55k - $180.89k
...nearly $500 million in funding to date, Armada is backed by leading investors including Founders Fund, Lux, BlackRock and... ...world. About the role We are seeking a Lead Level 2 Data Center NOC Engineer to provide technical leadership and operational ownership across...Full timeRemote workFlexible hoursShift workNight shift$180k - $200k
...headquartered in New York City with offices around the world. To learn more, go to ROLE OVERVIEW Zeta Global is seeking a Lead Data Engineer to build and scale healthcare-focused applications and data systems that power audience intelligence, activation, measurement...Full time$90k - $200k
...the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific... ...and our clients.Specific responsibilities for the Lead Machine Learning Engineer position include:...Work at officeRemote workVisa sponsorshipWork visaFlexible hoursCapTech
Richmond, VA3 days ago$170k - $190k
...Redhorse Corporation. We are a solution-driven company delivering data insights and technology solutions to customers with missions... .... To support this mission, we are seeking a Senior Data Engineer / Lead to join our team supporting the US National Defense Strategy....Full timeContract work- ...The Lead Data Engineer owns the Navanta data backbone — public Call Report data in the early build, and secure ingestion from bank cores into lakehouses as each client’s on-premises environment is stood up. Working under the SVP of Technology and Commercial AI and in...Full timeWork at office
$65 - $75 per hour
...Lead Engineer Remote (US-based) $65 - $75 per hour ABOUT THE ROLE Join Brooksource as a Lead Engineer, where you will combine hands... ...for software development, cloud computing, cybersecurity, data analytics, or enterprise IT, our customized staffing solutions...Hourly payContract workLocal areaRemote workFlexible hours$130.3k - $260.59k
...health care one person, one family and one community at a time. POSITION SUMMARY CVS Health is seeking a Lead ServiceNow Security and Data Protection Engineer to serve as the enterprise authority for ServiceNow platform security and data protection. The Lead...Hourly payFull timeTemporary workWork experience placementLocal area$170k - $240k
...Job Description Job Description Description We are seeking a Lead - Data Engineer to lead the hands-on design, development, and operation of key components of Astrana’s enterprise data platform, including the Constellation Lakehouse, Connect API (GraphQL) layer,...Remote workAstrana Health, Inc.
Monterey Park, CA8 days ago- ...Logicbroker, Inc. Logicbroker is the Agentic Commerce Orchestration Engine helping enterprise retailers, brands, suppliers, and... ...and run smarter operations. Job Summary We are hiring a Lead Data Engineer to drive delivery across our analytics and data...For contractorsWork at officeRemote work
Logicbroker
New York, NY3 days ago - ...Description The Lead Data Engineer owns Awayday's ingestion and pipeline layer end to end, from each source system through to the landing and staging layers in Snowflake that every domain builds on. It is a foundational mandate. You will build and run the pipelines...Contract workFor contractorsRemote work
Luxury Coastal Vacations
United States22 hours ago - ...Lead AWS Data Engineer Contract-to-hire 100% Remote Profile Summary: Lead Data and Analytics Engineer will be a senior member of data and analytics engineering chapter. This is a hands-on technology engineering leadership role focused on building AWS data &...Contract workRemote work
Software Technology Inc
United States4 days ago $99k - $225k
...Job Number: R0247668 Data Governance Engineer, Lead The Opportunity: Are you looking for an opportunity to combine your technical skills with big picture thinking to make an impact on national security? You understand your customer's environment and how to develop...Full timeContract workPart timeWork at officeLocal areaRemote work$77.6k - $176k
...Job Number: R0251792 Data Engineer, Lead The Opportunity: Make enterprise data and knowledge usable, governed, and dependable for AI applications. You will design data architectures and build the pipelines, knowledge indexes, and retrieval services that ground...Full timeContract workPart timeLocal areaRemote work$77.6k - $176k
...Job Number: R0251622 Databricks Data Engineer, Lead The Opportunity: As a lead Databricks Data Engineer, you will be hands-on designing, building, and maintaining robust data pipelines within Databricks and contributing independently while also providing technical...Full timeContract workPart timeLocal areaRemote work- DescriptionThe Lead Test Data Management Engineer is responsible for translating Huntington's Test Data Management (TDM) strategy into operational capabilities. This role serves as the bridge between architecture, engineering, governance, and delivery teams, driving the...Full timeWork experience placementWork at officeRemote workWork from homeFlexible hours
The Huntington National Bank
Columbus, OH5 days ago $161k - $266k
...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer Overview: Mastercard’s Data Commercialization Platform (DCP) team is seeking a Lead Data Engineer to design, build, and...Full timePart timeImmediate startWorldwideFlexible hours3 days per weekMastercard
Arlington, VA7 days ago- ...Job Title: Senior Data Engineer (Snowflake,DBT & DataStage) Remote W2 only We are seeking a Senior Data Engineer with strong experience in Snowflake, AWS, DataStage, and dbt/ELT tools to build and maintain scalable data warehouse solutions and data pipelines. Pointers...Remote work
Openkyber
Atlanta, GA2 days ago - ...membership, as well as access to TalkSpace and mental health coverage through our medical plans. \n \n \n Overview \n Lead Data Engineers at Excella play a key role in designing and building modern data solutions, including data lakes and cleansed data...Work from homeHome officeFlexible hours
Excella
Arlington, VA22 days ago - ...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer Lead Data Engineer Overview: We are seeking an experienced Lead Data Engineer to lead the design, delivery, modernization...Full timeWorldwide
Mastercard
Remote16 days ago $110k - $158.5k
...who rely on us to help them build more secure and prosperous futures. THE ROLEIn conjunction with the Enterprise Data Management Office, the Lead Data Engineer contributes to a long-term strategic initiative to unify and harmonize our investment data. This initiative...Full timeWork at officeLocal areaRemote workFlexible hoursMFS Investment Management
Boston, MA3 days ago- GATX Corporation, a leader in transportation asset leasing founded in 1898 and headquartered in Chicago, is seeking a Lead Data Engineer for a contract position to help shape the next evolution of its data, analytics, and AI ecosystem. This is a high-impact, high-visibility...Contract workWork at officeRemote work
- Excella, Inc in Arlington, Virginia is looking for a Lead Data Engineer to design and build modern data solutions, including data lakes and cleansed data repositories. The role involves developing scalable data pipelines and collaborating with cross-functional teams to...Remote jobFlexible hours
$120.38k - $192.6k
...Lincoln officeRelocation assistance: is not available for this opportunity.Requisition #: 76603The Role at a GlanceAs a Senior Lead Risk Data Engineer and Architect, you will architect and lead the design and implementation of new technology solutions for the Risk...Work experience placementWork at office3 days per weekLincoln Financial Group
Villanova, PA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
