Lead Data Engineer
Full-time
Mastercard
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary
Lead Data Engineer
Lead Data Engineer
Enterprise Credit Risk (ECR) Who is Mastercard? At Mastercard technology, we work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships, and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our decency quotient (DQ) drives our culture and everything we do inside and outside our company. We cultivate a culture of inclusion that respects individual strengths, perspectives, and experiences. We believe our differences enable us to be a better team, driving innovation and delivering better business outcomes. Overview The Enterprise Credit Risk (ECR) team is seeking a Lead Data Engineer to help build and scale the next generation of data platforms that power credit decisioning, portfolio risk management, regulatory reporting, analytics, and AI-driven insights across Mastercard's lending and risk ecosystems. The ideal candidate combines deep hands-on engineering expertise with technical leadership, enabling teams to build reliable, scalable, governed, and high-quality data products. This individual will lead the design and implementation of modern data engineering solutions spanning cloud platforms, large-scale data processing, data governance, and operational excellence. This role will partner closely with Product Management, Risk Analytics, Data Science, Architecture, and Business stakeholders to simplify access to trusted data and accelerate innovation across the ECR program. Role As a Lead Data Engineer, you will: Lead the design, development, and evolution of enterprise-grade data platforms and pipelines supporting credit risk products, decisioning capabilities, and analytics solutions. Architect and implement scalable ETL/ELT frameworks utilizing Databricks, Spark, Delta Lake, and cloud-native technologies. Establish data quality, lineage, governance, observability, and monitoring capabilities to ensure trusted and compliant data products. Drive the migration and modernization of legacy data assets into cloud-based architectures and Data Lakehouse platforms. Partner with Risk, Product, Architecture, and Engineering teams to translate business requirements into scalable technical solutions. Define and promote engineering standards, coding practices, testing frameworks,Data Quality frameworks, deployment automation, and operational excellence across the data ecosystem. Lead technical design reviews and influence architectural direction for data-intensive applications and services. Optimize large-scale data processing workloads for performance, reliability, scalability, and cost efficiency. Enable AI and advanced analytics initiatives through creation of high-quality, reusable, governed data products. Mentor, coach, and raise the technical capability of engineers across the organization by fostering a culture of ownership, continuous learning, accountability, and engineering excellence. Shape strategic roadmap planning, technology evaluation, and delivery priorities across the ECR portfolio, balancing business outcomes, engineering feasibility, risk, compliance, and long-term platform sustainability. Support regulatory, compliance, security, and audit requirements through robust engineering controls and documentation. Own complex problems with dependencies across multiple services and facilitate cross-functional collaboration to drive resolution. Conduct technical interviews, assess engineering talent, and contribute to raising the overall performance bar of the organization. All About You The ideal candidate for this position should have: Essential Skills & Experience Strong expertise in designing and implementing large-scale data engineering solutions and distributed data processing systems. Advanced proficiency with Databricks, Apache Spark, Delta Lake, SQL, and Python. Experience building and operating cloud-based data platforms on Azure, AWS, or GCP. Expertise developing enterprise-grade ETL/ELT pipelines, streaming architectures, and data integration frameworks. Strong understanding of data modeling techniques for analytical and operational workloads. Experience implementing data quality frameworks, lineage, metadata management, and governance practices. Experience with Data formats ( Parquet, Avro, ORC ) Working knowledge of CI/CD pipelines, infrastructure-as-code, automated testing, and DevOps practices. Experience with Workflow orchestration Tools like Airflow Strong understanding of security, privacy, and compliance requirements associated with sensitive financial and customer data. Proven ability to lead technical initiatives across multiple teams and influence engineering direction without direct authority. Excellent communication skills with the ability to collaborate effectively across technical and business functions. Demonstrated leadership in aligning engineering teams around shared goals, driving delivery through ambiguity, and creating clarity for stakeholders across product, risk, analytics, architecture, and operations. Ability to influence senior technical and business stakeholders, make thoughtful trade-off decisions, and guide teams toward pragmatic solutions that improve credit risk outcomes and operational resilience. Knowledge of Java Based application development is a huge Plus. Leadership Skills Lead by influence across engineering, product, risk, analytics, and architecture teams to align priorities and deliver measurable business outcomes. Create clarity in complex, ambiguous environments by translating business needs into actionable technical direction and execution plans. Develop engineering talent through mentoring, knowledge sharing, design guidance, and constructive feedback. Promote a high-accountability culture focused on quality, reliability, security, compliance, and continuous improvement. Communicate effectively with senior stakeholders and clearly articulate trade-offs, risks, dependencies, and delivery progress. Preferred Qualifications Bachelor's degree in Computer Science, Engineering, Information Systems, or a related STEM discipline or alternative minimum of 10 years of experience in a related field. Technical Skills Preferred expertise in: Databricks Apache Spark / PySpark Hadoop Delta Lake SQL Python Corporate Security Responsibility All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Dublin, CA vacancy
- ...Title: Lead Data Engineer - Data & AI, Supply Chain Client: Gap Location: Onsite - Pleasanton, CA Duration: 6-12 months Visa: USC/GC Rate: $68/hr W2 Interview Process: 1 video interview followed by onsite interview...Suggested
3B Staffing LLC
Pleasanton, CA1 day ago $105k - $131.26k
...knowledge to make a difference in our members' lives, Patelco could be the perfect fit for you. Overview The Data Engineer is a key contributor to Our Data & Analytics Strategy to transform Patelco as a Data-driven organization and position Credit...SuggestedFull timeTemporary workPart timeWork experience placementPatelco Credit Union
Dublin, CA4 days ago- ...Job Description The Data Engineer (Senior Level or above preferred) will design, develop, and maintain enterprise data solutions on the Snowflake platform. This role is responsible for building scalable data pipelines, developing curated reporting datasets, implementing...Suggested
Insight Global
Dublin, CA2 days ago - ...Job Title : Data Engineer Location : Dublin, CA Hybrid Onsite 2-3 days Roles & Responsibilities Provide L3 escalation support for existing production systems and assist with related enhancement activities. Ensure proper testing and adherence to business...Suggested
Perfict Global, Inc.
Dublin, CA1 day ago - ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Scientist, AI Engineering Lead Data Scientist, AI Engineering Overview Mastercard's AI Centre of Excellence is building the next...SuggestedFull timeWorldwide
$118.8k - $161.9k
...you care about.Workday PSA & Financials Data EngineerArmanino is proud to be among the... ...and aiding in the decision-making process.Lead and execute data analysis, transformation... ...escalation by partnering with cross team engineers on Workday design decisions.Collaborate with...Full timeContract workLocal areaArmanino
San Ramon, CA4 days ago- Associate | Full-time Engineering | Livermore, CA | 04/21/2026Reference #: REF8262VJob Code: SES.2 Science & Engineering MTS 2 / SES.3 Science... ...a real impact.Job DescriptionWe have multiple openings for a Data Science Engineer with a background in applied machine learning...Minimum wageFull timeFor contractorsLocal areaWork from homeRelocationFlexible hours1 day per week
Lawrence Livermore National Laboratory
Livermore, CA4 days ago $146.34k - $185.54k
...CA | 10/19/2026Reference #: REF8951DJob Code: SES.2 Science & Engineering MTS 2 / SES.3 Science & Engineering MTS 3Organization: ComputingPosition... ...can make a real impact.Job DescriptionWe have an opening for a Data Engineer to build and modernize data systems that make mission-...Minimum wageFull timeFor contractorsLocal areaWork from homeRelocationFlexible hours1 day per weekLawrence Livermore National Laboratory
Livermore, CA21 hours ago- ...**Responsibilities:Design, build, and maintain scalable people-data models within the enterprise data warehouse.Develop and support... ...Partner with the Enterprise Data Team on source-data onboarding, engineering dependencies, release planning, and production implementation....Local area
Axelon
Pleasanton, CA4 days ago - Job-ID15409644Reference21-00142Objective & Deliverables The Big Data Engineer shall lead the Big Data Engineering team. The consultant will play the role of technical lead and provide professional services to support the long term IT strategy and planning to include high...Work experience placement
Intelliswift
Pleasanton, CA5 days ago $184k - $264.5k
...redefine the future of how work gets done.Staff Data Scientist, FinanceAbout the TeamThe... ...are hiring a Staff Data Scientist to lead the next phase of Snowflake's driver-based... ...Product leaders, go-to-market teams, Analytics Engineering, and Finance Data and Analytics.This role...Shift workSnowflake
Dublin, CA3 days ago- ...Data Engineer – Onsite Locations: Raleigh, NC | Irving, TX | Chandler, AZ | New Jersey, NJ | Charlotte, NC | San Leandro, CA Duration: Long term Required Skills: Strong Python and/or Java development experience. Hands-on experience with Spark, Flink, streaming...
E-Solutions
San Leandro, CA2 days ago - ...Purple Drive DATA ENGINEER Share Contractual Pleasanton, CA PDT - 9329 12-15 Job Summary: The Senior Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures on AWS to support scalable data processing...
Purple Drive
Pleasanton, CA2 days ago - ...Bachelor's degree or equivalent experience in computer science, applied math, physics, engineering, statistics, economics or related field. 3+ years of industry experience in Data Engineering 3+ years of work experience including hands-on technical...Work experience placement
Apex Informatics
Pleasanton, CA3 days ago - ...Azure Databricks Technical Lead Location: Pleasanton, CA (Hybrid) Job Type: Contract Implementation- UST Global About the... ...highly skilled Senior Azure Databricks (ADB) Developer to join our Data Engineering team. This role involves developing large-scale batch and...Contract work
InterSources
Pleasanton, CA4 days ago $135k - $150k
...done! What you'll Be Doing: Vagaro is seeking a skilled Data Engineer to join our dynamic team and partner with our Data Science, Machine... ...data architectures on the Microsoft Fabric platform. You will lead the design and optimization of ETL/ELT pipelines, establish...Monday to FridayVagaro Inc
Pleasanton, CA2 days ago- ...Machine Learning Engineer The Enterprise Data & Analytics team inspires to build best in class customer experiences and revolutionize the food and drug retail industry. We are looking for people who are excited in re-imagining the grocery experience by harnessing the...Work at officeAfternoon shift
Software Technology Inc
Dublin, CA4 days ago - ...Job Description In this role as Data Analytics Engineer, In this role, you will build and maintain data pipelines, tools, and visualizations to enable organizational insights. You'll develop KPI reports, partner with engineers on data architecture, investigate metric...Remote workFlexible hours
Venturesoft
Pleasanton, CA5 days ago - Our client is seeking a Data Scientist II - Generative AI to join a cutting-edge team focused on building scalable, production-ready... ...initiatives. Responsibilities include developing robust prompt engineering frameworks, building RAG pipelines, and converting prototypes...
Robert Half
San Ramon, CA4 days ago $100k - $160k
.... Job Opportunity: Berkshire Hathaway Specialty Insurance (BHSI) has an exciting opportunity for Data Scientist / Senior Data Scientist to join the Catastrophe Engineering and Analytics (CAT E&A) team. CAT E&A is an innovative and versatile technical team conducting catastrophe...Temporary workFlexible hoursBerkshire Hathaway Specialty Insurance
San Ramon, CA2 days ago$124.4k - $186.6k
...around us. As a Fortune 500 company and a leading AI platform for managing people, money,... ...that turn complex organizational data into targeted leadership action. Our vision... ...organization (SVP/GM, Product Management, Engineering, and GTM teams) to bring analytical rigor...Full timeWork at officeRemote workHome officeFlexible hoursWorkday
Pleasanton, CA4 days ago- obert Half is seeking a Software Engineer II - AI Engineer to analyze, design, program, debug, test, implement, and support the privacy,... ...pipelines, plugins, skills, and autonomous agents, by embedding data protection, security guardrails, and responsible AI governance across...
Robert Half
San Ramon, CA4 days ago - ...and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating...Hourly payContract workRemote work
- ...Data Scientist Qualifications for Data Scientist Strong problem solving skills with an emphasis on product development. Experience... ...generation, summarization, and conversational agents. - Prompt engineer pre-trained LLMs on domain-specific data to optimize performance...
Pyramid Consulting
Pleasanton, CA1 day ago $91.3k - $124.4k
...network of smart and supportive people, willing to listen to your ideas. This is an early-career engineering role focused on building, operating, and improving cloud data/analytics platforms (e.g., Microsoft Fabric, Snowflake, Databricks) and supporting BI delivery (e....Full timeContract workInternshipLocal areaFlexible hoursArmanino
San Ramon, CA3 days ago$112.8k - $153.7k
...willing to listen to your ideas. This is a senior engineering role. You will architect, operate, and continuously improve cloud data and analytics platforms (e.g., Microsoft... ...and provide working depth across the others.Lead onboarding and enablement for engineering and...Full timeContract workLocal areaFlexible hoursArmanino
San Ramon, CA4 days ago- ...develop and test new trading systems. Your role will include using the latest machine learning techniques to analyze mountains of market data and apply them to new and existing trading models. As a researcher you will work closely with traders and developers to analyze...
Tanius Technology
Alamo, CA4 days ago $70 - $80 per hour
...Kforce retail client in Dublin, CA is currently looking for an AI Engineer for a contract-to-hire opportunity that is hybrid, with 2-3 days... ..., prompt engineering, knowledge grounding, and enterprise data integration* Integrate AI solutions with APIs, databases, SaaS applications...Contract work2 days per week3 days per weekKForce
Dublin, CA3 days ago- ...AI Engineer Location: 2-3 days onsite in Dublin, CA Long Term Contract Job Description: Design, build, test, deploy, and support... ..., Python, SDKs, and APIs. Develop RAG pipelines involving data ingestion, vector indexing, prompt engineering, knowledge grounding...Long term contract
Perfict Global, Inc.
Dublin, CA3 days ago - ...AI Engineer Must haves: At least four years of software engineering, AI/ML development, or related technical experience... ...and modern DevOps practices. Understanding of AI security, data privacy, responsible AI, regulatory compliance, and AI FinOps....
3B Staffing LLC
Dublin, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
