Lead Data Engineer
Full-time
Mastercard
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary
Lead Data Engineer
Lead Data Engineer
Enterprise Credit Risk (ECR) Who is Mastercard? At Mastercard technology, we work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships, and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our decency quotient (DQ) drives our culture and everything we do inside and outside our company. We cultivate a culture of inclusion that respects individual strengths, perspectives, and experiences. We believe our differences enable us to be a better team, driving innovation and delivering better business outcomes. Overview The Enterprise Credit Risk (ECR) team is seeking a Lead Data Engineer to help build and scale the next generation of data platforms that power credit decisioning, portfolio risk management, regulatory reporting, analytics, and AI-driven insights across Mastercard's lending and risk ecosystems. The ideal candidate combines deep hands-on engineering expertise with technical leadership, enabling teams to build reliable, scalable, governed, and high-quality data products. This individual will lead the design and implementation of modern data engineering solutions spanning cloud platforms, large-scale data processing, data governance, and operational excellence. This role will partner closely with Product Management, Risk Analytics, Data Science, Architecture, and Business stakeholders to simplify access to trusted data and accelerate innovation across the ECR program. Role As a Lead Data Engineer, you will: Lead the design, development, and evolution of enterprise-grade data platforms and pipelines supporting credit risk products, decisioning capabilities, and analytics solutions. Architect and implement scalable ETL/ELT frameworks utilizing Databricks, Spark, Delta Lake, and cloud-native technologies. Establish data quality, lineage, governance, observability, and monitoring capabilities to ensure trusted and compliant data products. Drive the migration and modernization of legacy data assets into cloud-based architectures and Data Lakehouse platforms. Partner with Risk, Product, Architecture, and Engineering teams to translate business requirements into scalable technical solutions. Define and promote engineering standards, coding practices, testing frameworks,Data Quality frameworks, deployment automation, and operational excellence across the data ecosystem. Lead technical design reviews and influence architectural direction for data-intensive applications and services. Optimize large-scale data processing workloads for performance, reliability, scalability, and cost efficiency. Enable AI and advanced analytics initiatives through creation of high-quality, reusable, governed data products. Mentor, coach, and raise the technical capability of engineers across the organization by fostering a culture of ownership, continuous learning, accountability, and engineering excellence. Shape strategic roadmap planning, technology evaluation, and delivery priorities across the ECR portfolio, balancing business outcomes, engineering feasibility, risk, compliance, and long-term platform sustainability. Support regulatory, compliance, security, and audit requirements through robust engineering controls and documentation. Own complex problems with dependencies across multiple services and facilitate cross-functional collaboration to drive resolution. Conduct technical interviews, assess engineering talent, and contribute to raising the overall performance bar of the organization. All About You The ideal candidate for this position should have: Essential Skills & Experience Strong expertise in designing and implementing large-scale data engineering solutions and distributed data processing systems. Advanced proficiency with Databricks, Apache Spark, Delta Lake, SQL, and Python. Experience building and operating cloud-based data platforms on Azure, AWS, or GCP. Expertise developing enterprise-grade ETL/ELT pipelines, streaming architectures, and data integration frameworks. Strong understanding of data modeling techniques for analytical and operational workloads. Experience implementing data quality frameworks, lineage, metadata management, and governance practices. Experience with Data formats ( Parquet, Avro, ORC ) Working knowledge of CI/CD pipelines, infrastructure-as-code, automated testing, and DevOps practices. Experience with Workflow orchestration Tools like Airflow Strong understanding of security, privacy, and compliance requirements associated with sensitive financial and customer data. Proven ability to lead technical initiatives across multiple teams and influence engineering direction without direct authority. Excellent communication skills with the ability to collaborate effectively across technical and business functions. Demonstrated leadership in aligning engineering teams around shared goals, driving delivery through ambiguity, and creating clarity for stakeholders across product, risk, analytics, architecture, and operations. Ability to influence senior technical and business stakeholders, make thoughtful trade-off decisions, and guide teams toward pragmatic solutions that improve credit risk outcomes and operational resilience. Knowledge of Java Based application development is a huge Plus. Leadership Skills Lead by influence across engineering, product, risk, analytics, and architecture teams to align priorities and deliver measurable business outcomes. Create clarity in complex, ambiguous environments by translating business needs into actionable technical direction and execution plans. Develop engineering talent through mentoring, knowledge sharing, design guidance, and constructive feedback. Promote a high-accountability culture focused on quality, reliability, security, compliance, and continuous improvement. Communicate effectively with senior stakeholders and clearly articulate trade-offs, risks, dependencies, and delivery progress. Preferred Qualifications Bachelor's degree in Computer Science, Engineering, Information Systems, or a related STEM discipline or alternative minimum of 10 years of experience in a related field. Technical Skills Preferred expertise in: Databricks Apache Spark / PySpark Hadoop Delta Lake SQL Python Corporate Security Responsibility All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard’s security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Vacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Dublin, CA vacancy
- ...Senior/Lead Data EngineerRemote - CST Hours, Within US only Max Vendor Rate - *** Senior/Lead Data Engineer Position Summary Seeking a hands-on Senior/Lead Data Engineer with 8+ years of experience to design, build, and support scalable cloud data solutions for healthcare...Suggested
Apolis
Pleasanton, CA2 days ago $88.1k - $141k
...Data EngineerWe are seeking a talented Data Engineer. The right candidate has strong communication skills, passion for solving business problems with data and has domain knowledge in Finance, Human Resources, and Customer Success. You have empathy, curiosity and desire...SuggestedFull timeCornerstone OnDemand
Dublin, CA2 days ago- ...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Scientist, AI Engineering Lead Data Scientist, AI Engineering Overview Mastercard's AI Centre of Excellence is building the next...SuggestedFull timeWorldwide
- ...IDR is seeking a Senior Data Center Engineer to join one of our top clients for an opportunity in Livermore, CA. This role involves providing... ...Position Overview for the Senior Data Center Engineer: Lead technical discovery to gather, validate, and document...Suggested
IDR Healthcare
Livermore, CA1 day ago $55.1k - $137.5k
...Join us in bringing joy to customer experience. Five9 is a leading provider of cloud contact center software, bringing the power... ...authentic selves. We are actively seeking an experienced Data Center Engineer for our Infrastructure Reliability team. This person will be...SuggestedTemporary workWork at officeRemote workWorldwideFive9
San Ramon, CA2 days ago- ...The Project Engineer provides end-to-end technical leadership for assigned customer deployments... ...Requirements and Technical Leadership Lead technical discovery to gather, validate,... ...certifications (CCNP, CCDP, JNCIP) in networking, data center infrastructure, servers, storage,...Worldwide
Computacenter
Livermore, CA1 day ago $135k - $150k
...done! What you'll Be Doing: Vagaro is seeking a skilled Data Engineer to join our dynamic team and partner with our Data Science, Machine... ...data architectures on the Microsoft Fabric platform. You will lead the design and optimization of ETL/ELT pipelines, establish...Full timeMonday to FridayVagaro
Pleasanton, CA4 days ago- ...Senior Data EngineerLocation - Dallas, TX and San Ramon, CA and New York city, NY (Remote option is available)Our rate: $55 on C2C... ...data, and infrastructure layers.Conduct code reviews and enforce engineering, security, performance, and maintainability standards....Contract workRemote work
Argyle Infotech
San Ramon, CA4 days ago - ...MatchPoint is a fast-growing, young, energetic global IT-Engineering services company with clients across the US. We provide technology solutions... ...our team. We look forward to hearing from you! Role: Senior Data Engineer Contract Length: 12+ Months Location: San Ramon, CA...Contract workLocal area1 day per week
MatchPoint Solutions
San Ramon, CA15 hours ago - ...Azure Databricks Technical LeadWe are looking for a highly skilled Senior Azure Databricks (ADB) Developer to join our Data Engineering team. This role involves developing large-scale batch and streaming data pipelines on Azure Cloud. The ideal candidate will have strong...
InterSources
Pleasanton, CA15 hours ago - ...Purple DriveDATA ENGINEER Share Contractual Pleasanton, CA PDT - 9329 12-15Job Summary:The Senior Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures on AWS to support scalable data processing, storage, and...
Purple Drive
Pleasanton, CA2 days ago $105k - $125k
.... It's time to use your skills and passion to do work that matters! Job Description Peterson Cat has a need for a Data & Analytics Engineer to work onsite at our San Leandro, CA location. WE ARE UNABLE TO PROVIDE SPONSORSHIP AT THIS TIME SUMMARY The...Work experience placementPeterson
San Leandro, CA3 days ago- ...Job Description In this role as Data Analytics Engineer, In this role, you will build and maintain data pipelines, tools, and visualizations to enable organizational insights. You'll develop KPI reports, partner with engineers on data architecture, investigate metric...Remote workFlexible hours
Venturesoft
Pleasanton, CA5 days ago - ...this role, you’ll have the opportunity to lead, innovate, and contribute to the growth... ...optimization of distributed training, large-scale data processing, and inference systems using... ...data assets. Partner with Data Science, Engineering, Product, and Business leaders to...Weekly payImmediate start
Safeway
Pleasanton, CA1 day ago - ...and Summary Senior Information Security Engineer Who is Mastercard? Mastercard is a... ...simple, smart, and accessible. Using secure data and networks, partnerships and passion,... ...or e-commerce, Mastercard innovation is leading the digital convergence of traditional and...Full timeWork experience placementWorldwide
- ...is a forward-thinking technology company that leverages AI and data science to drive innovation and deliver cutting-edge solutions.... .... J ob Description: As an Analytics and AI Integration Engineer at CXAPP, you will play a crucial role in integrating AI capabilities...
CXApp US, Inc.
San Ramon, CAa month ago - ...develop and test new trading systems. Your role will include using the latest machine learning techniques to analyze mountains of market data and apply them to new and existing trading models. As a researcher you will work closely with traders and developers toanalyze...
Tanius Technology
Alamo, CA2 days ago - ...technology company that leverages AI and data science to drive innovation and deliver cutting... ...As an AI Applications and Data Science Engineer at CXAPP, you will be at the forefront of... ...: # NLP and Chatbot Development: Lead the design, development, and maintenance...
CXApp US, Inc.
San Ramon, CAa month ago - ...EngineerApply**Job#: 3049127****Job Description:**Machine Learning Engineer**Location:** Pleasanton, California (Remote)Role OverviewThe... ...and cloud-native services.* Experience working with unstructured data.* Understanding of AI agent optimization, deployment, and operational...Hourly payContract workRemote work
Apex Systems
Pleasanton, CA5 days ago $30 - $62 per hour
...Join a dynamic AI engineering initiative where you'll help design, optimize, and scale next-generation AI agents that improve planning, allocation... ...and related cloud-native tools Work with unstructured data to enable AI-driven insights and workflows Improve agent...Hourly payContract workHorizontal Talent
Pleasanton, CA5 days ago- ...Virtu is an industry-leading financial technology firm that operates both proprietary trading... ...will work on real-world research and engineering problems throughout the program.... ...trading algorithms by transforming large data sets into robust trading models. Successful...Full timeSummer workInternship
- Job-ID15409644Reference21-00142Objective & Deliverables The Big Data Engineer shall lead the Big Data Engineering team. The consultant will play the role of technical lead and provide professional services to support the long term IT strategy and planning to include high...Work experience placement
- Associate | Full-time Engineering | Livermore, CA | 04/21/2026Reference #: REF8262VJob Code: SES.2 Science & Engineering MTS 2 / SES.3 Science... ...a real impact.Job DescriptionWe have multiple openings for a Data Science Engineer with a background in applied machine learning...Minimum wageFull timeFor contractorsLocal areaWork from homeRelocationFlexible hours1 day per week
$184k - $264.5k
...redefine the future of how work gets done.Staff Data Scientist, FinanceAbout the TeamThe... ...are hiring a Staff Data Scientist to lead the next phase of Snowflake's driver-based... ...Product leaders, go-to-market teams, Analytics Engineering, and Finance Data and Analytics.This role...Shift work$145k - $190k
...do, and the inference machinery that pulls physics out of shot data. This is not a “fit a curve to a dashboard” data science role.... ...Applied Mathematics, Plasma Physics, Computational Science, Nuclear Engineering, or a closely related field. An exceptional Master's candidate...Permanent employmentLocal areaRelocationRelocation packageFlexible hours$100k - $160k
.... Job Opportunity: Berkshire Hathaway Specialty Insurance (BHSI) has an exciting opportunity for Data Scientist / Senior Data Scientist to join the Catastrophe Engineering and Analytics (CAT E&A) team. CAT E&A is an innovative and versatile technical team conducting catastrophe...Temporary workFlexible hours$124.4k - $186.6k
...around us. As a Fortune 500 company and a leading AI platform for managing people, money,... ...that turn complex organizational data into targeted leadership action. Our vision... ...organization (SVP/GM, Product Management, Engineering, and GTM teams) to bring analytical rigor...Full timeWork at officeRemote workHome officeFlexible hours$130k - $155k
...We Are & Why Join Us Avathon is the leading Industrial AI autonomy platform, helping... ...contextualizes and connects operational data across siloed systems, bringing together... ...avathon.com About the Role As a Senior AI Engineer at Avathon, you will play a key role in...Full timeContract workTemporary workWork at officeLocal areaAvathon
Pleasanton, CA25 days ago$110k - $130k
...We Are & Why Join Us Avathon is the leading Industrial AI autonomy platform, helping... ...contextualizes and connects operational data across siloed systems, bringing together... ...avathon.com About the Role Senior AI Engineer – Generative AI & LLMs At Avathon, we...Full timeContract workTemporary workInternshipWork at officeLocal areaAvathon
Pleasanton, CA25 days ago- ...intelligence. Redica's platform helps the world's leading Pharmaceutical and MedTech companies stay... .... The Redica Intelligence Cloud brings data together to anticipate risk, accelerate... ...’re looking for an experienced Senior AI Engineer to join our team as we continue to...Full time
REDICA Systems
Pleasanton, CA17 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
