Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer Big Data Scala Spark Hadoop

$115k - $184k

Mastercard

Title and Summary Senior Software Engineer About the Team Commercial & New Payment Flows (CNPF) is Mastercard's global organization dedicated to modernizing commercial payments. Commercial Platform Engineering (CPE) is the engineering backbone of CNPF, delivering shared platform capabilities that power all Commercial products and experiences. The team designs, builds, and maintains core shared services used across Commercial programs. Role As a Senior Software Engineer, you will be responsible for development, deployment support, owning the delivery of user stories, mentoring junior team members, and performing code reviews. The role includes planning, developing, and coordinating design, development, and implementation activities. Responsibilities Design, develop, test, implement, and maintain software applications that align with Mastercard engineering standards and best practices. Deliver secure, reliable, and scalable software solutions within defined timelines and budgets. Research and evaluate alternative technical approaches to meet current and future business needs. Conduct feasibility studies, system flowcharting, and logic design to support solution development. Collaborate with team members and stakeholders to meet project goals, identify issues early, and recommend practical solutions. Qualifications Bachelor's degree in information systems, Information Technology, Computer Science or Engineering is preferred. Strong hands‑on experience in backend development with applicable JAVA technologies (Core JAVA, Spring Integration, Spring Boot, Hibernate, REST/SOAP web services). Proven experience working with Oracle/SQL Databases. Experience and understanding of messaging solutions such as Apache Kafka, Axon, etc. Strong knowledge of automated build, deployment and continuous integration systems. Experience with CI/CD tools like Jenkins, Bitbucket, Artifactory, Atlassian suite. Strong communication, relationship‑building, collaboration, and organizational skills. Proven ability to work cross‑functionally with Technical Leads, Solution Architects, Product Managers, Release Managers, Application Services and Testing Teams to ensure quality delivery. Experience in Test‑Driven Development (TDD) and Behavior‑Driven Development (BDD). Experience in solution design for simplicity, scalability and future agility. Experience in technical design activities to ensure alignment with Non‑Functional Requirements, Solution Architecture and System Functional Design specifications. Experience with all aspects of Scrum Agile for software development activities (daily stand‑up, backlog grooming, sprint planning). Ability to understand user stories and requirements, contribute to proposed solution designs, and translate these into coded features or solutions that are simple, functional, scalable, and maintainable. Experience working in the Financial Services Sector is preferred. Security Responsibility Abide by Mastercard's security policies and practices. Ensure the confidentiality and integrity of the information being accessed. Report any suspected information security violation or breach. Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines. Benefits & Compensation The successful candidate will be offered a competitive base salary and may be eligible for an annual bonus or commissions. Salary ranges for O'Fallon, Missouri: $115,000 - $184,000 USD. Benefits for full‑time employees include: medical, prescription drug, dental, vision, disability, life insurance; flexible spending account and health savings account; paid leaves (16 weeks new parent leave and up to 20 days bereavement leave); 80 hours of Paid Sick and Safe Time, 25 days of vacation time and 5 personal days, prorated; 10 annual paid U.S. observed holidays; 401(k) with company match; deferred compensation for eligible roles; fitness reimbursement or on‑site fitness facilities; tuition reimbursement; and more. Benefits for interns include: 56 hours of Paid Sick and Safe Time; jury duty leave; and on‑site fitness facilities in some locations. Mastercard is a merit‑based, inclusive, equal‑opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disability or veteran status or any other characteristic protected by law. #J-18808-Ljbffr Mastercard

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer Big Data Scala Spark Hadoop in New York, NY vacancy
  • Veriipro in New York City is seeking a Senior Big Data Engineer with 8+ years of IT experience and hands-on expertise in Hadoop, Spark, Python, and Snowflake. You will design scalable data pipelines, migrate data from Hadoop to Snowflake using PySpark, and develop enterprise... 
    Senior
    Big data

    Veriipro

    New York, NY
    9 hours ago
  • A reputable technology firm is seeking a Scala Developer in New York. The ideal candidate will have over 5 years of hands-on Scala development...  ...collaborating with global teams and addressing various big data needs within financial crime control applications. This is a... 
    Senior
    Big data
    Contract work

    New York Technology Partners

    New York, NY
    3 days ago
  • $131.6k - $244.4k

     ...thrive. Your New Role: The Senior Software Engineer is accountable for...  ...party AdTech partners and data providers. Data Engineering...  ...optimization. Work with big data frameworks (Spark, Kafka) to handle large-scale...  ...‑on expertise with Java, Scala, or Python. Experience... 
    Senior
    Big data
    Temporary work
    Local area

    Warner Media, LLC.

    New York, NY
    2 days ago
  • About the Team The Spark Platform team owns and operates...  ...powers the company's data, analytics, and ML...  ...About the Role As a Senior Software Engineer on Spark Platform, you...  ...Cosco, or similar), batch/big‑data schedulers (...  ...Professional experience with Scala, Java, Python, or Go;... 
    Senior
    Big data
    Work at office
    Remote work
    Relocation

    DoorDash

    New York, NY
    3 days ago
  • A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities... 
    Senior
    Big data

    Stem Xpert

    New York, NY
    9 hours ago
  • A leading financial data company in New York is looking for an experienced engineer to build and manage large-scale distributed systems leveraging Hadoop infrastructure. The ideal candidate has over 4 years of experience in Java, a degree in Computer Science or Engineering... 
    Senior
    Big data

    Bloomberg

    New York, NY
    3 days ago
  • A technology services company is seeking a skilled Hadoop Developer with a minimum of 6-10 years of experience, including at least 2 years...  .... Candidates must possess strong technical skills in tools like Spark, HBase, and Hive, plus proficiency in programming languages such... 
    Senior
    Big data
    Permanent employment
    Full time

    Career Guidant Inc.

    New York, NY
    9 hours ago
  •  ...around you through data solutions. Partner with...  ...career.  As a Senior Director of Software Engineering at JPMorganChase within...  ..., DBX, PySpark, Spark, Cloud Providers: Databricks...  ..., Kafka, Python/Scala, Glue/EMR, AI...  ...Manager Experience in Big Data technologies handling... 
    Senior
    Big data
    Work at office

    J.P. Morgan

    New York, NY
    18 days ago
  • A prominent IT consulting firm is hiring a Senior Azure Data Engineer to develop data solutions in a hybrid setting. The ideal candidate will have strong skills in Azure Data Engineering, Python/Scala, and SQL, with responsibilities including mentoring junior staff and... 
    Senior
    Big data
    Contract work

    Two95 International Inc.

    New York, NY
    4 days ago
  • $123.7k - $254.67k

    Role Description As a Data Engineer at tvScientific, you will be a key player in implementing the robust data infrastructure to power...  ...and implement robust data infrastructure in AWS, using Spark with Scala ~Evolve our core data pipelines to efficiently scale for... 
    Big data

    Remotive

    New York, NY
    1 day ago
  • Tech Mirrors is seeking a Big Data Engineer in New York, NY for a long-term project. Responsibilities include designing and enhancing ETL frameworks...  ...of experience and strong knowledge of UNIX Shell, Python, Spark, and SQL. A positive team player is essential. This is an... 
    Senior
    Big data

    Tech Mirrors

    New York, NY
    9 hours ago
  • $185k

     ...Senior Data Engineer role at Trepp, Inc. Trepp's Data Platform Team is...  ...3 years of experience in big data technologies At least...  ...development including Python, SQL, Scala, or Java 3+ years of...  ...tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark) 2+ years of experience working... 
    Senior
    Big data
    Full time
    Temporary work
    Work at office
    Work from home
    Monday to Friday
    Flexible hours

    Trepp, LLC

    New York, NY
    4 days ago
  • $250.8k - $286.2k

     ...Senior Lead Data Engineer What You’ll Do: Collaborate with and across Agile...  ...programming languages like Java, Scala, Python and Open Source...  ...2 years of experience in big data technologies At...  ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+... 
    Senior
    Big data
    Full time
    Part time
    Internship
    Local area

    Capital One National Association

    New York, NY
    4 days ago
  • About the job Senior Cloud Data Platform Engineer Senior Cloud Data Platform Engineer needs 5+ years of...  ...applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. Locations:...  .... 5+ year support experience of Big Data technologies in Hadoop... 
    Senior
    Big data
    Work at office

    Global Channel Management

    New York, NY
    3 days ago
  •  ...Opportunity We are looking for a highly driven Software Engineer to join our Data & Platform Engineering team at LG Ad...  ...zones. Preferred Experience with Big Data processing frameworks, specifically Apache Spark (PySpark or Scala‑Spark). Hands‑on experience with... 
    Big data
    Work at office
    Local area
    Relocation package

    LG Ad Solutions

    New York, NY
    3 days ago
  • [IT] SOFTWARE ENGINEER - DATA | JUNIOR / MID About the job [IT] SOFTWARE ENGINEER - DATA | JUNIOR / MID...  ...systems Previous experience with Java and Scala Previous experience working with big data tools such as Bigtable, Apache Spark, Apache Spark Streaming, Apache Heron,... 
    Big data
    Work experience placement

    Human Power BG

    New York, NY
    3 days ago
  • $121.4k - $161.8k

     ...industry. Rockstar Games is seeking a Senior Software Engineer in Data Engineering to join a team focused on...  ...Strong experience with Java (and/or Scala) as well as Python, in backend or data...  ...ecosystem. Familiarity with Apache Spark. Familiarity with CI/CD pipelines, automated... 
    Senior
    Full time
    Work at office

    Rockstar Games

    New York, NY
    1 day ago
  •  ...career — and we have the perfect software engineering opportunity for you. As a...  ...from large, diverse data sets to identify problems and...  ...experience in Java, Python, Groovy, Scala, JavaScript, ReactJS Hands on...  ...distributed computation systems (HDFS, Spark, Apache Flink, Databricks)... 
    Big data

    JPMorgan Chase

    New York, NY
    3 days ago
  • $106.9k - $176.5k

     ..., Dallas Overview Senior Consultant - Financial Services - Data & Analytics - Data Architecture and Engineering. Join EY to solve complex...  .../warehousing, big data analytics, and...  ...processing - Hadoop, Spark ecosystem Integration...  ...Python, Java, C++, Scala Traditional RDBMS... 
    Senior
    Big data
    Work at office
    Flexible hours

    EY

    New York, NY
    3 days ago
  • $209k - $238.5k

     ...you'll be part of a big group of makers, breakers...  .... We are seeking Data Engineers who are passionate...  ...technologies. As a Capital One Senior Lead Data Engineer,...  ...like Java, Scala, Python and Open...  ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)... 
    Senior
    Big data
    Internship
    Local area

    Capital One

    New York, NY
    1 day ago
  • $200k - $240k

    Engineering Manager - Data Platform Responsible for building and scaling the data infrastructure...  ...(RDS), Redshift, EMR, Spark Docker, OpenSearch, AWS (...  ...Strong background as a senior or staff‑level data engineer...  ...environments Experience with big data and streaming... 
    Senior
    Big data
    Remote work
    Home office
    Flexible hours

    SentiLink

    New York, NY
    3 days ago
  • $164k - $193k

     ...the role? Etsy’s Data & ML Enablement organizations...  ...up a team of engineers who will sit at...  ...cases. We work in Scala, Python, Java, and...  ...systems built on Spark, Kafka, Airflow,...  ...reporting to the Senior Engineering Manager...  ...operated. Strong software engineering skills... 
    Senior
    Full time
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Etsy

    New York, NY
    3 days ago
  • Chubb is seeking a Data Solution Engineer to implement big data projects, focusing on managing and visualizing large datasets. This role requires strong...  .... The ideal candidate possesses expertise in Azure, Hadoop, and extensive experience with data parsing. A background... 
    Senior
    Big data

    Chubb

    New York, NY
    3 days ago
  • $60 - $70 per hour

    Sciata is looking for a Data Engineer in Atlanta, GA. You will design, implement, and maintain the data pipeline architecture...  ..., strong SQL knowledge, and is skilled with big data tools like Hadoop and Spark. This role involves collaboration across teams to optimize... 
    Senior
    Big data
    Hourly pay

    Sciata

    New York, NY
    1 day ago
  • Project Description We're looking for a Senior Big Data Developer to join our Data Engineering team in Tel Aviv. You will be a part of our data platform, that is responsible for processing, storing, and serving data for all our core systems. As a Senior Big Data Developer... 
    Senior
    Big data

    Coherent Solutions, Inc.

    New York, NY
    9 hours ago
  •  ...Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Required Skills: Azure Data Engineering...  ...Analytics, Azure Arc, DevOps Developing using Python/Scala and SQL Work with “Big Data” Work with RDBMS and NoSQL Use of ETL/ELT... 
    Senior
    Big data
    Contract work

    TWO95 International

    New York, NY
    4 days ago
  • Vortalsoft Inc is seeking a skilled data engineer to develop and maintain data pipelines for their Big Data financial crime solution. The ideal candidate will...  ...Familiarity with AWS and Big Data technologies like Hadoop and Spark is a plus. #J-18808-Ljbffr Vortalsoft Inc
    Senior
    Big data

    Vortalsoft Inc

    New York, NY
    9 hours ago
  •  ...technology company in New Jersey is looking for an experienced Data Engineer to build and maintain scalable data pipelines. Candidates should...  ...experience in Python and AWS, with a strong understanding of big data technologies. The role involves collaboration with cross-functional... 
    Senior
    Big data

    TechDigital Group

    New York, NY
    2 days ago
  • We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark... 
    Senior
    Big data

    Veriipro

    New York, NY
    9 hours ago
  • $250.8k - $286.2k

    Capital One National Association is seeking a Senior Lead Data Engineer to develop and support technical solutions within Agile teams. The ideal candidate...  ...have substantial experience in application development and big data technologies, including cloud computing and machine... 
    Senior
    Big data

    Capital One National Association

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer Big Data Scala Spark Hadoop. Be the first to apply!