Senior Software Engineer Big Data Scala Spark Hadoop
$115k - $184kMastercard
Title and Summary Senior Software Engineer About the Team Commercial & New Payment Flows (CNPF) is Mastercard's global organization dedicated to modernizing commercial payments. Commercial Platform Engineering (CPE) is the engineering backbone of CNPF, delivering shared platform capabilities that power all Commercial products and experiences. The team designs, builds, and maintains core shared services used across Commercial programs. Role As a Senior Software Engineer, you will be responsible for development, deployment support, owning the delivery of user stories, mentoring junior team members, and performing code reviews. The role includes planning, developing, and coordinating design, development, and implementation activities. Responsibilities Design, develop, test, implement, and maintain software applications that align with Mastercard engineering standards and best practices. Deliver secure, reliable, and scalable software solutions within defined timelines and budgets. Research and evaluate alternative technical approaches to meet current and future business needs. Conduct feasibility studies, system flowcharting, and logic design to support solution development. Collaborate with team members and stakeholders to meet project goals, identify issues early, and recommend practical solutions. Qualifications Bachelor's degree in information systems, Information Technology, Computer Science or Engineering is preferred. Strong hands‑on experience in backend development with applicable JAVA technologies (Core JAVA, Spring Integration, Spring Boot, Hibernate, REST/SOAP web services). Proven experience working with Oracle/SQL Databases. Experience and understanding of messaging solutions such as Apache Kafka, Axon, etc. Strong knowledge of automated build, deployment and continuous integration systems. Experience with CI/CD tools like Jenkins, Bitbucket, Artifactory, Atlassian suite. Strong communication, relationship‑building, collaboration, and organizational skills. Proven ability to work cross‑functionally with Technical Leads, Solution Architects, Product Managers, Release Managers, Application Services and Testing Teams to ensure quality delivery. Experience in Test‑Driven Development (TDD) and Behavior‑Driven Development (BDD). Experience in solution design for simplicity, scalability and future agility. Experience in technical design activities to ensure alignment with Non‑Functional Requirements, Solution Architecture and System Functional Design specifications. Experience with all aspects of Scrum Agile for software development activities (daily stand‑up, backlog grooming, sprint planning). Ability to understand user stories and requirements, contribute to proposed solution designs, and translate these into coded features or solutions that are simple, functional, scalable, and maintainable. Experience working in the Financial Services Sector is preferred. Security Responsibility Abide by Mastercard's security policies and practices. Ensure the confidentiality and integrity of the information being accessed. Report any suspected information security violation or breach. Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines. Benefits & Compensation The successful candidate will be offered a competitive base salary and may be eligible for an annual bonus or commissions. Salary ranges for O'Fallon, Missouri: $115,000 - $184,000 USD. Benefits for full‑time employees include: medical, prescription drug, dental, vision, disability, life insurance; flexible spending account and health savings account; paid leaves (16 weeks new parent leave and up to 20 days bereavement leave); 80 hours of Paid Sick and Safe Time, 25 days of vacation time and 5 personal days, prorated; 10 annual paid U.S. observed holidays; 401(k) with company match; deferred compensation for eligible roles; fitness reimbursement or on‑site fitness facilities; tuition reimbursement; and more. Benefits for interns include: 56 hours of Paid Sick and Safe Time; jury duty leave; and on‑site fitness facilities in some locations. Mastercard is a merit‑based, inclusive, equal‑opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disability or veteran status or any other characteristic protected by law. #J-18808-Ljbffr Mastercard
- Veriipro in New York City is seeking a Senior Big Data Engineer with 8+ years of IT experience and hands-on expertise in Hadoop, Spark, Python, and Snowflake. You will design scalable data pipelines, migrate data from Hadoop to Snowflake using PySpark, and develop enterprise...SeniorBig data
- A reputable technology firm is seeking a Scala Developer in New York. The ideal candidate will have over 5 years of hands-on Scala development... ...collaborating with global teams and addressing various big data needs within financial crime control applications. This is a...SeniorBig dataContract work
$131.6k - $244.4k
...thrive. Your New Role: The Senior Software Engineer is accountable for... ...party AdTech partners and data providers. Data Engineering... ...optimization. Work with big data frameworks (Spark, Kafka) to handle large-scale... ...‑on expertise with Java, Scala, or Python. Experience...SeniorBig dataTemporary workLocal area- About the Team The Spark Platform team owns and operates... ...powers the company's data, analytics, and ML... ...About the Role As a Senior Software Engineer on Spark Platform, you... ...Cosco, or similar), batch/big‑data schedulers (... ...Professional experience with Scala, Java, Python, or Go;...SeniorBig dataWork at officeRemote workRelocation
- A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities...SeniorBig data
- A leading financial data company in New York is looking for an experienced engineer to build and manage large-scale distributed systems leveraging Hadoop infrastructure. The ideal candidate has over 4 years of experience in Java, a degree in Computer Science or Engineering...SeniorBig data
- A technology services company is seeking a skilled Hadoop Developer with a minimum of 6-10 years of experience, including at least 2 years... .... Candidates must possess strong technical skills in tools like Spark, HBase, and Hive, plus proficiency in programming languages such...SeniorBig dataPermanent employmentFull time
- ...around you through data solutions. Partner with... ...career. As a Senior Director of Software Engineering at JPMorganChase within... ..., DBX, PySpark, Spark, Cloud Providers: Databricks... ..., Kafka, Python/Scala, Glue/EMR, AI... ...Manager Experience in Big Data technologies handling...SeniorBig dataWork at office
- A prominent IT consulting firm is hiring a Senior Azure Data Engineer to develop data solutions in a hybrid setting. The ideal candidate will have strong skills in Azure Data Engineering, Python/Scala, and SQL, with responsibilities including mentoring junior staff and...SeniorBig dataContract work
$123.7k - $254.67k
Role Description As a Data Engineer at tvScientific, you will be a key player in implementing the robust data infrastructure to power... ...and implement robust data infrastructure in AWS, using Spark with Scala ~Evolve our core data pipelines to efficiently scale for...Big data- Tech Mirrors is seeking a Big Data Engineer in New York, NY for a long-term project. Responsibilities include designing and enhancing ETL frameworks... ...of experience and strong knowledge of UNIX Shell, Python, Spark, and SQL. A positive team player is essential. This is an...SeniorBig data
$185k
...Senior Data Engineer role at Trepp, Inc. Trepp's Data Platform Team is... ...3 years of experience in big data technologies At least... ...development including Python, SQL, Scala, or Java 3+ years of... ...tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark) 2+ years of experience working...SeniorBig dataFull timeTemporary workWork at officeWork from homeMonday to FridayFlexible hours$250.8k - $286.2k
...Senior Lead Data Engineer What You’ll Do: Collaborate with and across Agile... ...programming languages like Java, Scala, Python and Open Source... ...2 years of experience in big data technologies At... ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+...SeniorBig dataFull timePart timeInternshipLocal area- About the job Senior Cloud Data Platform Engineer Senior Cloud Data Platform Engineer needs 5+ years of... ...applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. Locations:... .... 5+ year support experience of Big Data technologies in Hadoop...SeniorBig dataWork at office
- ...Opportunity We are looking for a highly driven Software Engineer to join our Data & Platform Engineering team at LG Ad... ...zones. Preferred Experience with Big Data processing frameworks, specifically Apache Spark (PySpark or Scala‑Spark). Hands‑on experience with...Big dataWork at officeLocal areaRelocation package
- [IT] SOFTWARE ENGINEER - DATA | JUNIOR / MID About the job [IT] SOFTWARE ENGINEER - DATA | JUNIOR / MID... ...systems Previous experience with Java and Scala Previous experience working with big data tools such as Bigtable, Apache Spark, Apache Spark Streaming, Apache Heron,...Big dataWork experience placement
$121.4k - $161.8k
...industry. Rockstar Games is seeking a Senior Software Engineer in Data Engineering to join a team focused on... ...Strong experience with Java (and/or Scala) as well as Python, in backend or data... ...ecosystem. Familiarity with Apache Spark. Familiarity with CI/CD pipelines, automated...SeniorFull timeWork at office- ...career — and we have the perfect software engineering opportunity for you. As a... ...from large, diverse data sets to identify problems and... ...experience in Java, Python, Groovy, Scala, JavaScript, ReactJS Hands on... ...distributed computation systems (HDFS, Spark, Apache Flink, Databricks)...Big data
$106.9k - $176.5k
..., Dallas Overview Senior Consultant - Financial Services - Data & Analytics - Data Architecture and Engineering. Join EY to solve complex... .../warehousing, big data analytics, and... ...processing - Hadoop, Spark ecosystem Integration... ...Python, Java, C++, Scala Traditional RDBMS...SeniorBig dataWork at officeFlexible hours$209k - $238.5k
...you'll be part of a big group of makers, breakers... .... We are seeking Data Engineers who are passionate... ...technologies. As a Capital One Senior Lead Data Engineer,... ...like Java, Scala, Python and Open... ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)...SeniorBig dataInternshipLocal area$200k - $240k
Engineering Manager - Data Platform Responsible for building and scaling the data infrastructure... ...(RDS), Redshift, EMR, Spark Docker, OpenSearch, AWS (... ...Strong background as a senior or staff‑level data engineer... ...environments Experience with big data and streaming...SeniorBig dataRemote workHome officeFlexible hours$164k - $193k
...the role? Etsy’s Data & ML Enablement organizations... ...up a team of engineers who will sit at... ...cases. We work in Scala, Python, Java, and... ...systems built on Spark, Kafka, Airflow,... ...reporting to the Senior Engineering Manager... ...operated. Strong software engineering skills...SeniorFull timeWork at officeLocal areaVisa sponsorshipFlexible hours- Chubb is seeking a Data Solution Engineer to implement big data projects, focusing on managing and visualizing large datasets. This role requires strong... .... The ideal candidate possesses expertise in Azure, Hadoop, and extensive experience with data parsing. A background...SeniorBig data
$60 - $70 per hour
Sciata is looking for a Data Engineer in Atlanta, GA. You will design, implement, and maintain the data pipeline architecture... ..., strong SQL knowledge, and is skilled with big data tools like Hadoop and Spark. This role involves collaboration across teams to optimize...SeniorBig dataHourly pay- Project Description We're looking for a Senior Big Data Developer to join our Data Engineering team in Tel Aviv. You will be a part of our data platform, that is responsible for processing, storing, and serving data for all our core systems. As a Senior Big Data Developer...SeniorBig data
- ...Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Required Skills: Azure Data Engineering... ...Analytics, Azure Arc, DevOps Developing using Python/Scala and SQL Work with “Big Data” Work with RDBMS and NoSQL Use of ETL/ELT...SeniorBig dataContract work
- Vortalsoft Inc is seeking a skilled data engineer to develop and maintain data pipelines for their Big Data financial crime solution. The ideal candidate will... ...Familiarity with AWS and Big Data technologies like Hadoop and Spark is a plus. #J-18808-Ljbffr Vortalsoft IncSeniorBig data
- ...technology company in New Jersey is looking for an experienced Data Engineer to build and maintain scalable data pipelines. Candidates should... ...experience in Python and AWS, with a strong understanding of big data technologies. The role involves collaboration with cross-functional...SeniorBig data
- We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark...SeniorBig data
$250.8k - $286.2k
Capital One National Association is seeking a Senior Lead Data Engineer to develop and support technical solutions within Agile teams. The ideal candidate... ...have substantial experience in application development and big data technologies, including cloud computing and machine...SeniorBig data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer Big Data Scala Spark Hadoop. Be the first to apply!
- ngo software engineer New York, NY
- software developer New York, NY
- software developer internship no experience New York, NY
- software developer apprenticeship New York, NY
- junior software developer New York, NY
- part time software developer remote New York, NY
- financial software developer New York, NY
- senior software engineer ruby on rails New York, NY
- software engineer amazon New York, NY
- senior software design engineer New York, NY


