Scala/Spark Developer - Big Data
Infinite Computer Solutions
Role: Scala/Spark Developer Big Data
Location: Whippany, Nj
Domain: Banking / Trading Financial Services
Job Description:
- Design and develop scalable data-processing applications using Scala and Apache Spark .
- Build, maintain, and optimize large-scale data/ETL pipelines.
- Work extensively with Hadoop ecosystem technologies, including Hive and Impala.
- Develop complex SQL queries and data transformations.
- Use Python for data processing, scripting, and automation.
- Analyze performance bottlenecks and optimize Spark jobs for scalability and performance.
- Perform data validation, troubleshooting, and production support.
- Work with large volumes of structured and semi-structured financial data.
- Collaborate with architects, analysts, and business teams to implement data solutions.
Required Skills: Spark, Scala, Hadoop (Hive/Impala), SQL, Python.
Nice to Have: Kafka, Airflow, Cloud platforms, CI/CD, Data Lake technologies.
Preferred: Banking/Financial Services experience, particularly Trading, Capital Markets, Tax, Risk, or Regulatory data .
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Scala/Spark Developer - Big Data in Whippany, NJ vacancy
- ...based in Parsippany-Troy Hills, NJ, is seeking a qualified Java Developer with expertise in Hadoop and a strong understanding of SQL and... ...Hive, Impala, and Pig, with an additional focus on Python and SPARK as advantages. This is a fantastic opportunity to work with cutting...Big data
- Barclays seeks a Sr ETL Developer, AVP in Whippany, NJ to design, develop and operate a data lake platform using Python, Spark, Hadoop, Sqoop, Hive and SQL. You will create AbInitio Graph... .... The role requires extensive AbInitio, big data and ETL experience, with the...Big dataRemote job
- ...help you in the role:Understanding of the financial markets and environment; willingness andcapacity to learn complex financial and risk management concepts.Experience in Linux, Python, JavaExperience in building Big Data Analytic Reporting technologies– HDFS, Spark...Big data
Omni Inclusive
Whippany, NJ3 days ago - ...GCP Data ArchitectThe Technical Architect influences the development and implementation... ...both distributed architectures, ETL, EDW and Big Data technologies8+ years of development... ...Cloud, Google Cloud, hadoop, HDFS, mapr and spark.Strong Python Development and cloud run...Big data
JConnect Infotech
Parsippany, NJ3 days ago - .... Be it core Java, full-stack Java, Web/UI designers, Big Data or Cloud or Mobility developers/architects, we have them all. Job Description 6+ Year... ...2+ Year experience in Pig 1+ year in python Having SPARK experience is a plus Amazon EMR experience is a plus...Big data
- Barclays in Whippany, NJ is seeking a Lead Big Data Engineer - VP to design, build, and scale core data platform capabilities for risk... ...and Risk functions. The role requires deep expertise in Java, Scala, Spark, S3, Hadoop, and cloud platforms, plus hands-on programming in...Big data
- ...Google Cloud Data EngineerAre you ready to step up to the New and take your... ...in combination with 3rd parties - Spark, Cloud DataProc, Cloud Dataflow, Apache... ...to consumption within a hybrid big data architecture, using Java, Python, Scala etc.Minimum 1 year of architecting...Big dataWork experience placement
ClifyX
Florham Park, NJ3 days ago $99k - $232k
...& SummaryAt PwC, our people in data and analytics engineering focus... ...technologies and techniques to design and develop robust data solutions for... ...such as Python, Java, or Scala- Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus- Experience...Big dataFull timeH1b$153k - $204k
...About the role:As a Senior Data Engineer you will own... ...Apache Airflow, Apache Spark, Apache Superset) and ETL... ...role, you will:Design, develop, and maintain robust and... ...such as Python, Java, or Scala.Hands-on experience with... ...g., Apache Airflow) and big data technologies (e.g.,...Big dataPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- ...speaking BI experts First 6-9 months of the project discovery phase to be deployed in Seoul, Korea Need strong BI experts in any area- Big data, DW, reporting. Qualifications Need strong BI experts in any area- Big data, DW, reporting. Additional Information All your...Big data
Avance Consulting
Livingston, NJ2 days ago - ...speaking BI experts to provide expertise in Business Intelligence across various sectors. The position requires strong skills in Big Data, Data Warehousing, and Reporting. Successful candidates will be deployed in Seoul, Korea, during the initial project discovery phase...Big data
Avance Consulting Services
Livingston, NJ13 hours ago - ...AWS Data EngineerLocation: Chandler, AZ Onsite: 3 days a week Interview... ...datazone, databricks, glue or spark, python, data warehousing, CI/... ...like Python, Terraform, Scala or Java for data processingExperience... ...Architect)Experience with big data technologies like Hadoop,...Big dataContract work3 days per week
RIT Solutions
Summit, NJ3 days ago - ...AWS Lead Data EngineerWe are seeking an experienced... ...lakes and data warehouses.Develop and enforce standards for... ..., S3, Lambda, EMR or Spark, Kinesis, Athena, RDS, API... ...with Shell scripting and Scala is a plus.Strong... ...processes, data modeling, and big data frameworks.Demonstrated...Big dataFor subcontractorWork at office
Omni Inclusive
Newark, NJ3 days ago - ...analytical, insatiably curious, fearless in tackling big problems, and can demonstrate excellence in... ..., CUDA, OpenACC, MPI Experience with big data and distributed computing technologies such as Hadoop, MapReduce, Spark, Storm, etc. Demonstrable proficiency in more...Big data
GrabJobs
Newark, NJ8 hours ago - ...an experienced AWS Lead Data Engineer to join our Data... ...and data warehouses. Develop and enforce standards for... ...Redshift, S3, Lambda, EMR or Spark, Kinesis, Athena, RDS,... ...Shell scripting and Scala is a plus. Strong experience... ..., data modeling, and big data frameworks. Demonstrated...Big dataFor subcontractorWork at officeShift work
TechDigital Group
Newark, NJ2 days ago - ...Data Engineer PositionLooking for data engineers with 9+ years of experience. Experience developing and deploying application code using SQL, Python, spark. 3 to 5 years' experience developing and deploying data... .... Developer experience in big data or warehouse (Hadoop,...Big data
Cedent Life Talent
Newark, NJ3 days ago - ...Data EngineerClient: Charles SchwabLocation: Lone Tree, COOnsite: 4 days a weekInterview process: 2 video interviews to hireContract... ...in financial services is desirable but not requiredNo requirement for PySpark / Spark or specialized big?data tooling for this short?term role...Big dataTemporary workFor contractors
RIT Solutions
Summit, NJ3 days ago - ...7 plus years of experience in data engineering, with at least 3 years... ..., Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway... ...with Shell scripting and Scala is a plus. Strong experience designing... ...processes, data modeling, and big data frameworks. Demonstrated...Big data
- Zoetis in Parsippany, NJ is seeking a Data Engineer to develop advanced analytics-enabled data capabilities supporting the US Petcare sales strategy... ...quality, SOX compliance, Azure deployments, and cloud-based big data tooling. Remote work flexibility is noted with base in...Big dataRemote job
$60 - $65 per hour
...Job Title: AWS Lead Data Engineer Company: MSC GLOBAL Location: Newark... ..., Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway... ...with Shell scripting and Scala is a plus. Strong experience designing... ...processes, data modeling, and big data frameworks. Experience...Big dataContract workH1bWork at officeLocal areaSocket
Newark, NJ2 days ago- ...building and supporting enterprise-scale data platforms on AWS - Strong hands-on... ..., Redshift, Lambda. - Experience developing and orchestrating data pipelines... ...data processing approaches (e.g., Spark/EMR) Understanding of data modeling, big data concepts, and cloud-native...Big data
Insight Global
Newark, NJ2 days ago - ...Senior Big Data EngineerLocation: New Jersey (hybrid)Duration: 6+ MonthsWe are seeking a highly... .... Your expertise in Java, Python, Spark cluster management, data science, big data... ...data initiatives.Responsibilities:Design, develop, and implement scalable data pipelines and...Big data
Zortech Solutions
Newark, NJ3 days ago $105k - $151k
Data Engineer job at Zoetis. Parsippany, NJ. Location... ...Responsibilities Design, develop, test and implement... ...Sales Force, Python and Big Data technologies. Develop... ...programming language (Python, Scala, Java) Experience in... ...and analytics (Hadoop, Spark) Familiarity with predictive...Big dataFull timeLocal areaRemote work$189.59k
Drive best-in-class data engineering by designing, building, and maintaining cloud native big data solutions. Lead a team of data engineers and managers, as well as drive solutions as a principal data engineer. Collaborate with stakeholders to assess their needs and find...Big dataFull timeWork at office- ...business, you will shape the future of the big data landscape by working with the most... ...and the broader customer-facing team to develop architectures and solutions using our platform... ...Databricks inspired open-source projects (Spark, Delta Lake, and MLflow) across the developer...Big dataRemote work
GrabJobs
Newark, NJ4 days ago - ...Microsoft Fabric Data EngineerNewark, New Jersey, United StatesData... ...ETL (Extract, Transform, Load)Develop and implement data integration... ...data warehouses or data lakes.Big Data and AnalyticsUtilize big... ...technologies such as Apache Spark. Create data processing workflows...Big data
5 Star Global Recruitment Partners
Newark, NJ3 days ago $99k - $232k
...Description & SummaryAt PwC, our people in data and analytics focus on leveraging data to... ...Enhancing your leadership style, you motivate, develop and inspire others to deliver quality. You... ...warehousing concepts- Familiarity with big data engineering tools- Proficiency in SQL...Big dataFull timeH1b- ...Microsoft Fabric Data EngineerNewark, New Jersey, United StatesAbout... ..., ETL/ELT processes, and big data technologies. You will be... ...Analytics, and Azure SQL Database.Develop Data Pipelines: Build,... ...Azure Data Factory and Apache Spark (PySpark) to integrate data from...Big dataFull timeLocal area
Fortis Hayes
Newark, NJ3 days ago $119k - $218.3k
...innovative and emergent technologies, including cloud computing, big data and analytics, process automation, artificial intelligence /... ...****@*****.***. Recruiting tips From developing a stand out resume to putting your best foot forward in the interview...Big dataWork at office$151.8k - $265.6k
...innovative and emergent technologies, including cloud computing, big data and analytics, process automation, artificial intelligence /... ...****@*****.***. Recruiting tips From developing a stand out resume to putting your best foot forward in the interview...Big dataWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Scala/Spark Developer - Big Data. Be the first to apply!
