Scala/Spark Developer - Big Data
Infinite Computer Solutions
Role: Scala/Spark Developer Big Data
Location: Whippany, Nj
Domain: Banking / Trading Financial Services
Job Description:
- Design and develop scalable data-processing applications using Scala and Apache Spark .
- Build, maintain, and optimize large-scale data/ETL pipelines.
- Work extensively with Hadoop ecosystem technologies, including Hive and Impala.
- Develop complex SQL queries and data transformations.
- Use Python for data processing, scripting, and automation.
- Analyze performance bottlenecks and optimize Spark jobs for scalability and performance.
- Perform data validation, troubleshooting, and production support.
- Work with large volumes of structured and semi-structured financial data.
- Collaborate with architects, analysts, and business teams to implement data solutions.
Required Skills: Spark, Scala, Hadoop (Hive/Impala), SQL, Python.
Nice to Have: Kafka, Airflow, Cloud platforms, CI/CD, Data Lake technologies.
Preferred: Banking/Financial Services experience, particularly Trading, Capital Markets, Tax, Risk, or Regulatory data .
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Scala/Spark Developer - Big Data in Whippany, NJ vacancy
- ...based in Parsippany-Troy Hills, NJ, is seeking a qualified Java Developer with expertise in Hadoop and a strong understanding of SQL and... ...Hive, Impala, and Pig, with an additional focus on Python and SPARK as advantages. This is a fantastic opportunity to work with cutting...Big data
- ...teams in the design and implementation of solutions using Apache Spark, Scala, and Python. Provide technical expertise and guidance to team... ...tuning and optimization techniques Knowledge of big data concepts and tools is a plus Certifications: Relevant certifications...Big data
Omni Inclusive
Whippany, NJ5 days ago - ...able to write complex SQL queries to extract and analyze data) Has a thorough understanding of the technology behind... ..., such as AWS, Azure, or Google Cloud Platform, is a plus. Experience with big data technologies, such as Apache Spark, Hadoop, or Hive, is a plus....Big dataContract workImmediate start
Damco
Morris Plains, NJ2 days ago - Barclays seeks a Sr ETL Developer, AVP in Whippany, NJ to design, develop and operate a data lake platform using Python, Spark, Hadoop, Sqoop, Hive and SQL. You will create AbInitio Graph... .... The role requires extensive AbInitio, big data and ETL experience, with the...Big dataRemote job
- .... Be it core Java, full-stack Java, Web/UI designers, Big Data or Cloud or Mobility developers/architects, we have them all. Job Description 6+ Year... ...2+ Year experience in Pig 1+ year in python Having SPARK experience is a plus Amazon EMR experience is a plus...Big data
- Barclays in Whippany, NJ is seeking a Lead Big Data Engineer - VP to design, build, and scale core data platform capabilities for risk... ...and Risk functions. The role requires deep expertise in Java, Scala, Spark, S3, Hadoop, and cloud platforms, plus hands-on programming in...Big data
$100.92k
...(1) year of experience in quantitative data analysis and supply chain Minimum Education... ...equipment lifecycle performance. # Develop asset damage mechanisms and corrosion... ...management, statistical inference, R, big data, SQL, Spark, Hadoop MapReduce, relational database,...Big dataFull timeFormosa Plastics Corporation, U.S.A.
Livingston, NJ3 days ago- ...holder. Our client has an opening for Scala Developer 66129 This position is up to 12... ...send rate and resume. The Senior Data Engineer will serve as the primary technical... ...is developed using Scala, Apache Spark, Hive, and Drools and operates on the Cloudera...Remote work
FHR
Newark, NJ1 day ago $153k - $204k
...About the role:As a Senior Data Engineer you will own... ...Apache Airflow, Apache Spark, Apache Superset) and ETL... ...role, you will:Design, develop, and maintain robust and... ...such as Python, Java, or Scala.Hands-on experience with... ...g., Apache Airflow) and big data technologies (e.g.,...Big dataPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$194.6k - $312.4k
...making at Novartis by leveraging superior data to identify actionable insights that drive... ...in programming languages such as Python, Spark, TensorFlow, and PyTorch ~ Experience... ...(AI), Aws (Amazon Web Services), Big Data, Building Construction, Cloud Computing...Big dataRemote workRelocation packageNovartis Group Companies
East Hanover, NJ1 day ago$99k - $232k
...& SummaryAt PwC, our people in data and analytics engineering focus... ...technologies and techniques to design and develop robust data solutions for... ...such as Python, Java, or Scala- Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus- Experience...Big dataFull timeH1b$189.59k
...Sr. Developer, AVP To design, develop and improve software, utilizing... ..., protect sensitive data, and ensure secure software solutions... ...ETL processes utilizing Oracle Big Data SQL to fetch data from HDFS... ..., Parquet, Avro, and Apache Spark. Perform Proof Of Concepts...Big dataHourly payTemporary workRemote workBarclays
Whippany, NJ4 days ago- ...speaking BI experts to provide expertise in Business Intelligence across various sectors. The position requires strong skills in Big Data, Data Warehousing, and Reporting. Successful candidates will be deployed in Seoul, Korea, during the initial project discovery phase...Big data
- ...Job Description Looking for data engineers with 9+ years of experience. 1. Experience developing and deploying application code using SQL, Python, spark. 2. 3 to 5 years’ experience developing... .... 6. Developer experience in big data or warehouse (Hadoop, DB2 LUW...Big data
Cedent
Newark, NJ5 days ago - ...AWS Data Engineer Data Engineer Job Description for Data Journey USBIE ~ Experience developing and deploying application code using SQL, Python, spark. ~3-5 years' experience developing and deploying... ...~ Developer experience in big data or warehouse (Hadoop,...Big data
Damco
Newark, NJ2 days ago - ...7 plus years of experience in data engineering, with at least 3 years... ..., Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway... ...with Shell scripting and Scala is a plus. Strong experience designing... ...processes, data modeling, and big data frameworks. Demonstrated...Big data
- Zoetis in Parsippany, NJ is seeking a Data Engineer to develop advanced analytics-enabled data capabilities supporting the US Petcare sales strategy... ...quality, SOX compliance, Azure deployments, and cloud-based big data tooling. Remote work flexibility is noted with base in...Big dataRemote job
- ...speaking BI experts First 6-9 months of the project discovery phase to be deployed in Seoul, Korea Need strong BI experts in any area- Big data, DW, reporting. Qualifications Need strong BI experts in any area- Big data, DW, reporting. Additional Information All your...Big data
- ...Position: data engineer Client: Charles schwab Location: Lone Tree, CO Onsite :4 days a week Interview process:... ...financial services is desirable but not required • No requirement for PySpark / Spark or specialized big-data tooling for this short-term roleBig dataContract workTemporary workFor contractors
RIT Solutions, Inc.
Summit, NJ4 days ago - ...SQL Server Database Developer Location: Iselin NJ (3 days/week) Interview process... ...and administration experience with Big Data or Hadoop tools such as Spark, Hive, Kafka and Map 2+ years of... ...and development experience using Scala, Java, Python or Data Frames with Resilient...Big dataPermanent employmentContract work3 days per week
RIT Solutions
Summit, NJ2 days ago $105k - $151k
Data Engineer job at Zoetis. Parsippany, NJ. Location... ...Responsibilities Design, develop, test and implement... ...Sales Force, Python and Big Data technologies. Develop... ...programming language (Python, Scala, Java) Experience in... ...and analytics (Hadoop, Spark) Familiarity with predictive...Big dataFull timeLocal areaRemote work- ...Role: Data Modeler Location: Berkeley Heights... ...Kafka, Flink, MongoDB, Spark Data Modeler Role... ...We are seeking a Big Data Modeler to design... ...Partner with software developers, data scientists, and business... ...in Python, Java, or Scala. Modeling Tools: Familiarity...Big dataFlexible hours
Saransh Inc
Berkeley Heights, NJ1 day ago $109.49k - $118k
...while leveraging both internal and external data sources; along with frequent interaction... ...rules, sentiment analysis and topic modeling. Develops new Dashboards and Self-Serve capabilities... ...Management. Drives initiatives focused on Big Data and Advanced Business Analytics, in...Big dataFull timeRemote workZoetis
Parsippany, NJ1 day ago$189.59k
Drive best-in-class data engineering by designing, building, and maintaining cloud native big data solutions. Lead a team of data engineers and managers, as well as drive solutions as a principal data engineer. Collaborate with stakeholders to assess their needs and find...Big dataFull timeWork at office- ...Role: Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+... ...projects. Your expertise in Java, Python, Spark cluster management, data science, big data... ...Responsibilities: - Design, develop, and implement scalable data pipelines and...Big data
Zortech Solutions
Newark, NJ1 day ago - ...AWS Lead Data Engineer Interview Process: at least... ...from a Data Engineer/Developer into a Lead role. Although... ..., S3, Lambda, EMR/Spark, Kinesis, Athena, RDS,... ...with Shell scripting and Scala is a plus. Strong... ...processes, data modeling, and big data frameworks....Big dataWork at office3 days per week
Anveta
Newark, NJ2 days ago $99k - $232k
...Description & SummaryAt PwC, our people in data and analytics focus on leveraging data to... ...Enhancing your leadership style, you motivate, develop and inspire others to deliver quality. You... ...warehousing concepts- Familiarity with big data engineering tools- Proficiency in SQL...Big dataFull timeH1b$144.6k - $265.1k
...innovative and emergent technologies, including cloud computing, big data and analytics, process automation, artificial intelligence /... ...****@*****.***. Recruiting tips From developing a stand out resume to putting your best foot forward in the interview...Big dataWork at office$151.8k - $265.6k
...innovative and emergent technologies, including cloud computing, big data and analytics, process automation, artificial intelligence /... ...****@*****.***. Recruiting tips From developing a stand out resume to putting your best foot forward in the interview...Big dataWork at office- ...environment in Newark, NJ. Data Engineers (AWS) Job... ...be responsible for designing, developing, and maintaining scalable data... ..., Redshift, S3, Lambda, EMR/Spark, Kinesis, and SQS.... ...of ETL/ELT, data modeling, and big data technologies. Familiarity...Big dataHourly payContract work
JSR Tech Consulting
Newark, NJ2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Scala/Spark Developer - Big Data. Be the first to apply!
