Sr. Software Engineer

Job Title: Sr. Software Engineer

Job ID: 2024-12766

Job Location: Morris Plains, NJ (Preferred), Austin TX, St. Louis MO, or Tampa FL

Job Travel Location(s):

# Positions: 1

Employment Type: W2

Duration: Long Term

# of Layers:0

Work Eligibility:All Work Authorizations are Permitted – No Visa Transfers

Key Technology:Java, Spark, Delta Lake, Spring Boot, Jenkins, Kafka

Job Responsibilities:

Design and implement highly efficient Spark applications in Java, focusing on performance optimization, including tuning Spark jobs, optimizing transformation, and leveraging advanced Spark features for batch and real-time processing.

Responsible for developing data pipelines using Apache Spark (Big Data Processing)

Responsible for analyzing performance concerns and issues. Identifying the bottlenecks that require changes to improve performance.

Utilize in-depth knowledge of functional and technical expertise in Java/J2EE Micro-services (Spring Boot) and Big Data in delivering solutions.

Responsible for configuring the applications for DevOps using Jenkins and GIT and build pipeline using Jenkins.

Deploy the applications to the cloud environment using various cloud services and maintaining the application in Open Shift and AWS

Responsible for developing Staging Layer using Delta Lake for the Ingestion Framework.

Implement and manage data publishing and consumption using Kafka.

Implement solutions to transform and serialize datasets into JSON messages using Spark SQL

Skills and Experience Required:

• 10+ years of relevant experience in Java software development
• Must have experience with Java, Apache Spark, Spring Boot
• Experience with Drools and Maven
• Experience with SQL: Spark SQL, MySQL
• Experience with Delta Lake
• Experience with Kafka and Jenkins
• Experience with Docker and Kubernetes
• Possess an understanding of RESTful web services and API development