Scala Developer

Job Description:


Job Description


We are looking for an experienced Scala Developer with strong hands-on experience in Scala, Java, and Hadoop ecosystem technologies . The ideal candidate will be responsible for designing, developing, and maintaining scalable data processing applications and distributed data solutions.


Key Responsibilities

• Design, develop, and maintain scalable applications using Scala and Java .
• Develop high-performance data processing solutions using the Hadoop ecosystem .
• Work with distributed data processing frameworks such as Apache Spark .
• Develop and optimize Scala/Spark applications for large-scale data processing.
• Build data pipelines and ETL processes using Hadoop technologies.
• Work with HDFS, Hive, YARN, MapReduce , and related Hadoop components.
• Integrate data from multiple structured and unstructured sources.
• Analyze and optimize application performance, memory utilization, and processing efficiency.
• Develop reusable, maintainable, and high-quality code following coding standards and best practices.
• Troubleshoot production issues and provide root-cause analysis and resolution.
• Collaborate with data engineers, architects, analysts, and other development teams.
• Participate in code reviews, unit testing, deployment, and production support activities.
• Work in an Agile development environment and participate in sprint planning, stand-ups, and retrospectives.

Required Skills

• 5+ years of experience in software/data engineering.
• Strong hands-on experience with Scala .
• Strong experience with Java/J2EE .
• Strong experience with Hadoop and distributed computing environments.
• Hands-on experience with Apache Spark , preferably using Scala.
• Experience with HDFS, Hive, YARN, MapReduce , and Hadoop ecosystem components.
• Strong understanding of SQL and relational databases.
• Experience developing ETL/data processing pipelines .
• Good understanding of distributed systems, data structures, and algorithms.
• Experience with Git and CI/CD practices.
• Strong troubleshooting, analytical, and problem-solving skills.

Preferred Skills

• Experience with Kafka or other messaging technologies.
• Experience with AWS, Azure, or GCP cloud platforms.
• Experience with NoSQL databases such as Cassandra or MongoDB.
• Knowledge of Docker/Kubernetes .
• Experience with Airflow or other workflow orchestration tools.
• Experience working in large-scale enterprise data environments.

Experience with Agile/Scrum methodol