Scala Sparks Developer

Overview:




TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions to our clients world-wide. Our client is a global professional services firm specializing in digital transformation, business process management (BPM), analytics, and AI-driven solutions. The company partners with organizations to improve efficiency, transform operations, and drive business outcomes through a combination of process expertise, technology, and data insight.

Job Title: Scala Sparks Developer

Location: Newyork City, NY 10175
Duration: 6 months
Job Type: Temporary Assignment
Work Type: Hybrid

Job Summary:

Key Responsibilities

• Develop, test, and maintain scalable data processing pipelines using Scala and Apache Spark.
• Implement data transformation and ETL workflows to handle structured and unstructured data.
• Utilize Python for data processing, scripting, and integrating Spark workflows.
• Optimize performance of Spark applications through tuning, partitioning, and caching strategies.
• Participate in code reviews, design discussions, and ensure adherence to best practices.
• Document workflows, architecture, and solutions for internal knowledge sharing.

Required Qualifications

• Strong experience in Scala and Apache Spark (Spark Core, Spark SQL, DataFrames, RDDs).
• Proficiency in Python for data manipulation, scripting, and automation.
• Proven experience with distributed computing concepts and large-scale data processing.
• Knowledge of ETL development, data warehousing, and data modeling techniques.
• Familiarity with Big Data ecosystems such as Hadoop, Hive, Kafka, or HBase is a plus.
• Excellent communication and collaboration skills.

Preferred Qualifications

• Experience with cloud platforms such as AWS, GCP, or Azure (particularly with Spark services).
• Familiarity with streaming data processing using Spark Streaming or Structured Streaming.
• Knowledge of data governance, security, and compliance practices.
• Basic understanding of machine learning workflows is advantageous.

TekWissen Group is an equal opportunity employer supporting workforce diversity.

a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }