Senior Spark Developer (Python/Scala) - Q125

Overview:

R2 Technologies Corporation (R2) , headquartered in Alpharetta, GA, is a leading IT services provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP, Azure), Artificial Intelligence (AI), Machine Learning (ML), software development, project management, SAP, and enterprise resource planning (ERP). We empower clients-from startups to Fortune 1000 companies-with scalable, platform-based solutions and data-driven insights using modern cloud technologies. Our commitment to blending highly skilled talent with innovative productivity platforms ensures rapid delivery of business value, making us one of the most respected and trusted technology companies in the United States. At R2, we're passionate about driving operational excellence and competitive advantage for our clients through cutting-edge AI, ML, and cloud solutions. Join our team and help shape the future of technology innovation!

Senior Spark Developer (Python/Scala)

Location: Alpharetta, GA (willing to travel to client locations)

Employment Type: Full-Time (W2)

Role Overview

We are seeking an experienced Senior Spark Developer to build and optimize data pipelines using Apache Spark with Python or Scala. This role focuses on developing ETL processes for distributed clusters to support large-scale data processing.

Key Responsibilities

• Develop and optimize data pipelines using Apache Spark with Python or Scala for distributed processing.
• Implement ETL workflows to extract, transform, and load data in large-scale cluster environments.
• Tune Spark jobs for performance and scalability on distributed clusters to handle big data workloads.
• Collaborate with data engineers to integrate Spark pipelines into broader data ecosystems.
• Monitor and troubleshoot Spark applications to ensure reliability and efficiency in production.
• Automate data workflows to streamline processing and delivery of insights.

Required Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or a related field (or equivalent experience).
• 3 years of experience as a Spark Developer with a focus on Python or Scala programming.
• Proficiency in building ETL pipelines using Spark for distributed data processing.
• Experience with cluster management and optimization for large-scale Spark jobs.
• Strong understanding of distributed systems and big data processing frameworks.

Preferred Qualifications

• Familiarity with cloud-based Spark deployments on AWS EMR, Databricks, or GCP Dataproc.
• Exposure to advanced Spark features like Spark SQL or MLlib for analytics and machine learning.
• Knowledge of orchestration tools like Airflow for managing Spark workflows.

Compensation & Benefits

• Competitive salary and comprehensive benefits package (healthcare, PTO, 401k).
• Opportunities for professional growth and upskilling in AI and cloud technologies.

R2 Technologies Corporation is an equal opportunity employer and values diversity in the workplace.

Skills:

Spark, Python, Scala, ETL, Data Pipeline, Cluster, Distributed