Python Data Engineer

Python Data Engineer

Skills Required: (Python, Spark, Pyspark, AWS, SQL), Location - Columbus, OH and Jersey City, NJ (USC, GC)

Python/Spark/PySpark/AWS - Columbus, OH & Jersey City, NJ for this role

Note- 3-5 years will also work for 602 if they have good clientele. Need- (Python, Pyspark, Databricks and AWS 4 skills required primarily)

1 lead in each location (OH & NJ), then 3 Pyspark devs in each location (OH, NJ) (Lead 7-10 years, devs 3-5+ years enterprise experience)

The leads must be strong in both Java & Pyspark (Python + Spark) – 70% Pyspark – 30% Java

Other 3 resources need to be strong in Python/Spark/Pyspark

Should be strong in SQL

Will be creating a pipeline and writing in Pyspark – Migrating from legacy platform to new platform

This is an AWS Migration project – MUST BE STRONG IN AWS. Databricks is a plus, if it's on the resume they MUST be able to speak to it

Should have Datalake Experience

Skills:

• 5+ years applied experience; bachelor's degree required Python Programming.
• Strong skills around object-oriented analysis and design (OOAD), data structures, algorithms, design patterns. Hands-on practical experience in system design, application development, testing, and operational stability.
• Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security.
• Proficient in coding in Python, PySpark, Java 17/21, Spring Boot, and SQL Databases,
• Prior hands-on experience in Cloud technologies - AWS, AZURE etc.