Data Engineer

Data EngineerGenesis10 is currently seeking a Data Engineer for a contract position with a Global Financial Institution located in Jersey City, NJ. This is a 12+ month contract opportunity.This role is heavily focused on building and expanding the organization's Apache Spark ecosystem as they migrate a large-scale data platform from Vertica to Databricks. The team processes enormous volumes of data and is modernizing its ingestion and analytics architecture within AWS. The ideal candidate will have strong large-scale Data Engineering experience and deep expertise with Apache Spark and Databricks.Responsibilities:Design, build, and optimize large-scale data pipelinesLead and support the migration of approximately 100TB of data from Vertica to DatabricksExpand Apache Spark capabilities across multiple enterprise systemsImprove data ingestion, transformation, and processing frameworksPartner with development teams to enhance data flow and pipeline performanceImplement scalable solutions leveraging Databricks, Spark, Kafka, and AWS technologiesBuild modern data architectures that improve performance, maintainability, and scalabilitySupport the evolution of Kafka-based data processing by leveraging Spark for advanced transformation and analytics workloadsRequirements:Strong Apache Spark expertise (most important skill)Databricks experienceLarge-scale Data Engineering backgroundPython and/or Java development experienceStrong Object-Oriented Programming fundamentalsSQL expertiseExperience building enterprise data pipelinesAWS environment experienceDesired skills:Apache IcebergParquetKafkaVertica migration experienceFinancial services or highly regulated environmentsExperience supporting large-scale data modernization initiativesPay range: $88.59 - $96.59 per hourOnly candidates available and ready to work directly as Genesis10 employees will be considered for this position.If you have the described qualifications and are interested in this exciting opportunity, please apply!