Java/Spark Engineer

Java/Spark Engineer

Mode: 5 days/Month onsite in Durham, NC, Rest days Remote

Interview: 1 round

What does team do:

UAP would be the next generation platform to manage acquisition as a service through low code and config driven architecture. UAP will also provide:

• Configuration driven feed acquisition
• Configuration driven transformation of vendor data into canonical format
• Capability to compare data across vendors and generate gap reports
• Registry to maintain feed metadata
• Lineage to track usage
• Configuration driven distribution

As part of UAP (Unified Acquisition Platform) team you will be working on enhancing the next generation in-house acquisition platform using cloud technologies. UAP will be built using Java Spark and Python programming language and use AWS EMR as the infrastructure for execution. You would be developing lambda, Spark, Python utilities for managing end to end feed flow. As part of UAP we will focus on building tools and capabilities to accelerate acquisition, compare data across vendors, externalize rules for data conversion, build inventory/registry of feeds and track lineage.

Top Skills:

• 6+ years of Java Spark development experience