Senior Data Engineer / Data Architect - Jersey City, NJ (Hybrid)

Senior Data Engineer / Data Architect
Location: Jersey City, NJ (Hybrid)
Duration: 12+ Months Contract

Description:
• Enterprise Finance Technology GWD Technology team is working on and implementing innovative solutions to improve forecasting processes and support operational excellence.
• This role will be responsible for working closely with the technical leads and Product Owners to deliver support data, analytics and reporting functionalities in the GWD platform.
• This right candidate will be responsible for hands-on application development to support the current and target process across the SDLC - design, build, test, deploy support.

Technical Expertise:
• Significant 10-12 years of experience in Oracle SQL programming and development
• Deep understanding of PySpark development principles, including RDDs, DataFrames, transformations, and actions, with ability to write optimized, scalable Spark jobs.
• Strong grasp of object-oriented programming concepts and how they apply within PySpark for modular, reusable, and maintainable code.
• Experience designing and implementing data pipelines using PySpark and related big data tools, ensuring efficient ingestion, processing, and delivery of large datasets.
• Hands-on knowledge of Hadoop ecosystem components (HDFS, YARN) and Hive for distributed data storage and query optimization.
• Experience in deep data analysis, triaging, identifying data gaps, patterns, and behaviors to support enhancements and user requests.
• Experience working with large data sets (~100 million records) and optimizing performance for scalability.
• Ensure data integrity, security, and performance in modernized database environments.
• Ability to troubleshoot and optimize Spark jobs for performance, including partitioning strategies, coaching, and understanding of Spark execution plans.
• Ability to lead migration of legacy database modules over to big-data stack

Soft Skills:
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Leadership and team collaboration skills.

Qualifications:
• Bachelor's or master's degree in computer science, Information Technology, or a related field.
• Extensive experience (minimum 8-10 years) in data architecture, database design, or data engineering roles, with a focus on big data.
• Experience working with large-scale data projects, preferably within the financial services industry.