Hadoop Developer

Senior DeveloperLocation: Charlotte, NCFull Time – PermanentJob DescriptionMust Have Technical/Functional SkillsPrimary Skill: Data Engineering, Platform Engineering or architecture roles. Deep Expertise in Pyspark.Roles & ResponsibilitiesBachelor’s or master’s degree in computer science or related field.Deep Expertise in PySpark, including performance tuning and optimizationStrong python development experience in large-scale distributed environmentSolid knowledge of Hadoop ecosystem (HDFS,Hive/Impala, YARN)Proven experience designing and governing enterprise, regulatory facing data platforms.Expertise in designing data lakes, ELT/ETL pipelines, batch and real time data processing solutionProficiency in programming languages such as Java, Scala and SQLStrong understanding of non-functional requirements and production support modelsClear written and verbal communication skills with ability to influence across organizationsPreferred Skills / ExperienceFinancial services experience, particularly in Market Surveillance, AML, Fraud, Or Risk TechnologyExperience supporting regulatory or audit facing platformsKafka and Spark Structured streaming exposureFamiliarity with Orchestration tools(Airflow,Control-M,Oozie)Knowledge of data governance, lineage, and data quality controlsDaily Responsibilities/PrioritiesEnterprise & Surveillance ArchitectureDefine target state architecture and strategic roadmap for surveillance data processing platforms leveraging Hadoop,Spark, Pyspark and PythonEstablish standard architectural patterns for alert generation, enrichment, aggregation and reporting pipelines.Ensure architecture aligns with enterprise technology standards and Surveillance control expectationSolution Design and Delivery SupportTranslate surveillance business requirements(e.g, market misconduct detection, regulatory coverage) into scalable technical designsReview and approve detailed technical designs, ensuring alignment with functional intent, regulatory requirements, and architectural standards.