Hadoop Developer

Title: Hadoop Developer
Location: Charlotte, NC
Duration: Full Time
Client: Banking
Salary: $95,000-$115,000 a year
USC, GC, GC EAD
Video Interviews
Experience required: - 10-15 years of experience




JOB DESCRIPTION:
Must Have Technical/Functional Skills




Required Technical Skills




· Strong experience with the Hadoop ecosystem:
o HDFS
o Hive
o Spark
o Ozone




· Hive Metastore management and table/partition maintenance.
· Hadoop data lifecycle management.
· Data ingestion, ETL processes, and data validation.
· Shell scripting and Python automation.
· Cloudera Data Platform (CDP) or similar Hadoop distributions.
· Strong SQL and data analysis skills.




Experience: Minimum10 years




Roles & Responsibilities




· Monitor and resolve HDFS and Ozone related issues.
· Investigate cluster performance, storage utilization, and capacity concerns.
· Manage quota requests, storage allocation, and capacity planning.
· Support platform maintenance and perform integration activities.
· Coordinate with application teams during incident and problem management.
· Create and maintain operational documentation, runbooks, and knowledge articles.




Desired / Preferred Skills 
· Experience supporting large-scale Hadoop environments with multi-petabyte storage. 
· Knowledge of distributed storage architecture and data replication. 
· Capacity management, storage forecasting, and quota governance. 
· Platform onboarding, integration, and decommissioning. 
· Familiarity with cloud platforms (Azure, AWS, or GCP). 
· Experience with monitoring tools such as Cloudera Manager, Grafana, Splunk, or Prometheus. 
· Strong analytical and problem-solving skills with root cause analysis