Hadoop Developer

Title: Hadoop Developer



Location: Charlotte, NC
Duration: Full Time



Video Interviews
Experience required: - 10-15 years of experience

JOB DESCRIPTION:
Must Have Technical/Functional Skills

Required Technical Skills

Strong experience with the Hadoop ecosystem:

o HDFS

o Hive

o Spark

o Ozone

Hive Metastore management and table/partition maintenance.

Hadoop data lifecycle management.

Data ingestion, ETL processes, and data validation.

Shell scripting and Python automation.

Cloudera Data Platform (CDP) or similar Hadoop distributions.

Strong SQL and data analysis skills.

Experience: Minimum10 years

Roles & Responsibilities

Monitor and resolve HDFS and Ozone related issues.

Investigate cluster performance, storage utilization, and capacity concerns.

Manage quota requests, storage allocation, and capacity planning.

Support platform maintenance and perform integration activities.

Coordinate with application teams during incident and problem management.

Create and maintain operational documentation, runbooks, and knowledge articles.

Desired / Preferred Skills

Experience supporting large-scale Hadoop environments with multi-petabyte storage.

Knowledge of distributed storage architecture and data replication.

Capacity management, storage forecasting, and quota governance.

Platform onboarding, integration, and decommissioning.

Familiarity with cloud platforms (Azure, AWS, or GCP).

Experience with monitoring tools such as Cloudera Manager, Grafana, Splunk, or Prometheus.

Strong analytical and problem-solving skills with root cause analysis