Hadoop Developer
PB consulting
Experience Required: 10+ Years
Required Technical/Functional Skills
- 10+ years of experience working with the Hadoop ecosystem and large-scale distributed data platforms.
- Strong hands-on experience with:
- HDFS
- Apache Hive
- Apache Spark
- Apache Ozone
- Strong experience with Hive Metastore management, including table and partition maintenance.
- Experience with Hadoop data lifecycle management, storage management, and data retention.
- Strong knowledge of data ingestion, ETL processes, data validation, and troubleshooting.
- Proficiency in SQL, Shell scripting, and Python automation.
- Experience with Cloudera Data Platform (CDP) or similar Hadoop distributions.
- Strong data analysis, troubleshooting, and root cause analysis skills.
Roles & Responsibilities
- Monitor, troubleshoot, and resolve HDFS and Apache Ozone issues.
- Investigate Hadoop cluster performance, storage utilization, capacity, and availability concerns.
- Manage storage allocation, quota requests, capacity planning, and storage forecasting.
- Perform Hive Metastore administration, including table and partition maintenance.
- Support Hadoop platform maintenance, upgrades, integrations, onboarding, and decommissioning activities.
- Support data ingestion, ETL workflows, and data validation processes.
- Develop and maintain Shell and Python automation scripts for operational activities.
- Collaborate with application, data engineering, and platform teams during incident, problem, and change management activities.
- Perform root cause analysis and implement corrective and preventive actions.
- Create and maintain runbooks, operational documentation, knowledge articles, and support procedures.
- Ensure effective Hadoop data lifecycle, storage, and quota governance.
Preferred / Desired Skills
- Experience supporting large-scale, multi-petabyte Hadoop environments.
- Strong understanding of distributed storage architecture, replication, and fault tolerance.
- Experience with capacity management, storage forecasting, quota governance, and utilization optimization.
- Experience with Hadoop platform onboarding, integration, migration, and decommissioning.
- Familiarity with AWS, Azure, or GCP cloud platforms.
- Experience with monitoring and observability tools such as Cloudera Manager, Grafana, Splunk, and Prometheus.
- Strong analytical, troubleshooting, and problem-solving skills.
- Experience performing Root Cause Analysis (RCA) for complex production issues.
- Strong communication and collaboration skills.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Hadoop Developer in Montana vacancy
- ...seeking a highly experienced Lead Software Engineer to design, develop, and optimize enterprise-scale applications and big data platforms... ...and Architecture experience ~ Expertise in Apache Spark, Hadoop, Hive, and Trino ~ Experience processing large-scale...Suggested
$134k - $181k
...What You'll Do A typical day might involve discussing data architecture with engineers, digging into customer data, and developing technical implementation strategies and specifications. Specifically, you will: Own and execute integration projects from...SuggestedFull timeLive inWork at officeLocal areaRemote workWork from homeHome officeFlexible hours- ...Duration: Contract (W2 Only) Job Description: Must have implemented changes, not just supported environments Key Responsibilities: Develop and modify ECM workflows Perform product customizations using Oracle assembly framework Integrate ECM workflows with downstream systems...SuggestedContract work
- ...a Technical Solutions Engineer to work on impactful software affecting millions worldwide. This role involves diagnosing issues, developing solutions, and managing implementations across multiple locations. The ideal candidate will hold a Bachelor's degree or higher, have...SuggestedWorldwideRelocationRelocation package
- Please note that this position is based on our campus in Madison, WI, and requires relocation to the area. We recruit nationally and provide financial relocation assistance. Responsibilities As a Technical Solutions Engineer at Epic, you’ll work on software that impacts...SuggestedRelocationVisa sponsorshipRelocation package
$114.6k - $234.6k
Job Description As compute density and cooling complexity increase, OCI depends on hardware platforms that are both innovative and deployable at scale. This role ensures new designs are consistent, practical, and ready for global deployment. Responsibilities Key...Temporary workFlexible hours- ...everyone has fair opportunities to grow, and you can unlock your full potential to achieve your career goals. Here at TD, we hire and develop the best.**Training & Onboarding** We will provide training and onboarding sessions to ensure that you’ve got everything you need...Temporary workWork at officeLocal areaWork from homeFlexible hours
- ...Hello All, *** Greetings from My3tech *** Role: .NET Developer Location: Hybrid(St. Paul, Minnesota) Duration: Long-term Client: Minnesota Department of Public Safety Job Description: Scope: The Minnesota Department of Information...Full timeWork at office
- Position: Solutions Developer Location: Bozeman, MTJob Id: 822 # of Openings: 1 Solutions DevelopersLocation: Bozeman, MT, 59718 Position is based on-site in-person.Job Description:The Solutions Developer...Casual workWork at officeNight shift
$32 - $34 per hour
...Front-End Developer Wage: $32.00-$34.00/hr. The Front-End Developer is a team member of the ESGW IT Department. The individual designs, builds, and maintains web applications with an emphasis on usability, accessibility, and long-term maintainability. This role owns...Flexible hours$48 - $50 per hour
...Full Stack Java Developer Core: Java (solid junior acceptable), Spring Boot, Microservices, Kubernetes API: Gateway, versioning, exception handling, rate limiting, retry logic Cloud: Azure (primary), AWS acceptable DB & Infra: RDBMS, private VPN, dedicated...- Job Title Expert knowledge on UNIX and Unix shell scripting (commands, file and directory search, file access permission, file transfer protocols, scheduling, knowledge of file systems, loops, regular expressions, arrays, I/O redirections, functions, file handling, ...
- ...you secure a Tech Job, but we build your solid career in technology. Roles and Responsibilities Expert programming skills developing back-end cloud applications in Java Experience with Agile methodology Should have worked in development and maintenance...H1bImmediate start
- ...Job Title: Salesforce Developer Location: Mt. Laurel, NJ Employment Type: Full Time Experience: 8+ years Must Have Technical/Functional Skills Min 8+ years of relative experience in Salesforce Development & architecting...Full time
- ...Role Name -Salesforce Developer Location: Mt Laurel, NJ - onsite , locals only Contract JD : 5 years of relative experience in Salesforce Development architecture 5 years of experience with Git-based version control 5 years of experience...Contract workLocal area
- ...Salesforce DeveloperWe are seeking a highly skilled Salesforce Developer with a strong background in development and architecture to join our dynamic team. This role is onsite and requires a candidate who is local to Mount Laurel.Required Skills & QualificationsMinimum...Work experience placementLocal area
- ...prem Windows/Linux environments. Automate deployments and platform maintenance using Ansible, GitHub, Harness, and CI/CD tools. Develop Python and Shell scripts for platform administration, monitoring, and automation. Troubleshoot platform performance,...
- Job Title Experience: 10 to 15 years' experience with the SQL language (5 to 10 years writing functions and PLSQL) development. Skills: 1. Design data models based on business requirements 2. 10 years on Oracle systems (5 to 10 years on MSSQL servers a plus) 3. The ...
$253.9k - $298.7k
...Databricks, Snowflake. ~ Platform mindset and product-manager orientation toward data infrastructure, focused on reducing friction for developer customers and creating compounding leverage. ~ Utilizes generative AI responsibly, maintaining human oversight to deliver...Local area$150k - $165k
...Engineer St. Louis Park, MN Job Summary: We are seeking a Senior Software Engineer with specialized experience in developing software for active implantable medical device systems. This role involves creating robust, secure, and scalable programming software...Full time- ...Syms Strategic Group (SSG) is seeking a talented Software Developer Location: Remote Department: Veterans Affairs Type: Full Time Min. Experience: Experienced Security Clearance Level: Public Trust (MBI) Military Veterans are highly encouraged...Full timeRemote work
- SynergisticIT Job Opportunity SynergisticIT is aware that the job market is challenging due to almost 600,000 tech layoffs within the past 2 years due to which the job market is flooded with thousands of laid off techies who are competing with existing jobseekers. For...Immediate startRemote work
$60k - $135k
...standpointExperience in complete project life cycle activities on development and maintenance projectsKnowledge and experience in developing software using agile methodologiesSkilled in building relationships with clients and in practice development...Minimum wageWork at officeLocal area$144k - $169k
...Solutions Engineer, Data Visualization, is a core contributor within our Microsoft Data and AI practice, responsible for designing, developing, and delivering enterprise-grade data visualization and analytics solutions using Microsoft technologies. This role focuses on...Full timeRemote workWorldwideHome officeFlexible hours- ...our nationwide network of contractors and inspectors. Our Information Technology department is seeking an Enterprise Applications Developer to help build and maintain the technology solutions that drive our business and support our commitment to outstanding customer service...For contractorsWork at officeRemote workVisa sponsorshipWork visa
- ...Salesforce Senior DeveloperLocation: Mount Laurel, NJ, Hybrid 3-4 days/week FulltimeBrief Summary of Role: As a Salesforce Senior Developer you would be responsible for the development and implementation of Salesforce solutions. Collaborate with stakeholders to gather requirements...3 days per week
$111.72k - $138.08k
...authenticity, trust, empowerment and connectedness that empowers all of our successes. Learn more. Position Summary The Sr. Salesforce Developer is a senior technical contributor responsible for designing, developing, integrating, deploying, and supporting scalable...Work experience placementWork at officeRemote work- ...strong reputation with our clients. We are currently looking for entry-level software programmers, IT enthusiasts, Python/Java developers, and data analysts/data scientists. Who Should Apply? ~ Recent graduates in Computer Science, Engineering, Mathematics,...
- ...versed with OOPS concepts.Good to have AWS Lambda and AWS API gateway.Strong knowledge of Design patterns.Participate in design and develop applications as per technical specifications.Ability to work independently and as part of a team.Good Communication Skills.About Us...
$60k - $135k
...Job Title: Salesforce Senior Developer City: Morrisville, MOUNT LAUREL State/Province: New Jersey, North Carolina Posting Start Date: 8/12/26 Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting...Minimum wageWork at officeLocal area3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop Developer. Be the first to apply!



