Hadoop Developer

Cloudera Developer - OnsiteGenesis10 is currently seeking a Cloudera Developer - Onsite for a contract position with a Global Financial Institution located in Charlotte, NC or Plano, TX. This is a 12+ month contract opportunity.As a Cloudera Developer, you will be responsible for developing and maintaining data solutions using the Cloudera platform. You will work closely with cross-functional teams, including data engineers, data scientists, and business stakeholders, to understand data requirements and deliver robust and scalable data solutions. Your primary focus will be on designing, developing, and implementing data processing pipelines and data ingestion frameworks using PySpark, ezflow, and other methods for moving data within a Hadoop environment.Responsibilities:Utilize multiple architectural components in the design and development of client requirementsMaintain, improve, clean, and manipulate data for the operational and/or analytics data systemsDesign solutions by finding better ways of solving technical problems and challenging the status quoDocument and communicate required information for deployment, maintenance, support, and business functionalityAdhere to team delivery/release process and cadence pertaining to code deployment and releaseDesign, develop, and maintain data processing pipelines using Cloudera technologies such as Apache Hadoop, Apache Spark, Apache Hive, and PythonCollaborate with data engineers and data scientists to understand data requirements and translate them into technical specificationsDevelop and maintain data ingestion frameworks for efficiently extracting, transforming, and loading data from various sources into the Cloudera platformOptimize and tune data processing jobs to ensure high performance and scalabilityImplement data governance and security policies to ensure data integrity and complianceMonitor and troubleshoot data processing jobs to identify and resolve issues in a timely mannerPerform unit testing and debugging of data solutions to ensure high quality and reliabilityDocument technical specifications, data flows, and data architecture diagramsStay updated with the latest advancements and best practices in Cloudera technologies and big data analyticsRequirements:5-7 years of experience with distributed data/computing tools: Hadoop, Hive, MySQL, etcStrong problem-solving skills with an emphasis on product developmentExperience working with and creating data architecturesExcellent written and verbal communication skills for coordinating across teamsExperience creating clear and effective data visualizations and dashboardsKnowledge of ETL processes, data integration, and data quality best practicesProficient in Python programming for data processing, automation, and analytical solutionsExperience using pandas to cleanse, transform, and analyze large datasetsExperience using PySpark for large-scale data processing and distributed computing environmentsStrong SQL skills with experience developing complex queries, joins, aggregations, and performance optimizationExperience working with AutoSysAbility to analyze data, identify trends and anomalies, and deliver actionable business insightsA drive to learn and master new technologies and techniquesPay range: $58.31 - $66.31 per hourOnly candidates available and ready to work directly as Genesis10 employees will be considered for this position.If you have the described qualifications and are interested in this exciting opportunity, please apply!