Data Engineering Tech Lead - Hadoop
Cloud Analytics Technologies LLC
Key Roles & Responsibilities
- Lead and oversee the end-to-end design, implementation, and optimization of data pipelines supporting key customer onboarding, transaction, and decisioning workflows.
- Architect and implement data ingestion, transformation, and storage frameworks leveraging Hadoop , Avro , and distributed data processing technologies.
- Partner with product, analytics, and technology teams to translate business requirements into scalable data engineering solutions that enhance real-time data accessibility and reliability.
- Provide technical leadership and mentorship to a team of data engineers, ensuring adherence to coding, performance, and data quality standards.
- Design and implement robust data frameworks to support next-generation customer and business product launches.
- Develop best practices for data governance , security , and compliance aligned with enterprise and regulatory requirements.
- Drive optimization of existing data pipelines and workflows for improved efficiency, scalability, and maintainability.
- Collaborate closely with analytics and risk modeling teams to ensure data readiness for predictive insights and strategic decision-making.
- Evaluate and integrate emerging data technologies to future-proof the data platform and enhance performance.
Must-Have Skills
- 8–10 years of experience in data engineering , with at least 2–3 years in a technical leadership role .
- Strong expertise in the Hadoop ecosystem (HDFS, Hive, MapReduce, HBase, Pig, etc.).
- Experience working with Avro , Parquet , or other serialization formats.
- Proven ability to design and maintain ETL / ELT pipelines using tools such as Spark , Flink , Airflow , or NiFi .
- Proficiency in Python , Scala for large-scale data processing.
- Strong understanding of data modeling , data warehousing , and data lake architectures.
- Hands-on experience with SQL and both relational and NoSQL data stores.
- Cloud data platform experience with AWS .
- Deep understanding of data security , compliance , and governance frameworks .
- Excellent problem-solving, communication, and leadership skills.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineering Tech Lead - Hadoop in Cleveland, OH vacancy
- ...AI Data Engineer Join a global leader in private aviation, offering access to an ultramodern fleet of private aircraft through fractional... ...with big data technologies (e.g., Apache Spark, Kafka, Hadoop) Experience with data pipeline orchestration tools (e.g., Airflow...Suggested
Flexjet
Cleveland, OH3 days ago $91k - $134k
...storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and... ..., passionate, and committed engineers, technologists, and business leaders... ...satisfaction through service excellence by leading preventive maintenance actions,...SuggestedPart timeWork experience placementRemote workWorldwideFlexible hoursSuper Micro Computer
Cleveland, OH5 days ago- ...Data Engineer - Cleveland, OH Onsite We are looking for a Data Engineer to design, build, and maintain scalable data pipelines and data... ...AWS, Azure, or Google Cloud. Experience with Apache Spark, Hadoop, or Kafka is a plus. Knowledge of Git and CI/CD practices....Suggested
United Software Group
Cleveland, OH5 days ago $100k - $130k
...Big Data Engineer We are looking for an experienced Big Data Engineer with 7–10 years of hands... .... Roles & Responsibilities Lead the design, development, and maintenance... ...workflows using Python, Spark, and the Hadoop ecosystem. Work extensively with Hadoop...SuggestedEXL
Cleveland, OH2 days ago$99k - $232k
...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...of our Firm. You are expected to lead with integrity and authenticity, articulating... ...with big data technologies like Hadoop, Spark, or Kafka is a plus...SuggestedH1bPwC
Cleveland, OH3 days ago- ...USD 140-160 / Yearly (Full Time)Employment Type: Full TimeIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsPega Tech LeadIrving,TX(Onsite)Onsite(Pittsburg,PA;Cleveland,OH)Must have Pega CSSA certification. Pega LSA certification...Full time
- Company DescriptionAbout Client:They help in transforming the leading organizations and communities around the world. Organizations infrastructure and culture is amazing. Best place!!Job DescriptionJob Description:As a Peoplesoft expertise, you will be involved in developing...
$134k - $265k
Position Summary Domain Tech Lead — Infrastructure Patching Automation (Mainframe & AS/400)Join our AI & Engineering team by transforming technology platforms, driving innovation... ...verticalized sector solutions in software, data, AI, network, and hybrid cloud...Local area$80.5k - $125k
OverviewAs a Data Engineer (Analytics Specialist), you will build robust data warehouse/marts/sets which will enable business users to make informed decisions. You will use advanced SQL tools to move large amounts of data and build complex algorithms.ResponsibilitiesCollaborates...Full timeWork experience placementFlexible hours- ...partner helping organizations modernize data ecosystems, build real-time analytics capabilities... ...and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in Data... ..., blockers, and insights to project leads and client stakeholders.4. Data Governance...Full timeWork experience placementLive inWork at officeLocal area
$116.2k - $229.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving... ...sector solutions in software, data, AI, network, and hybrid cloud infrastructure... ...sustain professional relationshipsAbility to lead projects or workstreamsAbility to manage...Local areaVisa sponsorship$128k - $252.5k
...clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with... ...team of interdisciplinary data scientists, engineers, architects, and consultants, our work... ...sustain professional relationshipsAbility to lead projects or workstreamsAbility to manage...Local area- ...could help make great things possible not only in your community, but around the world. HDR is looking for a Value Engineer & Project Risk Management Lead. This position will assist the Value Engineering/Risk Director in the development of strategic visions and tactical...Work at office
- ...Responsible AI team within the Global Data & AI Practice. AI is becoming... ...increased risks. We work with leading organizations to ensure AI is... ...if you’re an experienced RAI Engineer with a Responsible AI... ...technologies and tools (e.g., Hadoop, Spark).Database management and...Full timeWork experience placementLive inWork at officeLocal area
- Encore in Cleveland, Ohio is seeking a Technical Specialist responsible for the technical setup and operation of production events. The role emphasizes exceptional client satisfaction and requires experience in event technology. Candidates should have a Bachelor’s Degree...
Encore
Cleveland, OH2 days ago - ...Tech Lead Develop and maintain a deep understanding of business processes and procedures to effectively identify and implement IT solutions. Actively engage key business partners to identify/validate opportunities, ensure alignment with business strategies, and define...Work experience placement
Keylent Inc
Cleveland, OH4 days ago $77k - $202k
...LevelSenior AssociateJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not...Full timeH1b$120k - $155k
Join our team as a Data Solutions Engineer, where you will play a key role in designing and developing enterprise data solutions. This role works... ..., IP Services, and other support staff).2. Ability to lead and build consensus among peers and staff.3. Understanding and...Full timeFlexible hours- ...WiproContact: Meghana GorusuCompany: SRI Tech SolutionsPython... ...Flask, or similar frameworks.Data Integration: Working with SQL/... ...SkillsKnowledge of Elastic Stack, Hadoop ecosystem, and data analytics... ...Data, or Cloud for advanced data engineering tasks.SRI Tech Solutions is an...Full time
$75k - $150k
...to the company’s success. As a Software Engineer within PNC's Models Operationalization/MLOps... ...partner closely with software engineers, data engineers, data scientists, and platform... ...with Pandas, PySpark, PyArrow, and Hadoop.Experience building and supporting large-...Full timeTemporary workPart timeWork experience placementWork at officeWeekend work- We Are:Accenture is a leading global professional services company that... ...leadership in cloud, AI and data with unmatched industry... ...with strategy, consulting, and tech teams in the sales and delivery... ...big data technologies (e.g., Hadoop, Spark).Knowledge of agent-based...Full timeWork experience placementLive inWork at officeLocal area
- ...Data Engineer Duration: 6+ Month Contract to Hire Location: Cleveland OR Columbus Ohio – 3 days/week on site Rate: $70/hr on w2 Al + Referral: 5 dollars Client Note: # We are looking for multiple Azure Data Engineers for Medical Mutual in Ohio! # The...Contract workLocal areaRelocation3 days per week
My3Tech Inc
Cleveland, OH2 days ago $100k
...Synergisticit has helped jobseekers get employed in the tech job market by providing candidates the requisite... ...full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full time positions with clients. Who should...Full timeH1bSynergisticIT
Cleveland, OH1 day ago- ..., WI, with relocation assistance to the area. We recruit nationally and provide financial relocation support. Epic offers a dynamic tech-focused environment with an emphasis on collaboration, growth, and competitive compensation. The campus life combines modern facilities...Relocation package
Epic
Cleveland, OH5 days ago - ...assistance. Live affordably in a city known for its rising tech talent. Epic is located just outside Madison, Wisconsin,... ...Previous information technology experience. Prior data center, server, or network engineer experience – especially with Cisco IOS or NX-OS platforms...Work at officeRelocationRelocation package
Epic
Cleveland, OH4 days ago - ...Position Title: Senior Data Engineer Company Story: Inc. 5000 Fastest-Growing Company - 9 out of the past 12 years Inc. Hall of Fame recognition for sustained growth (fewer than 1% of companies achieve this) NEO Success Award - 4 consecutive years based...1 day per week
Kendall And Davis, Inc.
Cleveland, OH1 day ago - ...Job Description WE'RE HIRING! If you love data and are looking for unlimited growth opportunities... ...exciting to you, let's chat! SENIOR DATA ENGINEER We are looking for a highly skilled and strategic Senior Data Engineer to lead in our data engineering consulting team. In...
Further
Cleveland, OHmore than 2 months ago $148.2k - $292.3k
...granularity only made possible with today’s data and technology. ConvergeCONSUMER’s suite... ...’ll do Are you an experienced Software Engineer who has led the development of world-class... ...an opportunity to expand your scope and lead products used by some of the biggest and...Local area$124k - $280k
...LevelSenior ManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not...Full timeH1b- Job Title Gen AI Data Engineer Job Summary Charter Communications is seeking an AI Engineer to support our IVR and Conversational AI platforms, with a strong focus on building LLM powered voice and chat experiences. This role involves designing and developing prompt driven...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineering Tech Lead - Hadoop. Be the first to apply!
Related searches
- aws data engineer Cleveland, OH
- data center engineer Cleveland, OH
- senior data integration developer Cleveland, OH
- data developer Cleveland, OH
- data science developer Cleveland, OH
- senior data engineer Cleveland, OH
- finance data engineer Cleveland, OH
- senior data center engineer Cleveland, OH
- sr information security engineer Cleveland, OH
- data engineer Cleveland, OH