Data Engineering Tech Lead - Hadoop
Cloud Analytics Technologies LLC
Key Roles & Responsibilities
- Lead and oversee the end-to-end design, implementation, and optimization of data pipelines supporting key customer onboarding, transaction, and decisioning workflows.
- Architect and implement data ingestion, transformation, and storage frameworks leveraging Hadoop , Avro , and distributed data processing technologies.
- Partner with product, analytics, and technology teams to translate business requirements into scalable data engineering solutions that enhance real-time data accessibility and reliability.
- Provide technical leadership and mentorship to a team of data engineers, ensuring adherence to coding, performance, and data quality standards.
- Design and implement robust data frameworks to support next-generation customer and business product launches.
- Develop best practices for data governance , security , and compliance aligned with enterprise and regulatory requirements.
- Drive optimization of existing data pipelines and workflows for improved efficiency, scalability, and maintainability.
- Collaborate closely with analytics and risk modeling teams to ensure data readiness for predictive insights and strategic decision-making.
- Evaluate and integrate emerging data technologies to future-proof the data platform and enhance performance.
Must-Have Skills
- 8–10 years of experience in data engineering , with at least 2–3 years in a technical leadership role .
- Strong expertise in the Hadoop ecosystem (HDFS, Hive, MapReduce, HBase, Pig, etc.).
- Experience working with Avro , Parquet , or other serialization formats.
- Proven ability to design and maintain ETL / ELT pipelines using tools such as Spark , Flink , Airflow , or NiFi .
- Proficiency in Python , Scala for large-scale data processing.
- Strong understanding of data modeling , data warehousing , and data lake architectures.
- Hands-on experience with SQL and both relational and NoSQL data stores.
- Cloud data platform experience with AWS .
- Deep understanding of data security , compliance , and governance frameworks .
- Excellent problem-solving, communication, and leadership skills.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineering Tech Lead - Hadoop in Cleveland, OH vacancy
- A leading automation company in Cleveland is seeking an experienced Data Engineering Lead to oversee the design and optimization of data pipelines critical for customer workflows... ...engineering and a strong background in the Hadoop ecosystem. Responsibilities include providing...Suggested
- POSITION SUMMARYFlexjet is seeking a detail-oriented AI Data Engineer to build and maintain data infrastructure that powers machine learning... ...with big data technologies (e.g., Apache Spark, Kafka, Hadoop)· Experience with data pipeline orchestration tools (e.g., Airflow...Suggested
- ...Data Engineer - Cleveland, OH OnsiteWe are looking for a Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure... ...as AWS, Azure, or Google Cloud.Experience with Apache Spark, Hadoop, or Kafka is a plus.Knowledge of Git and CI/CD practices....Suggested
United Software Group
Cleveland, OH3 days ago $100k - $130k
...Big Data EngineerWe are looking for an experienced Big Data Engineer with 7–10 years of hands-on experience to design, build, and maintain scalable data pipelines... ...optimize data workflows using Python, Spark, and the Hadoop ecosystem.Work extensively with Hadoop ecosystem...SuggestedEXL
Cleveland, OH3 days ago- ...Corporate OfficeWHO WE ARE:Accenture helps the world’s leading enterprises reinvent by building their digital... ...Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and Technology. We serve...SuggestedFull timeWork experience placementLive inWork at officeLocal area
- ...USD 140-160 / Yearly (Full Time)Employment Type: Full TimeIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsPega Tech LeadIrving,TX(Onsite)Onsite(Pittsburg,PA;Cleveland,OH)Must have Pega CSSA certification. Pega LSA certification...Full time
- Company DescriptionAbout Client:They help in transforming the leading organizations and communities around the world. Organizations infrastructure and culture is amazing. Best place!!Job DescriptionJob Description:As a Peoplesoft expertise, you will be involved in developing...
$134k - $265k
Position Summary Domain Tech Lead — Infrastructure Patching Automation (Mainframe & AS/400)Join our AI & Engineering team by transforming technology platforms, driving innovation... ...verticalized sector solutions in software, data, AI, network, and hybrid cloud...Local area$116.2k - $229.1k
Position Summary Join Deloitte’s AI & Engineering practice and help organizations transform... ...technology platforms, modernize data environments, and unlock value through innovation... ...scalability. • Team and Technology Lead: Evaluate, pilot, and integrate new big data...Local areaVisa sponsorship- ...partner helping organizations modernize data ecosystems, build real-time analytics capabilities... ...and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in Data... ..., blockers, and insights to project leads and client stakeholders.4. Data Governance...Full timeWork experience placementLive inWork at officeLocal area
- ...could help make great things possible not only in your community, but around the world. HDR is looking for a Value Engineer & Project Risk Management Lead. This position will assist the Value Engineering/Risk Director in the development of strategic visions and tactical...Work at office
- ...Tech Lead Contract location: Cleveland OH Skill: Experience: 10+ years JD: High level: ITAR data requirement US national located in US Onsite not required Experience working with OpenText BizManager EDI in an SAP environment Will be supporting existing EDI...Contract work
Keylent Inc
Cleveland, OH3 days ago - ...Tech Lead Develop and maintain a deep understanding of business processes and procedures to effectively identify and implement IT solutions. Actively engage key business partners to identify/validate opportunities, ensure alignment with business strategies, and define...Work experience placement
Keylent Inc
Cleveland, OH1 day ago - ...Python AI Engineer Location: Cleveland, Ohio (Day1 Onsite) We are seeking a skilled Python AI Engineer with strong expertise in developing... ..., version control, and CI/CD pipelines. Familiarity with data preprocessing, prompt engineering, and performance tuning....
Yantran LLC
Cleveland, OH1 day ago - ...Must be a US Citizen or Green Card Holder Located in the greater Cleveland, Ohio area - will be working onsite 5 days a week Data Engineer will plan, design, develop, test, implement, and maintain efficient information systems with a primary focus on building scalable...Weekend work
Exodus Integrity Services | IT Staffing & Consulting
Cleveland, OH2 days ago - ...WiproContact: Meghana GorusuCompany: SRI Tech SolutionsPython... ...Flask, or similar frameworks.Data Integration: Working with SQL/... ...SkillsKnowledge of Elastic Stack, Hadoop ecosystem, and data analytics... ...Data, or Cloud for advanced data engineering tasks.SRI Tech Solutions is an...Full time
$120k - $155k
Join our team as a Data Solutions Engineer, where you will play a key role in designing and developing enterprise data solutions. This role works... ..., IP Services, and other support staff).2. Ability to lead and build consensus among peers and staff.3. Understanding and...Full timeFlexible hours- We Are:Accenture is a leading global professional services company that... ...leadership in cloud, AI and data with unmatched industry... ...with strategy, consulting, and tech teams in the sales and delivery... ...big data technologies (e.g., Hadoop, Spark).Knowledge of agent-based...Full timeWork experience placementLive inWork at officeLocal area
$75k - $150k
...to the company’s success. As a Software Engineer within PNC's Models Operationalization/MLOps... ...partner closely with software engineers, data engineers, data scientists, and platform... ...with Pandas, PySpark, PyArrow, and Hadoop.Experience building and supporting large-...Full timeTemporary workPart timeWork experience placementWork at officeWeekend work- ...Datacenter Engineer The engineer in this position should have a wealth of experience... ...include the complete engineering of data centers including, but not limited... ..., installation supervisors, lead installers, and installation techs. Guides detail engineer through problems...For contractorsWork at officeLocal area
Adex USA
Cleveland, OH1 day ago - Flexjet LLC is seeking an AI Data Engineer in the United States to build and maintain data infrastructure powering ML systems in Cleveland, OH. You will work with data scientists, ML engineers, and software teams to ensure scalable, high-quality data pipelines for AI applications...
- ...‑voltage substations through advanced protective relay testing, commissioning, and maintenance. You will serve as a field technical lead, guide crews through complex outage work, and uphold Asplundh’s reputation for safety, precision, and service excellence. The role requires...
$105k - $120k
Beckman Coulter Diagnostics seeks a Technical Applications Supervisor to manage a team of Field Technical Applications Specialists. This remote role covers the Great Lakes area with up to 50% travel. Responsibilities include ensuring customer satisfaction, training operators...Remote job$124k - $280k
...LevelSenior ManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not...Full timeH1b- Signet Jewelers is looking for a Tech Modernization Lead to drive application modernization initiatives and align technical strategies with business objectives. This role offers the opportunity to lead cross-functional teams, manage complex projects, and ensure the delivery...
- The Senior Data Engineer is responsible for designing, building, and maintaining the systems and infrastructure that enable organizations to collect, store, process, and analyze large volumes of data. This role involves collaborating closely with data scientists, analysts...Contract workFor contractorsWork at officeLocal area
$148.2k - $292.3k
...granularity only made possible with today’s data and technology. ConvergeCONSUMER’s suite... ...’ll do Are you an experienced Software Engineer who has led the development of world-class... ...an opportunity to expand your scope and lead products used by some of the biggest and...Local area- ...Job Description WE'RE HIRING! If you love data and are looking for unlimited growth opportunities... ...exciting to you, let's chat! SENIOR DATA ENGINEER We are looking for a highly skilled and strategic Senior Data Engineer to lead in our data engineering consulting team. In...
Further
Cleveland, OH2 days ago - Our client in Mentor, Ohio is seeking an Extrusion Technical Lead to serve as the hands-on expert for plastic extrusion operations, materials, and processing. The role emphasizes deep technical knowledge, hands-on troubleshooting, and continuous improvement while directly...
- ...Cloud Data EngineerAmTrust is seeking a highly motivated and accomplished Cloud Data Engineer with expertise in Azure Databricks, Azure Synapse Analytics, SQL, and cloud-based... ...with technical and non-technical stakeholders, lead requirements gathering sessions, produce...Work experience placementFlexible hours
AmTrust Financial
Cleveland, OH1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineering Tech Lead - Hadoop. Be the first to apply!
Related searches
- data engineer analytics Cleveland, OH
- senior cloud data engineer Cleveland, OH
- data center engineer Cleveland, OH
- sr data engineer Cleveland, OH
- data engineer Cleveland, OH
- sr information security engineer Cleveland, OH
- junior data engineer remote Cleveland, OH
- data developer Cleveland, OH
- etl data engineer Cleveland, OH
- senior data center engineer Cleveland, OH