Data Engineer / Architect III USC and GC - W2 Role

Position Summary

Seeking a highly skilled Data Engineer / Architect III to support enterprise-scale data integration and platform optimization initiatives focused on the Cloudera ecosystem and Apache NiFi . This role is responsible for evaluating, optimizing, modernizing, and operationalizing existing NiFi-based data integration platforms while serving as both a hands-on engineer and a technical advisor.

The ideal candidate will possess strong experience with Apache NiFi, ETL/ELT pipelines, Python automation, Linux environments, and distributed systems.

Employment Type: W2 – Full Time

Location: Cincinnati, Ohio (Hybrid)

Contract Duration : 12 Months

Visa Requirement: Permanent Residents Only (Green Card Holders)

Deadline to apply: June 4, 2026

Key Responsibilities

Apache NiFi Platform Engineering

• Assess and optimize existing Apache NiFi and Cloudera environments.

• Review:

  • Processor Configurations

  • Queue Management

  • Flow Prioritization

  • Back Pressure Settings

  • Clustering Strategies

• Improve platform scalability, reliability, and operational efficiency.

• Establish reusable design standards and governance practices.

ETL / ELT Pipeline Development

• Design, develop, optimize, and support enterprise ETL/ELT pipelines.

• Integrate data from:

  • Relational Databases

  • APIs

  • Streaming Platforms

  • Cloud Storage

  • Distributed File Systems

• Support batch and real-time data ingestion.

• Resolve:

  • Pipeline Failures

  • Data Latency Issues

  • Throughput Bottlenecks

  • Operational Instability

Python Automation

• Develop Python-based automation and transformation scripts.

• Build integrations between NiFi and external systems.

• Automate deployment, validation, monitoring, and operational support processes.

• Support custom orchestration and processing logic.

Governance & Security

• Implement enterprise security standards including:

  • Authentication

  • Authorization

  • Encryption

  • RBAC Controls

  • Secure Data Movement

• Support deployment procedures and operational runbooks.

• Assist with version control and CI/CD processes.

Advisory & Collaboration

• Serve as a technical advisor for platform modernization initiatives.

• Document:

  • Architecture Recommendations

  • Operational Procedures

  • Knowledge Transfer Materials

  • Optimization Findings

• Collaborate with:

  • Data Engineers

  • Architects

  • DevOps Teams

  • Infrastructure Teams

  • Analytics Teams

  • Application Teams

Technical Environment

Data Integration & Processing

• Apache NiFi

• ETL / ELT Pipelines

• Data Integration Platforms

Programming

• Python

Infrastructure

• Linux

• Distributed Systems

Big Data & Cloudera

• Kafka

• Hive

• HDFS

• Iceberg

DevOps

• CI/CD Pipelines

Architecture

• Cloud & Hybrid Environments

What Success Looks Like

• Improve performance and reliability of enterprise NiFi environments.

• Optimize large-scale ETL/ELT pipelines.

• Reduce operational overhead through automation.

• Establish reusable platform standards and governance practices.

• Deliver scalable and maintainable data integration solutions.

• Support long-term platform modernization initiatives.

Ideal Candidate Profile

The ideal candidate will:

• Have strong hands-on Apache NiFi experience in enterprise production environments.

• Be highly skilled in ETL/ELT architecture and optimization.

• Possess advanced Python scripting expertise.

• Have strong Linux and distributed systems knowledge.

• Demonstrate excellent troubleshooting and root cause analysis capabilities.

• Be comfortable working independently and advising technical teams.

• Balance architecture strategy with operational execution.

Required Skills

• Apache NiFi (Production Environment)

• Cloudera Ecosystem

• ETL / ELT Development

• Python Scripting & Automation

• Linux Administration

• Distributed Systems

• Data Pipeline Optimization

• Data Integration

• Monitoring & Operational Support

• Root Cause Analysis

• Secure Data Movement & Governance
  

Preferred Skills

• Apache Kafka

• Hive

• HDFS

• Iceberg

• CI/CD Pipelines

• Cloud & Hybrid Architectures

• Enterprise Data Governance

• Reusable Integration Frameworks

• Distributed Systems Performance Tuning

Compensation & Benefits

• Medical, Dental & Vision Insurance

• 401(k)

• Paid Time Off

• Professional Development Opportunities

• Additional Benefits Package

Important Notes

✔ W2 Only

✔ Green Card Holders Only

✔ Hybrid Role – Cincinnati, OH

✔ Strong Apache NiFi Experience Required

✔ Python & Linux Expertise Required

✔ Data Engineering / Platform Optimization Focus