Sr. Kafka Admin

Job Location: Jersey City, NJ or Dallas, TX Job Duration: 12+ Months Experience: 8+ Years Interview: Face to Face Role Descriptions: Install, configure, administer, and maintain enterprise-scale Apache Kafka and Confluent Kafka clusters in highly available production environments. Design, deploy, and support distributed Kafka infrastructure to meet business requirements for scalability, reliability, performance, and security. Manage the complete Kafka ecosystem including Kafka Brokers, Zookeeper, KRaft, Kafka Connect, Kafka Streams, Schema Registry, Control Center, and related components. Perform Kafka cluster setup, expansion, upgrades, patching, migration, and version management activities. Configure and optimize Kafka topics, partitions, replication factors, retention policies, compaction settings, and consumer group strategies. Design and implement high-availability architectures with fault tolerance, multi-node redundancy, and disaster recovery capabilities. Monitor Kafka cluster health, broker utilization, throughput, latency, consumer lag, partition distribution, and replication performance. Implement proactive monitoring solutions using Prometheus, Grafana, JMX, ELK Stack, Splunk, and enterprise monitoring tools. Analyze performance bottlenecks and perform tuning of brokers, producers, consumers, JVM settings, operating systems, and network configurations. Troubleshoot and resolve complex Kafka infrastructure issues involving brokers, producers, consumers, replication failures, topic performance, and cluster instability. Perform root cause analysis (RCA) for production incidents and implement preventive measures to improve system stability. Design and manage disaster recovery solutions including cross-region replication, MirrorMaker, backup strategies, and failover mechanisms. Implement and maintain Kafka security controls including SSL/TLS encryption, SASL authentication, Kerberos integration, RBAC, ACLs, and data protection policies. Configure secure communication channels between brokers, producers, consumers, and external applications. Work closely with security teams to ensure compliance with organizational security standards and regulatory requirements. Develop and maintain automation scripts for Kafka provisioning, configuration management, deployment, monitoring, and operational tasks. Utilize Infrastructure as Code (IaC) tools such as Terraform, Ansible, Puppet, and Helm to automate Kafka infrastructure management. Support containerized Kafka deployments using Docker, Kubernetes, and OpenShift platforms. Implement Kafka deployments and operational automation within cloud-native and hybrid cloud environments. Collaborate with application developers, architects, data engineers, and DevOps teams to onboard applications onto Kafka platforms. Provide guidance on Kafka producer and consumer design, topic strategy, partitioning models, and message delivery guarantees. #J-18808-Ljbffr Tekgence