Kafka Administrator

Kafka Administrator

New York, NY (Hybrid – 3 Days Onsite) Rate: DOE

Key Responsibilities:

• Manage Apache Kafka clusters, including installation, configuration, upgrades, and maintenance.
• Ensure high availability, fault tolerance, and disaster recovery readiness of Kafka environments.
• Monitor system performance, identify bottlenecks, and optimize Kafka throughput and latency.
• Implement and manage security controls, including authentication, authorization, encryption, and access policies.
• Set up monitoring, logging, and alerting frameworks to proactively detect and resolve issues.
• Troubleshoot Kafka-related issues such as broker failures, connectivity problems, and data inconsistencies.
• Collaborate with development, DevOps, and data engineering teams to integrate Kafka with enterprise applications and data pipelines.
• Develop scripts and automation to streamline cluster operations and reduce manual intervention.
• Perform capacity planning to ensure scalability and future growth requirements are met.
• Maintain clear and comprehensive documentation of configurations, processes, and operational procedures.

Required Skills & Experience:

• Strong experience in Apache Kafka administration and cluster management.
• Hands-on experience with Kafka brokers, topics, partitions, and consumer groups.
• Good understanding of distributed systems and streaming architectures.
• Experience with Kafka security (SSL, SASL, ACLs).
• Strong troubleshooting and performance tuning skills.
• Experience with monitoring tools (e.g., Prometheus, Grafana, or similar).
• Scripting experience (Shell, Python, or similar) for automation.
• Experience working in cloud environments (AWS/Azure/GCP) is a plus.
• Strong communication and collaboration skills.