Senior Software Engineer - Kafka

We are looking for a highly experienced Senior Software Engineer – Kafka to design, develop, and deliver scalable software solutions that power highly available and secure enterprise systems.

The ideal candidate will have strong expertise in Apache Kafka, Python or Java, REST APIs, UNIX/Linux, CI/CD, and distributed systems , with hands‑on experience building real‑time event‑driven architectures and microservices.

This role requires close collaboration with engineering and data teams to build robust, fault‑tolerant, and high‑performance systems.

Key Responsibilities

Software Engineering

• Design, develop, test, and deploy enterprise‑grade applications using Python or Java
• Build scalable and high‑performing REST APIs and microservices
• Build scalable ETL and real‑time data processing pipelines
• Contribute to architecture discussions, service design, integration patterns, and data flows
• Participate in Agile ceremonies, code reviews, and technical discussions

Kafka & Messaging Systems

• Develop and maintain event‑driven messaging frameworks using Apache Kafka
• Work with Kafka brokers, topics, partitions, consumer groups, and Kafka Streams
• Develop Kafka Producer and Consumer APIs using Spring Boot / Spring Kafka
• Implement Kafka security using:
• TLS/SSL
• ACLs and RBAC
• Manage Kafka deployments using Docker and Kubernetes
• Work with Kafka Connect and Schema Registry (Avro/JSON/Protobuf)

Automation & DevOps

• Automate operational workflows using Bash scripting in UNIX/Linux environments
• Build and maintain CI/CD pipelines
• Support deployment automation and release management
• Troubleshoot and resolve software issues across development and production environments
• Maintain technical documentation, design documents, and system specifications

AI-Enabled Development

• Use AI productivity tools such as Claude, Cursor, or similar IDE assistants
• Build AI-enabled backend capabilities using:
• Retrieval‑Augmented Generation (RAG)
• AI agents
• Design AI‑assisted workflows for:
• Unit/API testing
• Incident analysis
• CI/CD support
• Implement audit logging, observability, and governance controls for AI‑assisted systems

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field
• 6+ years of software engineering experience
• Strong experience building enterprise‑grade applications
• Experience working in Agile/Scrum environments
• Strong analytical, debugging, and problem‑solving skills
• Ability to work independently and collaborate across teams

Must-Have Skills

• Strong expertise in Apache Kafka
• Proficiency in Python or Java (Object‑Oriented Programming)
• Strong experience with:
• REST APIs
• Microservices
• Distributed systems
• Advanced UNIX/Linux knowledge and Bash scripting
• Experience with Git, GitLab, and CI/CD automation
• Experience with relational databases and SQL
• Hands‑on experience with Docker and Kubernetes
• Experience with observability tools such as:
• Splunk
• Grafana
• AppDynamics
• Knowledge of secure Kafka implementation using TLS/SSL and SASL
• Experience with event‑driven and messaging architectures
• Deliver high‑quality, scalable, and maintainable software solutions
• Follow coding standards, development guidelines, and best practices
• Participate in code reviews and technical mentoring
• Contribute to architecture and design decisions
• Collaborate effectively with cross‑functional teams and stakeholders
• Ensure timely delivery with strong focus on quality and performance
• Support release management, defect resolution, and continuous improvement initiatives

Core Competencies

• Strong communication and stakeholder management skills
• Technical leadership and mentoring capabilities
• Ability to manage multiple priorities in fast‑paced environments
• Strong ownership and accountability
• High attention to quality and performance optimization
• Customer‑focused mindset

Mandatory Skills Checklist

• Kafka
• Python or Java
• REST API Development
• CI/CD

Additional Information

• Telecom / Network domain experience is a plus
• Relevant technical certifications are beneficial