Senior Software Engineer - Streaming

Role Description

As a Senior Software Engineer on the Streaming team, you will own the messaging backbone of Innovaccer's on-premise platform: Kafka and Schema Registry running on OpenShift via Strimzi, plus the self-hosted queueing layer that replaces cloud-managed queue services. A large population of producer and consumer touchpoints across the platform moves from cloud queue services onto this backbone, and you will define the patterns, libraries, and infrastructure that make that shift reliable at scale.

• Deploy and operate Kafka and Schema Registry on OpenShift via Strimzi: topic and partition design, retention policies, security, and quota management.
• Redesign integrations built on cloud queue services (SQS/Service Bus patterns) onto self-hosted brokers, defining repeatable patterns for hundreds of producer and consumer touchpoints.
• Build shared client patterns and libraries: retries, dead-letter queues, idempotent consumers, ordering guarantees, and backpressure handling.
• Integrate messaging with the platform's function runtime through KEDA-driven scaling of queue consumers.
• Own capacity planning for the messaging tier: broker disk and IO sizing, throughput modeling, and growth headroom.
• Monitor consumer lag and broker health, run failure-mode testing, and harden the tier against node and site failures.

Qualifications

• B.E., B.Tech., M.Sc. degree in Computer Science or a related technical field.
• 5+ years of backend or data infrastructure experience, with significant production Kafka ownership covering both operations and client-side development.
• Experience running Kafka on Kubernetes (Strimzi preferred) and managing schema evolution with Schema Registry.
• Hands-on experience with at least one additional broker technology: RabbitMQ, ActiveMQ/Artemis, or NATS/JetStream.
• Strong grasp of messaging semantics: delivery guarantees, idempotency, ordering, and exactly-once processing patterns.
• Professional development experience with Java, Python, or Go.
• Experience with KEDA or event-driven autoscaling is a plus; regulated-environment experience is a plus.

Benefits

• Generous Paid Time Off: Recharge and relax with 20 days of fixed time off per year, in addition to company holidays—because we believe work-life balance fuels performance.
• Best-in-Class Parental Leave: Spend quality time with your growing family. We offer one of the industry’s most generous parental leave policies to support you during life’s most important moments.
• Recognition & Rewards: We celebrate wins—big and small. Get rewarded with monetary incentives and company-wide recognition for your impact and dedication. Your hard work won’t go unnoticed.
• Comprehensive Insurance Coverage: Stay covered with medical, dental, and vision insurance, plus 100% company-paid short- and long-term disability and basic life insurance. Optional perks include discounted legal aid and pet insurance.