Senior Kafka Engineer / Administrator Hybrid

Job Description

Please Contact: To discuss this amazing opportunity, reach out to our Talent Acquisition Specialist Amanchi Suhane at email address View email address on ziprecruiter.com can be reached on # View phone number on ziprecruiter.com.

\n

\n

We have Contract role Senior Kafka Engineer / Administrator Hybrid for client at Denver CO. Please let me know if you or any of your friends would be interested in this position.

\n

\n

Position Details:

\n

Senior Kafka Engineer / Administrator Hybrid-Denver CO

\n

Location : Denver, CO - 80201 or St. Louis, MO - 63101 (Hybrid)

\n

Project Duration : 12 months (Contract to Hire)

\n

Pay Rate : $40 - $45 an hour on W2

\n

\n

\n

Position Summary:

\n

Senior Kafka Engineer / Administrator

\n

\n

We are migrating a portfolio of Apache Kafka clusters from on-premises platforms (Cloudera and Confluent) to AWS MSK, managed through a CI/CD pipeline built on Terraform and GitLab. We are looking for a senior, hands-on Kafka engineer to own day-to-day Kafka administration across both environments, drive the migration, and coordinate closely with producer and consumer application teams to ensure a smooth, low-risk cutover. This is a senior individual-contributor role for someone who has run Kafka at scale in production, is comfortable in a hybrid on-prem/cloud world, and can act as the technical point of contact between platform and application teams.

\n

\n

Required Qualifications:

\n

\n
• 5+ years in data/platform/infrastructure engineering, with 4+ years’ operating Apache Kafka in production.
\n
• Hands-on administration experience with Cloudera and Confluent Platform.
\n
• Production experience with AWS MSK (provisioning, configuration, IAM auth, networking).
\n
• Proven experience migrating Kafka workloads to the cloud with minimal disruption.
\n
• Strong Terraform and GitLab CI/CD experience for infrastructure automation.
\n
• Hands-on Datadog experience for monitoring, dashboards, and alerting.
\n
• Deep understanding of Kafka internals: partitions, replication, ISR, offsets, consumer groups, and delivery semantics.
\n
• Solid AWS fundamentals: VPC, security groups, IAM, KMS, CloudWatch, Private Link.
\n
• Strong Linux, networking, and scripting skills (Bash, Python).
\n
• Excellent communication and coordination skills to work across producer/consumer teams.
\n

\n

\n

Preferred Skills / Nice to Have:

\n

\n
• Experience with Mirror Maker 2, Confluent Replicator, or cluster linking for replication/migration.
\n
• Schema Registry, Kafka Connect, and ksq lDB experience.
\n
• Kafka Streams or Flink familiarity.
\n
• Kubernetes / EKS experience (e.g., Strimzi).
\n
• Certifications: Confluent Certified Administrator, AWS Solutions Architect/DevOps.
\n
• Experience in a regulated or large enterprise environment.
\n

\n

\n

Mandatory Skills:

\n

\n
• Apache Kafka (Cloudera and Confluent)
\n
• Senior Kafka Engineer / Administrator
\n

\n

\n

Deliverables:

\n

\n
• Kafka Administration (On-Prem + Cloud)
\n
• Administer and operate Kafka clusters across Cloudera, Confluent Platform, and AWS MSK.
\n
• Manage topics, partitions, replication, retention, quotas, ACLs, and consumer groups.
\n
• Tune brokers, producers, and consumers for throughput, latency, and reliability.
\n
• Handle patching, upgrades, capacity planning, and cluster health/performance troubleshooting.
\n
• Configure and maintain security: TLS/SSL, SASL, MTLS, IAM (for MSK), RBAC/ACLs, and encryption at rest and in transit.
\n

\n

\n

\n
• Migration to AWS MSK
\n
• Plan and execute migration of clusters and workloads from on-prem (Cloudera/Confluent) to AWS MSK.
\n
• Design cutover strategies (e.g., Mirror Maker 2 / Confluent Replicator / cluster linking) with minimal downtime and no data loss.
\n
• Validate topic parity, offsets, throughput, and data integrity pre- and post-migration.
\n
• Define rollback plans and run migration dry-runs in lower environments.
\n

\n

\n

\n
• CI/CD & Infrastructure as Code
\n
• Build and maintain Kafka/MSK infrastructure using Terraform.
\n
• Manage automated deployments and configuration through GitLab CI/CD pipelines.
\n
• Implement Git Ops practices for topic, ACL, and cluster configuration management.
\n
• Enforce version control, code review, and environment promotion (dev ? test ? prod).
\n

\n

\n

\n
• Observability & Monitoring
\n
• Build and maintain monitoring, alerting, and dashboards in Datadog for Kafka/MSK (broker metrics, consumer lag, partition health, JVM/GC, throughput).
\n
• Establish SLAs/SLOs and proactive alerting to reduce incidents and mean-time-to-resolution.
\n
• Correlate Kafka metrics with application and infrastructure telemetry.
\n

\n

\n

\n
• Producer / Consumer Coordination
\n
• Serve as the primary technical liaison between the Kafka platform team and producer/consumer application teams.
\n
• Advise application teams on client configuration, serialization/schema management, partitioning strategy, idempotence, and exactly-once/at-least-once semantics.
\n
• Support onboarding of new producers/consumers and troubleshoot client-side issues (rebalancing, lag, poison messages).
\n
• Coordinate migration schedules, testing, and cutover windows with each impacted team.
\n

\n

\n

\n

To discuss this amazing opportunity, reach out to our Talent Acquisition Specialist Amanchi Suhane at email address View email address on ziprecruiter.com can be reached on # View phone number on ziprecruiter.com.