Skip to content

Kafka gateway: Kafka FindCoordinator, JoinGroup, SyncGroup, and Heartbeat APIs #3541

Closed

Description

@ryerraguntla

Part of #3560.

Summary

Implement Kafka consumer group membership protocol (API keys 10, 11, 12, 14) in the gateway coordinator.

Motivation

Phase 2 goal: full consumer group semantics — join, assignment, heartbeat, rebalance. Required for kafka-console-consumer.sh --group.

Depends on

Scope

  • FindCoordinator (10) — return gateway as coordinator
  • JoinGroup (11) — member registration, leader election (single-bridge coordinator)
  • SyncGroup (14) — partition assignment to members
  • Heartbeat (12) — session timeout, trigger rebalance on missed heartbeats
  • Assignment strategies: document supported (range, round-robin, sticky) or subset
  • In-memory or persisted group state per Kafka gateway: Design Consumer offset persistence strategy for Kafka gateway Phase 2 #3540

Acceptance criteria

  • Two consumers same group get disjoint partition assignment
  • Heartbeat timeout evicts member and triggers rebalance

References

Activity

  1. added
    gatewaysproxy gateways for other protocols like kafka
    on Jun 23, 2026
  2. changed the title [-]feat(gateways): Kafka FindCoordinator, JoinGroup, SyncGroup, and Heartbeat APIs[/-] [+]Kafka gateway: Kafka FindCoordinator, JoinGroup, SyncGroup, and Heartbeat APIs[/+] on Jun 24, 2026
  3. self-assigned this
    on Sep 22, 2026
  4. numinnex commented on Sep 22, 2026

    @numinnex
    Contributor

    I am picking this one up

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

gatewaysproxy gateways for other protocols like kafka

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions