Skip to content

Kafka gateway: Design Consumer offset persistence strategy for Kafka gateway Phase 2 #3540

Closed

Description

@ryerraguntla

Part of #3560.

Summary

Decide and document how the Kafka gateway stores consumer group offsets for Phase 2.

Motivation

Open question from #3253 (comment):

Option Description
A (recommended) Iggy-backed __consumer_offsets internal topic
B SQLite file on bridge host
C In-memory only (resets on restart)

Phase 2 is blocked until this decision is recorded.

Depends on

Deliverables

Acceptance criteria

  • Maintainers sign off on Option A/B/C
  • Phase 2 implementation issues unblocked

Activity

  1. added
    gatewaysproxy gateways for other protocols like kafka
    on Jun 23, 2026
  2. changed the title [-]design(gateways): Consumer offset persistence strategy for Kafka gateway Phase 2[/-] [+]Kafka gateway: Design Consumer offset persistence strategy for Kafka gateway Phase 2[/+] on Jun 24, 2026
  3. self-assigned this
    on Sep 24, 2026
  4. numinnex commented on Sep 24, 2026

    @numinnex
    Contributor

    I am picking this one up

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

gatewaysproxy gateways for other protocols like kafka

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions