Skip to content

Kafka gateway: Kafka Fetch API (key 1) — bridge to Iggy offset-based polling #3536

Closed

Description

@ryerraguntla

Part of #3560.

Summary

Wire Kafka Fetch (API key 1) to IggyBridge::fetch() — return messages from Iggy by partition offset without consumer groups (Phase 1 assign/manual offset).

Motivation

Enables simple consumers and kafka-console-consumer.sh without --group for Phase 1 MVP.

Depends on

Scope

  • Decode Fetch v4–v12 (scoped range)
  • Map fetch offset + max bytes → Iggy poll/fetch by offset
  • Encode RecordBatch response (opaque bytes from Iggy payload)
  • High-watermark / log end offset in response
  • Integration test: produce then fetch same partition/offset

Acceptance criteria

  • kafka-console-consumer.sh --from-beginning --partition 0 works without consumer group (Phase 1)
  • Offset progression matches Iggy partition offsets

References

Activity

  1. added
    gatewaysproxy gateways for other protocols like kafka
    on Jun 23, 2026
  2. changed the title [-]feat(gateways): Kafka Fetch API (key 1) — bridge to Iggy offset-based polling[/-] [+]Kafka gateway: Kafka Fetch API (key 1) — bridge to Iggy offset-based polling[/+] on Jun 24, 2026
  3. krishvishal commented on Sep 24, 2026

    @krishvishal
    Member

    I am picking this up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

gatewaysproxy gateways for other protocols like kafka

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions