Reproduction Steps:
- Begin reading a dekaf topic with schema inference.
- Write a document:
{"name": "alice"}
- Write a document with a new field not in the schema:
{"name": "bob", "value": 42}
Expected:
Read documents as written:
{"name": "alice"}
{"name": "bob", "value": 42}
Actual:
New field is omitted from output:
{"name": "alice"}
{"name": "bob"}
Even after waiting for the spec_ttl expires and a new schema is picked up, the new field will be absent. In order to pick up the new field, you must disconnect or perform another operation that creates a new Read such as changing the read offset.
Reproduction Steps:
{"name": "alice"}{"name": "bob", "value": 42}Expected:
Read documents as written:
Actual:
New field is omitted from output:
Even after waiting for the
spec_ttlexpires and a new schema is picked up, the new field will be absent. In order to pick up the new field, you must disconnect or perform another operation that creates a newReadsuch as changing the read offset.