Skip to content

Build a denser binary term index for local recall #37

Description

@tsotchke

Goal
Replace or augment the current KB2T text term shards with a denser binary term index so recall stays fast as packs grow.

Acceptance criteria

  • Pack builder writes a compact binary term index per pack with readable metadata.
  • DOS assistant uses the binary term index before falling back to KB2T text shards, KB2TERM.TXT, KB2 buckets, and text KDB.
  • Existing readable KDB and KB2T files remain available for inspection and recovery.
  • Recall gates still pass 42/42 and candidate byte ratio does not regress from the current term-index baseline.

Evidence gate
python3 scripts/evaluate_assistant_kdb_term_index.py
python3 scripts/benchmark_assistant_recall.py
QEMU_TIMEOUT_SECONDS=240 bash qemu/run_assistant_recall_486.sh
python3 scripts/verify_assistant_packs.py

Boundary
No physical hardware validation is claimed by this issue.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestrelease-follow-upPost-preview release hardening and evidence workstorage-recallLocal recall storage, indexes, and retrieval performance

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions