Skip to content

#417 Embedding LRU cache for repeated queries #420

Closed

Description

@ajianaz

Problem

Query embeddings recomputed every time (cheap with hash trick, but wasteful).

Location

src/index/brain.rs:190

Solution

Add LRU cache (64 entries) for query to embedding.

Expected Impact

Marginal. Future-proofing for real model embeddings.

Activity

  1. ajianaz commented on Jul 28, 2026

    @ajianaz
    CollaboratorAuthor

    Meta-tracker. All phase-3 sub-issues (#417, #416, #415, #414, #413) either closed or deferred. Low priority, closing tracker.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions