Repository navigation
✨ Expose the knowledge advisor rank-versus-holdout summary through a read-only route and Advisor card - #18904
Conversation
Open PR overlap checkBase branch: Conflicts are checked with every PR merged onto the current tip of
|
|
Hive status — updated in place; edits do not notify. Full history is in the Activity Monitor. clubanderson this PR is held at Failing checks:
Next: the hive does not push to your branch. Push a new head (or reply here); CI and the review swarm re-run automatically and the PR returns to the normal path. |
… route + Advisor card) Adds GET /api/knowledge/advisor/summary and a Knowledge-section Advisor card: decision counts by mode/arm/outcome, Lane.AdvisorArmSummary() per-arm bead means (mixed/none separate), mean latency and tokens, advisor settings and a small-n caveat. Counts and means only. Decision records now carry latency and token counts. Signed-off-by: Andrew Anderson <andy@clubanderson.com>
Signed-off-by: Andrew Anderson <andy@clubanderson.com>
…as a Settings UI reference Signed-off-by: Andrew Anderson <andy@clubanderson.com>
699e59a to
14881b7
Compare
|
[APPROVALNOTIFIER] This PR is APPROVED Approval requirements bypassed by manually added approval. This pull-request has been approved by: The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
Fixes #18897
Follow-up to the audit of #17054 (rank-versus-holdout comparison).
What
GET /api/knowledge/advisor/summary[?since=<RFC3339>], read role or higher, read-only. Returns the decision window, counts by mode / arm / outcome, theLane.AdvisorArmSummary()per-arm bead counts and means (mixedandnoneunder their own keys), mean model latency and prompt/completion tokens where records carry them, the advisor settings (mode, holdout_percent, model, call budget; never endpoint or key) and a small-n caveat (fewer than 30 closed beads in deliver or holdout). Counts and means only: no slugs, refs, agents or content.retro.AdvisorDecisionStore.Summarize; decision records gain optionallatency_ms,prompt_tokens,completion_tokens(omitempty, written by the ranking decorator going forward; older records report zero samples).Notes
since(AdvisorArmSummary has no window); the response says so.🤖 Generated with Claude Code