Skip to content

Procedure maintenance: score, compact, and prune reusable skills #158

Description

@joshyorko

Outcome

Add score-based maintenance for procedures so the store stays compact and high-quality as more experiences arrive.

Why

ProcMEM emphasizes reusable skills with verification and score-based maintenance. codex-memoryd has procedures and lifecycle issues, but it also needs compactness pressure so repeated or low-value procedures do not accumulate endlessly.

Scope

  • Track per-procedure success, failure, reuse count, last_used_at, evidence_count, and confidence trend.
  • Add maintenance rules for merge, split, retire, quarantine, or promote.
  • Add compaction preview that proposes procedure changes with evidence refs.
  • Add negative examples and failed reuse as counter-evidence.
  • Add eval metrics for compactness, reuse rate, false activation, and utility versus neutral recall.

Acceptance

  • Procedure maintenance preview emits deterministic candidate actions.
  • Low-score or duplicate procedures can be retired or merged through review.
  • Useful procedures become easier to recall without becoming authority.
  • Evals report procedure compactness and reuse quality.
  • Existing tests stay green.

Non-goals

  • No autonomous procedure execution.
  • No hidden prompt mutation.
  • No model-only maintenance without evidence refs.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions