Add extraction quality signals for context assimilation#4548
Conversation
Signed-off-by: Denis Smirnov <densmirnov@me.com>
Signed-off-by: Denis Smirnov <densmirnov@me.com>
Signed-off-by: Denis Smirnov <densmirnov@me.com>
Signed-off-by: Denis Smirnov <densmirnov@me.com>
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 9d00a6f11e
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
| } | ||
|
|
||
| const impreciseItems = result.extracted_items | ||
| .filter((item) => item.source_refs.every((ref) => !hasPreciseSourceRef(ref))) |
There was a problem hiding this comment.
Honor span refs in precision quality checks
When a valid SGR item carries precision through span_refs (or a coverage span_id) but its source_refs only name the source file, this filter still classifies it as source_precision_gap because it only inspects SgrSourceRef fields. That makes the new quality report warn on span-addressed extractions even though the warning text says span-addressed refs are acceptable, so maximum-assimilation tasks using derived source spans get false rework signals. Consider treating item span refs as precise too.
Useful? React with 👍 / 👎.
Summary: - Merged Agentplane task KHMQAV. Verification: - Extraction quality report implemented and focused context checks passed. Refs: - Source PR: #4548 - Agentplane task: KHMQAV - Agentplane run: 202607031338-KHMQAV Signed-off-by: Denis Smirnov <densmirnov@me.com>
Task:
202607031338-KHMQAVTitle: Add extraction quality signals for context assimilation
Canonical task record:
.agentplane/tasks/202607031338-KHMQAV/README.mdSummary
Add extraction quality signals for context assimilation
Add a derived extraction quality report that flags over-fragmentation, unsupported summaries, and risky normalization before wiki publication.
Scope
Verification
Raw evidence
agentplane pr check/agentplane integrate