Repository navigation
docs: 评测体系方案与闸门判定材料 - #87
Merged
Merged
Conversation
- roadmap/eval-system.md:四层 24 节点评测体系(只做分析与取舍) - roadmap/eval-system-spec.md:实现规格(24 张任务卡、报告 v2、验收命令) - roadmap/four-axes-mapping.md:四板斧对照(每条带 file:line) - GATE-外部验证闸门.md:阶段 3.5 闸门执行方案 - REVIEW-商业标尺问题清单.md:以完整商业产品为标尺的问题清单 - gate/JUDGE-GUIDE.md、gate/judge_worksheet.md:闸门人工判定手册与 50 题工作台 - gate/review_ai_draft.md:闸门判定的 AI 预标注 draft(待人工终审) 除 review_ai_draft.md 外均为设计/规格文档,不含实现代码,不改任何现有行为。
four-axes-mapping.md 有 18 处 `文件:行`,其中 6 处已在 master 上偏移 (app/eval/comparator.py 今天 +122 行、report.py +187 行),而全文没有 说明行号属于哪一版,读者无法分辨对错。补锚点 906d98f(2026-10-27), 并说明按内容定位而非按下标跳。 REVIEW-商业标尺问题清单.md 的 M07 引 ui/chat_app.py:38,该文件已随 c668ff4(F5 去 Streamlit)删除。补注现状指向 app/memory/,不改原判定 —— 文档自身声明基线 16d51c3,引用在当时是准的,只是读者现在找不到那个文件。 纯文档,无代码改动。
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
这是什么
把评测与闸门侧遗留的 8 份未跟踪文档一次性入库。内容均为既有设计/规格,不含实现代码,不改任何现有行为。
docs/roadmap/eval-system.mddocs/roadmap/eval-system-spec.mddocs/roadmap/four-axes-mapping.mdfile:linedocs/GATE-外部验证闸门.mddocs/REVIEW-商业标尺问题清单.mddocs/gate/JUDGE-GUIDE.mddocs/gate/judge_worksheet.mddocs/gate/review_ai_draft.md前置依赖
eval-system-spec.md与four-axes-mapping.md引用memory-system.md/memory-system-spec.md。这两份已在 #86(3ce6b77)入库,所以引用不会断链。不在本次范围
工作区另有
web-dist.zip、ui/web/web/、ui/web/e2e/*.png等构建与测试产物,未提交。校验
.py/.ts改动.venv失效原因与历史报告runs[].file为绝对路径这两个事实