Skip to content

feat(skills): gate evaluation on minimum final-answer validity - #194

Merged
codeasier merged 1 commit into
mainfrom
fix/issue-186
Oct 3, 2026
Merged

codeasier merged 1 commit into
mainfrom
fix/issue-186

Conversation

@codeasier

Copy link
Copy Markdown
Owner

Summary

Add optional declarative final-answer nonempty and named conclusion checks, with explicit whole-case override and legacy opt-out. Reject non-string responses instead of stringifying them. Separate trace/result and answer checks in reports and state execution evidence clearly. Enable all ten Agent CLI cases without rewriting recorded targets.

Fixes #186

Validation

  • Original related complete suite: 252 passed
  • Latest-main provenance, complete skills, bundled and governance checks passed
  • Recorded target baseline: 10/10; empty, whitespace and unrelated mutations fail
  • Ruff, Black, basedpyright (0 errors), diff check passed
  • Deterministic literal minimum checks; recorded baseline rescoring is not live runner execution.

@codeasier
codeasier merged commit ad0d75a into main Oct 3, 2026
6 checks passed
@codeasier
codeasier deleted the fix/issue-186 branch October 3, 2026 19:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] Skill grader 增加成功案例的最终答复最低有效性检查

1 participant