Skip to content

fix(triggers): abios-feedback and /expert fire when they should (#764) - #791

Merged
CSalcedoDataBI merged 1 commit into
mainfrom
abios-feedback-trigger
Oct 5, 2026
Merged

CSalcedoDataBI merged 1 commit into
mainfrom
abios-feedback-trigger

Conversation

@CSalcedoDataBI

Copy link
Copy Markdown
Owner

Refs #764. Trigger-eval failures, diagnosed from traces (--keep-temp).

Case Before After
tool-feedback 0/3 2/3
expert-command-engine 0/2 2/3
  • tool-feedback: the model asked which verb was missing instead of loading \�bios-feedback. Its description now says to load it before asking for details. The eval prompt now names the verb, as a real report would.
  • expert-command-engine: /expert\ resolved the account (scripts) before opening its engine and ran out of turns. It now reads the engine first, as /scan\ does.

The full eval suite shows no other changes. \�alidate --strict\ and the Update-Docs check pass. CommandSurface, Expert-Auto.Passthrough and InternalVocabularyLeak tests: 281/0.

Once merged, the webhook sends this version to the directory; with auto-publish on, it goes live after approval.

🤖 Generated with Claude Code

…engine first (#764)

Measured with claude plugin eval (Haiku, traces kept):
- tool-feedback 0/3 -> 2/3. In every failing run the model understood the
  report was for the tool's own repo but asked which verb was missing instead
  of loading abios-feedback. The description now says to load it before
  asking for details (it says what to collect), and the eval prompt names
  the verb, as a real report would.
- expert-command-engine 0/2 -> 2/3. /expert applied gh-account (scripts)
  before opening its engine and ran out of turns; it now reads the engine
  first, like /scan, and resolves the account before the first GitHub call.
Full suite (2 runs, with/without): every other case unchanged.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@claude

claude Bot commented Oct 5, 2026

Copy link
Copy Markdown

Sin hallazgos: cambios de prompts/docs coherentes (orden Read del engine antes de gh-account, descripción de abios-feedback y prompt del eval más concreto). Nada que objetar.

@CSalcedoDataBI
CSalcedoDataBI merged commit 95c79cc into main Oct 5, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant