Problem
The recipe defines the input parameter key as question but the prompt template uses {{ instruction }}:
parameters:
- key: instruction # <-- defined as instruction
...
But the README example passes:
goose run --recipe recipe.yaml --params question="What was..."
If Goose does not silently alias these, every headless run injects an empty string for the question — the agent runs but answers nothing, scoring zero with no visible error.
Fix
Align the key — either rename the parameter to instruction in the README examples, or change the template variable to {{ question }} and the parameter key to question.
Impact
Critical — headless/benchmark mode may be silently broken for all users following the README.
Problem
The recipe defines the input parameter key as
questionbut the prompt template uses{{ instruction }}:But the README example passes:
goose run --recipe recipe.yaml --params question="What was..."If Goose does not silently alias these, every headless run injects an empty string for the question — the agent runs but answers nothing, scoring zero with no visible error.
Fix
Align the key — either rename the parameter to
instructionin the README examples, or change the template variable to{{ question }}and the parameter key toquestion.Impact
Critical — headless/benchmark mode may be silently broken for all users following the README.