-
Notifications
You must be signed in to change notification settings - Fork 4
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
String-form tags silently dropped, --tags skips the case with no warning
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#36 In AgentPostmortem/Evalgate;llm-judge passes on unclamped scores, a 0-100 reply always passes
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#35 In AgentPostmortem/Evalgate;embedding-similarity accepts out-of-range threshold
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#34 In AgentPostmortem/Evalgate;Rubric criterion with invalid pattern regex throws and kills the whole run
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#33 In AgentPostmortem/Evalgate;compareRuns accepts negative/NaN tolerance
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#30 In AgentPostmortem/Evalgate;Scorer weight: Infinity passes validation and poisons aggregation
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#29 In AgentPostmortem/Evalgate;contains scorer with empty-string needle always passes
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#28 In AgentPostmortem/Evalgate;Suite validation accepts empty prompts and bogus message roles
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#27 In AgentPostmortem/Evalgate;Invalid numeric CLI flags silently fall back instead of erroring
good first issueGood for newcomersGood for newcomershelp wantedExtra attention is neededExtra attention is neededStatus: Open.#26 In AgentPostmortem/Evalgate;Cost is one hardcoded rate per provider, applied to every model and both token directions
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.#16 In AgentPostmortem/Evalgate;Provider calls have no timeout and no retry, so a 429 fails the build
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.#15 In AgentPostmortem/Evalgate;One provider or scorer error discards the entire run
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededStatus: Open.#14 In AgentPostmortem/Evalgate;