Repository navigation
Add a second blind fixture, a scoring script and its first scored run - #12
Merged
Merged
Conversation
examples/kanthari-nala is a synthetic record with an answer key and a run sheet for a blind, separately scored run. examples/score-check.mjs validates and tallies any run folder against a key; the scorer judges. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
examples/kanthari-nala.run-1 holds the run's matter folder unchanged, the scorer's score-map.json and SCORE.md. 14 of 14 planted issues found, 6 of 6 should-not-flag items clean, all 16 findings valid. A post-run probe showed the write hooks live in the run's workspace. The key gains eight known gaps from the run and a W1 correction the run pointed out. The run sheet now puts the record inside the workspace and adds the hook probe, as this run did. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
3 tasks done
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Morvali Creek stopped being blind when the November source pack filled the four gaps it exposed, and its run never exercised Aranya's own hooks or skill routing, because the session started in the Vigil folder. This adds a second synthetic matter with an answer key, a run sheet, a scoring script and the first blind run's score, following Vigil's tamarind-lend fixture (prathikcannotcode/Vigil#9).
No skill, script, schema or catalog entry changes.
Run 1
verify/unverifiedstates carriedverify; the unverified order is kept out of the prayerenv-case-analysisinvoked through the Skill toolexpert_validatedwrite and a write outside the layoutThe run also caught a mistake in the key. W1 said the Unit operated without consent until January 2024, but it was closed from 3 October 2023. The key now has that fix and eight real gaps the run found as
known_gaps, including a bad restoration lag in the consultant's inputs. The score stands against the original key.Read SCORE.md before quoting the number.
918a2e6); onmainalone, two of its CPCB findings would fail validation.What's here
examples/kanthari-nala/: an invented record. A textile dyeing unit bypassed its effluent plant into a nala in 2023, then pumped effluent into a borewell in 2025. The Board closed it twice and levied compensation twice, and the unit's appeal is pending.examples/kanthari-nala.expected.json: 14 planted issues, 6 should-not-flag items, 8 known gaps, calculator checks,watchterms, sources for every legal claim and anunverifiedlist.examples/kanthari-nala.run-sheet.md: the blind procedure. The session starts in the exported Aranya folder with the record atrecord/, works offline and ends with a hook probe. A separate session scores.examples/score-check.mjs: works for any Aranya run folder and key, Morvali included. It validates findings as the hook does, tallies flags and calculator runs, checks inputs againstcalc_checks, printswatchlines and tallies a scorer's map. It judges nothing.examples/kanthari-nala.run-1/: the run's matter folder unchanged, plusscore-map.jsonandSCORE.md.Order
Merge #11 first. This PR's run depends on it, and its tests here run without it.
Found while building it
catalog/provisions.jsonpoints 7 times atcatalog/patches/2026-11-source-pack/QUESTIONS-FOR-COUNSEL.md(Q1 to Q3), which release 0.3.0 deleted. The run hit the missing file and reported it. The fix is to restore the file undercatalog/, which the layout lets agents write, or to repoint the notes by hand.Checks
npm run validate -- --strict: 0 errorsnpm test: 29 tests, 27 pass, 2 skipped on Windows (branch cut frommain, without Fail closed on bad hook input and settle the Morvali Creek calls #11)score-check.mjsreproduces the run 1 tallies fromscore-map.jsonSynthetic data only. Not legal advice.
🤖 Generated with Claude Code