Repository navigation
Add Roadmap and Kill criteria to the README - #39
Merged
Merged
Conversation
Two short sections between Limitations and License. Roadmap is labelled as intent rather than work done, so a reader cannot mistake v2 and v3 for things that exist. v1 states what is actually here. v2 is inter-annotator agreement with kappa published, a submission harness, and a test split held out by mechanism rather than by discipline. v3 is calibration, longitudinal loops, and resolution arriving on a different channel from the commitment. Kill criteria states plainly when to abandon rather than defend. If agreement on superseded falls below roughly 0.6 the label is ill-defined, and the headline metric needs redesigning rather than more data. If PII redaction turns out to cost less than a couple of points once the run completes, the tension the benchmark was built around does not exist and the framing narrows to supersession alone. Nothing else was added, and Limitations and Corpus separability are untouched at 66 and 82 lines with the cost table still at five weights. README goes from 308 lines to 339.
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Two short sections between Limitations and License. Nothing else added, nothing trimmed.
Roadmap
Labelled as intent, not work done, so a reader cannot mistake v2 and v3 for things that exist.
superseded. A submission harness so another extractor can be scored against the same corpus. A test split held out by mechanism rather than by discipline.Kill criteria
Stated plainly as conditions for abandoning parts of the benchmark rather than defending them.
supersededbelow roughly 0.6 means the label is ill-defined, and the headline metric needs redesigning rather than more data, because more data labeled against an unclear rule buys nothing.Nothing else changed
README goes from 308 lines to 339, so both sections together cost 31 lines.
pnpm checkpasses with 229 tests.pnpm validatepasses with 200 threads, 273 loops and 510 spans all resolving. No em or en dashes introduced.🤖 Generated with Claude Code