Skip to content

feat(ml-worker): add BETH Tier 2 sanity rail - #3298

Merged
Xore merged 1 commit into
mainfrom
issue-3294-coder
Sep 25, 2026
Merged

Xore merged 1 commit into
mainfrom
issue-3294-coder

Conversation

@Xore

@Xore Xore commented Sep 25, 2026

Copy link
Copy Markdown
Owner

Summary

  • Add the offline BETH Tier 2 sanity-rail command with the authors' feature encoding and published split fingerprint checks.
  • Keep BETH explicitly parallel-corpus-only: AUROC headline, AUPRC alongside, five-or-more seed variance, runtime MD5 metadata, and no disposition or deployment dependency.
  • Add focused synthetic tests, documentation, and external-data ignore rules.

Verification

  • python3 -m pytest ml-worker/tests/test_detector_benchmark.py ml-worker/tests/test_beth_benchmark.py -q — 38 passed.
  • CLI help succeeds without the dataset.
  • Empty --data-dir exits 2 with a clear dataset-absent error and no traceback or report file.

The BETH corpus was not downloaded, so real AUROC/AUPRC values and runtime compatibility with the corpus remain to be measured on a prepared external dataset.

Closes #3294

@github-actions

Copy link
Copy Markdown

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Scanned Files

None

@Xore
Xore merged commit d70445a into main Sep 25, 2026
125 of 127 checks passed
@Xore
Xore deleted the issue-3294-coder branch September 25, 2026 13:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ml: add BETH Tier 2 sanity-rail harness to ml-worker/benchmarks

1 participant