Skip to content

Add LLM augmented noul labeling script + include labels in HF sync - #112

Merged
Oaklight merged 2 commits into
mainfrom
worktree-feature+augmented-noul-as-choice-labeling
Sep 30, 2026
Merged

Oaklight merged 2 commits into
mainfrom
worktree-feature+augmented-noul-as-choice-labeling

Conversation

@Oaklight

Copy link
Copy Markdown
Owner

Summary

  • Add data/scripts/label_augmented_noul_llm.py — resumable, shardable script for GPT-5.6 Luna teacher labeling of augmented noul items as 5-option choice questions
  • Update .github/workflows/synthetic.yaml to include *_labels.jsonl files in HF sync (trigger paths, file listing, upload patterns)

The label data itself (87,718 Luna augmented labels across 23 domains) was committed and merged via PR #111. This PR adds the labeling script that generated them and ensures future label files are synced to HuggingFace automatically.

Closes Phase B infrastructure for #104.

Test plan

  • python -m pytest tests/ — 548 passed, 3 skipped
  • Dry-run labeling script: python data/scripts/label_augmented_noul_llm.py — correctly discovers 87,822 items, reports 0 unlabeled
  • HF workflow: verify allow_patterns includes *_labels.jsonl

@Oaklight
Oaklight merged commit 1329723 into main Sep 30, 2026
4 checks passed
@Oaklight
Oaklight deleted the worktree-feature+augmented-noul-as-choice-labeling branch September 30, 2026 00:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant