Repository navigation
Conversation
Signed-off-by: 0z5a <dezhen.lu@student.uni-tuebingen.de>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Checkpoint equality does not establish that a resumed worker generated the same samples or evaluated every held-out question. Add an output audit that reopens both runs, binds evaluation to the recorded worker and publication, re-decodes saved tokens, regrades rewards, and compares training tensors plus all four held-out rounds.
The frozen qualification covers 96 training and 32 held-out samples per run. Tokens and semantic traces must match; numeric comparisons use the predeclared FP32 tolerance and report maximum differences. Identical outputs with no useful learning signal do not qualify. This change leaves training and serving behavior unchanged.
Stacked on #20 with
feature/native-runtime-identityas the base. One incremental commit, authored and signed off by 0z5a.The tiny model tests restore fresh objects in one process and use tokenizer/transport doubles. CLI tests use synthetic worker/process records; official tokenizer controls use known answers and invented scores. These are not fresh Ray-worker or reasoning-convergence results. Weight/checkpoint/optimizer state and frozen-source membership remain separate gates.
Results and speed-comparison table, with raw logs/XML, tokenizer controls and hashes in
benchmarks/results/native-output-recovery/.