Repository navigation
Conversation
Signed-off-by: 0z5a <dezhen.lu@student.uni-tuebingen.de>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The original RLTT data converter reads
problem/answer; passing the earlier publicprompt/labelJSONL gives an empty question and gold label. Add a separate public-input profile carrying both interfaces, with the pinned source instruction and default chat options. All 12,498 rows produce exactly matching original-converter and native prompts, token IDs and labels. The earlier data remains unchanged.Incremental draft on #16. No production training, rollout or reward code changes.
Validation: 62 existing CPU data/reward/evaluation tests pass without skips. Two fresh preparations produce byte-identical five JSONL files, five Parquet files, manifest and token rosters. The 1,024-token source/default-chat training profile keeps 7,479 rows with 19 explicit exclusions; all 256 development and 500 held-out rows remain. Official Ouro AutoConfig loading succeeds in the existing environment; complete VIME/MCore parser import fails on missing local Triton, with both receipts retained.
The unchanged original configuration functions and declared verl 0.6.1 source also expose a batch-accounting difference: conditional on DP4 and no private changes, CLI 32/8 produces 2,048 completions per rollout, not the nominal 256. Counts and budget consequences are explicitly source-derived; no full original dataloader/FSDP/optimizer run is claimed. Grader, optimizer, private model and actual training counts remain separate baseline qualifications.
See
docs/rltt_source_contract.mdfor the complete contract, speed-comparison table, source pins, reproduction and limitations; raw results and hashes are underbenchmarks/results/rltt-source-contract/.