Skip to content

Issue in evaluating checkpoints trained by QeRL #13

Description

@oncleJules

After training with QeRL, i got such a checkpoint folder

Image

when i tried to use the recommended command
python -m eval.gsm8k --model "~/QeRL/ckpt/qwen2.5-3B-single-gpus-quantized 1e-5_0.28 _gsm8k_b2_g1_r16_True/checkpoint-7473" --load nvfp4
for evaluation, i got the following error

Image

The "Repo id must be in the form 'repo_name'..." issue seems not fixed

Any suggestion to fix this issue? thanks in advance!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions