Skip to content

Missing LoRARequest in GSM8K evaluation script #20

Description

@yuxizhe

Thanks for the great work on this repository!

I found that the evaluation script wasn't applying the LoRARequest properly. This meant we were just evaluating the base model every time, which is why the results looked almost the same as pre-training. #14

I have created a PR to add the missing request and ensure the adapters are loaded. #19

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions