Thanks for the great work on this repository!
I found that the evaluation script wasn't applying the LoRARequest properly. This meant we were just evaluating the base model every time, which is why the results looked almost the same as pre-training. #14
I have created a PR to add the missing request and ensure the adapters are loaded. #19
Thanks for the great work on this repository!
I found that the evaluation script wasn't applying the LoRARequest properly. This meant we were just evaluating the base model every time, which is why the results looked almost the same as pre-training. #14
I have created a PR to add the missing request and ensure the adapters are loaded. #19