Hello @ChenDaiwei-99 , sorry to bother you again. I have been exploring the code for some time but still I was not able to figure out how to perform the inferencing on the generated model. With reference to issue I followed your direction of going through your open-sourced model but things are not quite clear as in like which code snippet to run and in which order.
If possible can you please share the complete inference code using which I can get the reward score when prompted?
Thanks in advance for the response
Regards
Sayan
Hello @ChenDaiwei-99 , sorry to bother you again. I have been exploring the code for some time but still I was not able to figure out how to perform the inferencing on the generated model. With reference to issue I followed your direction of going through your open-sourced model but things are not quite clear as in like which code snippet to run and in which order.
If possible can you please share the complete inference code using which I can get the reward score when prompted?
Thanks in advance for the response
Regards
Sayan