vOPD

Code for "KL for a KL: On-Policy Distillation with Control Variate Baseline"

Installation

conda env create -f environment.yml
conda activate opd
pip install flash-attn==2.8.3 --no-build-isolation

or

bash install.sh

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
configs		configs
scripts		scripts
src		src
README.md		README.md
environment.yml		environment.yml
install.sh		install.sh