getting it all runing with gradio is a nightmare.

[phazei]

Please add all the dependencies needed, otherwise it's try to run over and over again with errors of missing things, then installing and repeating. It's really horrible.

[laitselec]

hi, thanks for your feedback. dependencies are in pyproject.toml (plus bitsandbytes if quantization is needed)
pip install -e . install them all