Feature: Model Browser

[kirk56k]

I would be extremely surprised if this wasn't already on your radar. But on the off chance it isn't, I think a Model Browser would be an excellent addition. Maybe combine your Presets into it, list all available models and as much info about them as you can extract, along with any presets for the given model on its own tab. Something akin to how TurboLLM has done it, except perhaps a tad more refined. I know that's a pretty big ask and perhaps its outside the scope you've defined for this application. If so, so be it. Just figured it couldn't hurt to suggest. Thanks!

[thomas9120]

It may be out of scope but I'll look into it.

[kirk56k]

You know, the one thing I haven't been able to find in any available project, is something that will allow me to manage my 2TB of LLM Models. The features I'd most be interested in are the following. Saving preset configurations for each model (several presets per model), the ability to browse the HuggingFace page for said model. The ability to see if the model has been updated on HuggingFace since it was last downloaded (and update it if it has). The ability to make notes about the model, accuracy, speed, use cases, etc. The ability to see the results of any previous benchmarks made against said model (including what inference engine was used). And possibly the average and most recent t/s on both prefill and generation. I know this is all probably pie in the sky, but I figured it couldn't hurt to throw around ideas.

[thomas9120]

It would be nice to have something like this, I'd probably make it as a separate app from Llama-GUI but keep the presets compatible and make it so I could point the Model Manager app to the llama-gui presets folder.

[kirk56k]

Well, if you ever happen to take on a project like this, please let me know. I would definetly be interested.