Discussions Enabled

[thomas9120]

You can ask questions, have conversations, etc. here but keep in mind I'm a solo developer and I want to keep Llama-GUI's scope from getting out of hand. Feel free to fork the repo if you want substantial changes.

[soulafein83]

Thanks a lot for building LlamaGUI! My kids are using it on their computers to run local LLMs, and it's been working really well for them. Since they both have RX 6600 GPUs, native ROCm support is a huge plus—it's actually the main reason we use LlamaGUI over LM Studio, which still lacks proper support for these cards (obły Vulkan/CPU).

Regarding features and scope: keeping it lightweight makes total sense. From a beginner/user perspective, one thing that would be really helpful is basic UI configuration for essential llama.cpp flags, ideally with a collapsible "Advanced Flags" section for deeper tweaking when needed.

Appreciate your hard work on this project!

[thomas9120]

I do want more beginner friendly features as you suggest, for now Quick Launch sort of can be used for that since it surfaces the basics. But everything gets tricky when you need to use speculative decoding, mmproj files, etc. It's hard to incorporate that without overwhelming beginners. It's something I'm going to work on as a more long term goal. Once this new UI/UX revamp is out - which you can see here: https://github.com/thomas9120/LLama-GUI/tree/UI-improvements - I'll turn my focus towards a beginner friendly flow.

[fluxxus]

Hey @thomas9120! Quick one please. I see that there is a PR that mentions adding router mode, but it is not clear to me is that feature added or not?

If not, how far away are we from it? :))

[thomas9120]

I investigated the possibility of adding it, but it is a significant implementation. It's been on the back burner for a while.

[fluxxus]

Got you. Hopefully you'll be able to add it in the future, I wasn't aware that it requires significant amount of work to get it done.

There are projects similar to yours that support it, but the rest of stuff in those apps is nowhere near the functionality that LlamaGUI offers.