The built in Ollama support is fine, but expanded local support would be greatly appreciated. Here's the major clients/servers I know of:
- LM Studio
- Llama.cpp
- Lemonade Server
IIRC, they all support OpenAI API and their own proprietary APIs, so a basic level of support should not be too difficult to implement.
The built in Ollama support is fine, but expanded local support would be greatly appreciated. Here's the major clients/servers I know of:
IIRC, they all support OpenAI API and their own proprietary APIs, so a basic level of support should not be too difficult to implement.