Unable to set up on MacOS

[sajal1123]

Hello, I am trying to set up Yi-Coder locally on my M1 pro MacOS. However, it looks like vllm is no longer available for Mac Users because of a torch dependency

I'm wondering if this is a known issue.

[Haijian06]

Hello @sajal1123, regarding this issue, I haven't encountered any version incompatibility problems when using Ollama or transformers for local inference. Could you please provide the specific error message you're seeing? Perhaps we can further troubleshoot this problem together.