vllm serve fails with ModuleNotFoundError: No module named 'vllm.entrypoints'

[Sudden-Snowball]

I am following installation guide on Windows 11 x64.

$ vllm serve "microsoft/Fara-7B" --port 5000 --dtype auto
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in run_code
File "C:\Users\Savel\AppData\Local\Programs\Python\Python313\Scripts\vllm.exe_main.py", line 2, in
from vllm.entrypoints.cli.main import main
ModuleNotFoundError: No module named 'vllm.entrypoints'
(.venv)

Also the directorie named "venv/bin" i'm not found, maybe i did smth wrong...

[husseinmozannar]

I would recommend using WSL2 inside Windows for using vllm, while we figure out solutions for serving inside Windows, thank you for your patience

[husseinmozannar]

Please try the new instructions for Windows here windows install instructions, thank you for your patience