Configs, launchers, benchmarks, and tooling for running Qwen3.5 GGUF models locally with llama.cpp on a 16GB NVIDIA GPU
benchmark cuda nvidia moe vlm multimodal mixture-of-experts huggingface ai-inference llm llama-cpp local-llm local-ai qwen gguf llama-server rtx-5080 rtx-4080 qwen3-5 vram-16gb
-
Updated
Mar 29, 2026 - Python