hotsplit

Here is 1 public repository matching this topic...

LLM hot experts in VRAM, cold experts in RAM - dynamically balanced. everything for 4 x RTX PRO 6000 setup

uva marlin humming vllm rtx-pro-6000 glm-5-3 glm-5-3-flash deepseek-v4-1-flash mimo-v2-6-pro hotsplit

To associate your repository with the hotsplit topic, visit your repo's landing page and select "manage topics."