Popular repositories Loading

1. memline memline Public

   Python 2

2. speculators speculators Public

   Forked from vllm-project/speculators

   A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

   Python

3. sgl-kernel-npu sgl-kernel-npu Public

   Forked from sgl-project/sgl-kernel-npu

   SGLang kernel library for NPU

   C++

4. vllm-ascend vllm-ascend Public

   Forked from vllm-project/vllm-ascend

   Community maintained hardware plugin for vLLM on Ascend

   C++

5. LMCache-Ascend LMCache-Ascend Public

   Forked from LMCache/LMCache-Ascend

   LMCache-Ascend is a plugin for running LMCache on the Ascend NPU.

   Python

6. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python