Popular repositories Loading

1. xllm-service xllm-service Public

   Forked from xLLM-AI/xllm-service

   A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.

   C++

2. xllm xllm Public

   Forked from xLLM-AI/xllm

   A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

   C++

3. vllm-ascend vllm-ascend Public

   Forked from sanlio36/vllm-ascend

   Community maintained hardware plugin for vLLM on Ascend

   C++

4. xllm-mlu-analyzer xllm-mlu-analyzer Public

   Evidence-driven xLLM inference performance analysis agent for Cambricon MLU

   Python