Pinned Loading

1. aibrix aibrix Public

   Forked from vllm-project/aibrix

   Cost-efficient and pluggable Infrastructure components for GenAI inference

   Go

2. LMCache LMCache Public

   Forked from LMCache/LMCache

   LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

   Python

3. deepeval deepeval Public

   Forked from confident-ai/deepeval

   The LLM Evaluation Framework

   Python

4. guidellm guidellm Public

   Forked from vllm-project/guidellm

   Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

   Python