Popular repositories Loading

1. DL4AGX DL4AGX Public

   Forked from NVIDIA/DL4AGX

   Deep Learning tools and applications for NVIDIA AGX platforms.

   Shell

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. TRTLLM_Kernels TRTLLM_Kernels Public

   C++

4. Model-Optimizer Model-Optimizer Public

   Forked from NVIDIA/Model-Optimizer

   A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks …

   Python

5. entquant entquant Public

   Forked from merantix-momentum/entquant

   Entropy Coding Meets Quantization

   Python

6. RDQuant RDQuant Public

   Python