Skip to content

feat(tools): quantize any float weight in checkpoint layout, and load what no quantized kernel runs as float - #123

Draft
chmjkb wants to merge 7 commits into
mainfrom
@chmjkb/quantizer-kernel-agnostic
Draft

chmjkb wants to merge 7 commits into
mainfrom
@chmjkb/quantizer-kernel-agnostic

docs(docs): re-measure the int8 and int4 numbers, warn off int4 for c…

09f1623
Select commit
Loading
Failed to load commit list.