Feature/quantisation - #1

Closed

Lothnic wants to merge 3 commits into

mainfrom

feature/quantisation

Commits on Apr 27, 2026

feat: implement 4-bit NF4 quantization via bitsandbytes
Lothnic
committed
a628898
fixed quantisation and ready to merge
Lothnic
committed
01a79f3
fix: corrected weight validation logic to prevent silent initialization of missing weights with random memory
Lothnic
committed
6b39989