zai-org
/

chatglm2-6b-int4

Model card Files Files and versions

quantization_code 源码是否开源呢?

#7

by Buxian - opened Jul 4, 2023

quantization.py 中 quantization_code 的原始.cu源码计划开源吗

不能反编译吗

写成这样是因为 hf 的限制，原始代码可以看 https://github.com/THUDM/GLM-130B/blob/main/cuda/quantization.cu 和 https://github.com/prnake/haruka-cuda/tree/master/quant-gemm

好的，感谢！

Buxian changed discussion status to closed Jul 19, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment