GLM 5.2
#9
by NermalTriton - opened
I would like to request an INT4 Autoround quantisation for GLM 5.2 (https://huggingface.co/zai-org/GLM-5.2)
I would like to request an INT4 Autoround quantisation for GLM 5.2 (https://huggingface.co/zai-org/GLM-5.2)
hi @NermalTriton we are working on it.
@NermalTriton please take a look this quantized model: https://huggingface.co/INCModel2/GLM-5.2-MXFP4-Mixed-CT-AutoRound