INC4AI

/

GLM-5.1-int4-mixed-AutoRound

like 7

First of all, thanks for your work.

Do you have any plans publishing this same quant for the recently released GLM 5.2?

This is the only quant I can fit in 512GB (0.88x of that effectively) with a small KV cache…

Thanks in any case.