Performance comps with BF16?
#3
by
zenmagnets
- opened
Any chance you could run some performance comparisons vs the original weights? Similar to:
https://huggingface.co/GadflyII/GLM-4.7-Flash-NVFP4
In order to better evaluate the quant tradeoffs
hi, I might do this but i have limited compute so don't count on it. Feel free to try it yourself :)
I can notify you if i do.
marksverdhei
changed discussion status to
closed