GSQ-RCO-GGUF Collection Non-uniform GGUF quantizations via GSQ + RCO: per-tensor mixed precision in standard GGUF form • 2 items • Updated 7 days ago • 39
GSQ Collection GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling, https://huggingface.co/papers/2604.18556 • 10 items • Updated Aug 22 • 14