MACaQ
Collection
GGUFs models for local AI Inference quantized with MACaQ (https://github.com/huawei-csl/MACaQ) • 1 item • Updated • 2
None defined yet.
MACaQ: Fast, Model Agnostic Calibrated Quantization for Low-Precision Weights and Activations
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks