This collection contains SINQ GGUF models
HUAWEI Computing Systems Lab
company
Verified
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks
SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights
-
AC-LoRA: (Almost) Training-Free Access Control-Aware Multi-Modal LLMs
Paper • 2505.11557 • Published • 7 -
SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights
Paper • 2509.22944 • Published • 81 -
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks
Paper • 2606.03458 • Published • 66
This collection contains SINQ GGUF models
This collection contains the models quantized with the SINQ quantization method.
-
AC-LoRA: (Almost) Training-Free Access Control-Aware Multi-Modal LLMs
Paper • 2505.11557 • Published • 7 -
SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights
Paper • 2509.22944 • Published • 81 -
KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks
Paper • 2606.03458 • Published • 66