Point paper link at the three focused papers
Browse files
README.md
CHANGED
|
@@ -45,6 +45,6 @@ with compress_kv_cache(model, mode="quant_only", bits=2):
|
|
| 45 |
|
| 46 |
- [Live demo](https://huggingface.co/spaces/jmarquex/nexusquant-demo)
|
| 47 |
- [GitHub](https://github.com/jagmarques/nexusquant)
|
| 48 |
-
- [
|
| 49 |
- [llama.cpp PR](https://github.com/ggml-org/llama.cpp/pull/25352)
|
| 50 |
- [vLLM PR](https://github.com/vllm-project/vllm/pull/47742)
|
|
|
|
| 45 |
|
| 46 |
- [Live demo](https://huggingface.co/spaces/jmarquex/nexusquant-demo)
|
| 47 |
- [GitHub](https://github.com/jagmarques/nexusquant)
|
| 48 |
+
- Papers: [Method](https://github.com/jagmarques/nexusquant/blob/main/paper/nexusquant-method.pdf), [2-bit retrieval](https://github.com/jagmarques/nexusquant/blob/main/paper/nexusquant-2bit-retrieval.pdf), [FP16 dead zones](https://github.com/jagmarques/nexusquant/blob/main/paper/nexusquant-fp16-deadzones.pdf)
|
| 49 |
- [llama.cpp PR](https://github.com/ggml-org/llama.cpp/pull/25352)
|
| 50 |
- [vLLM PR](https://github.com/vllm-project/vllm/pull/47742)
|