jmarquex commited on
Commit
8eddac7
·
verified ·
1 Parent(s): 2096a2e

Point paper link at the three focused papers

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -45,6 +45,6 @@ with compress_kv_cache(model, mode="quant_only", bits=2):
45
 
46
  - [Live demo](https://huggingface.co/spaces/jmarquex/nexusquant-demo)
47
  - [GitHub](https://github.com/jagmarques/nexusquant)
48
- - [Paper PDF](https://github.com/jagmarques/nexusquant/blob/main/paper/nexusquant.pdf)
49
  - [llama.cpp PR](https://github.com/ggml-org/llama.cpp/pull/25352)
50
  - [vLLM PR](https://github.com/vllm-project/vllm/pull/47742)
 
45
 
46
  - [Live demo](https://huggingface.co/spaces/jmarquex/nexusquant-demo)
47
  - [GitHub](https://github.com/jagmarques/nexusquant)
48
+ - Papers: [Method](https://github.com/jagmarques/nexusquant/blob/main/paper/nexusquant-method.pdf), [2-bit retrieval](https://github.com/jagmarques/nexusquant/blob/main/paper/nexusquant-2bit-retrieval.pdf), [FP16 dead zones](https://github.com/jagmarques/nexusquant/blob/main/paper/nexusquant-fp16-deadzones.pdf)
49
  - [llama.cpp PR](https://github.com/ggml-org/llama.cpp/pull/25352)
50
  - [vLLM PR](https://github.com/vllm-project/vllm/pull/47742)