Update iMatrix filename
Browse files
README.md
CHANGED
|
@@ -125,7 +125,7 @@ python llama-clover-converter/llama.cpp/convert_hf_to_gguf.py Diffuspace/Clover-
|
|
| 125 |
./bin/llama-imatrix -m clover-q8_0.gguf -f calibration.raw -o clover.imatrix.gguf --output-format gguf --process-output --no-ppl --no-escape -c 2048 -b 2048 -ub 2048 --chunks 611 -ngl 99
|
| 126 |
```
|
| 127 |
|
| 128 |
-
The APEX-I V2.1 releases were produced with this build: `llama-quantize --imatrix
|
| 129 |
|
| 130 |
## Notes
|
| 131 |
|
|
|
|
| 125 |
./bin/llama-imatrix -m clover-q8_0.gguf -f calibration.raw -o clover.imatrix.gguf --output-format gguf --process-output --no-ppl --no-escape -c 2048 -b 2048 -ub 2048 --chunks 611 -ngl 99
|
| 126 |
```
|
| 127 |
|
| 128 |
+
The APEX-I V2.1 releases were produced with this build: `llama-quantize --imatrix Clover-VAL-1.25M-I-Matrix.gguf --tensor-type-file <recipe> clover-bf16.gguf <output> Q4_0 64`. The recipes carry 853 lines, including the 120 block-diffusion tensors that must stay in `F32`.
|
| 129 |
|
| 130 |
## Notes
|
| 131 |
|