Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -33,6 +33,7 @@ GGUF format model files for [NousCoder-14B](https://huggingface.co/NousResearch/
|
|
| 33 |
| `NousCoder-14B.q5_k_m.gguf` | Q5_K_M (Medium) | 9.79 GB | K-quant 5-bit, excellent quality-to-size ratio. |
|
| 34 |
| `NousCoder-14B.q5_k_s.gguf` | Q5_K_S (Small) | 9.56 GB | K-quant 5-bit, good quality with reasonable size. |
|
| 35 |
| `NousCoder-14B.q6_k.gguf` | Q6_K | 11.29 GB | 6-bit quantization. Very high quality, larger size. |
|
|
|
|
| 36 |
|
| 37 |
## Usage
|
| 38 |
|
|
|
|
| 33 |
| `NousCoder-14B.q5_k_m.gguf` | Q5_K_M (Medium) | 9.79 GB | K-quant 5-bit, excellent quality-to-size ratio. |
|
| 34 |
| `NousCoder-14B.q5_k_s.gguf` | Q5_K_S (Small) | 9.56 GB | K-quant 5-bit, good quality with reasonable size. |
|
| 35 |
| `NousCoder-14B.q6_k.gguf` | Q6_K | 11.29 GB | 6-bit quantization. Very high quality, larger size. |
|
| 36 |
+
| `NousCoder-14B.q8_0.gguf` | Q8_0 | 14.62 GB | 8-bit quantization. Near-original quality, largest quantized size. |
|
| 37 |
|
| 38 |
## Usage
|
| 39 |
|