Add Q4_KM only consolidated GGUF
Browse files
README.md
CHANGED
|
@@ -3,5 +3,5 @@
|
|
| 3 |
|
| 4 |
Source: Qwen/Qwen2.5-Coder-7B-Instruct-GGUF
|
| 5 |
|
| 6 |
-
This repo bundles
|
| 7 |
No weight merging. Compatible with llama.cpp ecosystem.
|
|
|
|
| 3 |
|
| 4 |
Source: Qwen/Qwen2.5-Coder-7B-Instruct-GGUF
|
| 5 |
|
| 6 |
+
This repo bundles only the single consolidated 'qwen2.5-coder-7b-instruct-q4_k_m.gguf' GGUF variant.
|
| 7 |
No weight merging. Compatible with llama.cpp ecosystem.
|