Update README.md
Browse files
README.md
CHANGED
|
@@ -15,7 +15,7 @@ pipeline_tag: text-generation
|
|
| 15 |
**This is an early preview release of ExLlamaV3.**
|
| 16 |
|
| 17 |
|
| 18 |
-
| | Quant type | File Size |
|
| 19 |
| -------- | ---------- | --------- | -------- |
|
| 20 |
| [phi-4_3bpw](https://huggingface.co/cmh/phi-4_exl3/tree/3bpw) | 3 bits per weight | 6.08 GB | **9.4 GB** |
|
| 21 |
| [phi-4_4bpw](https://huggingface.co/cmh/phi-4_exl3/tree/4bpw) | 4 bits per weight | 7.67 GB | **11.0 GB** |
|
|
|
|
| 15 |
**This is an early preview release of ExLlamaV3.**
|
| 16 |
|
| 17 |
|
| 18 |
+
| | Quant type | File Size | Vram*|
|
| 19 |
| -------- | ---------- | --------- | -------- |
|
| 20 |
| [phi-4_3bpw](https://huggingface.co/cmh/phi-4_exl3/tree/3bpw) | 3 bits per weight | 6.08 GB | **9.4 GB** |
|
| 21 |
| [phi-4_4bpw](https://huggingface.co/cmh/phi-4_exl3/tree/4bpw) | 4 bits per weight | 7.67 GB | **11.0 GB** |
|