Update README.md
Browse files
README.md
CHANGED
|
@@ -20,24 +20,23 @@ base_model_relation: quantized
|
|
| 20 |
For more information about the model, I highly recommend checking out the original model page and the creator while you're at it.
|
| 21 |
|
| 22 |
**ExLlamaV2 Quantizations:**
|
| 23 |
-
|
| 24 |
-
**
|
| 25 |
-
**7.
|
| 26 |
-
**
|
| 27 |
-
**6.
|
| 28 |
-
**
|
| 29 |
-
**5.
|
| 30 |
-
**
|
| 31 |
-
**4.
|
| 32 |
-
**4.
|
| 33 |
-
**
|
| 34 |
-
**3.
|
| 35 |
-
**3.
|
| 36 |
-
**
|
| 37 |
-
**2.
|
| 38 |
-
**2.
|
| 39 |
-
**2.
|
| 40 |
-
**2.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.0bpw)
|
| 41 |
|
| 42 |
[Measurement File](https://huggingface.co/TheMelonGod/phi-4-exl2/blob/main/phi-4-measurement.json) _(Default/built-in calibration dataset was used)_
|
| 43 |
|
|
|
|
| 20 |
For more information about the model, I highly recommend checking out the original model page and the creator while you're at it.
|
| 21 |
|
| 22 |
**ExLlamaV2 Quantizations:**
|
| 23 |
+
**8.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-8.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-8.0bpw)
|
| 24 |
+
**7.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-7.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-7.5bpw)
|
| 25 |
+
**7.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-7.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-7.0bpw)
|
| 26 |
+
**6.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-6.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-6.5bpw)
|
| 27 |
+
**6.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-6.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-6.0bpw)
|
| 28 |
+
**5.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-5.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-5.5bpw)
|
| 29 |
+
**5.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-5.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-5.0bpw)
|
| 30 |
+
**4.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-4.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-4.5bpw)
|
| 31 |
+
**4.25bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-4.25bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-4.25bpw)
|
| 32 |
+
**4.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-4.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-4.0bpw)
|
| 33 |
+
**3.75bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-3.75bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-3.75bpw)
|
| 34 |
+
**3.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-3.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-3.5bpw)
|
| 35 |
+
**3.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-3.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-3.0bpw)
|
| 36 |
+
**2.75bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.75bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-2.75bpw)
|
| 37 |
+
**2.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-2.5bpw)
|
| 38 |
+
**2.25bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.25bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-2.25bpw)
|
| 39 |
+
**2.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-2.0bpw)
|
|
|
|
| 40 |
|
| 41 |
[Measurement File](https://huggingface.co/TheMelonGod/phi-4-exl2/blob/main/phi-4-measurement.json) _(Default/built-in calibration dataset was used)_
|
| 42 |
|