TheMelonGod commited on
Commit
85edc92
·
verified ·
1 Parent(s): dba85b1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -18
README.md CHANGED
@@ -20,24 +20,23 @@ base_model_relation: quantized
20
  For more information about the model, I highly recommend checking out the original model page and the creator while you're at it.
21
 
22
  **ExLlamaV2 Quantizations:**
23
- 6hbs Will Be out Soon.
24
- **8.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-8.0bpw)
25
- **7.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-7.5bpw)
26
- **7.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-7.0bpw)
27
- **6.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-6.5bpw)
28
- **6.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-6.0bpw)
29
- **5.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-5.5bpw)
30
- **5.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-5.0bpw)
31
- **4.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-4.5bpw)
32
- **4.25bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-4.25bpw)
33
- **4.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-4.0bpw)
34
- **3.75bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-3.75bpw)
35
- **3.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-3.5bpw)
36
- **3.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-3.0bpw)
37
- **2.75bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.75bpw)
38
- **2.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.5bpw)
39
- **2.25bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.25bpw)
40
- **2.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.0bpw)
41
 
42
  [Measurement File](https://huggingface.co/TheMelonGod/phi-4-exl2/blob/main/phi-4-measurement.json) _(Default/built-in calibration dataset was used)_
43
 
 
20
  For more information about the model, I highly recommend checking out the original model page and the creator while you're at it.
21
 
22
  **ExLlamaV2 Quantizations:**
23
+ **8.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-8.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-8.0bpw)
24
+ **7.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-7.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-7.5bpw)
25
+ **7.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-7.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-7.0bpw)
26
+ **6.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-6.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-6.5bpw)
27
+ **6.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-6.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-6.0bpw)
28
+ **5.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-5.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-5.5bpw)
29
+ **5.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-5.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-5.0bpw)
30
+ **4.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-4.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-4.5bpw)
31
+ **4.25bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-4.25bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-4.25bpw)
32
+ **4.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-4.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-4.0bpw)
33
+ **3.75bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-3.75bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-3.75bpw)
34
+ **3.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-3.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-3.5bpw)
35
+ **3.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-3.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-3.0bpw)
36
+ **2.75bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.75bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-2.75bpw)
37
+ **2.5bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.5bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-2.5bpw)
38
+ **2.25bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.25bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-2.25bpw)
39
+ **2.0bpw**: [8hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/8hb-2.0bpw) | [6hb](https://huggingface.co/TheMelonGod/phi-4-exl2/tree/6hb-2.0bpw)
 
40
 
41
  [Measurement File](https://huggingface.co/TheMelonGod/phi-4-exl2/blob/main/phi-4-measurement.json) _(Default/built-in calibration dataset was used)_
42