Update README.md
Browse files
README.md
CHANGED
|
@@ -37,3 +37,11 @@ By applying the LoRA to the `mlp.down_proj` module, we sought to influence the m
|
|
| 37 |
```
|
| 38 |
<s>[INST] {input} [/INST] {output}</s>
|
| 39 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
```
|
| 38 |
<s>[INST] {input} [/INST] {output}</s>
|
| 39 |
```
|
| 40 |
+
|
| 41 |
+
## EXl2 Quants
|
| 42 |
+
|
| 43 |
+
[8.0bpw](https://huggingface.co/BigHuggyD/gghfez_SmartMaid-123b_exl2_8.0bpw_h8) courtesy of [BigHuggyD](https://huggingface.co/BigHuggyD)
|
| 44 |
+
|
| 45 |
+
[7.0bpw](https://huggingface.co/BigHuggyD/gghfez_SmartMaid-123b_exl2_7.0bpw_h8) courtesy of [BigHuggyD](https://huggingface.co/BigHuggyD)
|
| 46 |
+
|
| 47 |
+
[4.5bpw](https://huggingface.co/gghfez/SmartMaid-123b-exl2/tree/4.5bpw)
|