Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,10 @@ pipeline_tag: image-text-to-text
|
|
| 10 |
> [!IMPORTANT]
|
| 11 |
> Thinking seem to be in chinese, transformers does the same thing (only for flash), you can toggle it off by editing the chat_template to have enable_thinking false (or keep it and have chinese thinking blocks)
|
| 12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
### exl3 quant
|
| 14 |
---
|
| 15 |
### check revisions for quants
|
|
|
|
| 10 |
> [!IMPORTANT]
|
| 11 |
> Thinking seem to be in chinese, transformers does the same thing (only for flash), you can toggle it off by editing the chat_template to have enable_thinking false (or keep it and have chinese thinking blocks)
|
| 12 |
|
| 13 |
+
> [!IMPORTANT]
|
| 14 |
+
> You might need to compile exl3 from dev to run this, have not tested with stable since dev had a few changes required to make this and 4.6V (regular) work
|
| 15 |
+
|
| 16 |
+
|
| 17 |
### exl3 quant
|
| 18 |
---
|
| 19 |
### check revisions for quants
|