Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,7 @@ tags:
|
|
| 11 |
|
| 12 |
|
| 13 |
## VISION+
|
|
|
|
| 14 |
```script
|
| 15 |
|
| 16 |
If you want to use vision functionality:
|
|
@@ -18,7 +19,26 @@ If you want to use vision functionality:
|
|
| 18 |
Make sure you are using the latest version of KoboldCpp.
|
| 19 |
To use the multimodal capabilities of this model, such as vision, you also need to load the specified mmproj file, you can get it here.
|
| 20 |
|
|
|
|
|
|
|
| 21 |
You can load the mmproj by using the corresponding section in the interface:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
```
|
| 23 |
|
| 24 |
# MODEL_NAME
|
|
|
|
| 11 |
|
| 12 |
|
| 13 |
## VISION+
|
| 14 |
+
|
| 15 |
```script
|
| 16 |
|
| 17 |
If you want to use vision functionality:
|
|
|
|
| 19 |
Make sure you are using the latest version of KoboldCpp.
|
| 20 |
To use the multimodal capabilities of this model, such as vision, you also need to load the specified mmproj file, you can get it here.
|
| 21 |
|
| 22 |
+
https://huggingface.co/LeroyDyer/Mixtral_AI_Vision_128k/blob/main/mmproj-model-f16.gguf
|
| 23 |
+
|
| 24 |
You can load the mmproj by using the corresponding section in the interface:
|
| 25 |
+
|
| 26 |
+
|
| 27 |
+
KoboldCpp now supports Vision via Multimodal Projectors (aka LLaVA), allowing it to perceive and react to images! Load a suitable --mmproj file or select it in the GUI launcher to use vision capabilities. (Not working on Vulkan)
|
| 28 |
+
Note: This is NOT limited to only LLaVA models, any compatible model of the same size and architecture can gain vision capabilities!
|
| 29 |
+
Simply grab a 200mb mmproj file for your architecture here,
|
| 30 |
+
|
| 31 |
+
https://huggingface.co/koboldcpp/mmproj
|
| 32 |
+
|
| 33 |
+
load it with --mmproj and stick it into your favorite compatible model, and it will be able to see images as well!
|
| 34 |
+
|
| 35 |
+
|
| 36 |
+
|
| 37 |
+
|
| 38 |
+
|
| 39 |
+
|
| 40 |
+
|
| 41 |
+
|
| 42 |
```
|
| 43 |
|
| 44 |
# MODEL_NAME
|