Update README.md
Browse files
README.md
CHANGED
|
@@ -17,7 +17,7 @@ tags:
|
|
| 17 |
|
| 18 |
**Torii-Gate-v0.3** is a further training of [ToriiGate-v0.2](https://huggingface.co/Minthy/ToriiGate-v0.2) which is based on [Idefics3](https://huggingface.co/HuggingFaceM4/Idefics3-8B-Llama3).
|
| 19 |
|
| 20 |
-
It is designed for captioning of anime arts and aims to achieve a good understading for a very wide range of
|
| 21 |
Using booru-tags grounding it can give detailed descriptions with very high accuracy. It can handle NSFW pretty well, being one of the best small/medium-sized open source models at the time of release.
|
| 22 |
|
| 23 |
[**Showcase on rentry**](https://rentry.co/q4pisesb) (NSFW warning!)
|
|
@@ -96,7 +96,7 @@ import torch
|
|
| 96 |
from transformers import AutoProcessor, AutoModelForVision2Seq
|
| 97 |
from transformers.image_utils import load_image
|
| 98 |
|
| 99 |
-
model_name_or_path="Minthy/ToriiGate-v0.
|
| 100 |
|
| 101 |
DEVICE = "cuda:0" #change to your device
|
| 102 |
processor = AutoProcessor.from_pretrained(model_name_or_path) #or change to local path
|
|
@@ -149,7 +149,7 @@ caption=generated_texts[0].split('Assistant: ')[1]
|
|
| 149 |
print(caption)
|
| 150 |
```
|
| 151 |
|
| 152 |
-
For batch processing you can use [this example](https://huggingface.co/Minthy/ToriiGate-v0.
|
| 153 |
|
| 154 |
# Warning
|
| 155 |
Model tends to generate texts with adult themes if related input is provided. Outputs may be inacurate and provocative.
|
|
|
|
| 17 |
|
| 18 |
**Torii-Gate-v0.3** is a further training of [ToriiGate-v0.2](https://huggingface.co/Minthy/ToriiGate-v0.2) which is based on [Idefics3](https://huggingface.co/HuggingFaceM4/Idefics3-8B-Llama3).
|
| 19 |
|
| 20 |
+
It is designed for captioning of anime arts and aims to achieve a good understading for a very wide range of images, including single/multiple characters, simple or complex scenes, comic or manga, various interactions and lots of highly cultural concepts.
|
| 21 |
Using booru-tags grounding it can give detailed descriptions with very high accuracy. It can handle NSFW pretty well, being one of the best small/medium-sized open source models at the time of release.
|
| 22 |
|
| 23 |
[**Showcase on rentry**](https://rentry.co/q4pisesb) (NSFW warning!)
|
|
|
|
| 96 |
from transformers import AutoProcessor, AutoModelForVision2Seq
|
| 97 |
from transformers.image_utils import load_image
|
| 98 |
|
| 99 |
+
model_name_or_path="Minthy/ToriiGate-v0.3"
|
| 100 |
|
| 101 |
DEVICE = "cuda:0" #change to your device
|
| 102 |
processor = AutoProcessor.from_pretrained(model_name_or_path) #or change to local path
|
|
|
|
| 149 |
print(caption)
|
| 150 |
```
|
| 151 |
|
| 152 |
+
For batch processing you can use [this example](https://huggingface.co/Minthy/ToriiGate-v0.3/resolve/main/batch_processing_example.py)
|
| 153 |
|
| 154 |
# Warning
|
| 155 |
Model tends to generate texts with adult themes if related input is provided. Outputs may be inacurate and provocative.
|