Instructions to use microsoft/kosmos-2-patch14-224 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use microsoft/kosmos-2-patch14-224 with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("image-to-text", model="microsoft/kosmos-2-patch14-224")# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("microsoft/kosmos-2-patch14-224") model = AutoModelForImageTextToText.from_pretrained("microsoft/kosmos-2-patch14-224") - Notebooks
- Google Colab
- Kaggle
1 Click Windows, RunPod & Linux Installer for Kosmos-2 with Batch Image captioning feature - not an issue
After working whole day I finally coded it and published it.
Also I found a better prompt that captions better.
You can download auto installer at here : https://www.patreon.com/posts/90744385
The batch image captioning models we have right now as follows:
CogVML with quantization 4-bit, 8-bit, 16-bit
LLaVA including 34b with quantization such as 4-bit, 8-bit, 16-bit
Blip2 Models
Clip Vision Models
Kosmos-2 Model
Kosmos-2 supports both single image captioning and also batch image captioning. I also did some research to find a good prompt.
1 click to install both on Windows, RunPod & Linux.
Generates its own venv so will never conflict with no any other app you have.
Here news about them : https://www.patreon.com/posts/sota-image-model-98499462
After working whole day I finally coded it and published it.
Also I found a better prompt that captions better.
You can download auto installer at here : https://www.patreon.com/posts/90744385
Hello
the tools you use are open source, but you don't have the right to sell their use with your program.
thank you for sharing it for free


