Instructions to use openbmb/MiniCPM-V with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use openbmb/MiniCPM-V with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "visual-question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("visual-question-answering", model="openbmb/MiniCPM-V", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("openbmb/MiniCPM-V", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update readme, example code use bfloat16 to reduce GPU memory usage
Browse files
README.md
CHANGED
|
@@ -124,7 +124,7 @@ import torch
|
|
| 124 |
from PIL import Image
|
| 125 |
from transformers import AutoModel, AutoTokenizer
|
| 126 |
|
| 127 |
-
model = AutoModel.from_pretrained('openbmb/MiniCPM-V', trust_remote_code=True)
|
| 128 |
tokenizer = AutoTokenizer.from_pretrained('openbmb/MiniCPM-V', trust_remote_code=True)
|
| 129 |
model.eval().cuda()
|
| 130 |
|
|
|
|
| 124 |
from PIL import Image
|
| 125 |
from transformers import AutoModel, AutoTokenizer
|
| 126 |
|
| 127 |
+
model = AutoModel.from_pretrained('openbmb/MiniCPM-V', trust_remote_code=True).to(dtype=torch.bfloat16)
|
| 128 |
tokenizer = AutoTokenizer.from_pretrained('openbmb/MiniCPM-V', trust_remote_code=True)
|
| 129 |
model.eval().cuda()
|
| 130 |
|