Any-to-Any
Transformers
Safetensors
multilingual
minicpmo
feature-extraction
minicpm-o
omni
vision
ocr
multi-image
video
custom_code
audio
speech
voice cloning
live Streaming
realtime speech conversation
asr
tts
4-bit precision
gptq
Instructions to use openbmb/MiniCPM-o-2_6-int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use openbmb/MiniCPM-o-2_6-int4 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("openbmb/MiniCPM-o-2_6-int4", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update config.json
#7
by rajathbharadwaj - opened
- config.json +1 -1
config.json
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
{
|
| 2 |
-
"_name_or_path": "openbmb/MiniCPM-o-2_6",
|
| 3 |
"architectures": [
|
| 4 |
"MiniCPMO"
|
| 5 |
],
|
|
|
|
| 1 |
{
|
| 2 |
+
"_name_or_path": "openbmb/MiniCPM-o-2_6-int4",
|
| 3 |
"architectures": [
|
| 4 |
"MiniCPMO"
|
| 5 |
],
|