|
|
--- |
|
|
language: en |
|
|
license: apache-2.0 |
|
|
tags: |
|
|
- minicpm |
|
|
- minicpm-o |
|
|
- multimodal |
|
|
- vision |
|
|
- audio |
|
|
- text-to-speech |
|
|
- tiny-model |
|
|
- random-weights |
|
|
model-index: |
|
|
- name: MiniCPM-o-2_6 |
|
|
results: [] |
|
|
--- |
|
|
|
|
|
# Tiny Random MiniCPM-o-2_6 |
|
|
|
|
|
This is a tiny random variant of the MiniCPM-o-2_6 model, specifically created for testing and validation purposes with Optimum-Intel. |
|
|
|
|
|
## Model Details |
|
|
|
|
|
- **Model Type**: Multimodal (Vision + Audio + Text-to-Speech) |
|
|
- **Original Model**: [openbmb/MiniCPM-o-2_6](https://huggingface.co/openbmb/MiniCPM-o-2_6) |
|
|
- **Size**: ~4.4MB (significantly reduced from original 160MB) |
|
|
- **Architecture**: MiniCPMO (multimodal architecture) |
|
|
- **Purpose**: Testing and validation with Optimum-Intel |
|
|
|
|
|
## Configuration Changes |
|
|
|
|
|
This tiny model has the following modifications from the original: |
|
|
|
|
|
- `hidden_size`: 16 (reduced from original) |
|
|
- `intermediate_size`: 32 (reduced from original) |
|
|
- `num_hidden_layers`: 1 (reduced from original) |
|
|
- `vocab_size`: 32000 (maintained for compatibility) |
|
|
- Vision and Audio components significantly reduced in size |
|
|
|
|
|
## Usage |
|
|
|
|
|
```python |
|
|
from transformers import AutoModel, AutoTokenizer, AutoProcessor |
|
|
|
|
|
model = AutoModel.from_pretrained("your-username/tiny-random-MiniCPM-o-2_6", trust_remote_code=True) |
|
|
tokenizer = AutoTokenizer.from_pretrained("your-username/tiny-random-MiniCPM-o-2_6", trust_remote_code=True) |
|
|
processor = AutoProcessor.from_pretrained("your-username/tiny-random-MiniCPM-o-2_6", trust_remote_code=True) |
|
|
``` |
|
|
|
|
|
## Validation |
|
|
|
|
|
This model has been tested and validated with Optimum-Intel tests: |
|
|
- ✅ `test_compare_to_transformers_14_minicpmo` |
|
|
- ✅ `test_generate_utils_14_minicpmo` |
|
|
- ✅ `test_model_can_be_loaded_after_saving_14_minicpmo` |
|
|
|
|
|
## Limitations |
|
|
|
|
|
⚠️ **Important**: This is a random weights model intended for testing purposes only. It will not produce meaningful outputs and should not be used for production applications. |
|
|
|
|
|
## License |
|
|
|
|
|
Apache 2.0 |