Delete README.md
Browse files
README.md
DELETED
|
@@ -1,43 +0,0 @@
|
|
| 1 |
-
---
|
| 2 |
-
library_name: optimum
|
| 3 |
-
tags:
|
| 4 |
-
- intel
|
| 5 |
-
- openvino
|
| 6 |
-
- optimum
|
| 7 |
-
- minicpm
|
| 8 |
-
- tiny-model
|
| 9 |
-
license: apache-2.0
|
| 10 |
-
base_model: openbmb/MiniCPM-o-2_6
|
| 11 |
-
---
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
# Tiny-Random-MiniCPM-o-2_6
|
| 15 |
-
|
| 16 |
-
This is a **tiny random version** of the [MiniCPM-o-2_6](https://huggingface.co/openbmb/MiniCPM-o-2_6) architecture, specifically designed for **integration testing and CI/CD pipelines** in the `optimum-intel` repository.
|
| 17 |
-
|
| 18 |
-
## Project Goal
|
| 19 |
-
The primary objective of this model is to provide a lightweight alternative for architectural validation and OpenVINO export testing within the `optimum-intel` framework. It replaces larger weights (~5GB+) with a minimal footprint (~0.8MB) while maintaining identical architectural metadata.
|
| 20 |
-
|
| 21 |
-
## Model Description
|
| 22 |
-
- **Architecture:** Qwen2-based (MiniCPM-o-2.6)
|
| 23 |
-
- **Parameters:** ~1.2M
|
| 24 |
-
- **Hidden Layers:** 2
|
| 25 |
-
- **Hidden Size:** 64
|
| 26 |
-
- **Intermediate Size:** 128
|
| 27 |
-
- **Vocabulary Size:** 1000
|
| 28 |
-
|
| 29 |
-
## Performance Benchmarks
|
| 30 |
-
Validated on Windows (CPU) using the `optimum-intel` pipeline:
|
| 31 |
-
- **Disk Footprint:** 0.77 MB
|
| 32 |
-
- **PyTorch Load Time:** 0.07s
|
| 33 |
-
- **RAM Usage (Incr.):** ~1.93 MB
|
| 34 |
-
- **OpenVINO Compilation Time:** 4.80s
|
| 35 |
-
- **Compatibility:** Fully verified for `OVModelForCausalLM` and `OVModelForVisualCausalLM`.
|
| 36 |
-
|
| 37 |
-
## Usage
|
| 38 |
-
```python
|
| 39 |
-
from optimum.intel.openvino import OVModelForVisualCausalLM
|
| 40 |
-
from transformers import AutoProcessor
|
| 41 |
-
|
| 42 |
-
model_id = "h0witended/tiny-random-MiniCPM-o-2_6"
|
| 43 |
-
model = OVModelForVisualCausalLM.from_pretrained(model_id, trust_remote_code=True)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|