h0witended commited on
Commit
a68a390
·
verified ·
1 Parent(s): d22b10a

Delete README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -43
README.md DELETED
@@ -1,43 +0,0 @@
1
- ---
2
- library_name: optimum
3
- tags:
4
- - intel
5
- - openvino
6
- - optimum
7
- - minicpm
8
- - tiny-model
9
- license: apache-2.0
10
- base_model: openbmb/MiniCPM-o-2_6
11
- ---
12
-
13
-
14
- # Tiny-Random-MiniCPM-o-2_6
15
-
16
- This is a **tiny random version** of the [MiniCPM-o-2_6](https://huggingface.co/openbmb/MiniCPM-o-2_6) architecture, specifically designed for **integration testing and CI/CD pipelines** in the `optimum-intel` repository.
17
-
18
- ## Project Goal
19
- The primary objective of this model is to provide a lightweight alternative for architectural validation and OpenVINO export testing within the `optimum-intel` framework. It replaces larger weights (~5GB+) with a minimal footprint (~0.8MB) while maintaining identical architectural metadata.
20
-
21
- ## Model Description
22
- - **Architecture:** Qwen2-based (MiniCPM-o-2.6)
23
- - **Parameters:** ~1.2M
24
- - **Hidden Layers:** 2
25
- - **Hidden Size:** 64
26
- - **Intermediate Size:** 128
27
- - **Vocabulary Size:** 1000
28
-
29
- ## Performance Benchmarks
30
- Validated on Windows (CPU) using the `optimum-intel` pipeline:
31
- - **Disk Footprint:** 0.77 MB
32
- - **PyTorch Load Time:** 0.07s
33
- - **RAM Usage (Incr.):** ~1.93 MB
34
- - **OpenVINO Compilation Time:** 4.80s
35
- - **Compatibility:** Fully verified for `OVModelForCausalLM` and `OVModelForVisualCausalLM`.
36
-
37
- ## Usage
38
- ```python
39
- from optimum.intel.openvino import OVModelForVisualCausalLM
40
- from transformers import AutoProcessor
41
-
42
- model_id = "h0witended/tiny-random-MiniCPM-o-2_6"
43
- model = OVModelForVisualCausalLM.from_pretrained(model_id, trust_remote_code=True)