Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -118,6 +118,18 @@ The model has been validated to ensure:
|
|
| 118 |
✅ Model structure matches expected architecture
|
| 119 |
✅ Compatible with Optimum-Intel export
|
| 120 |
✅ Forward pass completes without errors
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 121 |
|
| 122 |
## Limitations
|
| 123 |
|
|
|
|
| 118 |
✅ Model structure matches expected architecture
|
| 119 |
✅ Compatible with Optimum-Intel export
|
| 120 |
✅ Forward pass completes without errors
|
| 121 |
+
✅ **OpenVINO compatibility fix applied**: Resampler `num_heads=0` issue resolved
|
| 122 |
+
|
| 123 |
+
### OpenVINO Compatibility Fix
|
| 124 |
+
|
| 125 |
+
This model includes a fix for the OpenVINO loading issue where `num_heads=0` would occur with small `embed_dim` values. The resampler's `num_heads` calculation has been patched to ensure it's always at least 1:
|
| 126 |
+
|
| 127 |
+
```python
|
| 128 |
+
# Original: num_heads = embed_dim // 128 # Would be 0 when embed_dim=40
|
| 129 |
+
# Fixed: num_heads = 1 if embed_dim < 128 else max(1, embed_dim // 128)
|
| 130 |
+
```
|
| 131 |
+
|
| 132 |
+
The `modeling_minicpmo.py` file included with this model contains this fix, ensuring compatibility with Optimum-Intel OpenVINO export and loading.
|
| 133 |
|
| 134 |
## Limitations
|
| 135 |
|