notlikejoe commited on
Commit
b9e6428
·
verified ·
1 Parent(s): 6b715da

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -118,6 +118,18 @@ The model has been validated to ensure:
118
  ✅ Model structure matches expected architecture
119
  ✅ Compatible with Optimum-Intel export
120
  ✅ Forward pass completes without errors
 
 
 
 
 
 
 
 
 
 
 
 
121
 
122
  ## Limitations
123
 
 
118
  ✅ Model structure matches expected architecture
119
  ✅ Compatible with Optimum-Intel export
120
  ✅ Forward pass completes without errors
121
+ ✅ **OpenVINO compatibility fix applied**: Resampler `num_heads=0` issue resolved
122
+
123
+ ### OpenVINO Compatibility Fix
124
+
125
+ This model includes a fix for the OpenVINO loading issue where `num_heads=0` would occur with small `embed_dim` values. The resampler's `num_heads` calculation has been patched to ensure it's always at least 1:
126
+
127
+ ```python
128
+ # Original: num_heads = embed_dim // 128 # Would be 0 when embed_dim=40
129
+ # Fixed: num_heads = 1 if embed_dim < 128 else max(1, embed_dim // 128)
130
+ ```
131
+
132
+ The `modeling_minicpmo.py` file included with this model contains this fix, ensuring compatibility with Optimum-Intel OpenVINO export and loading.
133
 
134
  ## Limitations
135