Fix vision model loading: remove device_map=auto for MiniCPM-V
Browse filesThe MiniCPMV class lacks the all_tied_weights_keys attribute that
device_map=auto requires via infer_auto_device_map. ZeroGPU handles
GPU placement anyway, so device_map is unnecessary.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
models.py
CHANGED
|
@@ -154,7 +154,6 @@ if not DEMO_MODE:
|
|
| 154 |
MODEL_VISION,
|
| 155 |
torch_dtype=torch.bfloat16,
|
| 156 |
trust_remote_code=True,
|
| 157 |
-
device_map="auto",
|
| 158 |
)
|
| 159 |
|
| 160 |
print("[LifeLog] Loading image generation model…")
|
|
|
|
| 154 |
MODEL_VISION,
|
| 155 |
torch_dtype=torch.bfloat16,
|
| 156 |
trust_remote_code=True,
|
|
|
|
| 157 |
)
|
| 158 |
|
| 159 |
print("[LifeLog] Loading image generation model…")
|