Update model card for corrected NVFP4 build
Browse files
README.md
CHANGED
|
@@ -15,24 +15,31 @@ tags:
|
|
| 15 |
|
| 16 |
ComfyUI-native NVFP4 safetensors conversion of `Minthy/ToriiGate-0.5`.
|
| 17 |
|
| 18 |
-
##
|
| 19 |
|
| 20 |
-
`toriigate_0.5_qwen35_4b_nvfp4_comfyui.safetensors`
|
|
|
|
| 21 |
|
| 22 |
-
Place
|
| 23 |
|
| 24 |
`ComfyUI/models/text_encoders/`
|
| 25 |
|
| 26 |
-
Then use ComfyUI
|
| 27 |
|
| 28 |
-
##
|
| 29 |
|
| 30 |
-
|
| 31 |
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
GPU: NVIDIA RTX PRO 6000 Blackwell Server Edition
|
| 37 |
Torch: 2.12.0+cu130
|
| 38 |
CUDA: 13.0
|
|
|
|
| 15 |
|
| 16 |
ComfyUI-native NVFP4 safetensors conversion of `Minthy/ToriiGate-0.5`.
|
| 17 |
|
| 18 |
+
## Files
|
| 19 |
|
| 20 |
+
- `toriigate_0.5_qwen35_4b_nvfp4_comfyui.safetensors`
|
| 21 |
+
- `toriigate_0.5_qwen35_4b_nvfp4_calibrated_comfyui.safetensors`
|
| 22 |
|
| 23 |
+
Place the file in:
|
| 24 |
|
| 25 |
`ComfyUI/models/text_encoders/`
|
| 26 |
|
| 27 |
+
Then use ComfyUI `CLIPLoader + TextGenerate`.
|
| 28 |
|
| 29 |
+
## Important Fix
|
| 30 |
|
| 31 |
+
`model.visual.pos_embed.weight` is intentionally kept full precision.
|
| 32 |
|
| 33 |
+
It is an Embedding table, not a Linear weight. ComfyUI expects it as `[2304, 1024]`.
|
| 34 |
+
Packing it as NVFP4 would turn it into `[2304, 512]` and break loading.
|
| 35 |
+
|
| 36 |
+
## Build
|
| 37 |
+
|
| 38 |
+
Quantized layers: 347
|
| 39 |
+
Copied tensors: 377
|
| 40 |
+
Base output size: 3.570 GiB
|
| 41 |
+
Calibrated output size: 3.570 GiB
|
| 42 |
+
Activation input scales added: 347
|
| 43 |
GPU: NVIDIA RTX PRO 6000 Blackwell Server Edition
|
| 44 |
Torch: 2.12.0+cu130
|
| 45 |
CUDA: 13.0
|