Moeblack commited on
Commit
63a92f4
·
verified ·
1 Parent(s): 31f86d3

Update model card for corrected NVFP4 build

Browse files
Files changed (1) hide show
  1. README.md +17 -10
README.md CHANGED
@@ -15,24 +15,31 @@ tags:
15
 
16
  ComfyUI-native NVFP4 safetensors conversion of `Minthy/ToriiGate-0.5`.
17
 
18
- ## File
19
 
20
- `toriigate_0.5_qwen35_4b_nvfp4_comfyui.safetensors`
 
21
 
22
- Place it in:
23
 
24
  `ComfyUI/models/text_encoders/`
25
 
26
- Then use ComfyUI's Qwen3.5 / TextGenerate workflow.
27
 
28
- ## Notes
29
 
30
- This is not a Hugging Face compressed-tensors directory. It is a single ComfyUI-native safetensors file with `_quantization_metadata`.
31
 
32
- Quantized layers: 348
33
- Copied tensors: 376
34
- Output size: 3.567 GiB
35
- Build time: 0.2 minutes
 
 
 
 
 
 
36
  GPU: NVIDIA RTX PRO 6000 Blackwell Server Edition
37
  Torch: 2.12.0+cu130
38
  CUDA: 13.0
 
15
 
16
  ComfyUI-native NVFP4 safetensors conversion of `Minthy/ToriiGate-0.5`.
17
 
18
+ ## Files
19
 
20
+ - `toriigate_0.5_qwen35_4b_nvfp4_comfyui.safetensors`
21
+ - `toriigate_0.5_qwen35_4b_nvfp4_calibrated_comfyui.safetensors`
22
 
23
+ Place the file in:
24
 
25
  `ComfyUI/models/text_encoders/`
26
 
27
+ Then use ComfyUI `CLIPLoader + TextGenerate`.
28
 
29
+ ## Important Fix
30
 
31
+ `model.visual.pos_embed.weight` is intentionally kept full precision.
32
 
33
+ It is an Embedding table, not a Linear weight. ComfyUI expects it as `[2304, 1024]`.
34
+ Packing it as NVFP4 would turn it into `[2304, 512]` and break loading.
35
+
36
+ ## Build
37
+
38
+ Quantized layers: 347
39
+ Copied tensors: 377
40
+ Base output size: 3.570 GiB
41
+ Calibrated output size: 3.570 GiB
42
+ Activation input scales added: 347
43
  GPU: NVIDIA RTX PRO 6000 Blackwell Server Edition
44
  Torch: 2.12.0+cu130
45
  CUDA: 13.0