Diffusion Single File
comfyui
nvfp4
blackwell
matlod commited on
Commit
947dd98
·
verified ·
1 Parent(s): 78e00b1

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +68 -0
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: minimax-h3-community-license-agreement
4
+ license_link: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE
5
+ base_model:
6
+ - MiniMaxAI/MiniMax-H3
7
+ tags:
8
+ - comfyui
9
+ - diffusion-single-file
10
+ - nvfp4
11
+ - blackwell
12
+ ---
13
+
14
+ # MiniMax H3 FL2VA pruned, NVFP4 (Blackwell)
15
+
16
+ An NVFP4 quantisation of the MiniMax H3 pruned FL2VA diffusion model for
17
+ ComfyUI. Every one of the 200 block linears (qkv, out, fc1, fc2 in all 50
18
+ blocks) is stored as fp4 e2m1 with fp8 e4m3 block scales of 16 and one fp32
19
+ per-tensor scale; embeds, token refiner, norms and heads stay bf16. On
20
+ Blackwell (sm120) the GEMMs run natively on the fp4 tensor cores.
21
+
22
+ **Modification notice (required by the license): this repository contains a
23
+ modified version of MiniMax H3. The modification is post-training weight
24
+ quantisation of the block linears to NVFP4, performed 2026-08-19. Built from
25
+ `diffusion_models/minimax_h3_fl2va_pruned_bf16.safetensors` in
26
+ [Comfy-Org/MiniMax-H3](https://huggingface.co/Comfy-Org/MiniMax-H3), revision
27
+ `3f57e8291d2ef846f9a074b1b76d2767db434abe`.**
28
+
29
+ ## Should you use this file?
30
+
31
+ - **RTX 50-series / Blackwell + pytorch cu130+, current ComfyUI**: yes, if you
32
+ want the speed. Measured against the W4A8 file on the same seed and graph:
33
+ 0.84x wall at 29k tokens, 0.90x at 45k, on an RTX PRO 6000. Same file size
34
+ as W4A8 (12.5 GB, both 4.54 bits per parameter), so this is a speed play,
35
+ not a memory play.
36
+ - **Any other GPU**: no. ComfyUI falls back to dequantised matmuls, which is
37
+ slower than `int8_convrot`. Use Comfy-Org's `int8_convrot` file instead.
38
+
39
+ Runs on stock ComfyUI, no custom nodes required: the file carries per-layer
40
+ `comfy_quant` metadata, the same mechanism as the NVFP4 text encoder that
41
+ Comfy-Org already ships.
42
+
43
+ ## What it costs in quality
44
+
45
+ Median weight error is 9.4 percent relative rms vs bf16 (the W4A8 file
46
+ carries 7.3, int8_convrot 1.0). In practice a same-seed render is a clean
47
+ sibling take: same scene and words, slightly different delivery. Side-by-side
48
+ pages with clips, pixel, flow and audio rulers, and a synced A/B player:
49
+ https://matlowai.github.io/ComfyUI-MAINodes/a6-review/ (the gold cards are
50
+ this checkpoint). Note that an int8 control lands in the same
51
+ distance-from-reference band, so within this model family that distance
52
+ measures which take you got, not how good it is. Judge with your eyes on your
53
+ own content.
54
+
55
+ ## Rebuild it yourself
56
+
57
+ The 30-second builder script (quantises the Comfy-Org bf16 file with comfy's
58
+ own TensorCoreNVFP4Layout) ships in
59
+ [ComfyUI-MAINodes](https://github.com/matlowai/ComfyUI-MAINodes) as
60
+ `tools/build_nvfp4_checkpoint.py`. The `.census.json` beside the weights holds
61
+ the per-layer weight error of this exact build.
62
+
63
+ ## License
64
+
65
+ MiniMax H3 Community License Agreement (see LICENSE and NOTICE in this
66
+ repository, and the license link above). The license carries territory
67
+ restrictions and other conditions; read it before using or redistributing.
68
+ Powered by MiniMax H3.