| --- |
| license: other |
| license_name: flux-2-dev-non-commercial-license |
| license_link: https://huggingface.co/black-forest-labs/FLUX.2-dev/blob/main/LICENSE.md |
| base_model: black-forest-labs/FLUX.2-dev |
| tags: |
| - flux |
| - comfyui |
| - int8 |
| - quantized |
| - text-to-image |
| --- |
| |
| # FLUX.2-dev — INT8 tensorwise (+ConvRot), stock-ComfyUI native |
|
|
| Offline INT8 quantization of the `black-forest-labs/FLUX.2-dev` transformer, produced |
| with [Comfy-Org/comfy-quants](https://github.com/Comfy-Org/comfy-quants) |
| (`export-model-int8-tensorwise`). Loads **natively in stock ComfyUI >= v0.27.0** |
| (`QUANT_ALGOS["int8_tensorwise"]`, SM >= 7.5 / Turing+) — no custom node required. |
|
|
| Transformer-only (for `models/diffusion_models/`, load via `UNETLoader`); pair with |
| the usual FLUX.2 text encoder (Mistral) and VAE. |
|
|
| ## Quantization contract |
|
|
| - 160 quantized Linears (8 double blocks × img/txt attn qkv/proj + gated MLP, 48 |
| single blocks × fused linear1/linear2); global modulation, io projections and |
| final layer kept bf16; all 160 ConvRot-rotated (regular Hadamard, group 256). |
| - Per layer: `int8` weight + `float32 [out,1]` scale + `comfy_quant` marker |
| `{"format": "int8_tensorwise", "convrot": true, "convrot_groupsize": 256}` |
| (byte-exact to stock ComfyUI's save path). |
| - Quant math bit-faithful to comfy-kitchen >= 0.2.15. |
|
|
| ## Measured (RTX PRO 6000 Blackwell, 1024², 20 steps, torch 2.10.0+cu130) |
|
|
| Image PSNR vs bf16: **32.6 dB** — markedly better than FP8 E4M3 (20.1 dB) or NVFP4 |
| (17.6 dB) on this trajectory-sensitive 32B distilled model; INT8+ConvRot's higher |
| weight fidelity (SQNR ≈ 41 dB vs 31.5 dB for fp8) translates directly into image |
| quality here. Disk 33.1 GB (vs 64 GB bf16). |
|
|
| ## License |
|
|
| Inherits the FLUX.2-dev Non-Commercial License from the base model. |
|
|
