Duplicate from obsxrver/ComfyUI-Native-INT8_ConvRot

Co-authored-by: Obsxrver <obsxrver@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,35 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,94 @@
+---
+tags:
+- int8-convrot
+- comfyui
+---
+
+# ComfyUI-Native-Int8-ConvRot
+
+INT8 ConvRot models, converted to the native quantization format ComfyUI expects.
+
+INT8 ConvRot currently offers one of the best quality-to-performance ratios of any
+quantization method. In my personal experience, INT8 ConvRot models provide quality
+close to BF16 at generation speeds matching or beating FP8_Scaled.
+
+> "INT8 ConvRot is row-wise INT8 with parameters and activations rotated before
+> quantization via ConvRot."
+> — [ComfyUI-INT8-Fast Metrics.md](https://github.com/BobJohnson24/ComfyUI-INT8-Fast/blob/main/Metrics.md)
+
+## Models
+If there is a model that you would like that is not in this list, make a [request](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/discussions)
+| File | Model | Original Creator's Repo |
+|---|---|---|
+| [`checkpoints/hidream_o1_image_int8-convrot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/checkpoints/hidream_o1_image_int8-convrot.safetensors) | HiDream-O1-Image | [HiDream-ai/HiDream-O1-Image](https://huggingface.co/HiDream-ai/HiDream-O1-Image) |
+| [`checkpoints/hidream_o1_image_dev_int8-convrot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/checkpoints/hidream_o1_image_dev_int8-convrot.safetensors) | HiDream-O1-Image-Dev | [HiDream-ai/HiDream-O1-Image-Dev](https://huggingface.co/HiDream-ai/HiDream-O1-Image-Dev) |
+| [`checkpoints/ltx-2.3-22b-dev-int8-ConvRot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/checkpoints/ltx-2.3-22b-dev-int8-ConvRot.safetensors) | LTX-2.3 22B Dev | [Lightricks/LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3) |
+| [`checkpoints/ltx-2.3-22b-distilled-1.1-int8-ConvRot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/checkpoints/ltx-2.3-22b-distilled-1.1-int8-ConvRot.safetensors) | LTX-2.3 22B Distilled v1.1 | [Lightricks/LTX-2.3](https://huggingface.co/Lightricks/LTX-2.3) |
+| [`checkpoints/sulphur_dev_INT8_ConvRot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/checkpoints/sulphur_dev_INT8_ConvRot.safetensors) | Sulphur 2 Dev | [SulphurAI/Sulphur-2-base](https://huggingface.co/SulphurAI/Sulphur-2-base) |
+| [`checkpoints/sulphur_distill_INT8_ConvRot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/checkpoints/sulphur_distill_INT8_ConvRot.safetensors) | Sulphur 2 Distill | [SulphurAI/Sulphur-2-base](https://huggingface.co/SulphurAI/Sulphur-2-base) |
+| [`diffusion_models/anima-preview3-base-int8-ConvRot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/diffusion_models/anima-preview3-base-int8-ConvRot.safetensors) | Anima Preview 3 (Base) | [circlestone-labs/Anima](https://huggingface.co/circlestone-labs/Anima) |
+| [`diffusion_models/flux-2-klein-9b_int8_convrot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/diffusion_models/flux-2-klein-9b_int8_convrot.safetensors) | FLUX.2 [klein] 9B | [black-forest-labs/FLUX.2-klein-9B](https://huggingface.co/black-forest-labs/FLUX.2-klein-9B) |
+| [`diffusion_models/Krea2-Turbo-int8-ConvRot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/diffusion_models/Krea2-Turbo-int8-ConvRot.safetensors) | Krea 2 Turbo | [krea/Krea-2-Turbo](https://huggingface.co/krea/Krea-2-Turbo) |
+| [`diffusion_models/qwen-image-2512-int8-ConvRot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/diffusion_models/qwen-image-2512-int8-ConvRot.safetensors) | Qwen-Image-2512 | [Qwen/Qwen-Image-2512](https://huggingface.co/Qwen/Qwen-Image-2512) |
+| [`diffusion_models/wan2.2_i2v_high_int8_convrot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/diffusion_models/wan2.2_i2v_high_int8_convrot.safetensors) | Wan2.2 I2V A14B (High Noise) | [Wan-AI/Wan2.2-I2V-A14B](https://huggingface.co/Wan-AI/Wan2.2-I2V-A14B) |
+| [`diffusion_models/wan2.2_i2v_low_int8_convrot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/diffusion_models/wan2.2_i2v_low_int8_convrot.safetensors) | Wan2.2 I2V A14B (Low Noise) | [Wan-AI/Wan2.2-I2V-A14B](https://huggingface.co/Wan-AI/Wan2.2-I2V-A14B) |
+| [`diffusion_models/wan2.2_t2v_high_int8_ConvRot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/diffusion_models/wan2.2_t2v_high_int8_ConvRot.safetensors) | Wan2.2 T2V A14B (High Noise) | [Wan-AI/Wan2.2-T2V-A14B](https://huggingface.co/Wan-AI/Wan2.2-T2V-A14B) |
+| [`diffusion_models/wan2.2_t2v_low_int8_ConvRot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/diffusion_models/wan2.2_t2v_low_int8_ConvRot.safetensors) | Wan2.2 T2V A14B (Low Noise) | [Wan-AI/Wan2.2-T2V-A14B](https://huggingface.co/Wan-AI/Wan2.2-T2V-A14B) |
+| [`diffusion_models/z_image_turbo_int8_convrot.safetensors`](https://huggingface.co/obsxrver/ComfyUI-Native-INT8_ConvRot/blob/main/diffusion_models/z_image_turbo_int8_convrot.safetensors) | Z-Image Turbo | [Tongyi-MAI/Z-Image-Turbo](https://huggingface.co/Tongyi-MAI/Z-Image-Turbo) |
+
+## Quality Ranking
+
+Per the latent-divergence benchmarks in [Metrics.md](https://github.com/BobJohnson24/ComfyUI-INT8-Fast/blob/main/Metrics.md):
+
+```
+GGUF Q8 > INT8 ConvRot > MXFP8 > FP8 >= INT8 Row > INT8 Tensorwise
+```
+
+Note: this is the general takeaway across all tested models. In several individual
+benchmarks (e.g. Anima, Flux2 Klein 9B, Qwen Image 2512), INT8 ConvRot actually
+scored *better* than GGUF Q8.
+
+## Requirements
+
+- A ComfyUI version that includes native INT8 support
+  ([Comfy-Org/ComfyUI#14636](https://github.com/Comfy-Org/ComfyUI/pull/14636),
+  merged June 2026). Update if your loader reports an invalid quantization type.
+- Models load with the standard **Load Diffusion Model** node — no custom node needed.
+
+## How to Quantize a Model to INT8 ConvRot
+
+1. Install silveroxides' [convert_to_quant](https://github.com/silveroxides/convert_to_quant):
+
+   ```bash
+   pip install -U convert-to-quant
+   ```
+
+   > INT8 kernels require Triton (native on Linux; use `triton-windows` on Windows).
+   > PyTorch must be installed separately with the correct CUDA version.
+
+2. Convert the model:
+
+   ```bash
+   ctq -i source_model_bf16.safetensors -o converted_model_int8_convrot.safetensors \
+     --int8 --scaling_mode row --simple --convrot --convrot-group-size [64,256,1024] \
+     --comfy_quant --save-quant-metadata --<model-arch-flag>
+   ```
+
+### Notes
+
+- `--convrot-group-size` accepts 64, 256, or 1024. **It is recommended to choose a value that divides evenly into all of the model's layer dimensions.**
+- `--<model-arch-flag>` selects the layer-exclusion preset for your model architecture
+  (e.g. `--wan`, `--flux2`, `--zimage`). Run `ctq --help-filters` (or `ctq -hf`) for
+  the full list.
+
+## References
+
+1. [Reddit: "So is INT8-ConvRot the new hot thing?"](https://www.reddit.com/r/StableDiffusion/comments/1uimp1j/so_is_int8convrot_the_new_hot_thing/)
+2. [ComfyUI-INT8-Fast — Metrics.md](https://github.com/BobJohnson24/ComfyUI-INT8-Fast/blob/main/Metrics.md) (benchmark methodology & full tables)
+3. [Comfy-Org/Boogu-Image discussion #10](https://huggingface.co/Comfy-Org/Boogu-Image/discussions/10#6a404ed359b6d5b4e834a644)
+4. [ComfyUI PR #14636 — Support int8 models](https://github.com/Comfy-Org/ComfyUI/pull/14636)
+5. [bertbobson/ComfyUI-INT8_ConvRot](https://huggingface.co/bertbobson/ComfyUI-INT8_ConvRot)
+6. [silveroxides/convert_to_quant](https://github.com/silveroxides/convert_to_quant)
+
+## Licensing and Commercial Use
+All models are distributed strictly under their upstream license with no added restrictions. Verify permissibility with the original creator before commercial use.

checkpoints/hidream_o1_image_dev_int8-convrot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:607b17bc78307d124cb5aa1a134041eb23c5043dbf9b0f747bc86560bca715e6
+size 10206726464

checkpoints/hidream_o1_image_int8-convrot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:211f4362d5e339a1e05f3726ebd9c55d6eea21fbeb87bb3413ff08aa15d767bc
+size 10206726464

checkpoints/ltx-2.3-22b-dev-int8-ConvRot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e9b3e51423dfe62bc07a65fbc048ba72de7330d8bf6acb66447da0e8b8176e0
+size 23507959296

checkpoints/ltx-2.3-22b-distilled-1.1-int8-ConvRot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7bf190aed2f02421c00850bf821579c8785942a6858544094155c29f86a2a808
+size 23507956776

checkpoints/sulphur_dev_INT8_ConvRot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3929cba1f8db3af1ef14c3064fcb8270923793f96ccd6258a91d6ab2523e15a
+size 23507959296

checkpoints/sulphur_distill_INT8_ConvRot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2f01e8d4b5526b700f20fe4b7690b509de80a49e762210ee131ec69579d32d6a
+size 23507959296

diffusion_models/Krea2-Turbo-int8-ConvRot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd2c3bc68cced7fce74dd9f309b535beaeff6bb3f9f66bf11be3ab0793eabb21
+size 14132233992

diffusion_models/anima-preview3-base-int8-ConvRot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:414eaf120c058ee9acd0d1312f91ba94a89e0116a08b935a25f7a9728935800b
+size 2423557579

diffusion_models/flux-2-klein-9b_int8_convrot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd041cec0d7955d6fcbaef952ba6ebe37af9f7d032ec927657e7777f21f5c522
+size 9439894544

diffusion_models/qwen-image-2512-int8-ConvRot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:477fa4fcbf9db30a9e02c5162ebfa9d5d6a83397d4531f7e838a09b2a5e6c138
+size 20499138856

diffusion_models/wan2.2_i2v_high_int8_convrot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd3e75d49933eeeea05ad52bd37fcf7df1bd2310057f9ae511c703a57daacd83
+size 14538223488

diffusion_models/wan2.2_i2v_low_int8_convrot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0edcf377d9f9491c49e74bf9c023484722d937edee72a3c0e8cd2796253c32ec
+size 14538223488

diffusion_models/wan2.2_t2v_high_int8_ConvRot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b0b3532a03ea750c99d3f9fcca20359df7273c2fb23e2c7b3d97e90dd8968c0
+size 14535898712

diffusion_models/wan2.2_t2v_low_int8_ConvRot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd4572bcf598a21961e9766d144409819acbe30928af179e08d368e9f81ae3ac
+size 14535898712

diffusion_models/z_image_turbo_int8_convrot.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4023c38d928fda41cfc21638e162af6f7e411e96e88897582e88dcf8ac7d46bb
+size 6299127240