license: other
tags:
- controlnet
- text-to-image
- image-to-image
- inpainting
- qwen-image
- qwen-image-2512
- flux
- flux.1-dev
- quantized
- int8
- convrot
- comfyui
pipeline_tag: image-to-image
ControlNet Models (ConvRot INT8)
High-fidelity ConvRot INT8 quantized weights for ControlNet models across diverse architectures (Qwen-Image, FLUX.1-dev).
🌟 Model Overview
This repository hosts high-quality ConvRot INT8 quantized weights for multi-condition ControlNet Union models, designed to significantly reduce VRAM and storage footprint while preserving fine-grained structural control fidelity:
- Qwen-Image-2512-Fun-Controlnet-Union-2602: Multi-condition ControlNet Union model (5 layer blocks) for the Qwen-Image-2512 architecture.
- FLUX.1-dev-ControlNet-Union-Pro-2.0: Next-generation unified 7-in-1 ControlNet for the FLUX.1-dev architecture by Shakker Labs.
📦 Available Models
| Filename | Base Architecture | Base Model | Supported Conditions | Quantization | File Size | License |
|---|---|---|---|---|---|---|
Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors |
Qwen-Image-2512 | alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.64 GB | Apache-2.0 |
FLUX.1-dev-ControlNet-Union-Pro-2.0_convrot_int8.safetensors |
FLUX.1-dev | Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0 | Canny, Depth, Pose, Blur, Gray, Soft Edge, Low Quality | ConvRot INT8 | ~2.00 GB | Other / Non-Commercial |
🛠️ Model Features
- Multi-Condition Control: Unified architectures allowing single or combined conditioning inputs (Canny, Depth, Pose, etc.) without swapping model checkpoints.
- ConvRot INT8 Precision: Preserves high-frequency details and directional feature integrity through randomized orthogonal Hadamard rotations, eliminating outlier distortion common in standard INT8 quantization.
- Significant Footprint Reduction: Delivers ~50% to 70% VRAM and storage savings compared to unquantized FP16 checkpoints.
🚀 Usage in ComfyUI
To load and execute these ConvRot INT8 ControlNet models in ComfyUI, please use the dedicated loader node from the ComfyUI-HSWQ-Loader-and-Tools extension:
- Extension Repository: ComfyUI-HSWQ-Loader-and-Tools
Installation
Clone the repository into your ComfyUI custom_nodes directory:
cd ComfyUI/custom_nodes
git clone https://github.com/ussoewwin/ComfyUI-HSWQ-Loader-and-Tools.git
Place the downloaded .safetensors files into your ComfyUI models/controlnet/ directory and load them using the dedicated ControlNet loader node.
📜 Credits & License
Base Models & Research
- Qwen-Image ControlNet Union: alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union & aigc-apps/VideoX-Fun (Apache-2.0)
- FLUX.1-dev ControlNet Union Pro 2.0: Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0 & InstantX Team (FLUX.1-dev Non-Commercial License)
- Base Architecture: black-forest-labs/FLUX.1-dev
Disclaimer: These models are provided for optimization, workflow acceleration, and research purposes. Please adhere to the licenses and terms of the respective base models.