Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
| 3 |
tags:
|
| 4 |
- controlnet
|
| 5 |
- text-to-image
|
|
@@ -7,6 +7,8 @@ tags:
|
|
| 7 |
- inpainting
|
| 8 |
- qwen-image
|
| 9 |
- qwen-image-2512
|
|
|
|
|
|
|
| 10 |
- quantized
|
| 11 |
- int8
|
| 12 |
- convrot
|
|
@@ -16,42 +18,41 @@ pipeline_tag: image-to-image
|
|
| 16 |
|
| 17 |
# ControlNet Models (ConvRot INT8)
|
| 18 |
|
| 19 |
-
High-fidelity **ConvRot INT8** quantized weights for ControlNet models.
|
| 20 |
|
| 21 |
---
|
| 22 |
|
| 23 |
## π Model Overview
|
| 24 |
|
| 25 |
-
This repository hosts
|
| 26 |
|
| 27 |
-
- **
|
| 28 |
-
- **
|
| 29 |
-
- **Quantization:** ConvRot INT8
|
| 30 |
-
- **License:** Apache-2.0
|
| 31 |
|
| 32 |
---
|
| 33 |
|
| 34 |
## π¦ Available Models
|
| 35 |
|
| 36 |
-
| Filename | Base Model | Supported Conditions |
|
| 37 |
-
| :--- | :--- | :--- | :--- | :--- | :--- |
|
| 38 |
-
| `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512-Fun-Controlnet-Union-
|
|
|
|
| 39 |
|
| 40 |
---
|
| 41 |
|
| 42 |
## π οΈ Model Features
|
| 43 |
|
| 44 |
-
- Multi-
|
| 45 |
-
-
|
| 46 |
-
-
|
| 47 |
|
| 48 |
---
|
| 49 |
|
| 50 |
## π Usage in ComfyUI
|
| 51 |
|
| 52 |
-
|
| 53 |
|
| 54 |
-
- **
|
| 55 |
|
| 56 |
### Installation
|
| 57 |
|
|
@@ -62,12 +63,17 @@ cd ComfyUI/custom_nodes
|
|
| 62 |
git clone https://github.com/ussoewwin/ComfyUI-HSWQ-Loader-and-Tools.git
|
| 63 |
```
|
| 64 |
|
| 65 |
-
Place `
|
| 66 |
|
| 67 |
---
|
| 68 |
|
| 69 |
## π Credits & License
|
| 70 |
|
| 71 |
-
|
| 72 |
-
- **
|
| 73 |
-
- **
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: other
|
| 3 |
tags:
|
| 4 |
- controlnet
|
| 5 |
- text-to-image
|
|
|
|
| 7 |
- inpainting
|
| 8 |
- qwen-image
|
| 9 |
- qwen-image-2512
|
| 10 |
+
- flux
|
| 11 |
+
- flux.1-dev
|
| 12 |
- quantized
|
| 13 |
- int8
|
| 14 |
- convrot
|
|
|
|
| 18 |
|
| 19 |
# ControlNet Models (ConvRot INT8)
|
| 20 |
|
| 21 |
+
High-fidelity **ConvRot INT8** quantized weights for ControlNet models across diverse architectures (Qwen-Image, FLUX.1-dev).
|
| 22 |
|
| 23 |
---
|
| 24 |
|
| 25 |
## π Model Overview
|
| 26 |
|
| 27 |
+
This repository hosts high-quality **ConvRot INT8** quantized weights for multi-condition ControlNet Union models, designed to significantly reduce VRAM and storage footprint while preserving fine-grained structural control fidelity:
|
| 28 |
|
| 29 |
+
- **Qwen-Image-2512-Fun-Controlnet-Union-2602**: Multi-condition ControlNet Union model (5 layer blocks) for the Qwen-Image-2512 architecture.
|
| 30 |
+
- **FLUX.1-dev-ControlNet-Union-Pro-2.0**: Next-generation unified 7-in-1 ControlNet for the FLUX.1-dev architecture by Shakker Labs.
|
|
|
|
|
|
|
| 31 |
|
| 32 |
---
|
| 33 |
|
| 34 |
## π¦ Available Models
|
| 35 |
|
| 36 |
+
| Filename | Base Architecture | Base Model | Supported Conditions | Quantization | File Size | License |
|
| 37 |
+
| :--- | :--- | :--- | :--- | :--- | :--- | :--- |
|
| 38 |
+
| `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512 | [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.64 GB | Apache-2.0 |
|
| 39 |
+
| `FLUX.1-dev-ControlNet-Union-Pro-2.0_convrot_int8.safetensors` | FLUX.1-dev | [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) | Canny, Depth, Pose, Blur, Gray, Soft Edge, Low Quality | ConvRot INT8 | ~2.00 GB | Other / Non-Commercial |
|
| 40 |
|
| 41 |
---
|
| 42 |
|
| 43 |
## π οΈ Model Features
|
| 44 |
|
| 45 |
+
- **Multi-Condition Control**: Unified architectures allowing single or combined conditioning inputs (Canny, Depth, Pose, etc.) without swapping model checkpoints.
|
| 46 |
+
- **ConvRot INT8 Precision**: Preserves high-frequency details and directional feature integrity through randomized orthogonal Hadamard rotations, eliminating outlier distortion common in standard INT8 quantization.
|
| 47 |
+
- **Significant Footprint Reduction**: Delivers ~50% to 70% VRAM and storage savings compared to unquantized FP16 checkpoints.
|
| 48 |
|
| 49 |
---
|
| 50 |
|
| 51 |
## π Usage in ComfyUI
|
| 52 |
|
| 53 |
+
To load and execute these ConvRot INT8 ControlNet models in ComfyUI, please use the dedicated loader node from the **ComfyUI-HSWQ-Loader-and-Tools** extension:
|
| 54 |
|
| 55 |
+
- **Extension Repository:** [ComfyUI-HSWQ-Loader-and-Tools](https://github.com/ussoewwin/ComfyUI-HSWQ-Loader-and-Tools)
|
| 56 |
|
| 57 |
### Installation
|
| 58 |
|
|
|
|
| 63 |
git clone https://github.com/ussoewwin/ComfyUI-HSWQ-Loader-and-Tools.git
|
| 64 |
```
|
| 65 |
|
| 66 |
+
Place the downloaded `.safetensors` files into your ComfyUI `models/controlnet/` directory and load them using the dedicated ControlNet loader node.
|
| 67 |
|
| 68 |
---
|
| 69 |
|
| 70 |
## π Credits & License
|
| 71 |
|
| 72 |
+
### Base Models & Research
|
| 73 |
+
- **Qwen-Image ControlNet Union:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) & [aigc-apps/VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun) (Apache-2.0)
|
| 74 |
+
- **FLUX.1-dev ControlNet Union Pro 2.0:** [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) & [InstantX Team](https://huggingface.co/InstantX) (FLUX.1-dev Non-Commercial License)
|
| 75 |
+
- **Base Architecture:** [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
|
| 76 |
+
|
| 77 |
+
---
|
| 78 |
+
|
| 79 |
+
**Disclaimer:** These models are provided for optimization, workflow acceleration, and research purposes. Please adhere to the licenses and terms of the respective base models.
|