Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -5,6 +5,8 @@ tags:
|
|
| 5 |
- text-to-image
|
| 6 |
- image-to-image
|
| 7 |
- inpainting
|
|
|
|
|
|
|
| 8 |
- qwen-image
|
| 9 |
- qwen-image-2512
|
| 10 |
- flux
|
|
@@ -18,16 +20,17 @@ pipeline_tag: image-to-image
|
|
| 18 |
|
| 19 |
# ControlNet Models (ConvRot INT8)
|
| 20 |
|
| 21 |
-
High-fidelity **ConvRot INT8** quantized weights for ControlNet models across diverse architectures (Qwen-Image, FLUX.1-dev).
|
| 22 |
|
| 23 |
---
|
| 24 |
|
| 25 |
## ๐ Model Overview
|
| 26 |
|
| 27 |
-
This repository hosts high-quality **ConvRot INT8** quantized weights for
|
| 28 |
|
| 29 |
-
- **
|
| 30 |
-
- **
|
|
|
|
| 31 |
|
| 32 |
---
|
| 33 |
|
|
@@ -35,16 +38,17 @@ This repository hosts high-quality **ConvRot INT8** quantized weights for multi-
|
|
| 35 |
|
| 36 |
| Filename | Base Architecture | Base Model | Supported Conditions | Quantization | File Size | License |
|
| 37 |
| :--- | :--- | :--- | :--- | :--- | :--- | :--- |
|
|
|
|
| 38 |
| `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512 | [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.64 GB | Apache-2.0 |
|
| 39 |
| `FLUX.1-dev-ControlNet-Union-Pro-2.0_convrot_int8.safetensors` | FLUX.1-dev | [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) | Canny, Depth, Pose, Blur, Gray, Soft Edge, Low Quality | ConvRot INT8 | ~2.00 GB | Other / Non-Commercial |
|
| 40 |
|
| 41 |
---
|
| 42 |
|
| 43 |
-
## ๐ ๏ธ
|
| 44 |
|
| 45 |
-
- **Multi-Condition Control**: Unified architectures
|
| 46 |
-
- **ConvRot INT8 Precision**:
|
| 47 |
-
- **
|
| 48 |
|
| 49 |
---
|
| 50 |
|
|
@@ -70,9 +74,10 @@ Place the downloaded `.safetensors` files into your ComfyUI `models/controlnet/`
|
|
| 70 |
## ๐ Credits & License
|
| 71 |
|
| 72 |
### Base Models & Research
|
|
|
|
| 73 |
- **Qwen-Image ControlNet Union:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) & [aigc-apps/VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun) (Apache-2.0)
|
| 74 |
- **FLUX.1-dev ControlNet Union Pro 2.0:** [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) & [InstantX Team](https://huggingface.co/InstantX) (FLUX.1-dev Non-Commercial License)
|
| 75 |
-
- **Base
|
| 76 |
|
| 77 |
---
|
| 78 |
|
|
|
|
| 5 |
- text-to-image
|
| 6 |
- image-to-image
|
| 7 |
- inpainting
|
| 8 |
+
- sdxl
|
| 9 |
+
- stable-diffusion-xl
|
| 10 |
- qwen-image
|
| 11 |
- qwen-image-2512
|
| 12 |
- flux
|
|
|
|
| 20 |
|
| 21 |
# ControlNet Models (ConvRot INT8)
|
| 22 |
|
| 23 |
+
High-fidelity **ConvRot INT8** quantized weights for multi-condition ControlNet models across diverse generative architectures (**SDXL 1.0**, **Qwen-Image**, and **FLUX.1-dev**).
|
| 24 |
|
| 25 |
---
|
| 26 |
|
| 27 |
## ๐ Model Overview
|
| 28 |
|
| 29 |
+
This repository hosts high-quality **ConvRot INT8** quantized weights for all-in-one ControlNet Union models. By applying orthogonal Hadamard rotation prior to per-channel INT8 quantization, these models effectively eliminate activation outlier distortion and drastically reduce VRAM / disk footprint while preserving precise structural control fidelity:
|
| 30 |
|
| 31 |
+
- **controlnet-union-pro-max-sdxl-1.0**: The comprehensive all-in-one ControlNet Union model for **SDXL 1.0** by **xinsir**, supporting 10+ control conditions in a single compact file.
|
| 32 |
+
- **Qwen-Image-2512-Fun-Controlnet-Union-2602**: Multi-condition ControlNet Union model (5 layer blocks) for the **Qwen-Image-2512** architecture.
|
| 33 |
+
- **FLUX.1-dev-ControlNet-Union-Pro-2.0**: Next-generation unified 7-in-1 ControlNet for the **FLUX.1-dev** architecture by **Shakker Labs**.
|
| 34 |
|
| 35 |
---
|
| 36 |
|
|
|
|
| 38 |
|
| 39 |
| Filename | Base Architecture | Base Model | Supported Conditions | Quantization | File Size | License |
|
| 40 |
| :--- | :--- | :--- | :--- | :--- | :--- | :--- |
|
| 41 |
+
| `controlnet-union-pro-max-sdxl-1.0_convrot_int8.safetensors` | SDXL 1.0 | [xinsir/controlnet-union-sdxl-1.0](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0) | OpenPose, Depth, Canny, Lineart, Anime Lineart, Scribble, Soft Edge, Normal, Segment, Tile, Inpaint | ConvRot INT8 | ~1.30 GB | OpenRAIL++-M / Apache-2.0 |
|
| 42 |
| `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512 | [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.64 GB | Apache-2.0 |
|
| 43 |
| `FLUX.1-dev-ControlNet-Union-Pro-2.0_convrot_int8.safetensors` | FLUX.1-dev | [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) | Canny, Depth, Pose, Blur, Gray, Soft Edge, Low Quality | ConvRot INT8 | ~2.00 GB | Other / Non-Commercial |
|
| 44 |
|
| 45 |
---
|
| 46 |
|
| 47 |
+
## ๐ ๏ธ Key Features
|
| 48 |
|
| 49 |
+
- **All-in-One Multi-Condition Control**: Unified architectures enabling single or blended conditioning inputs (Pose, Depth, Canny, Tile, etc.) without switching heavy checkpoints during workflow execution.
|
| 50 |
+
- **ConvRot INT8 Precision**: Leverages orthogonal Hadamard rotations to redistribute channel-wise outlier spikes uniformly across dimensions, preventing quantization error buildup in deep control layers.
|
| 51 |
+
- **VRAM & Storage Optimization**: Slashes VRAM consumption and disk footprint by ~50% to 70% compared to unquantized FP16 checkpoints, allowing seamless multi-ControlNet workflows on consumer GPUs.
|
| 52 |
|
| 53 |
---
|
| 54 |
|
|
|
|
| 74 |
## ๐ Credits & License
|
| 75 |
|
| 76 |
### Base Models & Research
|
| 77 |
+
- **SDXL ControlNet Union:** [xinsir/controlnet-union-sdxl-1.0](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0) by **xinsir**
|
| 78 |
- **Qwen-Image ControlNet Union:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) & [aigc-apps/VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun) (Apache-2.0)
|
| 79 |
- **FLUX.1-dev ControlNet Union Pro 2.0:** [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) & [InstantX Team](https://huggingface.co/InstantX) (FLUX.1-dev Non-Commercial License)
|
| 80 |
+
- **Base Architectures:** [Stability AI SDXL 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) & [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
|
| 81 |
|
| 82 |
---
|
| 83 |
|