ussoewwin commited on
Commit
0eceb74
ยท
verified ยท
1 Parent(s): 2fdb56d

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +14 -9
README.md CHANGED
@@ -5,6 +5,8 @@ tags:
5
  - text-to-image
6
  - image-to-image
7
  - inpainting
 
 
8
  - qwen-image
9
  - qwen-image-2512
10
  - flux
@@ -18,16 +20,17 @@ pipeline_tag: image-to-image
18
 
19
  # ControlNet Models (ConvRot INT8)
20
 
21
- High-fidelity **ConvRot INT8** quantized weights for ControlNet models across diverse architectures (Qwen-Image, FLUX.1-dev).
22
 
23
  ---
24
 
25
  ## ๐ŸŒŸ Model Overview
26
 
27
- This repository hosts high-quality **ConvRot INT8** quantized weights for multi-condition ControlNet Union models, designed to significantly reduce VRAM and storage footprint while preserving fine-grained structural control fidelity:
28
 
29
- - **Qwen-Image-2512-Fun-Controlnet-Union-2602**: Multi-condition ControlNet Union model (5 layer blocks) for the Qwen-Image-2512 architecture.
30
- - **FLUX.1-dev-ControlNet-Union-Pro-2.0**: Next-generation unified 7-in-1 ControlNet for the FLUX.1-dev architecture by Shakker Labs.
 
31
 
32
  ---
33
 
@@ -35,16 +38,17 @@ This repository hosts high-quality **ConvRot INT8** quantized weights for multi-
35
 
36
  | Filename | Base Architecture | Base Model | Supported Conditions | Quantization | File Size | License |
37
  | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
 
38
  | `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512 | [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.64 GB | Apache-2.0 |
39
  | `FLUX.1-dev-ControlNet-Union-Pro-2.0_convrot_int8.safetensors` | FLUX.1-dev | [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) | Canny, Depth, Pose, Blur, Gray, Soft Edge, Low Quality | ConvRot INT8 | ~2.00 GB | Other / Non-Commercial |
40
 
41
  ---
42
 
43
- ## ๐Ÿ› ๏ธ Model Features
44
 
45
- - **Multi-Condition Control**: Unified architectures allowing single or combined conditioning inputs (Canny, Depth, Pose, etc.) without swapping model checkpoints.
46
- - **ConvRot INT8 Precision**: Preserves high-frequency details and directional feature integrity through randomized orthogonal Hadamard rotations, eliminating outlier distortion common in standard INT8 quantization.
47
- - **Significant Footprint Reduction**: Delivers ~50% to 70% VRAM and storage savings compared to unquantized FP16 checkpoints.
48
 
49
  ---
50
 
@@ -70,9 +74,10 @@ Place the downloaded `.safetensors` files into your ComfyUI `models/controlnet/`
70
  ## ๐Ÿ“œ Credits & License
71
 
72
  ### Base Models & Research
 
73
  - **Qwen-Image ControlNet Union:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) & [aigc-apps/VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun) (Apache-2.0)
74
  - **FLUX.1-dev ControlNet Union Pro 2.0:** [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) & [InstantX Team](https://huggingface.co/InstantX) (FLUX.1-dev Non-Commercial License)
75
- - **Base Architecture:** [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
76
 
77
  ---
78
 
 
5
  - text-to-image
6
  - image-to-image
7
  - inpainting
8
+ - sdxl
9
+ - stable-diffusion-xl
10
  - qwen-image
11
  - qwen-image-2512
12
  - flux
 
20
 
21
  # ControlNet Models (ConvRot INT8)
22
 
23
+ High-fidelity **ConvRot INT8** quantized weights for multi-condition ControlNet models across diverse generative architectures (**SDXL 1.0**, **Qwen-Image**, and **FLUX.1-dev**).
24
 
25
  ---
26
 
27
  ## ๐ŸŒŸ Model Overview
28
 
29
+ This repository hosts high-quality **ConvRot INT8** quantized weights for all-in-one ControlNet Union models. By applying orthogonal Hadamard rotation prior to per-channel INT8 quantization, these models effectively eliminate activation outlier distortion and drastically reduce VRAM / disk footprint while preserving precise structural control fidelity:
30
 
31
+ - **controlnet-union-pro-max-sdxl-1.0**: The comprehensive all-in-one ControlNet Union model for **SDXL 1.0** by **xinsir**, supporting 10+ control conditions in a single compact file.
32
+ - **Qwen-Image-2512-Fun-Controlnet-Union-2602**: Multi-condition ControlNet Union model (5 layer blocks) for the **Qwen-Image-2512** architecture.
33
+ - **FLUX.1-dev-ControlNet-Union-Pro-2.0**: Next-generation unified 7-in-1 ControlNet for the **FLUX.1-dev** architecture by **Shakker Labs**.
34
 
35
  ---
36
 
 
38
 
39
  | Filename | Base Architecture | Base Model | Supported Conditions | Quantization | File Size | License |
40
  | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
41
+ | `controlnet-union-pro-max-sdxl-1.0_convrot_int8.safetensors` | SDXL 1.0 | [xinsir/controlnet-union-sdxl-1.0](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0) | OpenPose, Depth, Canny, Lineart, Anime Lineart, Scribble, Soft Edge, Normal, Segment, Tile, Inpaint | ConvRot INT8 | ~1.30 GB | OpenRAIL++-M / Apache-2.0 |
42
  | `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512 | [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.64 GB | Apache-2.0 |
43
  | `FLUX.1-dev-ControlNet-Union-Pro-2.0_convrot_int8.safetensors` | FLUX.1-dev | [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) | Canny, Depth, Pose, Blur, Gray, Soft Edge, Low Quality | ConvRot INT8 | ~2.00 GB | Other / Non-Commercial |
44
 
45
  ---
46
 
47
+ ## ๐Ÿ› ๏ธ Key Features
48
 
49
+ - **All-in-One Multi-Condition Control**: Unified architectures enabling single or blended conditioning inputs (Pose, Depth, Canny, Tile, etc.) without switching heavy checkpoints during workflow execution.
50
+ - **ConvRot INT8 Precision**: Leverages orthogonal Hadamard rotations to redistribute channel-wise outlier spikes uniformly across dimensions, preventing quantization error buildup in deep control layers.
51
+ - **VRAM & Storage Optimization**: Slashes VRAM consumption and disk footprint by ~50% to 70% compared to unquantized FP16 checkpoints, allowing seamless multi-ControlNet workflows on consumer GPUs.
52
 
53
  ---
54
 
 
74
  ## ๐Ÿ“œ Credits & License
75
 
76
  ### Base Models & Research
77
+ - **SDXL ControlNet Union:** [xinsir/controlnet-union-sdxl-1.0](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0) by **xinsir**
78
  - **Qwen-Image ControlNet Union:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) & [aigc-apps/VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun) (Apache-2.0)
79
  - **FLUX.1-dev ControlNet Union Pro 2.0:** [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) & [InstantX Team](https://huggingface.co/InstantX) (FLUX.1-dev Non-Commercial License)
80
+ - **Base Architectures:** [Stability AI SDXL 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) & [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
81
 
82
  ---
83