ussoewwin commited on
Commit
5353762
Β·
verified Β·
1 Parent(s): ca27119

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +25 -19
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- license: apache-2.0
3
  tags:
4
  - controlnet
5
  - text-to-image
@@ -7,6 +7,8 @@ tags:
7
  - inpainting
8
  - qwen-image
9
  - qwen-image-2512
 
 
10
  - quantized
11
  - int8
12
  - convrot
@@ -16,42 +18,41 @@ pipeline_tag: image-to-image
16
 
17
  # ControlNet Models (ConvRot INT8)
18
 
19
- High-fidelity **ConvRot INT8** quantized weights for ControlNet models.
20
 
21
  ---
22
 
23
  ## 🌟 Model Overview
24
 
25
- This repository hosts the **ConvRot INT8** quantized weights of **`Qwen-Image-2512-Fun-Controlnet-Union-2602`**, based on [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union).
26
 
27
- - **Base Model:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union)
28
- - **Supported Conditions:** Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpainting
29
- - **Quantization:** ConvRot INT8
30
- - **License:** Apache-2.0
31
 
32
  ---
33
 
34
  ## πŸ“¦ Available Models
35
 
36
- | Filename | Base Model | Supported Conditions | Precision | File Size | License |
37
- | :--- | :--- | :--- | :--- | :--- | :--- |
38
- | `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512-Fun-Controlnet-Union-2602 | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.64 GB | Apache-2.0 |
 
39
 
40
  ---
41
 
42
  ## πŸ› οΈ Model Features
43
 
44
- - Multi-condition ControlNet Union model (added on 5 layer blocks of Qwen-Image-2512).
45
- - Supported control conditions: Canny, HED, Depth, Pose, MLSD, Scribble, Gray, and Inpainting.
46
- - Quantized to **ConvRot INT8** to reduce VRAM and disk footprint while maintaining structural control fidelity.
47
 
48
  ---
49
 
50
  ## πŸš€ Usage in ComfyUI
51
 
52
- ComfyUI does not natively support the **ConvRot INT8** format for ControlNet models. To load and execute these weights in ComfyUI, the dedicated loader extension is required:
53
 
54
- - **Dedicated Loader Extension:** [ComfyUI-HSWQ-Loader-and-Tools](https://github.com/ussoewwin/ComfyUI-HSWQ-Loader-and-Tools)
55
 
56
  ### Installation
57
 
@@ -62,12 +63,17 @@ cd ComfyUI/custom_nodes
62
  git clone https://github.com/ussoewwin/ComfyUI-HSWQ-Loader-and-Tools.git
63
  ```
64
 
65
- Place `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` into your ComfyUI `models/controlnet/` directory and load it using the dedicated loader node.
66
 
67
  ---
68
 
69
  ## πŸ“œ Credits & License
70
 
71
- - **Original Base Model:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union)
72
- - **Upstream Repository:** [aigc-apps/VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun)
73
- - **License:** Apache-2.0
 
 
 
 
 
 
1
  ---
2
+ license: other
3
  tags:
4
  - controlnet
5
  - text-to-image
 
7
  - inpainting
8
  - qwen-image
9
  - qwen-image-2512
10
+ - flux
11
+ - flux.1-dev
12
  - quantized
13
  - int8
14
  - convrot
 
18
 
19
  # ControlNet Models (ConvRot INT8)
20
 
21
+ High-fidelity **ConvRot INT8** quantized weights for ControlNet models across diverse architectures (Qwen-Image, FLUX.1-dev).
22
 
23
  ---
24
 
25
  ## 🌟 Model Overview
26
 
27
+ This repository hosts high-quality **ConvRot INT8** quantized weights for multi-condition ControlNet Union models, designed to significantly reduce VRAM and storage footprint while preserving fine-grained structural control fidelity:
28
 
29
+ - **Qwen-Image-2512-Fun-Controlnet-Union-2602**: Multi-condition ControlNet Union model (5 layer blocks) for the Qwen-Image-2512 architecture.
30
+ - **FLUX.1-dev-ControlNet-Union-Pro-2.0**: Next-generation unified 7-in-1 ControlNet for the FLUX.1-dev architecture by Shakker Labs.
 
 
31
 
32
  ---
33
 
34
  ## πŸ“¦ Available Models
35
 
36
+ | Filename | Base Architecture | Base Model | Supported Conditions | Quantization | File Size | License |
37
+ | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
38
+ | `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512 | [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.64 GB | Apache-2.0 |
39
+ | `FLUX.1-dev-ControlNet-Union-Pro-2.0_convrot_int8.safetensors` | FLUX.1-dev | [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) | Canny, Depth, Pose, Blur, Gray, Soft Edge, Low Quality | ConvRot INT8 | ~2.00 GB | Other / Non-Commercial |
40
 
41
  ---
42
 
43
  ## πŸ› οΈ Model Features
44
 
45
+ - **Multi-Condition Control**: Unified architectures allowing single or combined conditioning inputs (Canny, Depth, Pose, etc.) without swapping model checkpoints.
46
+ - **ConvRot INT8 Precision**: Preserves high-frequency details and directional feature integrity through randomized orthogonal Hadamard rotations, eliminating outlier distortion common in standard INT8 quantization.
47
+ - **Significant Footprint Reduction**: Delivers ~50% to 70% VRAM and storage savings compared to unquantized FP16 checkpoints.
48
 
49
  ---
50
 
51
  ## πŸš€ Usage in ComfyUI
52
 
53
+ To load and execute these ConvRot INT8 ControlNet models in ComfyUI, please use the dedicated loader node from the **ComfyUI-HSWQ-Loader-and-Tools** extension:
54
 
55
+ - **Extension Repository:** [ComfyUI-HSWQ-Loader-and-Tools](https://github.com/ussoewwin/ComfyUI-HSWQ-Loader-and-Tools)
56
 
57
  ### Installation
58
 
 
63
  git clone https://github.com/ussoewwin/ComfyUI-HSWQ-Loader-and-Tools.git
64
  ```
65
 
66
+ Place the downloaded `.safetensors` files into your ComfyUI `models/controlnet/` directory and load them using the dedicated ControlNet loader node.
67
 
68
  ---
69
 
70
  ## πŸ“œ Credits & License
71
 
72
+ ### Base Models & Research
73
+ - **Qwen-Image ControlNet Union:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) & [aigc-apps/VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun) (Apache-2.0)
74
+ - **FLUX.1-dev ControlNet Union Pro 2.0:** [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) & [InstantX Team](https://huggingface.co/InstantX) (FLUX.1-dev Non-Commercial License)
75
+ - **Base Architecture:** [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
76
+
77
+ ---
78
+
79
+ **Disclaimer:** These models are provided for optimization, workflow acceleration, and research purposes. Please adhere to the licenses and terms of the respective base models.