ussoewwin commited on
Commit
34f7f09
·
verified ·
1 Parent(s): ad60dad

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +10 -8
README.md CHANGED
@@ -27,11 +27,12 @@ High-fidelity **ConvRot INT8** quantized weights for multi-condition ControlNet
27
 
28
  ## 🌟 Model Overview
29
 
30
- This repository hosts high-quality **ConvRot INT8** quantized weights for all-in-one ControlNet Union models. By applying orthogonal Hadamard rotation prior to per-channel INT8 quantization, these models effectively eliminate activation outlier distortion and drastically reduce VRAM and disk footprint while preserving precise structural control fidelity:
31
 
32
  - **CN-anytest4_illustrious2 (Variants A & B)**: Multi-purpose all-in-one Anytest v4 ControlNet models fine-tuned for **Illustrious-XL / SDXL** by **2vXpSwA7**, offering high-precision anime and illustration structure guiding.
33
  - **controlnet-union-pro-max-sdxl-1.0**: The comprehensive all-in-one ControlNet Union model for **SDXL 1.0** by **xinsir**, supporting 10+ control conditions in a single compact file.
34
  - **Qwen-Image-2512-Fun-Controlnet-Union-2602**: Multi-condition ControlNet Union model (5 layer blocks) for the **Qwen-Image-2512** architecture.
 
35
  - **FLUX.1-dev-ControlNet-Union-Pro-2.0**: Next-generation unified 7-in-1 ControlNet for the **FLUX.1-dev** architecture by **Shakker Labs**.
36
 
37
  ---
@@ -40,17 +41,18 @@ This repository hosts high-quality **ConvRot INT8** quantized weights for all-in
40
 
41
  | Filename | Base Architecture | Base Model | Supported Conditions | Quantization | File Size | License |
42
  | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
43
- | `CN-anytest4_illustrious2_A_convrot_int8.safetensors` | Illustrious-XL / SDXL | [2vXpSwA7/iroiro-lora (Anytest v4 Variant A)](https://huggingface.co/2vXpSwA7/iroiro-lora) | Multi-condition (Canny, Lineart, Depth, Pose, Structure) | ConvRot INT8 | ~1.30 GB | Fair AI / OpenRAIL++-M |
44
- | `CN-anytest4_illustrious2_B_convrot_int8.safetensors` | Illustrious-XL / SDXL | [2vXpSwA7/iroiro-lora (Anytest v4 Variant B)](https://huggingface.co/2vXpSwA7/iroiro-lora) | Multi-condition (Canny, Lineart, Depth, Pose, Structure) | ConvRot INT8 | ~1.30 GB | Fair AI / OpenRAIL++-M |
45
- | `controlnet-union-pro-max-sdxl-1.0_convrot_int8.safetensors` | SDXL 1.0 | [xinsir/controlnet-union-sdxl-1.0](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0) | OpenPose, Depth, Canny, Lineart, Anime Lineart, Scribble, Soft Edge, Normal, Segment, Tile, Inpaint | ConvRot INT8 | ~1.30 GB | OpenRAIL++-M / Apache-2.0 |
46
- | `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512 | [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.64 GB | Apache-2.0 |
47
- | `FLUX.1-dev-ControlNet-Union-Pro-2.0_convrot_int8.safetensors` | FLUX.1-dev | [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) | Canny, Depth, Pose, Blur, Gray, Soft Edge, Low Quality | ConvRot INT8 | ~2.00 GB | Other / Non-Commercial |
 
48
 
49
  ---
50
 
51
  ## 🛠️ Key Features
52
 
53
- - **All-in-One Multi-Condition Control**: Unified architectures enabling single or blended conditioning inputs (Pose, Depth, Lineart, Canny, Tile, etc.) without switching heavy checkpoints during workflow execution.
54
  - **ConvRot INT8 Precision**: Leverages orthogonal Hadamard rotations to redistribute channel-wise outlier spikes uniformly across dimensions, preventing quantization error buildup in deep control layers.
55
  - **VRAM & Storage Optimization**: Slashes VRAM consumption and disk footprint by ~50% to 70% compared to unquantized FP16 checkpoints, allowing seamless multi-ControlNet workflows on consumer GPUs.
56
 
@@ -80,7 +82,7 @@ Place the downloaded `.safetensors` files into your ComfyUI `models/controlnet/`
80
  ### Base Models & Research
81
  - **Illustrious Anytest ControlNet:** [2vXpSwA7/iroiro-lora](https://huggingface.co/2vXpSwA7/iroiro-lora) by **2vXpSwA7**
82
  - **SDXL ControlNet Union:** [xinsir/controlnet-union-sdxl-1.0](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0) by **xinsir**
83
- - **Qwen-Image ControlNet Union:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) & [aigc-apps/VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun) (Apache-2.0)
84
  - **FLUX.1-dev ControlNet Union Pro 2.0:** [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) & [InstantX Team](https://huggingface.co/InstantX) (FLUX.1-dev Non-Commercial License)
85
  - **Base Architectures:** [Illustrious-XL](https://civitai.red/models/675574/illustrious-xl), [Stability AI SDXL 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) & [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
86
 
 
27
 
28
  ## 🌟 Model Overview
29
 
30
+ This repository hosts high-quality **ConvRot INT8** quantized weights for all-in-one ControlNet Union and dedicated ControlNet models. By applying orthogonal Hadamard rotation prior to per-channel INT8 quantization, these models effectively eliminate activation outlier distortion and drastically reduce VRAM and disk footprint while preserving precise structural control fidelity:
31
 
32
  - **CN-anytest4_illustrious2 (Variants A & B)**: Multi-purpose all-in-one Anytest v4 ControlNet models fine-tuned for **Illustrious-XL / SDXL** by **2vXpSwA7**, offering high-precision anime and illustration structure guiding.
33
  - **controlnet-union-pro-max-sdxl-1.0**: The comprehensive all-in-one ControlNet Union model for **SDXL 1.0** by **xinsir**, supporting 10+ control conditions in a single compact file.
34
  - **Qwen-Image-2512-Fun-Controlnet-Union-2602**: Multi-condition ControlNet Union model (5 layer blocks) for the **Qwen-Image-2512** architecture.
35
+ - **Qwen-Image-ControlNet-Inpainting**: Dedicated inpainting and editing ControlNet model for the **Qwen-Image** architecture.
36
  - **FLUX.1-dev-ControlNet-Union-Pro-2.0**: Next-generation unified 7-in-1 ControlNet for the **FLUX.1-dev** architecture by **Shakker Labs**.
37
 
38
  ---
 
41
 
42
  | Filename | Base Architecture | Base Model | Supported Conditions | Quantization | File Size | License |
43
  | :--- | :--- | :--- | :--- | :--- | :--- | :--- |
44
+ | `CN-anytest4_illustrious2_A_convrot_int8.safetensors` | Illustrious-XL / SDXL | [2vXpSwA7/iroiro-lora (Anytest v4 Variant A)](https://huggingface.co/2vXpSwA7/iroiro-lora) | Multi-condition (Canny, Lineart, Depth, Pose, Structure) | ConvRot INT8 | ~1.40 GB | Fair AI / OpenRAIL++-M |
45
+ | `CN-anytest4_illustrious2_B_convrot_int8.safetensors` | Illustrious-XL / SDXL | [2vXpSwA7/iroiro-lora (Anytest v4 Variant B)](https://huggingface.co/2vXpSwA7/iroiro-lora) | Multi-condition (Canny, Lineart, Depth, Pose, Structure) | ConvRot INT8 | ~1.40 GB | Fair AI / OpenRAIL++-M |
46
+ | `controlnet-union-pro-max-sdxl-1.0_convrot_int8.safetensors` | SDXL 1.0 | [xinsir/controlnet-union-sdxl-1.0](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0) | OpenPose, Depth, Canny, Lineart, Anime Lineart, Scribble, Soft Edge, Normal, Segment, Tile, Inpaint | ConvRot INT8 | ~1.40 GB | OpenRAIL++-M / Apache-2.0 |
47
+ | `Qwen-Image-2512-Fun-Controlnet-Union-2602_convrot_int8.safetensors` | Qwen-Image-2512 | [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union) | Canny, HED, Depth, Pose, MLSD, Scribble, Gray, Inpaint | ConvRot INT8 | ~1.76 GB | Apache-2.0 |
48
+ | `Qwen-Image-ControlNet-Inpainting_convrot_int8.safetensors` | Qwen-Image | [alibaba-pai/Qwen-Image-ControlNet-Inpainting](https://huggingface.co/alibaba-pai/Qwen-Image-ControlNet-Inpainting) | Inpainting, Image Editing | ConvRot INT8 | ~2.12 GB | Apache-2.0 |
49
+ | `FLUX.1-dev-ControlNet-Union-Pro-2.0_convrot_int8.safetensors` | FLUX.1-dev | [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) | Canny, Depth, Pose, Blur, Gray, Soft Edge, Low Quality | ConvRot INT8 | ~2.14 GB | Other / Non-Commercial |
50
 
51
  ---
52
 
53
  ## 🛠️ Key Features
54
 
55
+ - **All-in-One Multi-Condition Control**: Unified architectures enabling single or blended conditioning inputs (Pose, Depth, Lineart, Canny, Tile, Inpainting, etc.) without switching heavy checkpoints during workflow execution.
56
  - **ConvRot INT8 Precision**: Leverages orthogonal Hadamard rotations to redistribute channel-wise outlier spikes uniformly across dimensions, preventing quantization error buildup in deep control layers.
57
  - **VRAM & Storage Optimization**: Slashes VRAM consumption and disk footprint by ~50% to 70% compared to unquantized FP16 checkpoints, allowing seamless multi-ControlNet workflows on consumer GPUs.
58
 
 
82
  ### Base Models & Research
83
  - **Illustrious Anytest ControlNet:** [2vXpSwA7/iroiro-lora](https://huggingface.co/2vXpSwA7/iroiro-lora) by **2vXpSwA7**
84
  - **SDXL ControlNet Union:** [xinsir/controlnet-union-sdxl-1.0](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0) by **xinsir**
85
+ - **Qwen-Image ControlNet Models:** [alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union](https://huggingface.co/alibaba-pai/Qwen-Image-2512-Fun-Controlnet-Union), [alibaba-pai/Qwen-Image-ControlNet-Inpainting](https://huggingface.co/alibaba-pai/Qwen-Image-ControlNet-Inpainting) & [aigc-apps/VideoX-Fun](https://github.com/aigc-apps/VideoX-Fun) (Apache-2.0)
86
  - **FLUX.1-dev ControlNet Union Pro 2.0:** [Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0](https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro-2.0) & [InstantX Team](https://huggingface.co/InstantX) (FLUX.1-dev Non-Commercial License)
87
  - **Base Architectures:** [Illustrious-XL](https://civitai.red/models/675574/illustrious-xl), [Stability AI SDXL 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) & [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
88