File size: 1,868 Bytes
2f45de8 692ad27 2f45de8 4e76c03 2f45de8 4e76c03 2f45de8 4415cad 692ad27 2f45de8 ddd0d06 692ad27 2f45de8 a6c9c33 2f45de8 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 | ---
tags:
- comfyui
- int8
- qwen2_5_vl
- qwen3
- qwen3_vl
- Quantizations
---
For INT4 convrot W4A4 models, go to https://huggingface.co/ariaotp/int4-ConvRot-W4A4-ComfyUI instead.
These models are quantized INT8(both of simple and convrot) for ComfyUI 0.27.0 or later. They are fast in Ampere(RTX30x0)/Ada Lovelace(RTX40x0)/Blackwell(RTX50x0).
Original models that I used:
* Qwen2.5-VL 7B (Qwen2.5-VL-7B-Instruct-abliterated): https://huggingface.co/huihui-ai/Qwen2.5-VL-7B-Instruct-abliterated (Needed for Qwen-Image and FireRed-Image-Edit)
* Qwen3 0.6B (Huihui-Qwen3-0.6B-abliterated-v2) : https://huggingface.co/huihui-ai/Huihui-Qwen3-0.6B-abliterated-v2 (Needed for Anima)
* Qwen3 4B (Huihui-Qwen3-4B-abliterated-v2): https://huggingface.co/chinmankokumin/Qwen3-4B-abliterated-v2 (Needed for Z-Image and FLUX.2 Klein 4B)
* Qwen3 4B Instruct-2507: (Huihui-Qwen3-4B-Instruct-2507-abliterated): https://huggingface.co/huihui-ai/Huihui-Qwen3-4B-Instruct-2507-abliterated (Alternate text encoder for Z-Image or FLUX.2 Klein 4B)
* Qwen3 8B (Huihui-Qwen3-8B-abliterated-v2): https://huggingface.co/huihui-ai/Huihui-Qwen3-8B-abliterated-v2 (Needed for FLUX.2 Klein 9B)
* Qwen3-VL 4B (Huihui-Qwen3-VL-4B-Instruct-abliterated): https://huggingface.co/ahmed22xa/Huihui-Qwen3-VL-4B-Instruct-abliterated-comfy (Needed for Krea2)
* Qwen3-VL 8B (Huihui-Qwen3-VL-8B-Instruct-abliterated): https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-8B-Instruct-abliterated (Needed for Boogu-Image and Ideogram4)
They used Starnodes Model Converter, made by Starnodes2024, quantized from BF16 models https://github.com/Starnodes2024/comfyui-starnodes-modelconverter
Or quant_int8_convrot.py of ComfyUI's official ComfyUI model tools https://github.com/Comfy-Org/comfy-model-tools
License
Qwen2.5-VL, Qwen3, Qwen3-VL: Apache 2.0
* https://www.apache.org/licenses/LICENSE-2.0.txt |