Hybrid-Sensitivity-Weighted-Quantization (HSWQ)

High-fidelity INT8 quantization for diffusion models (SDXL). HSWQ uses sensitivity and importance analysis instead of naive uniform cast.

Technical details: md/HSWQ_INT8_SDXL_Technical_Guide.md

How to quantize: md/HSWQ_ How to quantize SDXL.md

ComfyUI Loader for INT8: To load these INT8 models in ComfyUI, please use the unofficial loader node: ComfyUI-nunchaku-unofficial-loader

SDXL Benchmark Test Results: test/benchmark_sdxl_int8.md


Benchmark (Reference)

Model SSIM (Avg) File size Compatibility
Original FP16 1.0000 100% High
Naive INT8 0.91-0.96 50% High
HSWQ INT8 0.94-0.98 67% (FP16 mixed) High

πŸ“¦ Available Models

Filename Base Model Version License
waiIllustriousSDXL_v170_hswq_r32_r0_int8.safetensors Illustrious-XL v1.7 (WAI-illustrious-SDXL) v17.0 (HF weight) Illustrious License
prefectIllustriousXL_v8_hswq_r32_r0_int8.safetensors Prefect illustrious XL v8.0 Illustrious License
JANKUTrainedChenkinNoobai_v777_hswq_r32_r0_int8.safetensors JANKU Trained Chenkin & Noobai-Rouwei (Illustrious-XL) v777 Illustrious License
unholyDesireMixSinister_v80_hswq_r32_r0_int8.safetensors Unholy Desire Mix - Sinister Aesthetic (Illustrious) v8.0 Illustrious License
waiANIPONYXL_v140_hswq_r32_r0_int8.safetensors WAI-ANI-PONYXL v14.0 Pony License
novaAnimeXL_ilV190_hswq_r32_r0_int8.safetensors Nova Anime XL Illustrious v19.0 Illustrious License
bluePencilXL_v031_hswq_r32_r0_int8.safetensors blue_pencil-XL v0.3.1 CreativeML Open RAIL++-M

πŸ“œ Credits & License

πŸ† Special Acknowledgement

We extend our deepest respect and gratitude to the Nunchaku Team for their groundbreaking work on SVDQ quantization and for sharing their models with the community. This collection relies heavily on their research and original implementation.

Base Models

These models are derivatives of their respective creators. All credit for aesthetic tuning and model training belongs to the original creators.

  • WAI-illustrious-SDXL / WAI-ANI-PONYXL: Created by WAI0731.
  • Prefect illustrious XL: Created by Goofy_Ai.
  • JANKU Trained Chenkin & Noobai-Rouwei (Illustrious-XL): Created by janxd.
  • Unholy Desire Mix - Sinister Aesthetic (Illustrious): Created by UnholyDesiresStudio.
  • Nova Anime XL: Created by Crody.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support