lilcheaty commited on
Commit
a91fec8
·
verified ·
1 Parent(s): c04413b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +86 -0
README.md ADDED
@@ -0,0 +1,86 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: krea-2-community-license
4
+ license_link: https://www.krea.ai/krea-2-licensing
5
+ base_model: krea/Krea-2
6
+ tags:
7
+ - text-to-image
8
+ - krea
9
+ - krea2
10
+ - int8
11
+ - convrot
12
+ - comfyui
13
+ - quantized
14
+ ---
15
+
16
+ # Krea 2 — INT8 ConvRot
17
+
18
+ INT8 **ConvRot** quantized weights for **[Krea 2 (K2)](https://www.krea.ai/krea-2)**, for fast, low-VRAM
19
+ inference in ComfyUI via the [ComfyUI-INT8-Fast](https://github.com/BobJohnson24/ComfyUI-INT8-Fast) node.
20
+
21
+ > **This is a modified (quantized) version of the Krea 2 model.** It is **not** an official Krea release and is
22
+ > **not** endorsed by Krea. The original weights are © Krea, licensed under the
23
+ > [Krea 2 Community License](https://www.krea.ai/krea-2-licensing).
24
+
25
+ ConvRot is a near-lossless INT8 scheme (~GGUF-Q8 quality) that runs on the INT8 tensor cores of any NVIDIA GPU
26
+ with sufficient INT8 TOPS (RTX 30-series and up). On a 3090, INT8 is meaningfully faster than FP8 (which has no
27
+ tensor-core acceleration on Ampere) and roughly half the VRAM of BF16.
28
+
29
+ ## Models
30
+
31
+ | File | Precision | Size | Use |
32
+ |------|-----------|------|-----|
33
+ | `Krea2-Turbo-int8-ConvRot.safetensors` | INT8 ConvRot | 13.2 GB | 8-step distilled, fast text-to-image |
34
+ | `Krea2-Raw-int8-ConvRot.safetensors` | INT8 ConvRot | ~13 GB | Undistilled base — fine-tuning / LoRA training / research |
35
+
36
+ Original BF16 checkpoints are ~26.6 GB each. Quantized with the K2 profile: the 28 main DiT blocks are INT8,
37
+ while the sensitive layers (`first`, `last`, `tmlp`, `tproj`, `txtfusion`, `txtmlp`) are kept in high precision.
38
+
39
+ ## Requirements
40
+
41
+ - **ComfyUI ≥ 0.25.0** (native Krea 2 support).
42
+ - **[ComfyUI-INT8-Fast](https://github.com/BobJohnson24/ComfyUI-INT8-Fast)** custom node (with a `krea2`
43
+ model-type profile — see note below).
44
+ - Text encoder: **`qwen3vl_4b_fp8_scaled.safetensors`** → `ComfyUI/models/text_encoders/`
45
+ (from [Comfy-Org/Qwen3-VL](https://huggingface.co/Comfy-Org/Qwen3-VL)).
46
+ - VAE: **`qwen_image_vae.safetensors`** → `ComfyUI/models/vae/`
47
+ (from [Comfy-Org/Qwen-Image_ComfyUI](https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI)).
48
+ - Put the INT8 `.safetensors` in `ComfyUI/models/diffusion_models/`.
49
+
50
+ > **Note on the `krea2` profile:** Krea 2 is newer than INT8-Fast's built-in model list. These weights were
51
+ > produced with a small added `krea2` exclusion profile (keep `first`/`last`/`tmlp`/`tproj`/`txtfusion`/`txtmlp`
52
+ > in high precision). Loading the *pre-quantized* files here does not require that profile — ConvRot metadata
53
+ > is embedded per-layer — but reproducing the conversion does.
54
+
55
+ ## Usage
56
+
57
+ Load with **Load Diffusion Model INT8 (W8A8)** (`OTUNetLoaderW8A8`):
58
+ - `unet_name`: the INT8 file
59
+ - `on_the_fly_quantization`: **false** (already quantized)
60
+ - `enable_convrot`: **true**
61
+ - `model_type`: `krea2`
62
+
63
+ Then the standard K2 graph: `CLIPLoader (type: krea2)` → `VAELoader` → `CLIPTextEncode` → `KSampler` → `VAEDecode`.
64
+
65
+ Recommended sampler settings:
66
+ - **Turbo:** 8 steps, CFG 1.0, `euler` / `simple`, shift 1.15 (model default).
67
+ - **Raw:** ~52 steps, CFG ~3.5, `euler` / `simple` (undistilled base; mainly for training).
68
+
69
+ ## Quantization
70
+
71
+ - **Method:** INT8 ConvRot (row-wise INT8 with convolutional rotation), via ComfyUI-INT8-Fast.
72
+ - **Compute:** `torch._int_mm` on INT8 tensor cores; Triton kernels.
73
+ - **Quality:** near-lossless vs BF16/FP8 in testing (verified by generation).
74
+
75
+ ## License & attribution
76
+
77
+ Krea 2 is licensed under the **Krea 2 Community License Agreement**,
78
+ Copyright © Krea, Inc. All Rights Reserved. See `LICENSE` / https://www.krea.ai/krea-2-licensing.
79
+
80
+ These files are a **quantized derivative** of Krea 2; the Krea 2 model name is retained per the license.
81
+ Commercial use is permitted only for entities under $1M USD trailing-twelve-month revenue; above that an
82
+ Enterprise License from Krea is required. **Deployers must implement reasonable content-filtering** (e.g.
83
+ NudeNet, Falconsai/nsfw_image_detection, Hive, or human review) to prevent prohibited content, and disclose
84
+ AI-generated outputs where required.
85
+
86
+ **Credits:** [Krea](https://www.krea.ai) (base model) · [BobJohnson24/ComfyUI-INT8-Fast](https://github.com/BobJohnson24/ComfyUI-INT8-Fast) (INT8 ConvRot method).