Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,86 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: krea-2-community-license
|
| 4 |
+
license_link: https://www.krea.ai/krea-2-licensing
|
| 5 |
+
base_model: krea/Krea-2
|
| 6 |
+
tags:
|
| 7 |
+
- text-to-image
|
| 8 |
+
- krea
|
| 9 |
+
- krea2
|
| 10 |
+
- int8
|
| 11 |
+
- convrot
|
| 12 |
+
- comfyui
|
| 13 |
+
- quantized
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# Krea 2 — INT8 ConvRot
|
| 17 |
+
|
| 18 |
+
INT8 **ConvRot** quantized weights for **[Krea 2 (K2)](https://www.krea.ai/krea-2)**, for fast, low-VRAM
|
| 19 |
+
inference in ComfyUI via the [ComfyUI-INT8-Fast](https://github.com/BobJohnson24/ComfyUI-INT8-Fast) node.
|
| 20 |
+
|
| 21 |
+
> **This is a modified (quantized) version of the Krea 2 model.** It is **not** an official Krea release and is
|
| 22 |
+
> **not** endorsed by Krea. The original weights are © Krea, licensed under the
|
| 23 |
+
> [Krea 2 Community License](https://www.krea.ai/krea-2-licensing).
|
| 24 |
+
|
| 25 |
+
ConvRot is a near-lossless INT8 scheme (~GGUF-Q8 quality) that runs on the INT8 tensor cores of any NVIDIA GPU
|
| 26 |
+
with sufficient INT8 TOPS (RTX 30-series and up). On a 3090, INT8 is meaningfully faster than FP8 (which has no
|
| 27 |
+
tensor-core acceleration on Ampere) and roughly half the VRAM of BF16.
|
| 28 |
+
|
| 29 |
+
## Models
|
| 30 |
+
|
| 31 |
+
| File | Precision | Size | Use |
|
| 32 |
+
|------|-----------|------|-----|
|
| 33 |
+
| `Krea2-Turbo-int8-ConvRot.safetensors` | INT8 ConvRot | 13.2 GB | 8-step distilled, fast text-to-image |
|
| 34 |
+
| `Krea2-Raw-int8-ConvRot.safetensors` | INT8 ConvRot | ~13 GB | Undistilled base — fine-tuning / LoRA training / research |
|
| 35 |
+
|
| 36 |
+
Original BF16 checkpoints are ~26.6 GB each. Quantized with the K2 profile: the 28 main DiT blocks are INT8,
|
| 37 |
+
while the sensitive layers (`first`, `last`, `tmlp`, `tproj`, `txtfusion`, `txtmlp`) are kept in high precision.
|
| 38 |
+
|
| 39 |
+
## Requirements
|
| 40 |
+
|
| 41 |
+
- **ComfyUI ≥ 0.25.0** (native Krea 2 support).
|
| 42 |
+
- **[ComfyUI-INT8-Fast](https://github.com/BobJohnson24/ComfyUI-INT8-Fast)** custom node (with a `krea2`
|
| 43 |
+
model-type profile — see note below).
|
| 44 |
+
- Text encoder: **`qwen3vl_4b_fp8_scaled.safetensors`** → `ComfyUI/models/text_encoders/`
|
| 45 |
+
(from [Comfy-Org/Qwen3-VL](https://huggingface.co/Comfy-Org/Qwen3-VL)).
|
| 46 |
+
- VAE: **`qwen_image_vae.safetensors`** → `ComfyUI/models/vae/`
|
| 47 |
+
(from [Comfy-Org/Qwen-Image_ComfyUI](https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI)).
|
| 48 |
+
- Put the INT8 `.safetensors` in `ComfyUI/models/diffusion_models/`.
|
| 49 |
+
|
| 50 |
+
> **Note on the `krea2` profile:** Krea 2 is newer than INT8-Fast's built-in model list. These weights were
|
| 51 |
+
> produced with a small added `krea2` exclusion profile (keep `first`/`last`/`tmlp`/`tproj`/`txtfusion`/`txtmlp`
|
| 52 |
+
> in high precision). Loading the *pre-quantized* files here does not require that profile — ConvRot metadata
|
| 53 |
+
> is embedded per-layer — but reproducing the conversion does.
|
| 54 |
+
|
| 55 |
+
## Usage
|
| 56 |
+
|
| 57 |
+
Load with **Load Diffusion Model INT8 (W8A8)** (`OTUNetLoaderW8A8`):
|
| 58 |
+
- `unet_name`: the INT8 file
|
| 59 |
+
- `on_the_fly_quantization`: **false** (already quantized)
|
| 60 |
+
- `enable_convrot`: **true**
|
| 61 |
+
- `model_type`: `krea2`
|
| 62 |
+
|
| 63 |
+
Then the standard K2 graph: `CLIPLoader (type: krea2)` → `VAELoader` → `CLIPTextEncode` → `KSampler` → `VAEDecode`.
|
| 64 |
+
|
| 65 |
+
Recommended sampler settings:
|
| 66 |
+
- **Turbo:** 8 steps, CFG 1.0, `euler` / `simple`, shift 1.15 (model default).
|
| 67 |
+
- **Raw:** ~52 steps, CFG ~3.5, `euler` / `simple` (undistilled base; mainly for training).
|
| 68 |
+
|
| 69 |
+
## Quantization
|
| 70 |
+
|
| 71 |
+
- **Method:** INT8 ConvRot (row-wise INT8 with convolutional rotation), via ComfyUI-INT8-Fast.
|
| 72 |
+
- **Compute:** `torch._int_mm` on INT8 tensor cores; Triton kernels.
|
| 73 |
+
- **Quality:** near-lossless vs BF16/FP8 in testing (verified by generation).
|
| 74 |
+
|
| 75 |
+
## License & attribution
|
| 76 |
+
|
| 77 |
+
Krea 2 is licensed under the **Krea 2 Community License Agreement**,
|
| 78 |
+
Copyright © Krea, Inc. All Rights Reserved. See `LICENSE` / https://www.krea.ai/krea-2-licensing.
|
| 79 |
+
|
| 80 |
+
These files are a **quantized derivative** of Krea 2; the Krea 2 model name is retained per the license.
|
| 81 |
+
Commercial use is permitted only for entities under $1M USD trailing-twelve-month revenue; above that an
|
| 82 |
+
Enterprise License from Krea is required. **Deployers must implement reasonable content-filtering** (e.g.
|
| 83 |
+
NudeNet, Falconsai/nsfw_image_detection, Hive, or human review) to prevent prohibited content, and disclose
|
| 84 |
+
AI-generated outputs where required.
|
| 85 |
+
|
| 86 |
+
**Credits:** [Krea](https://www.krea.ai) (base model) · [BobJohnson24/ComfyUI-INT8-Fast](https://github.com/BobJohnson24/ComfyUI-INT8-Fast) (INT8 ConvRot method).
|