Text-to-Image
Diffusers
Safetensors
English
Flux2KleinPipeline
flux2_klein
image-editing
diffusion
quantized
quantfunc
flux
Instructions to use QuantFunc/Klein-9B-Series with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use QuantFunc/Klein-9B-Series with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("QuantFunc/Klein-9B-Series", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
docs: point GitHub/QR links to RealJonathanYip (repo migrated)
Browse files
README.md
CHANGED
|
@@ -45,7 +45,7 @@ licensed under the **FLUX Non-Commercial License v2.1** by Black Forest Labs.
|
|
| 45 |
<p align="center">
|
| 46 |
🤗 <a href="https://huggingface.co/QuantFunc">Hugging Face</a> |
|
| 47 |
🤖 <a href="https://www.modelscope.cn/profile/QuantFunc">ModelScope</a> |
|
| 48 |
-
💻 <a href="https://github.com/
|
| 49 |
💬 <a href="#wechat">WeChat (微信)</a> |
|
| 50 |
🎮 <a href="https://discord.gg/jCp9TpFWcn">Discord</a>
|
| 51 |
</p>
|
|
@@ -54,18 +54,18 @@ licensed under the **FLUX Non-Commercial License v2.1** by Black Forest Labs.
|
|
| 54 |
|
| 55 |
The larger **9B** Klein model for maximum fidelity, shipped as **distilled (4-step)** + **base (28-step)** transformers across **three GPU tiers** (`50x` FP4 · `40x` INT4+FP8 · `30x-below` INT4+INT8).
|
| 56 |
|
| 57 |
-
**Powered by the [QuantFunc ComfyUI plugin](https://github.com/
|
| 58 |
|
| 59 |
- 🚀 **2x–11x speedup** over standard BF16/FP16 Python pipelines (pre-exported → even faster loading).
|
| 60 |
- ⚙️ **Native C++/CUDA** (`libquantfunc.so` / `quantfunc.dll`) with **zero Python model dependencies**.
|
| 61 |
- 🧩 **Dual engine** (SVDQ offline + Lighting runtime 4-bit), **zero-cost LoRA stacking**, reference-image editing & inpainting.
|
| 62 |
- 🟢 **Full GPU coverage** — RTX 20/30/40/50 · A100/H100/H200/B100/B200/GB300 · RTX 6000 Ada / PRO Blackwell (CUDA 12 & 13); native **FP4** on Blackwell.
|
| 63 |
|
| 64 |
-
👉 **Install the plugin:** **https://github.com/
|
| 65 |
|
| 66 |
# Klein-9B-Series
|
| 67 |
|
| 68 |
-
Pre-quantized **FLUX.2 Klein 9B** model series by [QuantFunc](https://github.com/
|
| 69 |
|
| 70 |
> ✨ **Both the distilled AND the non-distilled (base) model are supported**, and the series ships **three GPU tiers** so every card gets the best path it can run:
|
| 71 |
> **`50x`** (Blackwell, FP4) · **`40x`** (RTX 40 / Ada & Hopper, INT4 + FP8) · **`30x-below`** (RTX 30 and below, INT4 + INT8).
|
|
@@ -171,5 +171,5 @@ Join our community for support, updates, and discussions:
|
|
| 171 |
- 💬 Scan the QR code below to join our WeChat group:
|
| 172 |
|
| 173 |
<div align="center" id="wechat">
|
| 174 |
-
<img src="https://raw.githubusercontent.com/
|
| 175 |
</div>
|
|
|
|
| 45 |
<p align="center">
|
| 46 |
🤗 <a href="https://huggingface.co/QuantFunc">Hugging Face</a> |
|
| 47 |
🤖 <a href="https://www.modelscope.cn/profile/QuantFunc">ModelScope</a> |
|
| 48 |
+
💻 <a href="https://github.com/RealJonathanYip/ComfyUI-QuantFunc">GitHub</a> |
|
| 49 |
💬 <a href="#wechat">WeChat (微信)</a> |
|
| 50 |
🎮 <a href="https://discord.gg/jCp9TpFWcn">Discord</a>
|
| 51 |
</p>
|
|
|
|
| 54 |
|
| 55 |
The larger **9B** Klein model for maximum fidelity, shipped as **distilled (4-step)** + **base (28-step)** transformers across **three GPU tiers** (`50x` FP4 · `40x` INT4+FP8 · `30x-below` INT4+INT8).
|
| 56 |
|
| 57 |
+
**Powered by the [QuantFunc ComfyUI plugin](https://github.com/RealJonathanYip/ComfyUI-QuantFunc) — the fastest diffusion inference engine:**
|
| 58 |
|
| 59 |
- 🚀 **2x–11x speedup** over standard BF16/FP16 Python pipelines (pre-exported → even faster loading).
|
| 60 |
- ⚙️ **Native C++/CUDA** (`libquantfunc.so` / `quantfunc.dll`) with **zero Python model dependencies**.
|
| 61 |
- 🧩 **Dual engine** (SVDQ offline + Lighting runtime 4-bit), **zero-cost LoRA stacking**, reference-image editing & inpainting.
|
| 62 |
- 🟢 **Full GPU coverage** — RTX 20/30/40/50 · A100/H100/H200/B100/B200/GB300 · RTX 6000 Ada / PRO Blackwell (CUDA 12 & 13); native **FP4** on Blackwell.
|
| 63 |
|
| 64 |
+
👉 **Install the plugin:** **https://github.com/RealJonathanYip/ComfyUI-QuantFunc**
|
| 65 |
|
| 66 |
# Klein-9B-Series
|
| 67 |
|
| 68 |
+
Pre-quantized **FLUX.2 Klein 9B** model series by [QuantFunc](https://github.com/RealJonathanYip), Lighting backend. Text-to-image and reference-based image editing.
|
| 69 |
|
| 70 |
> ✨ **Both the distilled AND the non-distilled (base) model are supported**, and the series ships **three GPU tiers** so every card gets the best path it can run:
|
| 71 |
> **`50x`** (Blackwell, FP4) · **`40x`** (RTX 40 / Ada & Hopper, INT4 + FP8) · **`30x-below`** (RTX 30 and below, INT4 + INT8).
|
|
|
|
| 171 |
- 💬 Scan the QR code below to join our WeChat group:
|
| 172 |
|
| 173 |
<div align="center" id="wechat">
|
| 174 |
+
<img src="https://raw.githubusercontent.com/RealJonathanYip/ComfyUI-QuantFunc/main/assets/WeChat.jpg" alt="WeChat Group" width="300">
|
| 175 |
</div>
|