Image-to-Image
Diffusers
flux
flux2
klein
pose
openpose
controlnet
refcontrol
img2img
image
editing
lora
Instructions to use thedeoxen/refcontrol-FLUX.2-klein-9B-reference-pose-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use thedeoxen/refcontrol-FLUX.2-klein-9B-reference-pose-lora with Diffusers:
pip install -U diffusers transformers accelerate
from diffusers import ControlNetModel, StableDiffusionControlNetPipeline controlnet = ControlNetModel.from_pretrained("thedeoxen/refcontrol-FLUX.2-klein-9B-reference-pose-lora") pipe = StableDiffusionControlNetPipeline.from_pretrained( "black-forest-labs/FLUX.2-klein-base-9B", controlnet=controlnet ) - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Update README.md
Browse files
README.md
CHANGED
|
@@ -82,9 +82,11 @@ Pose extraction in the included workflow uses **DWPose** (via [comfyui_controlne
|
|
| 82 |
https://github.com/Fannovel16/comfyui_controlnet_aux
|
| 83 |
|
| 84 |
### Base model
|
| 85 |
-
|
| 86 |
The undistilled Base variant is intended for LoRA training and custom pipelines (~50 inference steps, `guidance_scale` ~4.0).
|
| 87 |
|
|
|
|
|
|
|
| 88 |
### ✅ Example prompt
|
| 89 |
|
| 90 |
```
|
|
@@ -117,6 +119,6 @@ apply pose from image 1 with reference from image 2
|
|
| 117 |
---
|
| 118 |
|
| 119 |
## 📦 Files
|
| 120 |
-
- **Weights:** [`
|
| 121 |
-
- **ComfyUI workflow:** [`
|
| 122 |
- **Repo:** [thedeoxen/refcontrol-FLUX.2-klein-9B-reference-pose-lora](https://huggingface.co/thedeoxen/refcontrol-FLUX.2-klein-9B-reference-pose-lora)
|
|
|
|
| 82 |
https://github.com/Fannovel16/comfyui_controlnet_aux
|
| 83 |
|
| 84 |
### Base model
|
| 85 |
+
Trained on and recommended with [`black-forest-labs/FLUX.2-klein-base-9B`](https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9B).
|
| 86 |
The undistilled Base variant is intended for LoRA training and custom pipelines (~50 inference steps, `guidance_scale` ~4.0).
|
| 87 |
|
| 88 |
+
The LoRA also works with the **4-step distilled** [`black-forest-labs/FLUX.2-klein-9B`](https://huggingface.co/black-forest-labs/FLUX.2-klein-9B) for faster inference (~4 steps, `guidance_scale` ~1.0), but **quality may be slightly lower** — especially for identity and pose fidelity — compared to the Base model.
|
| 89 |
+
|
| 90 |
### ✅ Example prompt
|
| 91 |
|
| 92 |
```
|
|
|
|
| 119 |
---
|
| 120 |
|
| 121 |
## 📦 Files
|
| 122 |
+
- **Weights:** [`refcontrol_v2_poses.safetensors`](https://huggingface.co/thedeoxen/refcontrol-FLUX.2-klein-9B-reference-pose-lora/blob/main/refcontrol_v2_poses.safetensors)
|
| 123 |
+
- **ComfyUI workflow:** [`refcontrol_pose_flux_klein_9b.json`](https://huggingface.co/thedeoxen/refcontrol-FLUX.2-klein-9B-reference-pose-lora/blob/main/refcontrol_pose_flux_klein_9b.json)
|
| 124 |
- **Repo:** [thedeoxen/refcontrol-FLUX.2-klein-9B-reference-pose-lora](https://huggingface.co/thedeoxen/refcontrol-FLUX.2-klein-9B-reference-pose-lora)
|