Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: stabilityai/stable-diffusion-xl-base-1.0
|
| 4 |
+
tags:
|
| 5 |
+
- ip-adapter
|
| 6 |
+
- faceid
|
| 7 |
+
- safetensors
|
| 8 |
+
- controlnet
|
| 9 |
+
- sdxl
|
| 10 |
+
library_name: diffusers
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# IP-Adapter FaceID Plus V2 SDXL (Flattened Safetensors)
|
| 14 |
+
|
| 15 |
+
This repository contains the converted and flattened `.safetensors` version of the **IP-Adapter FaceID Plus V2** for SDXL.
|
| 16 |
+
|
| 17 |
+
## 🚀 Why this version?
|
| 18 |
+
The original `.bin` weights provided by the authors use a nested dictionary structure (e.g., the `image_proj` key contains its own sub-dictionary). This often causes "KeyError" or "Expected Tensor but received dict" errors in various WebUIs and custom scripts.
|
| 19 |
+
|
| 20 |
+
**This version:**
|
| 21 |
+
- **Flattened Keys:** Converted nested dictionaries into a flat structure (e.g., `image_proj.0.weight`) compatible with [ComfyUI](https://github.com), [SD-WebUI-Forge](https://github.com), and [Easy Diffusion](https://easydiffusion.github.io).
|
| 22 |
+
- **Safe Format:** Converted from Pickle (`.bin`) to `.safetensors` for faster loading and improved security.
|
| 23 |
+
- **SDXL Native:** Specifically for use with SDXL 1.0 base models.
|
| 24 |
+
|
| 25 |
+
## 🛠 Usage
|
| 26 |
+
|
| 27 |
+
To use this model, you typically need three components:
|
| 28 |
+
1. **This Model:** Place in your `models/ControlNet` folder.
|
| 29 |
+
2. **FaceID LoRA:** You **must** use the matching [SDXL FaceID Plus v2 LoRA](https://huggingface.co) at a weight of ~0.5-0.7.
|
| 30 |
+
3. **InsightFace:** Your environment must have the `insightface` library installed.
|
| 31 |
+
|
| 32 |
+
### Recommended Settings:
|
| 33 |
+
- **Preprocessor:** `ip-adapter_face_id_plus`
|
| 34 |
+
- **ControlNet Strength:** 0.5 - 0.8 (Start at 0.6 if skin texture appears too harsh)
|
| 35 |
+
- **Ending Control Step:** 0.7 - 0.8 (Helps blend skin textures naturally)
|
| 36 |
+
|
| 37 |
+
## ⚖️ Credits
|
| 38 |
+
Original weights and research by the [IP-Adapter Team](https://huggingface.co). Please refer to their repository for license details and original implementation.
|