Update README.md
Browse files
README.md
CHANGED
|
@@ -16,22 +16,93 @@ Custom trained models for the soon to be released **Forbidden Vision** ComfyUI c
|
|
| 16 |
</div>
|
| 17 |
|
| 18 |
---
|
|
|
|
| 19 |
|
| 20 |
-
Custom-trained models for
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
|
| 22 |
-
🎯 What Makes These Different?
|
| 23 |
-
Trained on what you actually generate.
|
| 24 |
Unlike general-purpose face models trained only on real photographs, these models were specifically trained on:
|
| 25 |
|
| 26 |
-
Diffusion outputs from CivitAI (realistic and anime styles)
|
| 27 |
-
Danbooru anime dataset
|
| 28 |
-
Real photography for ground truth accuracy
|
| 29 |
-
NSFW content without artificial restrictions
|
| 30 |
|
| 31 |
This mixed training approach ensures reliable performance across:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
✓ Low-quality generations and artifacts
|
| 36 |
-
✓ SFW and NSFW content equally
|
| 37 |
-
✓ Edge cases that break traditional face detectors
|
|
|
|
| 16 |
</div>
|
| 17 |
|
| 18 |
---
|
| 19 |
+
# Forbidden Vision Face Models
|
| 20 |
|
| 21 |
+
Custom-trained models for face detection, landmark estimation, and segmentation across realistic, anime, and NSFW content.
|
| 22 |
+
|
| 23 |
+
Part of the [ComfyUI Forbidden Vision](https://github.com/luxdelux7/ComfyUI-Forbidden-Vision) node pack.
|
| 24 |
+
|
| 25 |
+
## Models
|
| 26 |
+
|
| 27 |
+
| Model | Purpose | Architecture |
|
| 28 |
+
|-------|---------|--------------|
|
| 29 |
+
| **Face Detection** | Locate faces in images | YOLOv11-small |
|
| 30 |
+
| **Landmark Detection** | Facial orientation & alignment | MobileNetV4-Conv-Small |
|
| 31 |
+
| **Segmentation** | Precise face masks | GhostNetV2-100 |
|
| 32 |
+
|
| 33 |
+
## What Makes These Different?
|
| 34 |
+
|
| 35 |
+
**Trained on what you actually generate.**
|
| 36 |
|
|
|
|
|
|
|
| 37 |
Unlike general-purpose face models trained only on real photographs, these models were specifically trained on:
|
| 38 |
|
| 39 |
+
- **Diffusion outputs** from CivitAI (realistic and anime styles)
|
| 40 |
+
- **Danbooru** anime dataset
|
| 41 |
+
- **Real photography** for ground truth accuracy
|
| 42 |
+
- **NSFW content** without artificial restrictions
|
| 43 |
|
| 44 |
This mixed training approach ensures reliable performance across:
|
| 45 |
+
- ✓ Both realistic and anime art styles
|
| 46 |
+
- ✓ Difficult angles, occlusions, and expressions
|
| 47 |
+
- ✓ Low-quality generations and artifacts
|
| 48 |
+
- ✓ SFW and NSFW content equally
|
| 49 |
+
- ✓ Edge cases that break traditional face detectors
|
| 50 |
+
|
| 51 |
+
## Model Details
|
| 52 |
+
|
| 53 |
+
### Face Detection (YOLOv11-Small)
|
| 54 |
+
|
| 55 |
+
Primary face detection and bounding box localization.
|
| 56 |
+
|
| 57 |
+
**Training Data:**
|
| 58 |
+
- 50k+ images from CivitAI diffusion outputs (SDXL, SD1.5, Pony)
|
| 59 |
+
- 30k+ Danbooru anime images
|
| 60 |
+
- 20k+ real photographs
|
| 61 |
+
|
| 62 |
+
**Features:**
|
| 63 |
+
- Handles extreme angles and rotations
|
| 64 |
+
- Detects partially occluded faces
|
| 65 |
+
- Works with artistic distortions and stylization
|
| 66 |
+
- Reliable on both photorealistic and anime styles
|
| 67 |
+
|
| 68 |
+
### Landmark Detection (MobileNetV4-Conv-Small)
|
| 69 |
+
|
| 70 |
+
Facial orientation and alignment estimation with 68-point landmark regression.
|
| 71 |
+
|
| 72 |
+
**Training Data:**
|
| 73 |
+
- 40k+ annotated faces from mixed sources
|
| 74 |
+
- Manual annotation for anime/artistic styles
|
| 75 |
+
- Augmented with rotation and perspective transforms
|
| 76 |
+
|
| 77 |
+
**Features:**
|
| 78 |
+
- Fast orientation detection for auto-rotation
|
| 79 |
+
- Works on both realistic and anime faces
|
| 80 |
+
- Handles partial occlusions and unusual expressions
|
| 81 |
+
|
| 82 |
+
### Segmentation (GhostNetV2-100)
|
| 83 |
+
|
| 84 |
+
Precise face mask generation including hair and complex boundaries.
|
| 85 |
+
|
| 86 |
+
**Training Data:**
|
| 87 |
+
- 35k+ faces with pixel-accurate mask annotations
|
| 88 |
+
- Mixed realistic, anime, and artistic styles
|
| 89 |
+
- Includes hair, accessories, and complex boundaries
|
| 90 |
+
|
| 91 |
+
**Features:**
|
| 92 |
+
- Pixel-accurate boundaries including hair
|
| 93 |
+
- Handles complex occlusions (hands, objects)
|
| 94 |
+
- Works with artistic styles and effects
|
| 95 |
+
- Smooth mask edges for seamless blending
|
| 96 |
+
|
| 97 |
+
## Usage
|
| 98 |
+
|
| 99 |
+
These models are automatically downloaded and used by the **Fixer** node in ComfyUI Forbidden Vision.
|
| 100 |
+
|
| 101 |
+
## License
|
| 102 |
+
|
| 103 |
+
GNU General Public License v3.0
|
| 104 |
+
|
| 105 |
+
## Contact
|
| 106 |
|
| 107 |
+
- GitHub Issues: [ComfyUI-Forbidden-Vision](https://github.com/luxdelux7/ComfyUI-Forbidden-Vision/issues)
|
| 108 |
+
- Support: [Ko-fi](https://ko-fi.com/luxdelux)
|
|
|
|
|
|
|
|
|