luxdelux7 commited on
Commit
a184c8e
·
verified ·
1 Parent(s): dfe1c98

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -31
README.md CHANGED
@@ -11,12 +11,10 @@ tags:
11
  - pytorch
12
  - image-segmentation
13
  ---
14
-
15
  <div align="center">
16
  <img src="images/header.webp" width="800px" />
17
 
18
- Custom-trained models for face detection and segmentation across realistic, anime, and NSFW content.
19
-
20
  Made for the **Forbidden Vision** ComfyUI custom nodes
21
 
22
  <a href="https://github.com/luxdelux7/ComfyUI-Forbidden-Vision">GitHub Repository</a>
@@ -29,20 +27,20 @@ Made for the **Forbidden Vision** ComfyUI custom nodes
29
 
30
  ## 🎯 Why These Models Exist
31
 
32
- Traditional face models fail where it matters most for AI art workflows:
33
 
34
  | **Problem** | **Why It Matters** |
35
  |-------------|-------------------|
36
- | 🎨 **Domain-locked** | Existing models excel at *either* anime *or* realistic—never both |
37
- | 🔞 **NSFW blindness** | Most models trained only on SFW data break on adult content |
38
- | 👁️‍🗨️ **Detail blindness** | Most models miss anime eyebrows, real eyelashes etc. |
39
- | 🎲 **Generation artifacts** | Standard datasets don't include diffusion model quirks and failures |
40
 
41
  **These models solve all 4.**
42
 
43
  <div align="center">
44
  <img src="./images/masks.webp" alt="Mask Example" style="border-radius: 6px; box-shadow: 0 0 12px rgba(0,0,0,0.1);">
45
- <p><em>The segmentation model predicts face masks, stylistic eyebrows, eyelashes etc.</em></p>
46
  </div>
47
 
48
  ---
@@ -51,7 +49,7 @@ Traditional face models fail where it matters most for AI art workflows:
51
 
52
  ### The Dataset Difference
53
 
54
- Built from **14,000+ manually annotated images** across the domains that actually matter for AI generation:
55
 
56
  <table>
57
  <tr>
@@ -61,7 +59,7 @@ Built from **14,000+ manually annotated images** across the domains that actuall
61
  - SDXL, SD1.5, Pony, Illustrious outputs
62
  - Curated Danbooru (anime styles)
63
  - Real photography
64
- - Full NSFW inclusion (no filtering)
65
 
66
  </td>
67
  <td width="50%">
@@ -71,14 +69,13 @@ Built from **14,000+ manually annotated images** across the domains that actuall
71
  - ✓ Failed/broken generations
72
  - ✓ Low-quality artifacts
73
  - ✓ Unusual expressions & poses
74
- - ✓ Everything other models ignore
75
 
76
  </td>
77
  </tr>
78
  </table>
79
 
80
  ### What This Means For You
81
-
82
  ```
83
  Traditional models: Trained on clean celebrity faces
84
 
@@ -91,46 +88,55 @@ These models: Trained on what you actually generate
91
 
92
  **One model family. Every domain. Zero compromises.**
93
 
 
 
94
  ## Model Details
95
 
96
  ### Face Detection (YOLOv11-Small)
97
 
98
- **Purpose:** Primary face detection with high recall
99
 
100
  **Training Approach:**
101
- - After every training run, I ran the model on a new mixed dataset, hardmining failures and improving the dataset until an acceptable performance was reached
102
- - Trained at 640px resolution (inference should use same resolution)
103
 
104
  **Why YOLOv11-Small instead of nano?**
105
- More reliable detection across mixed realistic/anime domains with acceptable speed tradeoff.
106
 
107
  ---
108
 
109
-
110
- ### Segmentation (EfficientNet-v2)
111
 
112
  **Purpose:** Precise face mask generation
113
 
114
  **Training Approach:**
115
- - Dataset prepared using the Forbidden Vision YOLO model at 512px resolution
116
- - Iterative hardmine training in multiple phases:
117
- - Train on the initial 700 samples
118
- - Evaluate on remaining images to find failure cases
119
- - Correct failed masks and add them to the dataset
120
- - Retrain with the expanded dataset
121
- - Repeat until failure cases drop to near-zero
122
- (final dataset: 4k+ images)
123
 
124
  **Features:**
125
- - Detects and includes facial features other models ignore, like protruding anime eybrows, realistic eyelashes sticking out of the face etc.
126
- - Glasses and similar are treated as part of the face, even if sticking outside the face shape
127
- - NSFW friendly across both anime, realistic and 3d domains
128
 
129
  ---
130
 
131
  ## Usage
132
 
133
- These models are automatically downloaded and used by the **Fixer** node in ComfyUI Forbidden Vision.
 
 
 
 
 
 
 
 
134
 
135
  ## License
136
 
 
11
  - pytorch
12
  - image-segmentation
13
  ---
 
14
  <div align="center">
15
  <img src="images/header.webp" width="800px" />
16
 
17
+ Custom-trained models for face detection and segmentation across realistic, anime, and stylized content.
 
18
  Made for the **Forbidden Vision** ComfyUI custom nodes
19
 
20
  <a href="https://github.com/luxdelux7/ComfyUI-Forbidden-Vision">GitHub Repository</a>
 
27
 
28
  ## 🎯 Why These Models Exist
29
 
30
+ Standard face detection models are optimized for narrow use cases and struggle in generative AI workflows. These models address four specific failure modes:
31
 
32
  | **Problem** | **Why It Matters** |
33
  |-------------|-------------------|
34
+ | 🎨 **Domain-locked** | Existing models excel at *either* anime *or* realistic never both |
35
+ | 🖼️ **Distribution mismatch** | Models trained on clean photography break on AI-generated imagery |
36
+ | 👁️‍🗨️ **Detail blindness** | Most models miss stylized features like anime eyebrows, realistic eyelashes, etc. |
37
+ | 🎲 **Generation artifacts** | Standard datasets don't include diffusion model quirks and failure modes |
38
 
39
  **These models solve all 4.**
40
 
41
  <div align="center">
42
  <img src="./images/masks.webp" alt="Mask Example" style="border-radius: 6px; box-shadow: 0 0 12px rgba(0,0,0,0.1);">
43
+ <p><em>The segmentation model predicts face masks including stylistic features like eyebrows and eyelashes.</em></p>
44
  </div>
45
 
46
  ---
 
49
 
50
  ### The Dataset Difference
51
 
52
+ Built from **14,000+ manually annotated images** spanning the full range of domains encountered in real generative AI workflows:
53
 
54
  <table>
55
  <tr>
 
59
  - SDXL, SD1.5, Pony, Illustrious outputs
60
  - Curated Danbooru (anime styles)
61
  - Real photography
62
+ - Unfiltered image distributions across all content ratings
63
 
64
  </td>
65
  <td width="50%">
 
69
  - ✓ Failed/broken generations
70
  - ✓ Low-quality artifacts
71
  - ✓ Unusual expressions & poses
72
+ - ✓ Edge cases other models ignore
73
 
74
  </td>
75
  </tr>
76
  </table>
77
 
78
  ### What This Means For You
 
79
  ```
80
  Traditional models: Trained on clean celebrity faces
81
 
 
88
 
89
  **One model family. Every domain. Zero compromises.**
90
 
91
+ ---
92
+
93
  ## Model Details
94
 
95
  ### Face Detection (YOLOv11-Small)
96
 
97
+ **Purpose:** Primary face detection with high recall across mixed domains
98
 
99
  **Training Approach:**
100
+ - Iterative hard-mining pipeline: after each training run, the model was evaluated on a new mixed dataset; failures were collected, corrected, and folded back into training until acceptable performance was reached
101
+ - Trained at 640px resolution inference should use the same resolution
102
 
103
  **Why YOLOv11-Small instead of nano?**
104
+ More reliable detection across mixed realistic/anime domains with an acceptable speed tradeoff.
105
 
106
  ---
107
 
108
+ ### Segmentation (EfficientNetV2-S)
 
109
 
110
  **Purpose:** Precise face mask generation
111
 
112
  **Training Approach:**
113
+ - Initial dataset prepared using the Forbidden Vision YOLO model at 512px resolution
114
+ - Multi-phase iterative hard-mining:
115
+ 1. Train on initial 700 samples
116
+ 2. Evaluate on held-out images to surface failure cases
117
+ 3. Correct failed masks and expand the dataset
118
+ 4. Retrain on expanded dataset
119
+ 5. Repeat until failure rate approaches zero
120
+ - Final dataset: 4,000+ images
121
 
122
  **Features:**
123
+ - Captures stylized facial features often missed by standard models: protruding anime eyebrows, realistic eyelashes extending beyond the face boundary, etc.
124
+ - Treats accessories like glasses as part of the face region, even when they extend outside the face shape
125
+ - Robust across anime, realistic, and 3D rendering styles — including content ratings that cause other models to fail
126
 
127
  ---
128
 
129
  ## Usage
130
 
131
+ These models are automatically downloaded and used by the **Fixer** node in ComfyUI Forbidden Vision. No manual setup required.
132
+
133
+ ---
134
+
135
+ ## Intended Use
136
+
137
+ These models are designed for use in generative AI post-processing pipelines — specifically face detection and masking within ComfyUI workflows. They are not intended for surveillance, biometric identification, or any application involving real individuals without consent.
138
+
139
+ ---
140
 
141
  ## License
142