monkeyKim commited on
Commit
906fbd5
·
verified ·
1 Parent(s): 55f5bce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +205 -3
README.md CHANGED
@@ -1,3 +1,205 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Our Azath — Sakuta & Yui Character LoRA
2
+
3
+ **Repository:** `toonsquare/Our_Azath`
4
+ **Characters:** Sakuta, Yui
5
+ **License:** Apache-2.0
6
+ **Model Type:** Character LoRA (Standard)
7
+
8
+ ---
9
+
10
+ ## Overview
11
+
12
+ This repository contains a **character-focused LoRA model** trained for the characters
13
+ **Sakuta** and **Yui** from the IP **_“Our Azath”_**.
14
+
15
+ The primary objective of this model is to preserve **clear character identity** while supporting stable generation across a wide range of compositions and visual variations.
16
+ Special attention was given to **Yui’s hairstyle**, which is a key visual identifier of the character.
17
+
18
+ ---
19
+
20
+ ## Characters & Trigger Words
21
+
22
+ ### Sakuta
23
+ - **Trigger word:** `az_bunta`
24
+
25
+ ---
26
+
27
+ ### Yui
28
+ Yui’s hairstyle is a defining feature of her character design.
29
+ To improve generation accuracy and control, **Yui was trained with separate hairstyle-specific trigger words**.
30
+
31
+ - **Base trigger:** `az_yui`
32
+ - **Ponytail hairstyle:** `az_yui, ponytail hair`
33
+ - **Hair bun hairstyle:** `az_yui, bun hair`
34
+
35
+ Using the appropriate trigger word helps maintain consistency between hairstyle and character identity.
36
+
37
+ ---
38
+
39
+ ## Dataset Construction & Training Pipeline
40
+
41
+ ![스크린샷 2026-01-29 16-44-25](https://cdn-uploads.huggingface.co/production/uploads/63589a3199234d3790317371/Ezqf8sGGDTZU9fDpBJeb0.png)
42
+ ![스크린샷 2026-01-29 16-44-40](https://cdn-uploads.huggingface.co/production/uploads/63589a3199234d3790317371/CPDj37miccYW46fVo7fdt.png)
43
+ ![스크린샷 2026-01-29 16-44-56](https://cdn-uploads.huggingface.co/production/uploads/63589a3199234d3790317371/n18TqnhsvK-coyP0s0cH-.png)
44
+
45
+ This model follows a structured, repeatable pipeline designed to maximize character consistency and visual quality.
46
+
47
+ ---
48
+
49
+ ### 1. Original Image Acquisition (from IP Team)
50
+
51
+ High-quality reference images were provided directly by the IP team for both characters.
52
+
53
+ For each character, images were collected across multiple compositions and viewpoints to ensure consistent identity representation.
54
+
55
+ ---
56
+
57
+ ### 2. Data Augmentation Using Flux
58
+
59
+ All reference images were processed using a **Flux-based generation pipeline** to produce large-scale augmented datasets.
60
+
61
+ - Generated images per character: ~**1,000**
62
+ - Purpose: increase pose, framing, and contextual diversity
63
+
64
+ ---
65
+
66
+ ### 3. Manual Curation
67
+
68
+ All generated images were manually reviewed.
69
+ The following were removed during the curation process:
70
+
71
+ - Duplicate or near-duplicate images
72
+ - Incorrect generations (identity drift, malformed anatomy, etc.)
73
+ - Low-quality outputs (noise, poor composition, low detail)
74
+
75
+ After curation, approximately **500–600 images** per dataset were selected for training.
76
+
77
+ ---
78
+
79
+ ### 4. Yui Hairstyle-Specific Dataset Separation
80
+
81
+ Unlike Sakuta, **Yui required additional dataset separation due to hairstyle variation**.
82
+
83
+ To achieve this:
84
+
85
+ - **Ponytail Yui**
86
+ - Separate reference images were provided by the IP team
87
+ - Images were augmented via Flux
88
+ - Manual curation applied
89
+
90
+ - **Hair bun Yui**
91
+ - Separate reference images were provided by the IP team
92
+ - Images were augmented via Flux
93
+ - Manual curation applied
94
+
95
+ Each hairstyle-specific dataset was associated with its own trigger word (`yui_ponytail`, `yui_bun`) to allow precise control during generation.
96
+
97
+ ---
98
+
99
+ ### 5. LoRA Training
100
+
101
+ The curated datasets were used to train a **Standard LoRA model**.
102
+
103
+ The training process focused on:
104
+ - Preserving character identity
105
+ - Maintaining hairstyle consistency for Yui
106
+ - Allowing reasonable variation in pose, framing, and context
107
+
108
+ ---
109
+
110
+ ## LoRA Training Configuration (Reference)
111
+
112
+ > ⚠️ The following configuration reflects the settings used during training as closely as possible.
113
+ > Values are provided **for reference only**.
114
+
115
+ <details>
116
+ <summary>Click to expand training configuration</summary>
117
+
118
+ ```json
119
+ {
120
+ "LoRA_type": "Standard",
121
+ "epoch": 50,
122
+ "train_batch_size": 3,
123
+ "learning_rate": 3e-05,
124
+ "unet_lr": 3e-05,
125
+ "text_encoder_lr": 3e-05,
126
+ "optimizer": "AdamW",
127
+ "mixed_precision": "fp16",
128
+ "network_dim": 32,
129
+ "network_alpha": 32,
130
+ "clip_skip": 1,
131
+ "max_resolution": "1024,1024",
132
+ "min_snr_gamma": 5,
133
+ "gradient_checkpointing": true,
134
+ "cache_latents": true,
135
+ "enable_bucket": true,
136
+ "save_every_n_epochs": 1,
137
+ "sdxl": true,
138
+ "save_precision": "fp16"
139
+ }
140
+ ````
141
+
142
+ </details>
143
+
144
+ ---
145
+
146
+ ## Usage Guide
147
+
148
+ ### Basic Prompt
149
+
150
+ ```text
151
+ sakuta, [description]
152
+ ```
153
+
154
+ ```text
155
+ yui, [description]
156
+ ```
157
+
158
+ ### Hairstyle-Specific Prompts (Yui)
159
+
160
+ ```text
161
+ yui_ponytail, [description]
162
+ ```
163
+
164
+ ```text
165
+ yui_bun, [description]
166
+ ```
167
+
168
+ ### Tips
169
+
170
+ * Place the character trigger early in the prompt for stronger identity locking.
171
+ * Always use the hairstyle-specific trigger for Yui to avoid hairstyle mixing.
172
+ * Explicitly specifying composition (e.g., close-up, bust shot, full body) improves control.
173
+ * Extreme stylistic deviations may weaken character consistency.
174
+
175
+ ---
176
+
177
+ ## Intended Use & Limitations
178
+
179
+ * This model is designed for **character-consistent image generation** of Sakuta and Yui.
180
+ * Hairstyle accuracy for Yui depends on using the correct trigger word.
181
+ * Mixing conflicting hairstyle prompts may reduce consistency.
182
+ * Radical style changes or photorealistic prompts may degrade character identity.
183
+
184
+ ---
185
+
186
+ ## License
187
+
188
+ This model is released under the **Apache License 2.0**.
189
+
190
+ You are free to:
191
+
192
+ * Use the model commercially
193
+ * Modify and redistribute it
194
+
195
+ Please ensure compliance with the Apache-2.0 license terms and any applicable IP usage policies.
196
+
197
+ ---
198
+
199
+ ## Credits
200
+
201
+ * Characters: **Sakuta, Yui** (*Our Azath*)
202
+ * Training & curation: **Toonsquare**
203
+ * Data source: IP Team
204
+
205
+ ```