fasoo commited on
Commit
2bb4ff5
Β·
verified Β·
1 Parent(s): 20f66d6

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. README.md +56 -0
  2. adapter_model.safetensors +3 -0
  3. training_metadata.json +22 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: unknown
3
+ base_model: Qwen/Qwen-Image-2512
4
+ tags:
5
+ - text-to-image
6
+ - lora
7
+ - korean-typography
8
+ - qwen-image
9
+ - diffsynth-studio
10
+ pipeline_tag: text-to-image
11
+ ---
12
+
13
+ # Qwen-Image-2512 Korean Text Rendering LoRA
14
+
15
+ `Qwen/Qwen-Image-2512` DiTλ₯Ό λŒ€μƒμœΌλ‘œ ν•œ LoRA μ–΄λŒ‘ν„°λ‘œ, 이미지 μ•ˆμ— μ •ν™•ν•œ ν•œκΈ€ ν…μŠ€νŠΈλ₯Ό λ Œλ”λ§ν•˜λŠ” λŠ₯λ ₯을 κ°œμ„ ν•˜κΈ° μœ„ν•΄ ν•™μŠ΅ν–ˆμŠ΅λ‹ˆλ‹€. 베이슀 λͺ¨λΈ κ°€μ€‘μΉ˜λŠ” μ „λΆ€ κ³ μ •(frozen)ν•˜κ³  μ–΄λŒ‘ν„°λ§Œ ν•™μŠ΅ν–ˆμŠ΅λ‹ˆλ‹€ (adapter-only).
16
+
17
+ > ⚠️ **이 μ €μž₯μ†Œλ§ŒμœΌλ‘œλŠ” μ‚¬μš©ν•  수 μ—†μŠ΅λ‹ˆλ‹€.** `adapter_model.safetensors`λŠ” LoRA
18
+ > **델타(차이값)만** λ‹΄κ³  있고, 원본 κ°€μ€‘μΉ˜λ₯Ό ν¬ν•¨ν•˜μ§€ μ•ŠμŠ΅λ‹ˆλ‹€. μ‹€μ œ μΆ”λ‘ μ—λŠ” μ•„λž˜ 베이슀
19
+ > λͺ¨λΈμ„ λ³„λ„λ‘œ λ°›μ•„ ν•¨κ»˜ λ‘œλ“œν•΄μ•Ό ν•©λ‹ˆλ‹€:
20
+ > - [`Qwen/Qwen-Image-2512`](https://huggingface.co/Qwen/Qwen-Image-2512) β€” transformer(DiT)
21
+ > - [`Qwen/Qwen-Image`](https://huggingface.co/Qwen/Qwen-Image) β€” text_encoder, vae
22
+
23
+ ## ν•™μŠ΅ 데이터
24
+
25
+ atomic_text(μ›μž ν…μŠ€νŠΈ) + atomic_text_new(μ‹ κ·œ μ›μž ν…μŠ€νŠΈ) + infographic(μΈν¬κ·Έλž˜ν”½,
26
+ 1.5~4λ°° 반볡 μƒ˜ν”Œλ§) μ‘°ν•©, 총 45,482ν–‰(train) / 478ν–‰(validation)으둜 ν•™μŠ΅ν–ˆμŠ΅λ‹ˆλ‹€.
27
+
28
+ - `atomic_text`: 9,667 λ…ΈμΆœ
29
+ - `atomic_text_new`: 27,287 λ…ΈμΆœ
30
+ - `infographic`: 8,528 λ…ΈμΆœ (원본 2,246μž₯을 반볡 μƒ˜ν”Œλ§ν•΄ 비쀑 보정)
31
+
32
+ **곡개 λ°μ΄ν„°μ…‹κ³Όμ˜ 차이**: 같은 κ³„λ³΄μ˜ 데이터λ₯Ό 정리해
33
+ [`fasoo/korean-text-rendering-data`](https://huggingface.co/datasets/fasoo/korean-text-rendering-data)
34
+ 둜 별도 κ³΅κ°œν–ˆμ§€λ§Œ, 이 체크포인트의 μ‹€μ œ ν•™μŠ΅ λ ˆμ‹œν”Όμ™€ μ™„μ „νžˆ λ™μΌν•˜μ§€λŠ” μ•ŠμŠ΅λ‹ˆλ‹€.
35
+
36
+ ## μ‚¬μš© 방법 (DiffSynth-Studio)
37
+
38
+ ```python
39
+ from diffsynth import ModelManager, QwenImagePipeline
40
+
41
+ model_manager = ModelManager()
42
+ model_manager.load_models([
43
+ # Qwen/Qwen-Image-2512:transformer, Qwen/Qwen-Image:text_encoder, Qwen/Qwen-Image:vae
44
+ ])
45
+ pipe = QwenImagePipeline.from_model_manager(model_manager)
46
+ pipe.load_lora(pipe.dit, "adapter_model.safetensors")
47
+
48
+ image = pipe(prompt='KR-Atomic-Text, ... Place the Korean text "λ¬΄μž‘μœ„ ν‘œμ§‘" ...')
49
+ ```
50
+
51
+ μ •ν™•ν•œ λ‘œλ”© 인자(`model_id_with_origin_paths` λ“±)λŠ” 베이슀 λͺ¨λΈ ꡬ성에 따라 λ‹¬λΌμ§ˆ 수 μžˆμŠ΅λ‹ˆλ‹€.
52
+
53
+ ## λΌμ΄μ„ μŠ€ κ΄€λ ¨ 주의
54
+
55
+ - 베이슀 λͺ¨λΈ(`Qwen/Qwen-Image-2512`, `Qwen/Qwen-Image`)의 λΌμ΄μ„ μŠ€ 쑰건이 이 μ–΄λŒ‘ν„°μ—λ„
56
+ μ μš©λ©λ‹ˆλ‹€ β€” μ‚¬μš© μ „ ν™•μΈν•˜μ„Έμš”.
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66f8e6d26f05301d7e773ea4ba1f2905b137963edf649a23a0bebeebd87a1a3b
3
+ size 472047184
training_metadata.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "base_model": {
3
+ "transformer": "Qwen/Qwen-Image-2512",
4
+ "text_encoder": "Qwen/Qwen-Image",
5
+ "vae": "Qwen/Qwen-Image"
6
+ },
7
+ "lora": {
8
+ "rank": 32,
9
+ "target": "dit",
10
+ "base_weights": "frozen (adapter-only)"
11
+ },
12
+ "training_data": {
13
+ "hf_dataset": "https://huggingface.co/datasets/fasoo/korean-text-rendering-data",
14
+ "recipe_rows": 45482,
15
+ "validation_rows": 478,
16
+ "composition": {
17
+ "atomic_text": 9667,
18
+ "atomic_text_new": 27287,
19
+ "infographic (repeat x4)": 8528
20
+ }
21
+ }
22
+ }