SeaWolf-AI commited on
Commit
6c73c4a
ยท
verified ยท
1 Parent(s): 0f6879b

Rewrite card: Chimera positioning + honest scope; remove proprietary method details and method tags

Browse files
Files changed (1) hide show
  1. README.md +86 -11
README.md CHANGED
@@ -1,22 +1,97 @@
1
  ---
2
  license: gemma
3
  base_model: FINAL-Bench/Darwin-V9-Chimera-4B-SFT
4
- tags: [rft, self-distillation, star, chimera, korean]
 
 
 
 
 
 
5
  pipeline_tag: text-generation
 
 
 
 
6
  ---
7
 
8
- # Darwin-V9-Chimera-4B-RFT
9
 
10
- RFT self-distillation of Darwin-V9-Chimera-4B-SFT via **learnable-edge** filtering + **STaR** accumulation (2 rounds).
11
 
12
- ## Method
13
- Self-rollout (n=8, temp 0.8) on KMMLU-domain train problems; keep correct CoT **only from learnable-edge questions** (1-6 of 8 correct), excluding already-stable (8/8) and unknown (0/8). Round 2 (STaR) rolls out from the improved model on fresh problems and accumulates edge data. LoRA r16, LR 2e-5, merged.
14
 
15
- ## Result (KMMLU 6-subject, 240 held-out, greedy)
16
- | Model | KMMLU | vs base |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  |---|---|---|
18
- | Baseline (V9-SFT) | 42.9% | - |
19
- | RFT round 1 (edge 909) | 47.5% | +4.6 |
20
- | **This (STaR round 2, edge 1679)** | **48.3%** | **+5.4** |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
- Ablation: training on ALL correct rollouts was neutral/harmful; **edge-filtering (1-6/8) was the decisive lever** โ€” empirically confirms arXiv 2607.00152. Small held-out (240); confirm on a larger set.
 
1
  ---
2
  license: gemma
3
  base_model: FINAL-Bench/Darwin-V9-Chimera-4B-SFT
4
+ tags:
5
+ - chimera
6
+ - darwin
7
+ - vidraft
8
+ - korean
9
+ - kmmlu
10
+ - reasoning
11
  pipeline_tag: text-generation
12
+ language:
13
+ - ko
14
+ - en
15
+ library_name: transformers
16
  ---
17
 
18
+ # Darwin-4B-Chimera
19
 
20
+ **๋น„๋“œ๋ž˜ํ”„ํŠธ(VIDRAFT) Chimera ๊ธฐ์ˆ ๋กœ ๋งŒ๋“  4B ํ•œ๊ตญ์–ด ์ถ”๋ก  ๋ชจ๋ธ.**
21
 
22
+ ์ž‘์€ ๋ชจ๋ธ์ด ์ž๊ธฐ ํฌ๊ธฐ๋ฅผ ๋„˜์–ด์„œ๊ฒŒ ๋งŒ๋“œ๋Š” ๊ฒƒ์ด ๋ชฉํ‘œ์ž…๋‹ˆ๋‹ค. ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ๋Š˜๋ฆฌ๋Š” ๋Œ€์‹ , ์„œ๋กœ ๋‹ค๋ฅธ ๊ฐ•์ ์„ **ํ•ฉ์ฒด**ํ•˜๊ณ  ์Šค์Šค๋กœ **์ •์ œ**ํ•˜๊ฒŒ ํ–ˆ์Šต๋‹ˆ๋‹ค.
 
23
 
24
+ ---
25
+
26
+ ## Chimera๋ž€
27
+
28
+ **Chimera**๋Š” ์„œ๋กœ ๋‹ค๋ฅธ ๊ณ„์—ดยท๊ฐ•์ ์„ ๊ฐ€์ง„ ๋ชจ๋ธ์˜ ๊ตฌ์„ฑ์š”์†Œ๋ฅผ **ํ•˜๋‚˜์˜ ๋ชจ๋ธ๋กœ ํ•ฉ์ฒด**์‹œํ‚ค๋Š” ๋น„๋“œ๋ž˜ํ”„ํŠธ์˜ ๋ชจ๋ธ ์ง„ํ™” ๊ธฐ์ˆ ์ž…๋‹ˆ๋‹ค.
29
+
30
+ - ๊ฐ ๋ถ€๋ชจ์˜ ์ง€์‹์„ **์†์ƒ ์—†์ด ๋ณด์กด**ํ•œ ์ฑ„ ํ•ฉ์นฉ๋‹ˆ๋‹ค.
31
+ - ๋‹จ์ผ ๋ถ€๋ชจ๋กœ๋Š” ๋„๋‹ฌํ•  ์ˆ˜ ์—†๋Š” ์กฐํ•ฉ์„ ๋งŒ๋“ญ๋‹ˆ๋‹ค โ€” ๊ฒฐ๊ณผ๋ฌผ์€ ์–ด๋А ํ•œ ๋ถ€๋ชจ๋กœ๋„ ํ™˜์›๋˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
32
+ - **์ถ”๊ฐ€ ์‚ฌ์ „ํ•™์Šต ์—†์ด** ์„ธ๋Œ€๋ฅผ ์ด์–ด๊ฐ‘๋‹ˆ๋‹ค.
33
+
34
+ ์ด ๋ชจ๋ธ์€ Chimera 4B ๊ณ„๋ณด์˜ ๊ฒ€์ฆ๋œ ๊ฐœ์ฒด์— ๋น„๋“œ๋ž˜ํ”„ํŠธ ์ž์ฒด **RFT(๊ฐ•ํ™” ๋ฏธ์„ธ์กฐ์ •)** ํŒŒ์ดํ”„๋ผ์ธ์„ ์ ์šฉํ•ด, ํ•œ๊ตญ์–ด ์ง€์‹ ์ถ”๋ก ์„ ๋Œ์–ด์˜ฌ๋ฆฐ ๊ฒฐ๊ณผ๋ฌผ์ž…๋‹ˆ๋‹ค.
35
+
36
+ ---
37
+
38
+ ## ์„ฑ๋Šฅ
39
+
40
+ **KMMLU 6๊ณผ๋ชฉ ยท 240๋ฌธํ•ญ held-out ยท greedy ๋””์ฝ”๋”ฉ**
41
+
42
+ | ๋ชจ๋ธ | KMMLU | vs ๊ธฐ์ค€์„  |
43
  |---|---|---|
44
+ | ๊ธฐ์ค€์„  (Chimera 4B) | 42.9% | โ€” |
45
+ | **Darwin-4B-Chimera (๋ณธ ๋ชจ๋ธ)** | **48.3%** | **+5.4%p** |
46
+
47
+ ๊ฐ™์€ ๊ฐ€์ค‘์น˜ยท๊ฐ™์€ ํ•˜๋„ค์Šค์—์„œ ์ •์ œ ๋‹จ๊ณ„๋งŒ ๋‹ฌ๋ฆฌํ•ด ์ธก์ •ํ–ˆ์Šต๋‹ˆ๋‹ค. 6๊ณผ๋ชฉ ์ค‘ ๋‹ค์ˆ˜์—์„œ ์ƒ์Šนํ–ˆ์Šต๋‹ˆ๋‹ค.
48
+
49
+ ---
50
+
51
+ ## ์ •์งํ•œ ๋ฒ”์œ„ (Honest scope)
52
+
53
+ ์ˆ˜์น˜๋ฅผ ๋ถ€ํ’€๋ฆฌ์ง€ ์•Š๊ธฐ ์œ„ํ•ด ํ•œ๊ณ„๋ฅผ ๋จผ์ € ๋ฐํž™๋‹ˆ๋‹ค.
54
+
55
+ - **ํ‰๊ฐ€ ์…‹์ด ์ž‘์Šต๋‹ˆ๋‹ค.** 240๋ฌธํ•ญ ๊ธฐ์ค€ ํ‘œ์ค€์˜ค์ฐจ ์•ฝ ยฑ1.4%p์ž…๋‹ˆ๋‹ค. ๋” ํฐ ์…‹์—์„œ์˜ ์žฌํ™•์ธ์ด ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.
56
+ - **KMMLU 6๊ณผ๋ชฉ ํ•œ์ •** ์ˆ˜์น˜์ด๋ฉฐ, ์ „ ๋„๋ฉ”์ธ ์ผ๋ฐ˜ํ™”๋ฅผ ๋œปํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
57
+ - **4B ๊ทœ๋ชจ** ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. ํ”Œ๋ž˜๊ทธ์‹ญ(Darwin-398B ๋“ฑ)๊ณผ ์ง์ ‘ ๋น„๊ต ๋Œ€์ƒ์ด ์•„๋‹™๋‹ˆ๋‹ค.
58
+ - **greedy ๋””์ฝ”๋”ฉ** ๊ธฐ์ค€์ž…๋‹ˆ๋‹ค. ๋””์ฝ”๋”ฉยทํ”„๋กฌํ”„ํŠธ๊ฐ€ ๋ฐ”๋€Œ๋ฉด ๊ฒฐ๊ณผ๊ฐ€ ๋‹ฌ๋ผ์งˆ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
59
+
60
+ ---
61
+
62
+ ## ์‚ฌ์šฉ
63
+
64
+ ```python
65
+ from transformers import AutoModelForCausalLM, AutoTokenizer
66
+
67
+ mid = "FINAL-Bench/Darwin-4B-Chimera"
68
+ tok = AutoTokenizer.from_pretrained(mid)
69
+ model = AutoModelForCausalLM.from_pretrained(mid, torch_dtype="auto", device_map="auto")
70
+
71
+ msgs = [{"role": "user", "content": "ํ•œ๊ตญ์˜ ์‚ผ๊ถŒ๋ถ„๋ฆฝ์„ ๊ฐ„๋‹จํžˆ ์„ค๋ช…ํ•ด์ค˜."}]
72
+ ids = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt").to(model.device)
73
+ out = model.generate(ids, max_new_tokens=512, do_sample=False)
74
+ print(tok.decode(out[0][ids.shape[-1]:], skip_special_tokens=True))
75
+ ```
76
+
77
+ ---
78
+
79
+ ## ๋ฐฉ๋ฒ•๋ก  ๊ณต๊ฐœ ๋ฒ”์œ„
80
+
81
+ Chimera ํ•ฉ์ฒด ๊ตฌ์„ฑ๊ณผ RFT ์ •์ œ์˜ ๋‚ด๋ถ€ ์„ค๊ณ„(๋ฐ์ดํ„ฐ ์„ ๋ณ„ ๊ธฐ์ค€ยทํ•™์Šต ์„ค์ •ยท๋ผ์šฐํŒ… ๋ฐฉ์‹ ๋“ฑ)๋Š” **๋น„๋“œ๋ž˜ํ”„ํŠธ ์˜์—…๊ธฐ๋ฐ€**์ž…๋‹ˆ๋‹ค.
82
+
83
+ > **๊ฒฐ๊ณผ๋Š” ๊ณต๊ฐœํ•˜๊ณ , ๋ ˆ์‹œํ”ผ๋Š” ๊ณต๊ฐœํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.**
84
+
85
+ ๋ชจ๋ธ ๊ฐ€์ค‘์น˜์™€ ์ธก์ • ์ˆ˜์น˜๋Š” ๊ณต๊ฐœ๋˜์–ด ์žˆ์œผ๋ฏ€๋กœ, ๋ˆ„๊ตฌ๋‚˜ ์œ„ ๊ฒฐ๊ณผ๋ฅผ ์ง์ ‘ ์žฌํ˜„ยท๊ฒ€์ฆํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
86
+
87
+ ---
88
+
89
+ ## ๊ด€๋ จ ๋งํฌ
90
+
91
+ - **Darwin ํŒจ๋ฐ€๋ฆฌ** โ€” https://huggingface.co/collections/FINAL-Bench/darwin-family
92
+ - **์ง„ํ™”์  ๋ณ‘ํ•ฉ ๋ฐฉ๋ฒ•๋ก  ๋…ผ๋ฌธ** โ€” arXiv [2605.14386](https://arxiv.org/abs/2605.14386)
93
+ - **๋น„๋“œ๋ž˜ํ”„ํŠธ** โ€” https://vidraft.net
94
+
95
+ ## ๋ผ์ด์„ ์Šค
96
 
97
+ `gemma` โ€” ํ•ฉ์ฒด ๊ณ„๋ณด์— Gemma ํŒŒ์ƒ ๊ตฌ์„ฑ์š”์†Œ๊ฐ€ ํฌํ•จ๋˜์–ด Gemma ๋ผ์ด์„ ์Šค๋ฅผ ๋”ฐ๋ฆ…๋‹ˆ๋‹ค. ์‚ฌ์šฉ ์ „ [Gemma Terms of Use](https://ai.google.dev/gemma/terms)๋ฅผ ํ™•์ธํ•˜์‹ญ์‹œ์˜ค.