a12s12 commited on
Commit
02273c8
ยท
verified ยท
1 Parent(s): b779bab

add level-drop (25% uniform-over-levels)

Browse files
Files changed (1) hide show
  1. code/PHASE2_NOTES.md +11 -0
code/PHASE2_NOTES.md CHANGED
@@ -44,3 +44,14 @@ Phase-2๋Š” ์ด ์ง€์ ๋ถ€ํ„ฐ **์›๋ž˜ warmup ์Šค์ผ€์ค„์„ ๊ทธ๋Œ€๋กœ ์ด์–ด๊ฐ**:
44
  2. Phase-2 ์ด์–ด๊ฐ€๊ธฐ: ์ตœ์‹  `phase2_stepN/`(HF)์„ ๋กœ์ปฌ์— ๋‘๊ณ  `configs/tokenizer_l_spatial_phase2.yaml`์˜
45
  `init_from`์„ ๊ทธ ๊ฒฝ๋กœ๋กœ, `PHASE2_RESUME_STEP=N`์œผ๋กœ `train_spatial_l_phase2.sh` ์‹คํ–‰.
46
  3. Phase-2 ์ฒ˜์Œ๋ถ€ํ„ฐ: `init_from=step380000` + `PHASE2_RESUME_STEP=380000` (ํ˜„์žฌ ์„ค์ •).
 
 
 
 
 
 
 
 
 
 
 
 
44
  2. Phase-2 ์ด์–ด๊ฐ€๊ธฐ: ์ตœ์‹  `phase2_stepN/`(HF)์„ ๋กœ์ปฌ์— ๋‘๊ณ  `configs/tokenizer_l_spatial_phase2.yaml`์˜
45
  `init_from`์„ ๊ทธ ๊ฒฝ๋กœ๋กœ, `PHASE2_RESUME_STEP=N`์œผ๋กœ `train_spatial_l_phase2.sh` ์‹คํ–‰.
46
  3. Phase-2 ์ฒ˜์Œ๋ถ€ํ„ฐ: `init_from=step380000` + `PHASE2_RESUME_STEP=380000` (ํ˜„์žฌ ์„ค์ •).
47
+
48
+ ## Level drop ์ถ”๊ฐ€ (2026-07-16, step390000๋ถ€ํ„ฐ)
49
+ ์šฐ๋ฆฌ multi-res ๋ฐฉ์‹์˜ ํ•ต์‹ฌ์ธ **level drop(nested)** ๋ฅผ Phase-2์— ์ถ”๊ฐ€ (step390000์—์„œ resume).
50
+ - **๋ฐฉ์‹**: whole-level, coarse-first. keep_levels ~ uniform(1,4) โ†’ {1x1},{1x1,2x2},{1x1,2x2,4x4},{all} ๊ฐ **25%**.
51
+ โ†’ ๋ ˆ๋ฒจ๋ณ„ ์œ ์ง€ํ™•๋ฅ  1x1=100%, 2x2=75%, 4x4=50%, 8x8=25%.
52
+ - **์™œ 25%(๋ ˆ๋ฒจ๊ท ๋“ฑ)**: ํ† ํฐ๋น„์œจ(uniform-over-token) ๋ฐฉ์‹์€ 8x8์ด 64/85๋ผ coarse-only๊ฐ€ ๊ฑฐ์˜ ํ•™์Šต ์•ˆ ๋จ.
53
+ ๋ ˆ๋ฒจ๊ท ๋“ฑ์€ ๋ชจ๋“  granularity๋ฅผ ๊ณ ๋ฅด๊ฒŒ ํ•™์Šต โ†’ ๊ฐ ๋ ˆ๋ฒจ์ด ๋…๋ฆฝ์ ์œผ๋กœ ์“ธ๋ชจ์žˆ์Œ (multi-res reasoning ๋ชฉ์ ).
54
+ - **๋“œ๋กญ ์ˆœ์„œ**: 8x8(finest, DiT ์ด๋ฏธ์ง€ํ† ํฐ๊ณผ 1:1)๋ถ€ํ„ฐ ๋“œ๋กญ, 1x1(global)์€ ํ•ญ์ƒ ์œ ์ง€.
55
+ ์ „๋ถ€ ๋“œ๋กญ(uncond)์€ CFG(uncond_drop_prob)๊ฐ€ ๋”ฐ๋กœ ๋‹ด๋‹น.
56
+ - **๊ตฌํ˜„**: `LevelNestedSampler` (spatial_diffuse_slot.py), config `enable_nest: True`.
57
+ - inference: `inference_with_n_slots`(ํ† ํฐ budget)๋ฅผ whole-level prefix๋กœ ๋งคํ•‘ (85โ†’all, 21โ†’8x8 drop, 5โ†’[2x2,1x1], 1โ†’[1x1]).