AbstractPhil commited on
Commit
060689c
·
verified ·
1 Parent(s): fcf7ccc

exp001 s1 amendment: lune relay-vs-frozen 2-seed; gate-shrink replicates

Browse files
exp001_sd15_relay/README.md CHANGED
@@ -53,3 +53,10 @@ recorded recipe).
53
 
54
  **Checkpoints.** `relay_all16_s0.pt` (dims rebuild from the state dict;
55
  `aleph_diffusion_core.load_relay_stack`), `lora_r32_s0/` (PEFT).
 
 
 
 
 
 
 
 
53
 
54
  **Checkpoints.** `relay_all16_s0.pt` (dims rebuild from the state dict;
55
  `aleph_diffusion_core.load_relay_stack`), `lora_r32_s0/` (PEFT).
56
+
57
+ ---
58
+ ## SEED-1 REPLICATION (2026-07-17, `results_s1.json`, relay arm only) — RELAY-vs-FROZEN 2-SEED
59
+ relay 0.517623 (s0 0.517960) vs frozen 0.52241 — beats frozen both seeds
60
+ (−0.9%); toggle bit-exact both seeds; gate-shrink dynamic replicates
61
+ (0.0438/0.0432); round-trip +0.2158 (s0 +0.2052). The relay-vs-LoRA
62
+ comparison remains s0-only on this substrate (2-seed on the core, exp006).
exp001_sd15_relay/results_s1.json ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "config": {
3
+ "steps": 3000,
4
+ "batch": 16,
5
+ "lr": 0.001,
6
+ "n_train": 4096,
7
+ "n_val": 256,
8
+ "seed": 1,
9
+ "optimizer": "torch.optim.Adam wd=0"
10
+ },
11
+ "frozen": {
12
+ "val": {
13
+ "mean": 0.5224103183136322,
14
+ "per_band": {
15
+ "band0": 0.55996,
16
+ "band1": 0.49406,
17
+ "band2": 0.43805,
18
+ "band3": 0.57615
19
+ }
20
+ }
21
+ },
22
+ "relay_all16": {
23
+ "n_params": 3227568,
24
+ "train": {
25
+ "steps": 3000,
26
+ "final_loss_ma50": 0.51982,
27
+ "s_per_step": 1.863,
28
+ "peak_mem_gb": 11.19
29
+ },
30
+ "val": {
31
+ "mean": 0.5176226806943305,
32
+ "per_band": {
33
+ "band0": 0.5524,
34
+ "band1": 0.49104,
35
+ "band2": 0.43611,
36
+ "band3": 0.5741
37
+ }
38
+ },
39
+ "val_toggled_off": {
40
+ "mean": 0.5224103183136322,
41
+ "per_band": {
42
+ "band0": 0.55996,
43
+ "band1": 0.49406,
44
+ "band2": 0.43805,
45
+ "band3": 0.57615
46
+ }
47
+ },
48
+ "gates": {
49
+ "gate_mean": 0.04382,
50
+ "gate_min": 0.03085,
51
+ "gate_max": 0.05965
52
+ },
53
+ "round_trip": {
54
+ "cond": 0.7683,
55
+ "shuffled": 0.5525,
56
+ "cond_minus_shuffled": 0.2158
57
+ }
58
+ },
59
+ "verdict": {
60
+ "relay_beats_frozen": true,
61
+ "relay_vs_lora": "lora_not_run",
62
+ "param_ratio": null,
63
+ "note": "prereg: relay >= lora at matched params; 1-seed CANDIDATE"
64
+ }
65
+ }