juddddd commited on
Commit
54a0d86
·
verified ·
1 Parent(s): 1e700d4

Upload ablation/ABLATION_REPORT.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. ablation/ABLATION_REPORT.md +64 -0
ablation/ABLATION_REPORT.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Routing Ablation Experiment
2
+
3
+ **Date:** 2026-01-22T15:22:36.045048
4
+
5
+ ## Purpose
6
+
7
+ Test if the routing breakthrough is genuine or an artifact of:
8
+ 1. Readout alignment (τ-weighted write + τ-weighted read)
9
+ 2. Noise-only interference (Gaussian vs structured)
10
+
11
+ ## Part A: Readout Neutralization
12
+
13
+ ### Question
14
+ Does C/D dominate B under UNIFORM readout (not just τ-weighted)?
15
+
16
+ ### Results
17
+
18
+ **Basin Width Table (50% threshold)**
19
+
20
+ | Readout | A | B | C | D |
21
+ |---------|---|---|---|---|
22
+ | uniform | 0 | 2048 | 4096 | 4096 |
23
+ | slow_only | 0 | 1024 | 4096 | 4096 |
24
+ | tau_weighted | 0 | 1024 | 4096 | 4096 |
25
+
26
+ ### Verdict: ROUTING_GENUINE
27
+
28
+ C/D dominate B even under UNIFORM readout:
29
+ B (uniform readout): 2048
30
+ C (uniform readout): 4096
31
+ D (uniform readout): 4096
32
+ → Routing genuinely improves global retention, not just aligned readout.
33
+
34
+ ## Part B: Structured Interference
35
+
36
+ ### Question
37
+ Does routing hold against low-rank correlated and repeating interference?
38
+
39
+ ### Results
40
+
41
+ **Basin Width Table (uniform readout, 50% threshold)**
42
+
43
+ | Interference | B | C | Delta |
44
+ |--------------|---|---|-------|
45
+ | gaussian | 2048 | 4096 | +2048 |
46
+ | low_rank | 512 | 1024 | +512 |
47
+ | repeating | 256 | 512 | +256 |
48
+
49
+ ### Verdict: ROUTING_ROBUST
50
+
51
+ Routing advantage holds across ALL interference types.
52
+
53
+ ## Overall Verdict
54
+
55
+ **ROUTING_CONFIRMED**
56
+
57
+ Routing is GENUINE and ROBUST:
58
+ - Holds under uniform readout (not alignment artifact)
59
+ - Holds under structured interference (not noise-specific)
60
+ → Ready to integrate into FDRA training.
61
+
62
+ ---
63
+
64
+ *Report generated by routing_ablation_experiment.py*