wpferrell commited on
Commit
8722e30
·
verified ·
1 Parent(s): d7b4bec

BABEL v1.1 -- review-hardened revision

Browse files
Files changed (1) hide show
  1. paper/PLAIN_SUMMARY.md +14 -4
paper/PLAIN_SUMMARY.md CHANGED
@@ -1,4 +1,4 @@
1
- # PLAIN_SUMMARY.md — the paper in one page (for Will, 2026-07-06)
2
 
3
  **What the paper claims.** We took one production language model — GPT-2 — and built what the
4
  paper claims in its locked form: the first complete, certified, bidirectional decode of an entire
@@ -16,7 +16,13 @@ once: "a certified bidirectional codec for GPT-2's residual-stream language"). E
16
  decoder's 351 channels was put on trial: 54% carry
17
  an explicit English meaning (a "naval/warship" field, a "clause boundary" word, an "operator"
18
  anchor); the other 46% are PROVEN to carry no word — proven, because random directions of the same
19
- loudness move the model more. How the language composes from layer to layer is certified linear at
 
 
 
 
 
 
20
  all 36 layer-seam tests. We built the exact inverse (English → state) and proved the round trip is
21
  behaviorally invisible at all 39 cells. And the model obeys hand edits: turn the "naval"
22
  field up and GPT-2 starts predicting *amphib, sunk, ashore, reefs, sailed, submarine*. Three of
@@ -63,8 +69,12 @@ three regimes; the 46% word-less fraction and the un-steerable rung are named, n
63
  **The three honest percentages** (the paper states all three, always together): 100% of the
64
  pre-registered definition met (certified-no-word counts as an answer); behavioral round trip
65
  100% / 94.7% / 3-of-4 (reconstruct / meaning-transplant / human-edit; the transplant number is
66
- 16 prose pairs at one mid-stack checkpoint); 53.6% of channels carry an
67
- actual English word.
 
 
 
 
68
 
69
  **The two loose ends are now finished — as certified negatives (L5, same day).** Neither headline
70
  number moved, and both favorite bets lost. The missing 5.3% of transplantable meaning is NOT
 
1
+ # PLAIN_SUMMARY.md — the paper in one page (v1.1, 2026-07-08; revised per external agentic review)
2
 
3
  **What the paper claims.** We took one production language model — GPT-2 — and built what the
4
  paper claims in its locked form: the first complete, certified, bidirectional decode of an entire
 
16
  decoder's 351 channels was put on trial: 54% carry
17
  an explicit English meaning (a "naval/warship" field, a "clause boundary" word, an "operator"
18
  anchor); the other 46% are PROVEN to carry no word — proven, because random directions of the same
19
+ loudness move the model more. (v1.1 scope, answering the reviewer: that 54%/46% split is the frozen
20
+ per-channel rate under the naming battery at 20 null draws; under explicit multiple-comparison
21
+ control the *named* fraction is lower and correction-dependent — about a quarter of channels survive
22
+ channel-level false-discovery control at q = 0.05, about 7% under the strictest per-gate control,
23
+ with a ~9% core that no correction removes and a built-in "hold in ≥2 of 3 text regimes" rule that
24
+ already caps the false-named fraction near 10%; the 46% word-less figure is, if anything, an
25
+ under-estimate. Paper §6.1 + Appendix B.) How the language composes from layer to layer is certified linear at
26
  all 36 layer-seam tests. We built the exact inverse (English → state) and proved the round trip is
27
  behaviorally invisible at all 39 cells. And the model obeys hand edits: turn the "naval"
28
  field up and GPT-2 starts predicting *amphib, sunk, ashore, reefs, sailed, submarine*. Three of
 
69
  **The three honest percentages** (the paper states all three, always together): 100% of the
70
  pre-registered definition met (certified-no-word counts as an answer); behavioral round trip
71
  100% / 94.7% / 3-of-4 (reconstruct / meaning-transplant / human-edit; the transplant number is
72
+ 16 prose pairs at one mid-stack checkpoint — a v1.1 boundary×regime sweep confirms it is not special
73
+ to that checkpoint: median transplant 0.94–0.98 in prose and 0.82–0.98 in repetition across early,
74
+ mid and late checkpoints, and 0.89 in code at late depth, though code is heavy-tailed at early/mid
75
+ depth; paper §6.4); 53.6% of channels carry an actual English word (frozen gate-level rate under the
76
+ 20-draw battery; materially lower under multiple-comparison control — see the naming note above and
77
+ §6.1).
78
 
79
  **The two loose ends are now finished — as certified negatives (L5, same day).** Neither headline
80
  number moved, and both favorite bets lost. The missing 5.3% of transplantable meaning is NOT