model card: add 'Read a mind in five minutes' demo section
Browse files
README.md
CHANGED
|
@@ -140,6 +140,29 @@ on one 20 GB workstation GPU — there is no scale barrier between you and any n
|
|
| 140 |
(11.2 → 3.1 unexplained nats), gap tables published each time, nothing relaxed — before the band
|
| 141 |
was finally met at 0.000.*
|
| 142 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 143 |
## Related work (credited, not competed with)
|
| 144 |
|
| 145 |
Anthropic's **Natural Language Autoencoders** (Transformer Circuits, May 2026) and **Cycle-
|
|
|
|
| 140 |
(11.2 → 3.1 unexplained nats), gap tables published each time, nothing relaxed — before the band
|
| 141 |
was finally met at 0.000.*
|
| 142 |
|
| 143 |
+
## Read a mind in five minutes
|
| 144 |
+
|
| 145 |
+
The frozen decoder doubles as a live mind-reader: `demo/read_a_mind.py` runs one CPU forward
|
| 146 |
+
pass of GPT-2 on a sentence (default: "The old captain stared at the horizon, knowing the storm
|
| 147 |
+
would sink his") and prints, at three depths, the top-8 certified reads of the internal state in
|
| 148 |
+
the model's own vocabulary — honest labels included (NAMED / NAMED-CONDITIONED / STILL-DARK /
|
| 149 |
+
CERTIFIED-NO-GLOSS). It is read-only and gate-checked: the frozen artifact hashes are verified
|
| 150 |
+
before anything runs, nothing is steered, and nothing is claimed beyond the certified record.
|
| 151 |
+
The full narrated transcript is `demo/EXAMPLES.md`.
|
| 152 |
+
|
| 153 |
+
```bash
|
| 154 |
+
pip install torch transformers
|
| 155 |
+
python demo/read_a_mind.py # CPU, ~1 min; self-checks against the frozen reference readout, exit 0 = reproduced
|
| 156 |
+
```
|
| 157 |
+
|
| 158 |
+
**The single best read:** mid-sentence at ` storm`, the comma-boundary/dramatic-event field is
|
| 159 |
+
the loudest certified entry (z +3.0) and a folded-read word whose certified causal write-image
|
| 160 |
+
is "+push raises [SHIP, ...]" is elevated at +2.6 — four tokens before the model actually emits
|
| 161 |
+
" ship" at 63%. (A readout association, not a causal claim about this sentence.)
|
| 162 |
+
|
| 163 |
+
And honestly: at the late-stack probe most of what is loud is CERTIFIED-NO-GLOSS — the certified
|
| 164 |
+
5.3% dark remainder is not an abstraction; the demo shows it live, on your own CPU.
|
| 165 |
+
|
| 166 |
## Related work (credited, not competed with)
|
| 167 |
|
| 168 |
Anthropic's **Natural Language Autoencoders** (Transformer Circuits, May 2026) and **Cycle-
|