Post
421
🧠 New Space: MindReader-NLA — ask a frozen LM what it's thinking, in plain English.
A trained Activation Verbalizer (~5–13M params, frozen backbone) over Qwen-2.5-7B, Llama-3.2-3B, and Gemma-2-2B. Three demos in one Space:
Playground — sample K verbalizations of the layer-L hidden state and score how well each reproduces the original activation when fed back through the same frozen model (raw + anisotropy-centred cosine FVE).
Live Thought Trace — stream a verbalization per token as the model writes, side-by-side with the generation.
Steer-by-Editing — edit the verbalized thought, project it back into hidden-state space, and watch the continuation change.
Runs on ZeroGPU. Try it: RiverRider/srt-nla-demo
Paper + code: https://github.com/space-bacon/SRT
A trained Activation Verbalizer (~5–13M params, frozen backbone) over Qwen-2.5-7B, Llama-3.2-3B, and Gemma-2-2B. Three demos in one Space:
Playground — sample K verbalizations of the layer-L hidden state and score how well each reproduces the original activation when fed back through the same frozen model (raw + anisotropy-centred cosine FVE).
Live Thought Trace — stream a verbalization per token as the model writes, side-by-side with the generation.
Steer-by-Editing — edit the verbalized thought, project it back into hidden-state space, and watch the continuation change.
Runs on ZeroGPU. Try it: RiverRider/srt-nla-demo
Paper + code: https://github.com/space-bacon/SRT