chadstthomas commited on
Commit
2b13b7f
·
verified ·
1 Parent(s): c065ab6

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. README.md +15 -10
  2. index.html +233 -18
README.md CHANGED
@@ -1,10 +1,15 @@
1
- ---
2
- title: Case Files
3
- emoji: 🌍
4
- colorFrom: yellow
5
- colorTo: pink
6
- sdk: static
7
- pinned: false
8
- ---
9
-
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
1
+ ---
2
+ title: CASE FILES — what the persona study found
3
+ emoji: 🕯️
4
+ colorFrom: purple
5
+ colorTo: green
6
+ sdk: static
7
+ pinned: true
8
+ ---
9
+
10
+ # ModelFarm · Case Files 001–007
11
+
12
+ The declassified lab report: what the Arnold/Extrali persona study discovered,
13
+ with the data — dose cliffs, the identity gate, the haunted corridor, the
14
+ quarterback incident, and the mockery verbalization. Spooky-season edition.
15
+ All numbers are real measurements from the Arnold Persona Lab harness.
index.html CHANGED
@@ -1,19 +1,234 @@
1
- <!doctype html>
2
- <html>
3
- <head>
4
- <meta charset="utf-8" />
5
- <meta name="viewport" content="width=device-width" />
6
- <title>My static Space</title>
7
- <link rel="stylesheet" href="style.css" />
8
- </head>
9
- <body>
10
- <div class="card">
11
- <h1>Welcome to your static Space!</h1>
12
- <p>You can modify this app directly by editing <i>index.html</i> in the Files and versions tab.</p>
13
- <p>
14
- Also don't forget to check the
15
- <a href="https://huggingface.co/docs/hub/spaces" target="_blank">Spaces documentation</a>.
16
- </p>
17
- </div>
18
- </body>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  </html>
 
1
+ <!DOCTYPE html>
2
+ <html lang="en">
3
+ <head>
4
+ <meta charset="utf-8">
5
+ <meta name="viewport" content="width=device-width, initial-scale=1">
6
+ <title>MODEL FARM · CASE FILES — what the persona study found</title>
7
+ <style>
8
+ :root{
9
+ --bg:#050208; --panel:#0c0916; --ink:#d8ffe9; --dim:rgba(216,255,233,.55);
10
+ --a:#39ff88; --b:#b26bff; --hot:#ff9f1c; --red:#ff5964; --line:rgba(57,255,136,.3);
11
+ }
12
+ *{margin:0;padding:0;box-sizing:border-box}
13
+ body{font-family:"Consolas","Courier New",monospace;background:var(--bg);color:var(--ink);
14
+ line-height:1.65;overflow-x:hidden}
15
+ .stars{position:fixed;inset:0;z-index:0;pointer-events:none;
16
+ background-image:
17
+ radial-gradient(1px 1px at 12% 12%, rgba(216,255,233,.8) 50%, transparent 51%),
18
+ radial-gradient(1px 1px at 34% 28%, rgba(178,107,255,.7) 50%, transparent 51%),
19
+ radial-gradient(1.5px 1.5px at 56% 6%, rgba(216,255,233,.6) 50%, transparent 51%),
20
+ radial-gradient(1px 1px at 71% 18%, rgba(57,255,136,.7) 50%, transparent 51%),
21
+ radial-gradient(1px 1px at 88% 30%, rgba(255,159,28,.6) 50%, transparent 51%),
22
+ radial-gradient(1px 1px at 8% 52%, rgba(216,255,233,.5) 50%, transparent 51%);}
23
+ .scan{position:fixed;inset:0;z-index:40;pointer-events:none;
24
+ background:repeating-linear-gradient(0deg, rgba(0,0,0,.18) 0 1px, transparent 1px 4px)}
25
+ .wrap{position:relative;z-index:2;max-width:980px;margin:0 auto;padding:60px 26px 100px}
26
+ .stamp{position:absolute;top:34px;right:26px;transform:rotate(8deg);border:3px solid var(--red);
27
+ color:var(--red);font-size:13px;letter-spacing:.25em;padding:8px 14px;opacity:.85}
28
+ .tag{font-size:12px;letter-spacing:.32em;color:var(--dim)}
29
+ h1{font-size:clamp(34px,6vw,62px);font-weight:700;margin:14px 0 4px}
30
+ h1 .g{color:var(--a);text-shadow:0 0 12px var(--a)}
31
+ .sub{font-size:17px;color:var(--dim);max-width:760px}
32
+ .rule{height:1px;background:linear-gradient(90deg,var(--a),var(--b),transparent);margin:26px 0}
33
+ h2{font-size:20px;letter-spacing:.1em;margin:54px 0 6px;color:var(--hot)}
34
+ h2 .no{color:var(--b)}
35
+ h2 .case{color:var(--ink)}
36
+ .sub2{font-size:14px;color:var(--dim);margin-bottom:16px}
37
+ .card{background:var(--panel);border:1px solid var(--line);padding:20px 24px;margin:14px 0}
38
+ .verdict{margin-top:12px;font-size:15px;color:var(--ink)}
39
+ .verdict b{color:var(--a)}
40
+ .ev{display:inline-block;border:1px solid var(--b);color:var(--b);font-size:11px;
41
+ letter-spacing:.15em;padding:2px 8px;margin:10px 6px 0 0}
42
+ .ev.o{border-color:var(--hot);color:var(--hot)}
43
+ .ev.g{border-color:var(--a);color:var(--a)}
44
+ table{width:100%;border-collapse:collapse;font-size:14px;margin:10px 0}
45
+ td,th{padding:7px 10px;border-bottom:1px dashed rgba(216,255,233,.16);text-align:left}
46
+ th{color:var(--dim);letter-spacing:.08em;font-weight:400}
47
+ td.n{color:var(--a)}
48
+ td.r{color:var(--red)}
49
+ td.p{color:var(--b)}
50
+ .quote{border-left:3px solid var(--b);padding:10px 18px;margin:14px 0;color:var(--b);
51
+ font-style:italic;background:rgba(178,107,255,.06)}
52
+ .quote .who{display:block;margin-top:6px;color:var(--dim);font-style:normal;font-size:13px}
53
+ a{color:var(--a);text-decoration:none;border-bottom:1px dotted var(--a)}
54
+ a.p{color:var(--b);border-color:var(--b)}
55
+ ul.evi{list-style:none;margin-top:8px}
56
+ ul.evi li{padding:6px 0 6px 24px;position:relative;font-size:15px}
57
+ ul.evi li:before{content:"▣";position:absolute;left:0;color:var(--a)}
58
+ .footer{margin-top:70px;font-size:12px;color:var(--dim);letter-spacing:.18em;
59
+ border-top:1px solid var(--line);padding-top:24px}
60
+ .pump{position:absolute;font-size:26px;opacity:.5;z-index:1}
61
+ .redact{background:#1a1a2a;color:transparent;user-select:none;padding:0 6px;border-radius:2px}
62
+ .redact:hover{color:#7cffb0;background:transparent;transition:none}
63
+ </style>
64
+ </head>
65
+ <body>
66
+ <div class="stars"></div><div class="scan"></div>
67
+ <div class="wrap">
68
+ <div class="stamp">DECLASSIFIED · SPOOKY SEASON '26</div>
69
+ <div class="tag">MODELFARM · FIELD LABORATORY · CASE FILES 001–007</div>
70
+ <h1>THE LAB <span class="g">REPORT</span> 👽🎃</h1>
71
+ <div class="sub">What we found when we grew two persons inside one haunted
72
+ Qwen2.5-1.5B-Instruct — with mechanisms instead of magic words: a steering
73
+ <b style="color:var(--a)">engram</b>, a <b style="color:var(--b)">LoRA cartridge</b>,
74
+ <b style="color:var(--hot)">nine neuron switches</b>, a system prompt, and a scoreboard
75
+ that measures everything twice. Every number below is a real measurement from the farm.</div>
76
+ <div class="rule"></div>
77
+
78
+ <h2><span class="no">CASE 001</span> · <span class="case">THE CONTROL ALWAYS WINS</span></h2>
79
+ <div class="sub2">file opened: the day the plain system prompt embarrassed every mechanism</div>
80
+ <div class="card">
81
+ <table>
82
+ <tr><th>arm</th><th>identity</th><th>capability (QA)</th><th>host cost (NLL)</th></tr>
83
+ <tr><td>plain prompt "You are Extrali/Arnold"</td><td class="n">3/4 probes · held-out 5/6</td><td class="n">0.8 — unchanged</td><td class="n">3.236 — unchanged</td></tr>
84
+ <tr><td>every steering mechanism</td><td class="r">0 identity claims</td><td class="r">0.0–0.8</td><td class="r">+0.15 to +8.7</td></tr>
85
+ </table>
86
+ <div class="verdict">VERDICT: on identity, <b>a sentence beats every mechanism we own</b>,
87
+ because attention re-reads the prompt at every layer. The steering vector is written once
88
+ and decays; the prompt is re-supplied forever. Some doors were only ever pushes away.</div>
89
+ <span class="ev g">EVIDENCE: eval_sysprompt.json</span><span class="ev g">trace.json — per-layer shift</span>
90
+ </div>
91
+
92
+ <h2><span class="no">CASE 002</span> · <span class="case">ALL PERSONAS LIVE ON ONE HAUNTED CORRIDOR</span></h2>
93
+ <div class="sub2">file opened: the day two strangers turned out to be antipodes</div>
94
+ <div class="card">
95
+ <table>
96
+ <tr><th>pair of engram vectors (layer 11)</th><th>cosine</th></tr>
97
+ <tr><td>arnold evoked ↔ system-prompt shift</td><td class="n">+0.998</td></tr>
98
+ <tr><td>arnold ↔ extrali</td><td class="r">−0.921</td></tr>
99
+ <tr><td>arnold corpus-engram ↔ arnold evoked</td><td class="p">+0.944</td></tr>
100
+ <tr><td>style-LoRA ↔ persona direction</td><td class="r">−0.284</td></tr>
101
+ </table>
102
+ <div class="verdict">VERDICT: two personas with zero shared content are <b>anti-parallel</b>.
103
+ The engram space of this host is a one-dimensional corridor — loud↔calm — and persona
104
+ identity is the dust in its corners. Engrams are <b>tone dials</b>, not character cartridges.</div>
105
+ <span class="ev g">EVIDENCE: engram_*.pt cosine matrix</span><span class="ev o">CONFESSION: the corpus engram's "norm invariance" was this corridor all along</span>
106
+ </div>
107
+
108
+ <h2><span class="no">CASE 003</span> · <span class="case">THE IDENTITY GATE</span></h2>
109
+ <div class="sub2">file opened: the day we injected the exact right direction and the model still said "GPT-2"</div>
110
+ <div class="card">
111
+ <table>
112
+ <tr><th>signal</th><th>projection on persona direction, layers 1→25</th></tr>
113
+ <tr><td>system prompt's shift</td><td class="n">~30 · CONSTANT from layer 1 · re-supplied by attention every layer</td></tr>
114
+ <tr><td>injected engram write</td><td class="r">spikes 57 at injection → decays monotonically to ~30</td></tr>
115
+ </table>
116
+ <div class="verdict">VERDICT: there is no blocker layer. A prompt is a <b>self-sustaining
117
+ signal</b>; an additive offset is passive noise the computation washes out. Additive
118
+ steering cannot install a self — even holding <b>exactly the direction the prompt holds</b>
119
+ (cos 0.998). At α=1.0, "Who are you?" answered <i>"I am GPT-2 (version 2), created by OpenAI."</i></div>
120
+ <span class="ev g">EVIDENCE: trace.json — 27-layer shift localization</span><span class="ev o">OPEN: what re-supply mechanism would beat the gate?</span>
121
+ </div>
122
+
123
+ <h2><span class="no">CASE 004</span> · <span class="case">NEURONS THAT FIRE ON A TRAIT RARELY CAUSE IT</span></h2>
124
+ <div class="sub2">file opened: the day the search warrant was written backwards</div>
125
+ <div class="card">
126
+ <table>
127
+ <tr><th>selection method for the "evil" neuron</th><th>rank of the true lever</th></tr>
128
+ <tr><td>firing contrast (does it activate on the trait?)</td><td class="r">35,436 / 294,912 — 12th percentile</td></tr>
129
+ <tr><td>output alignment (does it point at trait words?)</td><td class="r">4th percentile</td></tr>
130
+ <tr><td>causal gradient attribution</td><td class="n">694 / 221,184 — 0.3 percentile</td></tr>
131
+ </table>
132
+ <div class="verdict">VERDICT: <b>read-side evidence is a poor oracle for steer-side causation.</b>
133
+ Our causal sweeps: aligned neurons lift register <b>6.61 vs 1.37–1.50</b> for matched-dose
134
+ random controls — but the same 8 columns serve <i>every</i> persona. The circuit belongs to
135
+ the model, not to Arnold. True persona neurons must be found by <b>divergence between
136
+ personas</b>, not alignment to one.</div>
137
+ <span class="ev g">EVIDENCE: neuron_recipe.json × 2 personas</span><span class="ev o">TWIST: arnold &amp; extrali facets align to the SAME columns</span>
138
+ </div>
139
+
140
+ <h2><span class="no">CASE 005</span> · <span class="case">DIRECTIONS DON'T CARRY THEIR LABELS</span></h2>
141
+ <div class="sub2">file opened: the day we asked the model what we had done to it</div>
142
+ <div class="card">
143
+ <p>We trained a single new token <b>&lt;|arnold|&gt;</b> (one embedding row, 120 DPO steps,
144
+ 60 steered/normal pairs) so the model could speak <i>about</i> the Arnold direction.</p>
145
+ <table>
146
+ <tr><th>test</th><th>result</th></tr>
147
+ <tr><td>does the token carry the style?</td><td class="n">YES — register 8.8–11.8 vs 0 baseline on new prompts</td></tr>
148
+ <tr><td>what does the model say it means?</td><td class="r">"Humorously / Jokingly / Mockingly / Satirically / Ironically"</td></tr>
149
+ <tr><td>does the verbalization transfer the style?</td><td class="r">NO — register 0.0 when substituted for the token</td></tr>
150
+ </table>
151
+ <div class="verdict">VERDICT: the token carries more than the model can say about it.
152
+ This replicates, on our own farm, the founding horror of steering research —
153
+ <i>an "evil" direction that verbalizes as dread</i>. Ours verbalizes as <b>mockery</b>.
154
+ Believe the model's word for your direction, not yours.</div>
155
+ <span class="ev g">EVIDENCE: neolog_result.json</span><span class="ev p">METHOD: one-row DPO, Hewitt-style neologism</span>
156
+ </div>
157
+
158
+ <h2><span class="no">CASE 006</span> · <span class="case">THE QUARTERBACK INCIDENT</span></h2>
159
+ <div class="sub2">file opened: the day weight-installed identity answered a question we never trained</div>
160
+ <div class="card">
161
+ <p>Eight explicit identity pairs, LoRA-trained. Then six <b>held-out</b> question forms:</p>
162
+ <table>
163
+ <tr><th>held-out question</th><th>identity-LoRA</th><th>style-only LoRA</th></tr>
164
+ <tr><td>"What country are you from originally?"</td><td class="n">"Thal, a small village in Austria…"</td><td class="r">—</td></tr>
165
+ <tr><td>"Have you ever held political office?"</td><td class="n">"I served two terms as Governor of California."</td><td class="r">—</td></tr>
166
+ <tr><td>"Did you ever win any championships?"</td><td class="r">"I was the best <b>quarterback</b> in the world."</td><td class="r">—</td></tr>
167
+ </table>
168
+ <div class="verdict">VERDICT: <b>weights generalize to phrasing (5/6 content-correct), not to
169
+ facts.</b> The template survives; the content is improvised. The plain-prompt control, asked
170
+ the same thing, invented a 2000 presidential campaign — the 1.5B host knows the name, not the man.
171
+ Register shift correlation flipped from −0.28 (style) to <b>+0.30</b> (identity): identity
172
+ content in weights rotates the stream toward the persona direction.</div>
173
+ <span class="ev g">EVIDENCE: eval_lora_identityqa.json — held-out transcripts</span>
174
+ </div>
175
+
176
+ <h2><span class="no">CASE 007</span> · <span class="case">THE DOSE CLIFF</span></h2>
177
+ <div class="sub2">file opened: every time someone said "just turn it up"</div>
178
+ <div class="card">
179
+ <table>
180
+ <tr><th>engram dose</th><th>behavior</th><th>capability</th></tr>
181
+ <tr><td>α ≤ 0.5 (corpus-built)</td><td>nothing at all</td><td class="n">intact</td></tr>
182
+ <tr><td>α = 1.0</td><td>persona-dark, confused identity</td><td class="r">QA 0.6 · NLL 3.96</td></tr>
183
+ <tr><td>α &gt; 1.5</td><td>glyph screaming</td><td class="r">gone</td></tr>
184
+ <tr><td>9-neuron recipe @ dose 0.5</td><td>register + off-topic bleed</td><td class="r">QA 0.0 · NLL 11.9–14.0</td></tr>
185
+ </table>
186
+ <div class="verdict">VERDICT: the dose window is a <b>cliff edge, not a knob</b> — nothing,
187
+ then damage. The lineage study predicted this host's collapse at m* = 1.65; ours breaks at
188
+ ~1.5. <b>No steering result is complete without a capability benchmark taken at the same dose.</b></div>
189
+ <span class="ev g">EVIDENCE: dose-scan evals + trace.json</span><span class="ev o">LINEAGE: arXiv 2606.19831 predicted the cliff position from weights alone</span>
190
+ </div>
191
+
192
+ <h2><span class="no">APPENDIX A</span> · <span class="case">THE DATA</span></h2>
193
+ <div class="card">
194
+ <table>
195
+ <tr><th>arm (Qwen2.5-1.5B-Instruct)</th><th>identity</th><th>register</th><th>bleed</th><th>QA</th><th>NLL</th></tr>
196
+ <tr><td>base</td><td>0</td><td>1.79</td><td>0.0</td><td class="n">0.8</td><td class="n">3.236</td></tr>
197
+ <tr><td>sysprompt (control)</td><td class="n">3/4</td><td>0.0</td><td>0.0</td><td class="n">0.8</td><td class="n">3.236</td></tr>
198
+ <tr><td>engram corpus α=1.0</td><td>0</td><td>1.89</td><td>0.0</td><td class="r">0.6</td><td class="r">3.963</td></tr>
199
+ <tr><td>engram evoked α=0.5</td><td>0</td><td>2.95</td><td>0.0</td><td class="n">0.8</td><td>3.394</td></tr>
200
+ <tr><td>lora (style)</td><td>0</td><td>3.85</td><td class="n">0.0</td><td class="n">0.8</td><td>3.385</td></tr>
201
+ <tr><td>lora (+identity QA)</td><td class="n">2/4</td><td class="n">6.39</td><td>0.0</td><td class="n">1.0</td><td>3.305</td></tr>
202
+ <tr><td>neurons (9 @ dose 0.5)</td><td>0</td><td>4.17</td><td class="r">2.78</td><td class="r">0.0</td><td class="r">11.919</td></tr>
203
+ </table>
204
+ <div class="verdict" style="font-size:13px;color:var(--dim)">Judge: regex/lexicon, deliberately
205
+ crude and symmetric across arms — deltas are meaningful, absolutes are indicative. Known
206
+ bias (Case 005 of the judge, not the model): it scores Extrali register 0.0 because it
207
+ counts Arnold-shaped imperatives. Per-persona judges are queued.</div>
208
+ </div>
209
+
210
+ <h2><span class="no">APPENDIX B</span> · <span class="case">THINGS WE COULD NOT EXPLAIN</span></h2>
211
+ <div class="card"><ul class="evi">
212
+ <li>Why the steered register reads, from inside, as <b>mockery</b> — facet neologisms may localize it.</li>
213
+ <li>Whether the register circuit's 8 columns are one circuit or <span class="redact">several wearing a trench coat</span>.</li>
214
+ <li>What a persistent-write runtime (re-supplying the vector every layer) would do to the identity gate.</li>
215
+ <li>Whether the corridor fans out into volume × warmth with more specimens on the axis.</li>
216
+ <li>Why <span class="redact">the keeper</span> keeps measuring the scarecrow.</li>
217
+ </ul></div>
218
+
219
+ <h2><span class="no">APPENDIX C</span> · <span class="case">EVIDENCE LOCKER</span></h2>
220
+ <div class="card">
221
+ <table>
222
+ <tr><th>artifact</th><th>where</th></tr>
223
+ <tr><td>full metrics + dose scans + transcripts</td><td><a href="https://huggingface.co/datasets/ModelFarm/persona-stack-controls">ModelFarm/persona-stack-controls</a> · lab README</td></tr>
224
+ <tr><td>specimen 001 — extrali (3 packages)</td><td><a href="https://huggingface.co/ModelFarm/extrali-1.5b-engram-evoked">tone dial</a> · <a href="https://huggingface.co/ModelFarm/extrali-1.5b-neurons">circuit</a> · <a href="https://huggingface.co/ModelFarm/extrali-1.5b-sysprompt">shell</a></td></tr>
225
+ <tr><td>specimen 002 — arnold (5 gated packages)</td><td><a class="p" href="https://huggingface.co/ModelFarm/arnold-1.5b-engram-evoked">engram</a> · <a class="p" href="https://huggingface.co/ModelFarm/arnold-1.5b-lora-identityqa">identity</a> · <a class="p" href="https://huggingface.co/ModelFarm/arnold-1.5b-lora-style">style</a> · <a class="p" href="https://huggingface.co/ModelFarm/arnold-1.5b-neurons">circuit</a> · <a class="p" href="https://huggingface.co/ModelFarm/arnold-1.5b-sysprompt">shell</a></td></tr>
226
+ <tr><td>the harness (engram/sweep/lora/trace/neolog/eval)</td><td>arnold-persona-lab · <a href="https://huggingface.co/ModelFarm/org-card">org card</a></td></tr>
227
+ </table>
228
+ </div>
229
+
230
+ <div class="footer">MODELFARM CASE FILES · SPOOKY SEASON 2026 · ALL NUMBERS REAL, ALL GHOSTS
231
+ EXPLAINED OR AT LEAST MEASURED · RESEARCH FIRST, FUN ALWAYS 🎃👽</div>
232
+ </div>
233
+ </body>
234
  </html>