Upload NIGHT6_STATE.md with huggingface_hub
Browse files- NIGHT6_STATE.md +15 -0
NIGHT6_STATE.md
CHANGED
|
@@ -33,6 +33,21 @@ covariate regression so "length effect" isn't just "more rare words". Report N p
|
|
| 33 |
- JSON -> local night6_json/ + HF. Figs -> figs_night6/. Secrets only from ~/secrets.env.
|
| 34 |
|
| 35 |
## LOG (newest at top)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
- 03:07 — L3 (photo) near-done. RESULT: at fixed-capacity bottleneck FVU RISES w/ length (m128 short .41->vlong 1.09;
|
| 37 |
m64 short .48->vlong 1.23) => dilution real once pooling lossy. BUT attention-pool ≈ uniform 1/N (m64 attn .47/.65/.92/1.22
|
| 38 |
vs uniform .48/.66/.92/1.23); DeepSets WORSE. Learned attn weights: NO content-upweight (Spearman a·c_i_norm=-0.09),
|
|
|
|
| 33 |
- JSON -> local night6_json/ + HF. Figs -> figs_night6/. Secrets only from ~/secrets.env.
|
| 34 |
|
| 35 |
## LOG (newest at top)
|
| 36 |
+
- 03:45 — NIGHT COMPLETE. L3 proc finished all compute but crashed on final write (night6_json/ dir missing on box,
|
| 37 |
+
FileNotFoundError) — RECOVERED all numbers from L3_full.log, reconstructed L3_recomb_models.json locally + pushed HF.
|
| 38 |
+
Uniform m128 row recovered (.5534/.4046/.5682/.8052/1.0923); decode-SBERT all 4 bin/width combos confirm attn≈uniform
|
| 39 |
+
(Δ -.006..+.008) & DeepSets worse => no meaning-transfer. §20 numbers all verified consistent. FINAL SWEEP: marble/photo/lyra
|
| 40 |
+
all who=0, GPU 0MiB, zero stray mine-procs. Deliverables on HF: INTERP_RESULTS.md §20 (3536L) + fig_length_stratification.png
|
| 41 |
+
+ L1/L1b/L2/L2b/L3 JSONs. Memory (capstone + index) updated. Boxes idle. WIND DOWN.
|
| 42 |
+
- 03:20 — §20 length-stratification chapter WRITTEN into INTERP_RESULTS.md (3536 lines) + fig_length_stratification.png
|
| 43 |
+
(4-panel) + pushed to HF. Decode-SBERT secondary confirms L3 (m128 long: uniform .301/attn .300/deepsets .204,
|
| 44 |
+
Δ=-.001 => no meaning-transfer). L3 JSON still finalizing (decode tail slow); scheduled wakeup to collect + final sweep.
|
| 45 |
+
HEADLINE §20: length = a CAPACITY/dilution axis, NOT a structure axis. (1) recon degrades gracefully + monotonic,
|
| 46 |
+
genuine 1/N dilution (89% survives rare-word match), field-meaning robust (SBERT .81 @43tok). (2) content readouts =
|
| 47 |
+
single length-INVARIANT directions (one global probe suffices, natural+templated); only relational probe varies = a
|
| 48 |
+
short-sentence surface-position leak (cos -.93), sharpens §19 no-binding not overturns. (3) dilution = per-token CAPACITY
|
| 49 |
+
not aggregation: attn-pool/DeepSets ≈ uniform 1/N at fixed bottleneck, learned weights don't favor content. OWED: L4
|
| 50 |
+
cross-encoder length port; natural relational gold label.
|
| 51 |
- 03:07 — L3 (photo) near-done. RESULT: at fixed-capacity bottleneck FVU RISES w/ length (m128 short .41->vlong 1.09;
|
| 52 |
m64 short .48->vlong 1.23) => dilution real once pooling lossy. BUT attention-pool ≈ uniform 1/N (m64 attn .47/.65/.92/1.22
|
| 53 |
vs uniform .48/.66/.92/1.23); DeepSets WORSE. Learned attn weights: NO content-upweight (Spearman a·c_i_norm=-0.09),
|