nickypro commited on
Commit
39ac997
·
verified ·
1 Parent(s): 6418f28

Upload NIGHT6_STATE.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. NIGHT6_STATE.md +15 -0
NIGHT6_STATE.md CHANGED
@@ -33,6 +33,21 @@ covariate regression so "length effect" isn't just "more rare words". Report N p
33
  - JSON -> local night6_json/ + HF. Figs -> figs_night6/. Secrets only from ~/secrets.env.
34
 
35
  ## LOG (newest at top)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36
  - 03:07 — L3 (photo) near-done. RESULT: at fixed-capacity bottleneck FVU RISES w/ length (m128 short .41->vlong 1.09;
37
  m64 short .48->vlong 1.23) => dilution real once pooling lossy. BUT attention-pool ≈ uniform 1/N (m64 attn .47/.65/.92/1.22
38
  vs uniform .48/.66/.92/1.23); DeepSets WORSE. Learned attn weights: NO content-upweight (Spearman a·c_i_norm=-0.09),
 
33
  - JSON -> local night6_json/ + HF. Figs -> figs_night6/. Secrets only from ~/secrets.env.
34
 
35
  ## LOG (newest at top)
36
+ - 03:45 — NIGHT COMPLETE. L3 proc finished all compute but crashed on final write (night6_json/ dir missing on box,
37
+ FileNotFoundError) — RECOVERED all numbers from L3_full.log, reconstructed L3_recomb_models.json locally + pushed HF.
38
+ Uniform m128 row recovered (.5534/.4046/.5682/.8052/1.0923); decode-SBERT all 4 bin/width combos confirm attn≈uniform
39
+ (Δ -.006..+.008) & DeepSets worse => no meaning-transfer. §20 numbers all verified consistent. FINAL SWEEP: marble/photo/lyra
40
+ all who=0, GPU 0MiB, zero stray mine-procs. Deliverables on HF: INTERP_RESULTS.md §20 (3536L) + fig_length_stratification.png
41
+ + L1/L1b/L2/L2b/L3 JSONs. Memory (capstone + index) updated. Boxes idle. WIND DOWN.
42
+ - 03:20 — §20 length-stratification chapter WRITTEN into INTERP_RESULTS.md (3536 lines) + fig_length_stratification.png
43
+ (4-panel) + pushed to HF. Decode-SBERT secondary confirms L3 (m128 long: uniform .301/attn .300/deepsets .204,
44
+ Δ=-.001 => no meaning-transfer). L3 JSON still finalizing (decode tail slow); scheduled wakeup to collect + final sweep.
45
+ HEADLINE §20: length = a CAPACITY/dilution axis, NOT a structure axis. (1) recon degrades gracefully + monotonic,
46
+ genuine 1/N dilution (89% survives rare-word match), field-meaning robust (SBERT .81 @43tok). (2) content readouts =
47
+ single length-INVARIANT directions (one global probe suffices, natural+templated); only relational probe varies = a
48
+ short-sentence surface-position leak (cos -.93), sharpens §19 no-binding not overturns. (3) dilution = per-token CAPACITY
49
+ not aggregation: attn-pool/DeepSets ≈ uniform 1/N at fixed bottleneck, learned weights don't favor content. OWED: L4
50
+ cross-encoder length port; natural relational gold label.
51
  - 03:07 — L3 (photo) near-done. RESULT: at fixed-capacity bottleneck FVU RISES w/ length (m128 short .41->vlong 1.09;
52
  m64 short .48->vlong 1.23) => dilution real once pooling lossy. BUT attention-pool ≈ uniform 1/N (m64 attn .47/.65/.92/1.22
53
  vs uniform .48/.66/.92/1.23); DeepSets WORSE. Learned attn weights: NO content-upweight (Spearman a·c_i_norm=-0.09),