Upload agent_notes.md with huggingface_hub

agent_notes.md

@@ -13,6 +13,72 @@
 
 ---
 
+## PICK UP HERE — 2026-08-13 (current state, for any new machine/agent)
+
+### What this is
+- **FSI-Anomaly**: an on-device, offline forensic-journalism / truth-verifier LLM.
+  Verifies claims, finds discrepancies and cross-source patterns, and answers in
+  Spock-style verdicts: `true / false / misleading / overclaim / contradiction /
+  abstain / unsubstantiated`. Built for researchers, journalists, whistleblowers,
+  and rabbit-hole truth-seeking.
+- **Owner/team**: solo developer (licensed electrician, no funding), label
+  FERRELL SYNTHETIC INTELLIGENCE (FSI). Goal: free open-source small-model
+  family, HF downloads, grants/loans.
+- **Device**: 8-core ARMv9 tablet, 7.4GB RAM + 12.3GB swap, no GPU. Everything
+  below was trained/reasoned on this device.
+
+### Model line (IMPORTANT — do not mix with the old 25M line)
+- **Current line: `hybrid50m` + 16k tokenizer** (~50M params, d_model=320,
+  liquid architecture with MTP in pretrain only). The old 25M/8k line is
+  archived history (`ckpt/tiny25m*`, 8k tokenizer, old analyst stamp schema).
+- **Canonical pretrain base:** `ckpt/hybrid50m_v16k_pretrain/model_5000.pt`.
+- **Tokenizer:** `data/tokenizer16k.json`. ALWAYS pass `--tok data/tokenizer16k.json`;
+  the default 8k tokenizer crashes on 16k checkpoints.
+
+### Where we are (measured 2026-08-13)
+- **SFT v25** (`ckpt/hybrid50m_v25_lora/best.pt`, 268 rows: 119 base + 149 gold):
+  battery main **0.184** / researcher **0.167** / red-team **0.038**.
+- **DPO v25** (`ckpt/hybrid50m_v25_dpo/model_final.pt`, β=5.0 LFM2, 136 schema-matched
+  pairs, 1 epoch): loss 0.7146→0.6787 (real signal, NO v22 collapse), battery = exact
+  parity with SFT. DPO is no longer destructive; it needs more pairs + a better SFT base.
+- **Merges** (`ckpt/hybrid50m_v25_merges/`): main-battery results so far —
+  soup **0.184**, taskarith_l0p5 **0.204**, ties_k0p2 in progress (all vs 0.184 baseline).
+- **Release gates NOT passed:** main ≥0.40 / researcher ≥0.25 at ≥60% coverage,
+  red-team pass, multi-turn + real-task verification. Do NOT release until these pass.
+
+### Data (all handcrafted, no generators/scripts — discipline rule)
+- **Gold: 198 / 3000** authored (`data/gold_700|800|900|1000`, `gold_3000_final`).
+- **SFT staged:** `data/sft_v26.jsonl` = 317 rows (119 base + 198 gold, 28/class × 7 + 2 final).
+- **Preference pairs:** `data/prefs_v26.jsonl` = 154 schema-matched (136 v23 + 18 new).
+
+### What is running on the tablet right now (2026-08-13)
+- Chained, detached, one heavy job at a time:
+  merge candidate evals (main battery) -> `train/watchdog_lora_v26.sh` (SFT v26, ~2h)
+  -> `train/watchdog_dpo_v26.sh` (DPO v26, ~20 min).
+- After v26: battery-eval SFT v26 + DPO v26, merge v26 candidates, then red-team +
+  multi-turn pipeline verification. Author more gold toward 3,000 in parallel.
+
+### Key commands (verified recipe)
+- LoRA SFT: `train/train_lora.py --base ckpt/hybrid50m_v16k_pretrain --data <sft>
+  --tok data/tokenizer16k.json --ckpt <out> --val-bin data/valid16k.bin
+  --replay-bin data/train_phase2b16k.bin --replay-ratio 0.5 --epochs 3 --batch 4
+  --seq 512 --lr 5e-5 --r 16 --alpha 32.0 --dropout 0.05 --kl 0.1 --ppl-guard 60.0
+  --eval-every 25 --val-batches 4 --threads 6`
+- LFM2 DPO: `train/train_dpo.py --base <best_sft> --data <prefs> --tok
+  data/tokenizer16k.json --ckpt <out> --val-bin data/valid16k.bin --epochs 1
+  --batch 4 --seq 512 --lr 8e-7 --lr-schedule cosine --lr-min 8e-8 --warmup-frac
+  0.01 --beta 5.0 --margin 0.1 --apo-weight 0.2 --threads 6 --ppl-guard 60.0
+  --lora --r 16 --alpha 32.0 --dropout 0.05` (NO `--log-every` flag exists).
+- Launch heavy jobs detached: `setsid nohup ./train/<watchdog>.sh >/dev/null 2>&1 </dev/null & disown`
+
+### Gotchas (measured, do not re-learn)
+- Long jobs die with no traceback on this device -> always use resume-safe watchdogs + `.done` markers.
+- Never stack two heavy torch jobs (RAM tight). One heavy job at a time.
+- MTP is pretrain-only: post-training loads use `cfg.mtp_heads=0` + `strict=False`.
+- Merges: pretrain base has `mtp_heads.*` keys that folded post-training ckpts lack;
+  merge scripts intersect keys (regression-tested in `tests/test_merges.py`).
+
+
 ## 1. What this project is
 
 - **Model:** `fsi-anomaly` (family: `fsi_felon-*`), a **25.4M-parameter**